[DO NOT MERGE] Adding code for experiments using pubsub queues#2005

Open

gustavogaldinoo wants to merge 23 commits intomasterfrom measurer-pub-sub-experiment

+933-175

Commits on Jul 25, 2024

Adding code for uexperiments ssing pubsub queues
gustavogaldinoo
committed
removed flaky test
gustavogaldinoo
committed

Commits on Jul 30, 2024

Some chnges based on PR feedback
gustavogaldinoo
committed

Commits on Aug 12, 2024

Fixing local experiments due to misusage of multiprocessing queue instead of sync manager queue
gustavogaldinoo
committed
Changing dispatcher startup script to use new image
gustavogaldinoo
committed
Adding more error treatments, and logs, also changing create subscription call
gustavogaldinoo
committed
Improving error handling and logging when calling google apis
gustavogaldinoo
committed
fixing typecheck
gustavogaldinoo
committed

Commits on Aug 13, 2024

Fixing task to bytes serializing function
gustavogaldinoo
committed
Refactoring put result to response queue method, and enable ordering messages
gustavogaldinoo
committed
Adding tests, enabling message ordering, and passing ordering key as correct type (str)
gustavogaldinoo
committed

Commits on Aug 14, 2024

Fixing pubsub publish call, refactoring, and adding more tests
gustavogaldinoo
committed
Adding more tests and fixing format
gustavogaldinoo
committed
Formatting
gustavogaldinoo
committed

Commits on Aug 15, 2024

Adding debug call, adding test for start workers, and fixing placeholder docstring
gustavogaldinoo
committed

Commits on Aug 16, 2024

Fixing pubsub pull call
gustavogaldinoo
committed
Wrapping initializing worker logs in a try statement
gustavogaldinoo
committed
Changing consume snapshots method to raise queue empty when returning None and tests
gustavogaldinoo
committed

Commits on Aug 19, 2024

Changing code to only use 1 gcloud worker for debugging purporses
gustavogaldinoo
committed
lint
gustavogaldinoo
committed
Reverting previous debug commit, and changing get_task method
gustavogaldinoo
committed

Commits on Aug 22, 2024

Refactoring gcloud workers to initialize a subscriber and publisher client for each worker
gustavogaldinoo
committed
Only starting measure worker in new process
gustavogaldinoo
committed