Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT MERGE] Adding code for experiments using pubsub queues #2005

Open
wants to merge 23 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
cab13c4
Adding code for uexperiments ssing pubsub queues
Jul 25, 2024
f4fc755
removed flaky test
Jul 25, 2024
fd6a30b
Some chnges based on PR feedback
Jul 30, 2024
5042cbb
Fixing local experiments due to misusage of multiprocessing queue ins…
Aug 12, 2024
88b0033
Changing dispatcher startup script to use new image
Aug 12, 2024
7484c35
Adding more error treatments, and logs, also changing create subscrip…
Aug 12, 2024
6a157ce
Improving error handling and logging when calling google apis
Aug 12, 2024
52eacb1
fixing typecheck
Aug 12, 2024
632f23f
Fixing task to bytes serializing function
Aug 13, 2024
20d2f03
Refactoring put result to response queue method, and enable ordering …
Aug 13, 2024
a036561
Adding tests, enabling message ordering, and passing ordering key as …
Aug 13, 2024
e413342
Fixing pubsub publish call, refactoring, and adding more tests
Aug 14, 2024
adfe36d
Adding more tests and fixing format
Aug 14, 2024
d3b9c07
Formatting
Aug 14, 2024
67f99a1
Adding debug call, adding test for start workers, and fixing placehol…
Aug 15, 2024
17d6ea0
Fixing pubsub pull call
Aug 16, 2024
e8a20d6
Wrapping initializing worker logs in a try statement
Aug 16, 2024
b523680
Changing consume snapshots method to raise queue empty when returning…
Aug 16, 2024
f940442
Changing code to only use 1 gcloud worker for debugging purporses
Aug 19, 2024
4b2ec86
lint
Aug 19, 2024
0c7987d
Reverting previous debug commit, and changing get_task method
Aug 19, 2024
05d3668
Refactoring gcloud workers to initialize a subscriber and publisher c…
Aug 22, 2024
a365f7e
Only starting measure worker in new process
Aug 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading