Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(relayer): queue processor Prefetch #14765

Merged
merged 4 commits into from
Sep 21, 2023
Merged

feat(relayer): queue processor Prefetch #14765

merged 4 commits into from
Sep 21, 2023

Conversation

cyberhorsey
Copy link
Contributor

@cyberhorsey cyberhorsey commented Sep 20, 2023

this PR allows each intance of a processor to grab up to "QUEUE_PREFETCH_COUNT" amount of messages at once, instead of one, and handle them in a goroutine, allowing us to scale up one processor to do more, to handle the insane amount of queue messages we are receiving.

@vercel
Copy link

vercel bot commented Sep 20, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
bridge-ui-v2-a5 ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 20, 2023 5:26pm
1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
bridge-ui-v2-internal ⬜️ Ignored (Inspect) Visit Preview Sep 20, 2023 5:26pm

@codecov
Copy link

codecov bot commented Sep 20, 2023

Codecov Report

Merging #14765 (23e35ea) into main (b4cb3ff) will decrease coverage by 0.01%.
Report is 16 commits behind head on main.
The diff coverage is 4.54%.

@@            Coverage Diff             @@
##             main   #14765      +/-   ##
==========================================
- Coverage   39.83%   39.83%   -0.01%     
==========================================
  Files         113      113              
  Lines        5239     5242       +3     
  Branches      113      113              
==========================================
+ Hits         2087     2088       +1     
- Misses       3020     3022       +2     
  Partials      132      132              
Flag Coverage Δ *Carryforward flag
bridge-ui 93.94% <ø> (ø) Carriedforward from b4cb3ff
eventindexer 19.38% <ø> (ø) Carriedforward from b4cb3ff
relayer 42.96% <4.54%> (-0.02%) ⬇️

*This pull request uses carry forward flags. Click here to find out more.

Files Changed Coverage Δ
packages/relayer/processor/processor.go 0.00% <0.00%> (ø)
packages/relayer/processor/config.go 53.73% <16.66%> (-0.12%) ⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@cyberhorsey cyberhorsey added this pull request to the merge queue Sep 21, 2023
Merged via the queue into main with commit a37797a Sep 21, 2023
@cyberhorsey cyberhorsey deleted the prefetch branch September 21, 2023 02:12
@github-actions github-actions bot mentioned this pull request Sep 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants