Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[bug] Debug consistent appearance of stragglers #145

Closed
antonzabreyko opened this issue Feb 19, 2022 · 0 comments · Fixed by #158
Closed

[bug] Debug consistent appearance of stragglers #145

antonzabreyko opened this issue Feb 19, 2022 · 0 comments · Fixed by #158
Assignees
@parasj
Labels
bug Something isn't working priority
Milestone
Skylark 0.1 alpha...

Comments

@antonzabreyko
Copy link
Contributor

antonzabreyko commented Feb 19, 2022 •
edited by parasj
Loading

See the following output from a gateway log when running the basic test in the readme:

today at 8:06:39 PMProcess Process-55:
today at 8:06:39 PMTraceback (most recent call last):
today at 8:06:39 PM  File "/usr/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
today at 8:06:39 PM    self.run()
today at 8:06:39 PM  File "/usr/lib/python3.8/multiprocessing/process.py", line 108, in run
today at 8:06:39 PM    self._target(*self._args, **self._kwargs)
today at 8:06:39 PM  File "/pkg/skylark/gateway/gateway_sender.py", line 60, in worker_loop
today at 8:06:39 PM    self.send_chunks([next_chunk_id], dest_ip)
today at 8:06:39 PM  File "/pkg/skylark/gateway/gateway_sender.py", line 128, in send_chunks
today at 8:06:39 PM    sock.sendall(chunk_data)
today at 8:06:39 PMConnectionResetError: [Errno 104] Connection reset by peer
@parasj parasj changed the title Potential cause of stragglers Debug consistent appearance of stragglers Feb 21, 2022
@parasj parasj added bug Something isn't working priority labels Feb 21, 2022
@parasj parasj moved this to In Progress in Skylark Alpha release Feb 21, 2022
@parasj parasj self-assigned this Feb 21, 2022
@parasj parasj changed the title Debug consistent appearance of stragglers [bug] Debug consistent appearance of stragglers Feb 21, 2022
@parasj parasj linked a pull request Feb 22, 2022 that will close this issue
Fix strange straggler issues #158
Merged
Repository owner moved this from In Progress to Done in Skylark Alpha release Feb 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@parasj parasj

Labels
bug Something isn't working priority
Projects
None yet
Milestone
Skylark 0.1 alpha critical
Development

Successfully merging a pull request may close this issue.

Fix strange straggler issues skyplane-project/skyplane
2 participants
@parasj @antonzabreyko