Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Fix very long runtimes for Artifact.describe #2273

Merged
merged 6 commits into from
Dec 11, 2024
Merged

Conversation

Koncopd
Copy link
Member

@Koncopd Koncopd commented Dec 11, 2024

Identified a few bottlenecks with a profiler and fixed them.

Now

ln.Artifact.get("NiaMP8YQMbmkdOgnAa1T").describe()
ln.Artifact.get("LmlgCMQRhSEHtcbG0000").describe()

runs around 10 sec each instead of several minutes.

Fixed describe when artifact is queried with using.

ln.Artifact.using("laminlabs/cellxgene").get("g0RcSSYe5vQKzSWYkhMc").describe() was failing before.

4-10 sec depending on annotations still feels pretty slow though, so it is probably not the final iteration.

Addresses:

Copy link

codecov bot commented Dec 11, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 92.84%. Comparing base (4c27162) to head (0ca3b78).
Report is 15 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2273      +/-   ##
==========================================
+ Coverage   92.71%   92.84%   +0.12%     
==========================================
  Files          55       55              
  Lines        6947     7196     +249     
==========================================
+ Hits         6441     6681     +240     
- Misses        506      515       +9     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

@github-actions github-actions bot temporarily deployed to pull request December 11, 2024 19:54 Inactive
@Koncopd Koncopd merged commit e706635 into main Dec 11, 2024
16 checks passed
@Koncopd Koncopd deleted the improve_describe branch December 11, 2024 20:00
@Zethson
Copy link
Member

Zethson commented Dec 13, 2024

@Koncopd does this also improve the memory usage? Can I try it again now?

@Koncopd
Copy link
Member Author

Koncopd commented Dec 13, 2024

I hope so, but i haven't checked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants