Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bat_int] Lisi indices file not found on nf-tower #237

Open
KaiWaldrant opened this issue Sep 28, 2023 · 4 comments
Open

[bat_int] Lisi indices file not found on nf-tower #237

KaiWaldrant opened this issue Sep 28, 2023 · 4 comments
Assignees
Labels
batch_integration relates to task batch_integration bug Something isn't working
Milestone

Comments

@KaiWaldrant
Copy link
Member

Describe the bug
On the nf-tower run the lisi component gives following error:

Traceback (most recent call last):
  File "/tmp/nxf.XxepoWYPjV/.viash_script.sh", line 40, in <module>
    ilisi_scores = lisi_graph_py(
  File "/usr/local/lib/python3.10/site-packages/scib/metrics/lisi.py", line 330, in lisi_graph_py
    simpson_estimate_batch = compute_simpson_index_graph(
  File "/usr/local/lib/python3.10/site-packages/scib/metrics/lisi.py", line 444, in compute_simpson_index_graph
    if os.stat(index_file).st_size == 0:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/lisi_pm06ey60/graph_lisi_indices_0.txt'
@mumichae
Copy link
Collaborator

mumichae commented Oct 4, 2023

I can't reproduce this locally with viash test. Can you show me the config of the LISI component?

@rcannood
Copy link
Member

rcannood commented Oct 4, 2023

I think the config is not the issue here -- LISI seems to fail on outputs produced by the random_integration component, but not from other components.

I can give you an S3 path to an h5ad file which should be able to reproduce the issue, if you want

@KaiWaldrant KaiWaldrant added bug Something isn't working batch_integration relates to task batch_integration labels Oct 13, 2023
@KaiWaldrant KaiWaldrant added this to the v2 (migration) milestone Oct 25, 2023
@KaiWaldrant KaiWaldrant changed the title Lisi indices file not found on nf-tower [bat_int] Lisi indices file not found on nf-tower Oct 25, 2023
@KaiWaldrant
Copy link
Member Author

@mumichae Could you document you findings on this issue.

@KaiWaldrant
Copy link
Member Author

As discussed we will be disabling these components for now as these are not part of the migration

KaiWaldrant added a commit that referenced this issue Nov 30, 2023
rcannood added a commit that referenced this issue Dec 6, 2023
* store %cpu as numeric

* update nf trace conversion

* Update get_results to r script

Co-authored-by: Robrecht Cannoodt <[email protected]>

* fix metrics info double listing

* update bat_int task_info

* rename metric_ids

* #237

---------

Co-authored-by: Robrecht Cannoodt <[email protected]>
Co-authored-by: Robrecht Cannoodt <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
batch_integration relates to task batch_integration bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants