Migrating indexes to Zenodo - Genís&Guillem

[genisplaja]

Hello :) In this PR I am migrating some dataset indexes to Zenodo, and updating the data loader modules and tests with the remote mechanics.

Some pending things:

• There are some core tests that do not run. I think it's related to the multitrack datasets. I think we should take a closer look... I am trying to see what's going on, will let you know if there is any update!
• There is a problem in the multitrack Slakh with the dataset split.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.05%. Comparing base (19600df) to head (c6161dc).
Report is 1 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #641      +/-   ##
==========================================
- Coverage   97.06%   97.05%   -0.02%     
==========================================
  Files          67       67              
  Lines        7537     7532       -5     
==========================================
- Hits         7316     7310       -6     
- Misses        221      222       +1     

[guillemcortes]

TODO list

• Move sample indexes to test
• Publish index from Cuidado and SIMAC to Zenodo
• Update pull request template with new pipeline. (As in Soundata)
• Add soundata/datasets/indexes/*.json to .gitignore
• Update docs/index.rst
• Update contributing.rst (adapt from Soundata)
• Update contributing_examples/example.py and contributing_examples/test_example.py
• Update tutorial.rst (adapt from soundata)
• https://github.com/mir-dataset-loaders/mirdata/pull/632/files#r1826008445 test_core.py fix name of acousticbrainz index
• https://github.com/mir-dataset-loaders/mirdata/pull/632/files#r1826010931 test_core change
  assert dataset_test.index_path == os.path.join( local_index_path, "mirdata/datasets/", "indexes", "blah_0.json" this to local_index_path, "tests", "indexes", "blah_0.json" when we decide to move all sample indexes to tests
• https://github.com/mir-dataset-loaders/mirdata/pull/632/files#r1826011610
• https://github.com/mir-dataset-loaders/mirdata/pull/632/files#r1826019192
• https://github.com/mir-dataset-loaders/mirdata/pull/632/files#r1825976429
• https://github.com/mir-dataset-loaders/mirdata/blob/master/mirdata/core.py#L824 Change path of indexes dir to tests/indexes/
• core.py Lines 175 to 176. Update FileNotFoundError message as in [soundata] (https://github.com/soundata/soundata/pull/169/files#diff-55d1c749bd9085f66844b7e47716d10136921538890e9d30f9267a98e8a3da36R184)

[guillemcortes]

Hi @tanmayy24 ! This is ready to review, could you take a look? :)

[tanmayy24]

Thank you! Looks good to me!
Great that it happened before the release :))