Modify MetabRef and CoreMS to deal with increased database size

[kheal]

After loading the Sphingolipids to Metabref (#956) we're experiencing more time outs for the API route. We need to modify the API routes in Metabref to handle pagination or bulk queries. We'll then need to modify CoreMS's MetabRefLCInterface class's methods to handle the new format of the results from MetabRef's API.

This is a blocker for microbiomedata/metaMS#32 .

RACI

Tag people in their roles

• Responsible: @kheal
• Accountable: @lamccue
• Consulted: James Carr
• Informed: @corilo

Describe the the task

• Metabref API code needs updating for pagination (J. Carr)
• CoreMS code needs updating for pagination from Metabref
• New PiPy release of CoreMS

Criteria for completion

• PiPy accessed CoreMS can handle pagination from MetabRef and doesn't time out with queries.

Estimate people time

• 2 people, 4 hours each

Completion Date (Goal)

• Dec 5

Target Sprint Start & End Dates

• Start: Dec 2
• End: Dec 13

Tag Blocker/Contingent upon issues

• Add lipidomics workflow to MetaMS (cli, wdl) metaMS#32 is contingent on this.