MedHelm: Implement medcalc bench scenario, metrics and specs#3207

Open

sashimono-san wants to merge 14 commits intostanford-crfm:med-helmfrom sashimono-san:feat/medcalc_bench_scenario

+1,312-126

Commits on Nov 23, 2024

Add Upstage Solar Pro Preview model (stanford-crfm#3181 )
yifanmai
authored
Add Llama 3.1 Nemotron Instruct (70B) model on Together AI (stanford-crfm#3172 )
yifanmai
authored

Commits on Dec 4, 2024

Add Air-Bench chat audio scenario (stanford-crfm#3189 )

ImKeTT
and
yifanmai
authored

Commits on Dec 5, 2024

Commits on Dec 6, 2024

Commits on Dec 10, 2024

Shorten run spec names for Unitxt runs (stanford-crfm#3205 )
yifanmai
authored

Commits on Dec 11, 2024

feat: implement medcalc bench scenario, metrics and specs
Leonardo Schettini
committed

Commits on Dec 12, 2024

feat: med calc bench one shot spec
Leonardo Schettini
committed

Commits on Dec 17, 2024

fix: dataset loading and standardize naming
Leonardo Schettini
committed