Custom recipes use slash path

[RdoubleA]

Context

What is the purpose of this PR? Is it to

• add a new feature
• fix a bug
• update tests and/or documentation
• other (please add here)

Custom imports/recipes were fixed by running as modules, but this required users to specify custom recipes as dotpaths, i.e., tune run path.to.my.recipe which isn't consistent (as discussed in #1759). We do the conversion under the hood for them here so they can still specify standard file paths with slashes.

Test plan

both of these now run, and they rely on custom dataset builders located outside of torchtune repo:
tune run --nproc_per_node 8 recipe/sft --config config/sft_llama3_2_1B.yaml
tune run --nproc_per_node 8 recipe/sft.py --config config/sft_llama3_2_1B.yaml

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchtune/1760

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit a059a29 with merge base a8a64ec ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 67.33%. Comparing base (7cf656b) to head (a059a29).
Report is 3 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1760      +/-   ##
==========================================
- Coverage   69.33%   67.33%   -2.00%     
==========================================
  Files         305      305              
  Lines       15892    15964      +72     
==========================================
- Hits        11018    10750     -268     
- Misses       4874     5214     +340     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[acisseJZhong]

thanks Rafi for the fix. Does this also work with customized configs inside torchtune repo?

[RdoubleA]

Does this also work with customized configs inside torchtune repo?

can't run any custom recipes from instead the recipes directory because of ModuleNotFoundError: The torchtune recipes directory isn't a package and you should not import anything from here., but I personally think this is ok

[joecummings]

Does this also work with customized configs inside torchtune repo?

can't run any custom recipes from instead the recipes directory because of ModuleNotFoundError: The torchtune recipes directory isn't a package and you should not import anything from here., but I personally think this is ok

Wait, so will it still work if the user adds their recipe to the registry?