Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added model router example #60

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Added model router example #60

wants to merge 3 commits into from

Conversation

veeragoni
Copy link
Contributor

Issue number:

Summary

An inherent capability of MAO is ability to route the request to different models based on the context using its classifier. In this demo, I have showed an example of how to route the route the request to different models based on cost vs. reliability vs. privacy.

Acknowledgment

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

@cornelcroi
Copy link
Contributor

Thank you for submitting this PR.
The concept of utilizing various agents for tasks based on their performance and cost-effectiveness is really good.
However, we can enhance this approach by incorporating realistic business scenarios.
I'd like to see a concrete business use case in each example.
At present, it's unclear how the classifier would effectively route tasks using the descriptions provided in this PR.

@cornelcroi cornelcroi self-assigned this Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants