Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can we add a directory , that contains the models to task' s auto allocation function? #1518

Open
CoderYiFei opened this issue Oct 20, 2024 · 1 comment

Comments

@CoderYiFei
Copy link

For some relatively difficult tasks, more complex models such as o1-preview or Claude 3.5 Sonnet will be automatically called.
For example, code review tasks or architecture tasks (unless the user specifies not to use them).

If it is a relatively simple task, such as writing code for a text classification model or writing a function for a simple crawler, etc., a faster domestic model such as DeepSeek v2.5 can be automatically selected.

The function is to automatically prioritize the allocation of large models according to the task difficulty (assuming that the user has several large models).

@geekan
Copy link
Owner

geekan commented Oct 21, 2024

This feature is planned and expected to be available in the coming months, but is not available yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants