Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AssertionError: your model failed to follow instructions and make API calls. please try a better model or do some better prompt engineering #16

Open
lzx2020 opened this issue Oct 27, 2023 · 6 comments

Comments

@lzx2020
Copy link

lzx2020 commented Oct 27, 2023

Using example:
AssertionError: your model failed to follow instructions and make API calls. please try a better model or do some better prompt
engineering

@liaoyansong
Copy link

I have met the same problem

@ECHO967
Copy link

ECHO967 commented Nov 14, 2023

I have met the same problem,how to solve?

@pitikorn32
Copy link

I have met the same problem

@tjyyy3
Copy link

tjyyy3 commented Dec 31, 2023

I have met the same problem, has anyone solved it?

@OceanTangWei
Copy link

有人解决这个问题嘛?

@pancodia
Copy link

pancodia commented Jul 7, 2024

First try of the code base today, having the same problem.

Quickly checked, the error is from

assert len(filtered_data_with_api_calls) > 0, 'your model failed to follow instructions and make API calls. please try a better model or do some better prompt engineering'

It seems that the no data returned after filtering? So no data is generated for fine-tuning?
Is it because the example uses PaLM model? It is not a pre-trained model. So it is not useful to generate any annotated data for fine-tuning?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants