- Sponsor
-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Claude-3 plugin with attachments seems to ignore prompt #20
Comments
Wow that's a bad bug! Thanks for catching this. |
llm -m claude-3.5-sonnet 'write a poem about this' -a https://static.simonwillison.net/static/2024/pelican.jpg
|
Manual testing of the fix:
|
Thanks for tracking this down. If you can push out a new version I would be grateful :) |
Fix is out in 0.8 https://github.com/simonw/llm-claude-3/releases/tag/0.8 |
Refs #25, #20, #24 Refs simonw/llm#507 Refs simonw/llm#613
If llm with the llm-claude-3 plugin version 0.6 and the claude-3-5-sonnet-latest model is used with an attachment, the prompt appears to be ignored. That's not true with, say, the gemini model.
Tested with
llm -m claude-3-5-sonnet-latest -a image.png "Ignore the image, describe birds"
The output is a the same description of the image, no matter what the prompt. For the latest gemini pro model, in contrast, the interpretation of the image is dependent on the prompt.
--log
shows that the prompt and the attachment are at least being logged.The text was updated successfully, but these errors were encountered: