Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Premium Leo refuses to summarize long text and transcripts #34131

Open
Tracked by #35733
bbondy opened this issue Nov 6, 2023 · 3 comments
Open
Tracked by #35733

Premium Leo refuses to summarize long text and transcripts #34131

bbondy opened this issue Nov 6, 2023 · 3 comments
Assignees
@LorenzoMinto
Labels
browser-ai bug feature/leo/context-size OS/Android Fixes related to Android browser functionality OS/Desktop priority/P2 A bad problem. We might uplift this to the next planned release. QA/Yes

Comments

@bbondy
Copy link
Member

bbondy commented Nov 6, 2023 •
edited
Loading

Go here:
https://www.youtube.com/watch?v=4g6VH-SjrxA

With Premium and Claude selected

Click Summarize this video:
Screenshot 2023-11-06 at 10 56 47 AM

The issue does not happen with the free model, although it does warn about it being truncated.

Expected result: Give a warning about it being truncated
@bbondy bbondy added OS/Android Fixes related to Android browser functionality OS/Desktop labels Nov 6, 2023
@bbondy bbondy added this to Browser AI Nov 6, 2023
@bbondy bbondy added the priority/P2 A bad problem. We might uplift this to the next planned release. label Nov 6, 2023
@bbondy bbondy moved this to Important / Polish in Browser AI Nov 10, 2023
@bbondy
Copy link
Member Author

bbondy commented Dec 4, 2023

This happens for long blog articles too. https://scottlocklin.wordpress.com/2023/11/29/calling-a-bureaucrat-by-its-name/

@bbondy bbondy moved this from Important / Polish to Alignment #2 - New default in Browser AI Dec 5, 2023
@bbondy bbondy changed the title Premium Leo refuses to summarize long transcripts Premium Leo refuses to summarize long text and transcripts Dec 5, 2023
@petemill petemill assigned petemill and nullhook and unassigned petemill Jan 9, 2024
@petemill
Copy link
Member

petemill commented Jan 9, 2024

We probably have the page content character limit "guess" set too high for this model.

@mattmcalister mattmcalister mentioned this issue Jan 31, 2024
Closed
18 tasks
@bbondy bbondy moved this from Alignment #2 - New default to Todo in Browser AI Feb 23, 2024
@nullhook nullhook mentioned this issue Mar 11, 2024
Open
@mattmcalister
Copy link

this should be resolved by the upcoming context updates

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@LorenzoMinto LorenzoMinto

Labels
browser-ai bug feature/leo/context-size OS/Android Fixes related to Android browser functionality OS/Desktop priority/P2 A bad problem. We might uplift this to the next planned release. QA/Yes
Projects
Browser AI
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
6 participants
@mattmcalister @stephendonner @petemill @bbondy @nullhook @LorenzoMinto