Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to make computer_use_demo's bash session visible and interactive on the screen? #112

Open
aereobert opened this issue Oct 25, 2024 · 3 comments

Comments

@aereobert
Copy link

As title, this would be extremely useful for saving screenshot tokens and increase speed

Also this would enable Claude to use tools like nmtui nano top etc.

@chrisgorgo
Copy link
Collaborator

You can disable BashTool and prompt the model to open visual terminal and use it for issuing commands. It wouldn't save tokens though.

@aereobert
Copy link
Author

aereobert commented Oct 25, 2024

You can disable BashTool and prompt the model to open visual terminal and use it for issuing commands. It wouldn't save tokens though.

Yes that's true, but as far as I can tell, it seemed that interacting with the terminal window is really slow comparing to direct interaction with shell tools. I used edited the bash tool to create a web interface, and it is really useful (yet not perfect and ugly)

@p-i-
Copy link

p-i- commented Nov 3, 2024

The problem is the bash_tool doesn't use a running bash session. It probably executes a single bash command in a subshell. It does dump the bash-commands to the convo, sure would be hella nice if it multi-lined it. Adding that one to my kanban.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants