Code for:
-
Click2Chat interface
-
JSON generation
Please run the following commands
git clone https://github.com/llm-bev/talk2bev
If using LLaVa
python click2chat/click2chat_llava.py --sam-checkpoint <path-to-sam-checkpoint> --conv-mode <conversion mode, default is llava v1> --model-path <path-llava-model> --gpu-id <gpu num>
If using MiniGPT-4
python click2chat/click2chat_minigpt4.py --sam-checkpoint <path-to-sam-checkpoint> --conv-mode <conversion mode, default is llava v1> --model-path <path-llava-model> --gpu-id <gpu num>