New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

我想在jetson agx orin上的ollama跑glm-4v-9b或者是CogVLM2，需要从safetensors转gguf导入到ollama中，用llama.cpp转换，报错。 #616

Open

2 tasks

GengyuXu opened this issue Oct 29, 2024 · 0 comments

GengyuXu commented Oct 29, 2024

System Info / 系統信息

Jetson AGX Orin 64GB

Who can help? / 谁可以帮助到您？

No response

Information / 问题信息

The official example scripts / 官方的示例脚本
My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

Cannot Map Tensor ‘vision.boi'

Expected behavior / 期待表现

能够成功转成gguf并导入到ollama使用

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment