Skip to content
This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

build failure on orin agx #341

Open
malv-c opened this issue Jul 2, 2023 · 3 comments
Open

build failure on orin agx #341

malv-c opened this issue Jul 2, 2023 · 3 comments
Labels
issue:bug Something isn't working os:linux Related to Linux

Comments

@malv-c
Copy link

malv-c commented Jul 2, 2023

llama-cpp/ggml.h(218): error: identifier "__fp16" is undefined
i request exllama anyway ( best loader now )

@LLukas22
Copy link
Contributor

LLukas22 commented Jul 2, 2023

Until the changes from ggerganov/llama.cpp#1455 get merged into ggml we probably can't do anything here.

Regarding exllama that's something to consider after we implemented #31

@malv-c
Copy link
Author

malv-c commented Jul 2, 2023 via email

@philpax
Copy link
Collaborator

philpax commented Jul 2, 2023

I'm afraid not, sorry - our ggml comes from llama,cpp. We don't currently support any other backends.

@philpax philpax added issue:bug Something isn't working os:linux Related to Linux labels Jul 2, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
issue:bug Something isn't working os:linux Related to Linux
Projects
None yet
Development

No branches or pull requests

3 participants