New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add external KV to LLaMA 3 #734

Open

gordicaleksa wants to merge 1 commit into karpathy:master from gordicaleksa:external_kv

Contributor

gordicaleksa commented Aug 10, 2024 •

edited

Loading

Initial design for external KV.

@karpathy does the job, tested it, feel free to propose a better design, I saw this commit in nano llama 3 after pushing out this PR.


          Add external KV

aeb9817

gordicaleksa changed the title ~~Add external KV~~ Add external KV to LLaMA 3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet