Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Accelerate LLaMA model loading #234

Merged
merged 7 commits into from
Aug 30, 2023
Merged

Accelerate LLaMA model loading #234

merged 7 commits into from
Aug 30, 2023

Commits on Jun 25, 2023

  1. [feat] use safetensors to accelerate weights loading

    @JF-D
    JF-D committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    1607b9f View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. Merge branch 'main' of https://github.com/vllm-project/vllm into main

    @JF-D
    JF-D committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    a2e4707 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2023

  1. Merge branch 'main' of https://github.com/vllm-project/vllm into main

    @JF-D
    JF-D committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    3074a67 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2023

  1. fix 'safe_open' import

    @JF-D
    JF-D committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    76695e9 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2023

  1. fix allow_patterns, lint

    @JF-D
    JF-D committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    61d4ba1 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Merge branch 'main' into JF-D/main

    @zhuohan123
    zhuohan123 committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    81c8c4a View commit details
    Browse the repository at this point in the history

  2. Do not automatically convert to safe tensor & format fixes

    @zhuohan123
    zhuohan123 committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    8ccedcf View commit details
    Browse the repository at this point in the history