Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Frontend] Refactor prompt processing #4028

Merged
merged 139 commits into from
Jul 22, 2024
Merged

[Frontend] Refactor prompt processing #4028

merged 139 commits into from
Jul 22, 2024

Commits on Apr 12, 2024

  1. Use discriminated union in prompt parsing

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    ce770f4 View commit details
    Browse the repository at this point in the history

  2. Fix some type errors along the way

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    6b016bc View commit details
    Browse the repository at this point in the history

  3. Some more fixes

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7620354 View commit details
    Browse the repository at this point in the history

  4. Apply formatter

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7c3e6d9 View commit details
    Browse the repository at this point in the history

  5. Refactor prompt parsing so that it can be shared between Chat Complet… 

    …ions API and legacy Completions API
    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7bdc84e View commit details
    Browse the repository at this point in the history

  6. Make code more readable

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    a7d1098 View commit details
    Browse the repository at this point in the history

  7. Move assertion to a more appropriate place

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    8b9d636 View commit details
    Browse the repository at this point in the history

  8. Add code documentation

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    c48c13a View commit details
    Browse the repository at this point in the history

  9. Decompose _validate_prompt_and_tokenize

    @DarkLight1337
    DarkLight1337 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    3530362 View commit details
    Browse the repository at this point in the history

  10. Fix missing import due to renaming

    @DarkLight1337
    DarkLight1337 authored Apr 12, 2024
    Configuration menu
    Copy the full SHA
    b8feec9 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Apr 13, 2024
    Configuration menu
    Copy the full SHA
    89d9086 View commit details
    Browse the repository at this point in the history

  2. Fix bug when parsing array of tokens

    @DarkLight1337
    DarkLight1337 committed Apr 13, 2024
    Configuration menu
    Copy the full SHA
    cc1a5b3 View commit details
    Browse the repository at this point in the history

  3. Add token array to batch completions testing

    @DarkLight1337
    DarkLight1337 committed Apr 13, 2024
    Configuration menu
    Copy the full SHA
    f9c1135 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2024

  1. Replace legacy conint with Annotated field

    @DarkLight1337
    DarkLight1337 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    f2e8180 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    797326b View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    1d00087 View commit details
    Browse the repository at this point in the history

  2. Fix mypy error

    @DarkLight1337
    DarkLight1337 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    a1db4e0 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    7b9a3ff View commit details
    Browse the repository at this point in the history

  2. Combine prompt inputs

    @DarkLight1337
    DarkLight1337 committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    5d42800 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. Fix a bunch of tests

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    5db2c5e View commit details
    Browse the repository at this point in the history

  2. Fix LLaVA test

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    74c5905 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    cd8917b View commit details
    Browse the repository at this point in the history

  4. Fix benchmark_latency test

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b49aba7 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    bfd7295 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    928b9b9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    45c7f23 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    493e6ed View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    aa5f32a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    20aeceb View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    0f46653 View commit details
    Browse the repository at this point in the history

  2. Clarify tokenizer usage

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    c4f3540 View commit details
    Browse the repository at this point in the history

  3. Rename encode_request -> process_model_inputs

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    ab8182c View commit details
    Browse the repository at this point in the history

  4. Support old API in LLM.generate

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    eac33e1 View commit details
    Browse the repository at this point in the history

  5. Add tests to ensure old API still works 

    - To facilitate equality tests, `CompletionOutput` is now a dataclass
    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    703d318 View commit details
    Browse the repository at this point in the history

  6. Let all entrypoints tests be run at the same time

    @DarkLight1337
    DarkLight1337 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    19d85f9 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    034ef30 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    baebd99 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    dc9816f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    29144e9 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    80729ad View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    1c50600 View commit details
    Browse the repository at this point in the history

  2. Add tests for LLM.encode and fix corresponding bugs

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    5759dfa View commit details
    Browse the repository at this point in the history

  3. Apply formatter

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    cc4bfb5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    6085b08 View commit details
    Browse the repository at this point in the history

  5. Rename _add_requests to _validate_and_add_requests to be more sim… 

    …ilar to the original `_validate_and_prepare_requests`
    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    d5c9731 View commit details
    Browse the repository at this point in the history

  6. Separate entrypoints tests into two groups

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    4f218a5 View commit details
    Browse the repository at this point in the history

  7. Fix memory profiling error

    @DarkLight1337
    DarkLight1337 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a9201d0 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Fix memory usage for embedding server

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    ceebfa6 View commit details
    Browse the repository at this point in the history

  2. Update embeddings API to use new imputs

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    7d991cd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    0e79dfb View commit details
    Browse the repository at this point in the history

  4. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    f23583c View commit details
    Browse the repository at this point in the history

  5. Remove unnecessary commas

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    07c0a2e View commit details
    Browse the repository at this point in the history

  6. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    2c0d58f View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    48e7a4a View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 17, 2024
    Configuration menu
    Copy the full SHA
    0cc0b74 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Merge branch 'upstream' into llm-inputs

    @DarkLight1337
    DarkLight1337 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    b6c0e29 View commit details
    Browse the repository at this point in the history

  2. Merge llm groups back into one by enabling gc

    @DarkLight1337
    DarkLight1337 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    3097582 View commit details
    Browse the repository at this point in the history

  3. Improve documentation for LLM/engine

    @DarkLight1337
    DarkLight1337 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    7bbd123 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Direct readers to the PromptInputs class

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    056eb61 View commit details
    Browse the repository at this point in the history

  2. Separate _run_engine from _validate_and_add_requests

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    b3b990a View commit details
    Browse the repository at this point in the history

  3. Add flag for deprecating legacy API

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    2169def View commit details
    Browse the repository at this point in the history

  4. Add tests for deprecate_kwargs

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    3dbded1 View commit details
    Browse the repository at this point in the history

  5. Apply formatter

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    8e20317 View commit details
    Browse the repository at this point in the history

  6. Rename attribute to be less misleading

    @DarkLight1337
    DarkLight1337 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    fdccaa2 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Renable using 'fork' start method and improve speed by using `torch… 

    ….multiprocessing` wrapper instead of stdlib `multiprocessing`
    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    77ee1c8 View commit details
    Browse the repository at this point in the history

  2. Simplify logic of casting request output

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b1bcdd1 View commit details
    Browse the repository at this point in the history

  3. Improve code readability

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    44b4681 View commit details
    Browse the repository at this point in the history

  4. Fix multi_modal_data being a required key

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    50343cb View commit details
    Browse the repository at this point in the history

  5. Fix index out of range error

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    45aa420 View commit details
    Browse the repository at this point in the history

  6. Use a flag to control whether to check output types

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    d4e2589 View commit details
    Browse the repository at this point in the history

  7. Simplify flags

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    c07b579 View commit details
    Browse the repository at this point in the history

  8. Move output validation to a more appropriate location

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    9d56eb0 View commit details
    Browse the repository at this point in the history

  9. Add message to deprecation notice

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    bc05031 View commit details
    Browse the repository at this point in the history

  10. Apply formatter

    @DarkLight1337
    DarkLight1337 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    95d4130 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Remove unused parameter in _validate_and_add_requests and fix test

    @DarkLight1337
    DarkLight1337 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    cc84f65 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    19de59f View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. Simplify code

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    6c5d4a6 View commit details
    Browse the repository at this point in the history

  2. Move attribute assignment outside _init_tokenizer

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    fd2da12 View commit details
    Browse the repository at this point in the history

  3. Only emit warning once

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    d78de94 View commit details
    Browse the repository at this point in the history

  4. Simplify assignment expression

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    8a86829 View commit details
    Browse the repository at this point in the history

  5. Place special case at the start

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    731ac0e View commit details
    Browse the repository at this point in the history

  6. Merge branch 'llm-inputs' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    1be75d2 View commit details
    Browse the repository at this point in the history

  7. move API reference to under developer doc

    @ywang96
    ywang96 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    2d1a0bc View commit details
    Browse the repository at this point in the history

Commits on May 26, 2024

  1. Fix links in docs

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    7b8ce2c View commit details
    Browse the repository at this point in the history

  2. Remove unnecessary code to avoid repeated warning

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    fff21a1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'llm-inputs' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    18d5bcd View commit details
    Browse the repository at this point in the history

  4. Parse and batch the prompt using #4328

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    fab7f92 View commit details
    Browse the repository at this point in the history

  5. Move logging from async engine to server

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    cb057eb View commit details
    Browse the repository at this point in the history

  6. Fix missing args in test

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    b682dfa View commit details
    Browse the repository at this point in the history

  7. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    c982b88 View commit details
    Browse the repository at this point in the history

  8. Improve control flow

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    d87ae34 View commit details
    Browse the repository at this point in the history

  9. Fix missing input text when processing Completions API output

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    c73e972 View commit details
    Browse the repository at this point in the history

  10. Remove extra attribute

    @DarkLight1337
    DarkLight1337 committed May 26, 2024
    Configuration menu
    Copy the full SHA
    7d2c08b View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    3eb1eaa View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    9862802 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    62418d6 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    ce48c94 View commit details
    Browse the repository at this point in the history

  2. Update docs

    @DarkLight1337
    DarkLight1337 committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    2936ee0 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    c932b89 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    156c017 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    5d57ce2 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    55044ba View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    87dc5d3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    118f935 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    7f5668e View commit details
    Browse the repository at this point in the history

  2. Fix type errors

    @DarkLight1337
    DarkLight1337 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    b0fa8ff View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    4aed3e4 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    187fb24 View commit details
    Browse the repository at this point in the history

  2. Fix bad merge

    @DarkLight1337
    DarkLight1337 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    4fc018c View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    e9ea1ac View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    81e8a55 View commit details
    Browse the repository at this point in the history

  2. Fix linter errors

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    59870cf View commit details
    Browse the repository at this point in the history

  3. Fix docs

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    e07c2be View commit details
    Browse the repository at this point in the history

  4. Remove logging params from tokenization endpoint

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    1b41a29 View commit details
    Browse the repository at this point in the history

  5. Remove duplicated function

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    3e88444 View commit details
    Browse the repository at this point in the history

  6. Fix type errors

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    0b2eac0 View commit details
    Browse the repository at this point in the history

  7. Handle lora and prompt adapters for embeddings

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    165c0b1 View commit details
    Browse the repository at this point in the history

  8. Remove redundant code

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    1dc3d21 View commit details
    Browse the repository at this point in the history

  9. Use type union for tokenization requests

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    6264c82 View commit details
    Browse the repository at this point in the history

  10. Fix request_id and add logging

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    0492d79 View commit details
    Browse the repository at this point in the history

  11. yapf

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    4aa552a View commit details
    Browse the repository at this point in the history

  12. Update request id

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    994f3ee View commit details
    Browse the repository at this point in the history

  13. Enable logging

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    fe0629d View commit details
    Browse the repository at this point in the history

  14. Fix invalid attribute access

    @DarkLight1337
    DarkLight1337 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    d85ba52 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. Add add_special_tokens to Completions API to simplify the logic

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    d0fd1f4 View commit details
    Browse the repository at this point in the history

  2. Factor out logging args

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    2c38ccf View commit details
    Browse the repository at this point in the history

  3. Make optional args keyword-only; cleanup

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    b0f9595 View commit details
    Browse the repository at this point in the history

  4. Remove extra line

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    4fddfa0 View commit details
    Browse the repository at this point in the history

  5. Move definition back

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    18a1fac View commit details
    Browse the repository at this point in the history

  6. Avoid creating new list

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    61cf999 View commit details
    Browse the repository at this point in the history

  7. Update args in test_serving_chat.py

    @DarkLight1337
    DarkLight1337 authored Jul 19, 2024
    Configuration menu
    Copy the full SHA
    76124a9 View commit details
    Browse the repository at this point in the history

  8. Silently ignore prompt adapter for tokenization

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    68d2c96 View commit details
    Browse the repository at this point in the history

  9. Clean

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    7a92e6e View commit details
    Browse the repository at this point in the history

  10. Use HTTP boolean format

    @DarkLight1337
    DarkLight1337 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    e78dd28 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2024

  1. Fix incorrectly allowing some sampling params to be None

    @DarkLight1337
    DarkLight1337 committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    d56c9cc View commit details
    Browse the repository at this point in the history

  2. Fix inconsistent arg availability and ordering

    @DarkLight1337
    DarkLight1337 committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    f62edef View commit details
    Browse the repository at this point in the history

  3. Fix wrong model class

    @DarkLight1337
    DarkLight1337 committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    032eeec View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2024

  1. Merge branch 'upstream' into openai-typing

    @DarkLight1337
    DarkLight1337 committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    2adb0ad View commit details
    Browse the repository at this point in the history

  2. isort

    @DarkLight1337
    DarkLight1337 committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    0a9b0d8 View commit details
    Browse the repository at this point in the history