Code

Update logprob for prefill step#1

Code

Merged

zxybazh merged 4 commits intozxybazh:feature/2023-11-22/enable-mlc-server-logprobszxybazh/mlc-llm:feature/2023-11-22/enable-mlc-server-logprobsfrom Deelvin:vc/prefill_logprobDeelvin/mlc-llm:vc/prefill_logprobCopy head branch name to clipboardDec 19, 2023

+74-43

Commits

Commits on Dec 5, 2023

• fix log_softmax

  

  Valery Chernov

  committed
  4cf50ce

  Copy full SHA for 4cf50ce

• use constant for number of top logprobs

  

  Valery Chernov

  committed
  7680c05

  Copy full SHA for 7680c05

Commits on Dec 7, 2023

• small clean

  

  Valery Chernov

  committed
  72f3044

  Copy full SHA for 72f3044

Commits on Dec 18, 2023

• upstream to new OpenAI API

  

  Valery Chernov

  committed
  ca91b7a

  Copy full SHA for ca91b7a