Code

Usage Stats Collection#2852

Code

Merged

simon-mo merged 62 commits intovllm-project:mainvllm-project/vllm:mainfrom yhu422:usageyhu422/vllm:usageCopy head branch name to clipboardMar 29, 2024

+362-24

Commits

Commits on Feb 8, 2024

• Write info to local json

  yhu422

  committed
  e0e1386

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  yhu422

  committed
  739f4a1

Commits on Feb 9, 2024

• add usage context

  yhu422

  committed
  c33b4cc

• removed usage_context from Engine_args

  yhu422

  committed
  b74e3a6

• Move IO to another process

  yhu422

  committed
  c988e07

Commits on Feb 13, 2024

• added http request

  yhu422

  committed
  88c5187

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  yhu422

  committed
  85adbab

• Added additional arg for from_engine_args

  yhu422

  committed
  33c9dff

• comments

  yhu422

  committed
  ad609f0

• Write info to local json

  Show description for 8a2f18a
  yhu422

  committed
  8a2f18a

• Merge branch 'usage' of https://github.com/yhu422/vllm into usage

  yhu422

  committed
  8e9e5be

• Added Comments

  yhu422

  committed
  f537692

• .

  yhu422

  committed
  0f1ba7f

• Collect usage info on engine initialization

  yhu422

  committed
  abc3948

• Merge branch 'usage' of https://github.com/yhu422/vllm into usage

  yhu422

  committed
  ec54145

• Write usage to local file for testing

  yhu422

  committed
  f84ccaa

• Fixed Formatting

  yhu422

  committed
  b08ba86

• Merge branch 'vllm-project:main' into usage

  yhu422

  authored
  83ff459

• formatting changes

  yhu422

  committed
  73b689a

• Merge branch 'usage' of https://github.com/yhu422/vllm into usage

  yhu422

  committed
  86da72f

• Minor bug fixed

  yhu422

  committed
  9c9a188

• tmp

  yhu422

  committed
  d2f84cf

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  yhu422

  committed
  4e888e0

Commits on Feb 14, 2024

• Fixed Bug

  yhu422

  committed
  eb48061

• Add Google Cloud Run service URL

  yhu422

  committed
  0684c06

Commits on Feb 16, 2024

• More GPU CPU Mem info

  yhu422

  committed
  8e9890e

Commits on Feb 27, 2024

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  yhu422

  committed
  5cf652a

• Added context constant

  yhu422

  committed
  d910b05

• Formatting & CPU Info

  yhu422

  committed
  8cf264b

• Update vllm/usage/usage_lib.py

  Show description for 93b8773
  

  yhu422

  and

  mgoin

  authored
  93b8773

• Added CPU info, new stat file path

  yhu422

  committed
  fe39b84

• added gpu memory

  yhu422

  committed
  fc6e374

Commits on Feb 28, 2024

• added memory

  yhu422

  committed
  ab23171

Commits on Mar 1, 2024

• Distinguish production/testing usage, added custom domain

  yhu422

  committed
  686c84a

• formatting

  yhu422

  committed
  877eb78

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  yhu422

  committed
  bc89a66

Commits on Mar 5, 2024

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  yhu422

  committed
  36fd304

• test/prod distinction

  yhu422

  committed
  e54f15b

• Remove cpuinfo import

  yhu422

  committed
  4e35b3b

• ruff

  yhu422

  committed
  a1597fb

Commits on Mar 14, 2024

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  yhu422

  committed
  c580797

• fixed merge

  yhu422

  committed
  84353d4

• Pass up model architecture info for GPUExecutor

  yhu422

  committed
  f2e69fc

• formatting

  yhu422

  committed
  4e19967

• formatting

  yhu422

  committed
  f327f3c

• Get architecture directly from configs

  yhu422

  committed
  d9c8a44

Commits on Mar 16, 2024

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  simon-mo

  committed
  59f0f10

Commits on Mar 17, 2024

• edits round

  simon-mo

  committed
  f34259a

• ruff

  simon-mo

  committed
  30df77c

Commits on Mar 28, 2024

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  simon-mo

  committed
  60b652b

• fix format

  simon-mo

  committed
  be91bab

• finish all code level functionality

  simon-mo

  committed
  4f04743

• add wip doc

  simon-mo

  committed
  f4bf862

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  simon-mo

  committed
  6b968db

• revert some fixes

  simon-mo

  committed
  2006788

• more fixes

  simon-mo

  committed
  db715c8

• finish doc, readability pass

  simon-mo

  committed
  2c1e557

• edit pass

  simon-mo

  committed
  42e66b8

• fix doc and isort

  simon-mo

  committed
  a4e5742

Commits on Mar 29, 2024

• Merge branch 'main' of github.com:vllm-project/vllm into usage

  simon-mo

  committed
  9652830

• bad merge

  simon-mo

  committed
  ba63b44

• add to amd req txt

  simon-mo

  committed
  58fb78d