Code

Meta inference for different models#223

Code

Merged

jeffra merged 6 commits intomastermicrosoft/DeepSpeedExamples:masterfrom meta-inferencemicrosoft/DeepSpeedExamples:meta-inferenceCopy head branch name to clipboardJan 3, 2023

+58-17

Commits

Commits on Nov 22, 2022

• Print latency in intference-test

  molly-smith

  committed
  675536e

Commits on Nov 23, 2022

• fix some issues in the script and add more flags

  

  Reza Yazdani

  committed
  d8d4fb3

Commits on Nov 29, 2022

• Add some changes to be able to run inference with meta-tensor on various model architectures

  

  Reza Yazdani

  committed
  c5fa568

• remove some dead code

  

  Reza Yazdani

  committed
  5910cd9

Commits on Dec 10, 2022

• Fix ds_inference_config.json string (#228)

  Show description for 91e9fff
  lekurile

  authored
  91e9fff

Commits on Jan 3, 2023

• Merge branch 'master' into meta-inference

  jeffra

  authored
  3ac4e14