Discussions

• 1 You must be logged in to vote

  💬

  Using GEMM files in fastertransformer_backend.

  SnoozingSimian started Sep 22, 2022 in General

  

  

  

  

  2
• 7 You must be logged in to vote

  🙏

  Deploying TrOCR by using FasterTransformer

  SShimmyo asked Jul 12, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to deploy a new model based on triton and fastertransformer_backend?

  WangYizhang01 asked Mar 16, 2023 in Q&A · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Dynamic Batching with Different Beam Widths?

  wenkesj asked Jun 7, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  How to deploy multiple instances of the the same T5-3b model on a single node with 4 GPUs

  James-Bao asked May 24, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  error with T5 inference

  sivakura asked May 17, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Running on Jetson Xavier

  haritsahm started Mar 19, 2023 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  How to determine the parameters for the t5_gemm file?

  eycheung asked Feb 20, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  💬

  How to run BERT model fine-tuned as Tensorflow checkpoint with FT backend?

  churinga started Jan 29, 2023 in General

  

  

  3
• 1 You must be logged in to vote

  🙏

  Support for FLAN T5

  vblagoje asked Nov 9, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to use the benchmark.py script?

  SnoozingSimian asked Nov 2, 2022 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💬

  Running BERT QA as ensemble + performance results

  vblagoje started Sep 25, 2022 in General

  

  

  0
• 1 You must be logged in to vote

  📣

  Welcome to fastertransformer_backend Discussions!

  byshiue announced Sep 18, 2022 in Announcements

  

  

  0