Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tensorrt backend #104

Merged
merged 30 commits into from
Jan 24, 2024
Merged

Tensorrt backend #104

merged 30 commits into from
Jan 24, 2024

Conversation

makaveli10
Copy link
Collaborator

  • add tensorrt backend

makaveli10 and others added 29 commits January 9, 2024 18:09
@makaveli10
add: tensorrt backend
fd86340
@makaveli10
add: tensorrt backend to server
0f9e93d
@makaveli10
remove duplicate code
244ca9e
@makaveli10
add tensorrt_llm installation script
6dff4fb
@makaveli10
move setup.sh to scripts
ddb1e09
@makaveli10
update readme to new setup.sh path
a26f990
@makaveli10
update dockerfiles
71a062b
@makaveli10
update with multilingual option
647c576
@makaveli10
update README; add TensorRT doc
3c202bf
@makaveli10
remove torch req
f06b9bc
@makaveli10
add docker setup for tensorrt-llm; update readme
389bb5a
@makaveli10
merge main
4cf9d95
@makaveli10
install whl
67232ff
@makaveli10
merge with main
735d6c7
@makaveli10
add tensorrt readme
7a9dc6d
@makaveli10
update requirements
6f1d13f
@makaveli10
updatetensorrt-llm dockerfile
75001ae
@makaveli10
add tensorrt installation & whisper conversion script
867ff52
@makaveli10
increase chunk size from 64ms to 256ms
f25ff17
@makaveli10
update READM
b955e63
@makaveli10
update tensorrt docker & readme
e3084b3
@makaveli10
fix: tensorrt llm idocker setup & docs
1e2faa3
@makaveli10
Merge remote-tracking branch 'upstream/main' into tensorrt_backend
986823d
@makaveli10
remove trt-llm dockerfile
44a2e20
@makaveli10
remove trt_llm install script
969a5aa
@makaveli10
add numba to req(trt-llm)
634dae8
@makaveli10
fix: server; remove debug stats
3bf5b47
@makaveli10
update tensorrt readme
8e26422
@makaveli10
update readme
bd54329
zoq
zoq reviewed Jan 23, 2024
View reviewed changes
README.md Outdated Show resolved Hide resolved
@makaveli10 @zoq
Update README.md
5cd59b1 
Co-authored-by: Marcus Edel <[email protected]>
@makaveli10 makaveli10 merged commit 3498787 into collabora:main Jan 24, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zoq zoq zoq approved these changes

Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@makaveli10 @zoq