ONNX 推論時のメモリ消費量を大幅に削減 & 前回 PR の実装ミスの修正#194

Open

tsukumijima wants to merge 13 commits intolitagin02:devfrom tsukumijima:master

+1,024,707-256,192

Commits on Nov 10, 2024

Update server_fastapi.py
aka7774
authored

Commits on Nov 17, 2024

Merge pull request litagin02#177 from aka7774/master
litagin02
authored

Commits on Dec 7, 2024

Merge branch 'litagin02:master' into master
tsukumijima
authored

Commits on Dec 18, 2024

Improve: Make it possible to convert BERT language models to FP16
tsukumijima
committed

Commits on Dec 21, 2024

Commits on Dec 22, 2024

Improve: Disable enable_cpu_mem_arena for CPU inference only to prevent excessive memory consumption during the inference session of the BERT model
tsukumijima
committed