Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: model preheat #1

Closed
wants to merge 830 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
830 commits
Select commit Hold shift + click to select a range
70bd0de
feat: export component context at top namespace (#4551)
frostming Mar 5, 2024
6da7d91
feat: use starlette request directly in service context (#4552)
frostming Mar 5, 2024
1bd2557
feat: mount asgi app and fastapi support (#4538)
frostming Mar 5, 2024
934773d
fix(sdk): build envs into dockerfile (#4546)
bojiang Mar 5, 2024
70fa6a2
fix: rename server context attributes (#4553)
frostming Mar 5, 2024
5b3e752
fix: crash when pulling bento from organization with proxy mode (#4554)
frostming Mar 5, 2024
0597dfe
fix: add str in enum for deployment schema (#4549)
FogDong Mar 5, 2024
f15210a
docs: Add envs field in bentofile (#4555)
Sherlock113 Mar 6, 2024
e095010
docs: Add GitHub repo links for use case docs (#4556)
Sherlock113 Mar 6, 2024
41456ff
docs: Update the vllm use case doc (#4558)
Sherlock113 Mar 7, 2024
9f6a742
docs: Add how to get deployment info doc (#4544)
Sherlock113 Mar 7, 2024
ca021df
fix: rename the _bentoml_sdk.api module (#4557)
frostming Mar 8, 2024
d87e20f
fix: wait until server ready when initializing client (#4559)
frostming Mar 8, 2024
064e087
feat: Add server.on_deployment hook to execute deployment-specific lo…
frostming Mar 9, 2024
cb01f10
docs: Add doc for server_ready_timeout (#4563)
Sherlock113 Mar 11, 2024
ed1b99e
fix: depracate all enum in schema (#4565)
FogDong Mar 11, 2024
ab494f0
feat: threaded serving (#4562)
frostming Mar 12, 2024
80ad614
docs: Adjust existing Bento deployment wording (#4567)
Sherlock113 Mar 12, 2024
49022b0
fix: fix list instance type (#4566)
FogDong Mar 12, 2024
8962774
docs: Add doc for using pydantic model at the top level (#4568)
Sherlock113 Mar 12, 2024
b8c30cf
fix: delete access in admin console (#4569)
FogDong Mar 13, 2024
408078e
fix(client): set upload timeouts to 10 hours (#4564)
sauyon Mar 13, 2024
4a42052
fix: respect the content type config for file output (#4570)
frostming Mar 13, 2024
d27415a
docs: Update the adaptive batching doc (#4571)
Sherlock113 Mar 13, 2024
264958c
feat: Service.to_asgi() method (#4572)
frostming Mar 13, 2024
4be4030
docs: Add asgi doc (#4574)
Sherlock113 Mar 14, 2024
9b04536
fix: allow legacy runnable methods when calling API (#4573)
frostming Mar 14, 2024
349b4ae
fix(stub): add envs to `__init__` construction (#4576)
aarnphm Mar 14, 2024
573ba07
docs: Add testing doc (#4578)
Sherlock113 Mar 15, 2024
100c1cc
chore(type): use TypedDict for inferred stubs (#4577)
aarnphm Mar 15, 2024
479ca9b
docs: Add lifecycle hooks doc (#4579)
Sherlock113 Mar 15, 2024
9d3f677
fix(build): remove deprecated warnings (#4580)
aarnphm Mar 15, 2024
4909488
fix: improve the bentoml build progress (#4582)
frostming Mar 15, 2024
8fe2d5c
fix: allow API endpoint to return response directly (#4581)
frostming Mar 15, 2024
68b5584
fix: raise the priority of the routes from mount apps (#4584)
frostming Mar 15, 2024
75b2874
fix(sdk): python build missing envs argument (#4585)
jianshen92 Mar 15, 2024
bdc5e7b
fix: build config env default to None (#4589)
jianshen92 Mar 18, 2024
eb0ad1a
fix: config from multiple services override with each other (#4591)
frostming Mar 18, 2024
6a7e6b7
feat: add concurrency config (#4560)
xianml Mar 19, 2024
8bd4dbb
docs: Add OpenAI compatible endpoints client doc (#4593)
Sherlock113 Mar 20, 2024
f6d1955
fix: ignore_extra_keys for v2 configuration schema (#4598)
xianml Mar 20, 2024
fc7d7a2
fix: emit warnings when copying large file (#4597)
frostming Mar 20, 2024
cf8f663
feat: service.to_async property (#4595)
frostming Mar 20, 2024
41623a5
feat: picklev5 serialization (#4594)
frostming Mar 20, 2024
608314a
docs: add autoscaling docs (#4601)
ssheng Mar 20, 2024
a270e0f
docs: Fix old configurations doc link (#4600)
Sherlock113 Mar 20, 2024
9f92bcf
docs: Update the concurrency doc (#4602)
Sherlock113 Mar 20, 2024
eda6a9f
fix(reload): make sure to watch for all src for editable (#4604)
aarnphm Mar 22, 2024
2f2aec2
fix(openapi): remove invalid fields for operations parameter (#4605)
aarnphm Mar 22, 2024
3b32064
chore: update swagger UI generated to 5.12 [skip ci] (#4606)
aarnphm Mar 22, 2024
a9000c8
fix(cloud cli): workaround env update issue (#4608)
bojiang Mar 22, 2024
08a26da
docs: Remove old example links (#4610)
Sherlock113 Mar 25, 2024
058d28d
feat(build): use jinja template for python install script (#4607)
aarnphm Mar 26, 2024
2fb329c
feat: download git+ssh dependencies to wheels/ folder (#4612)
frostming Mar 26, 2024
f210da1
docs: Update the ASGI doc (#4614)
Sherlock113 Mar 27, 2024
899b05a
fix: non batched request executed in non FIFO manner (#4619)
frostming Mar 28, 2024
0a9a979
feat: light-weighted dev sdist builder (#4615)
frostming Apr 1, 2024
3e1cd6c
fix: add response headers for error responses (#4622)
frostming Apr 1, 2024
87e7e4a
docs: Refactor the autoscaling doc (#4620)
Sherlock113 Apr 1, 2024
2066a18
docs: Add simple verification test for Services (#4629)
Sherlock113 Apr 1, 2024
1dbfb4f
ci: pre-commit autoupdate [skip ci] (#4630)
pre-commit-ci[bot] Apr 2, 2024
9774f46
docs: Add workers doc (#4628)
Sherlock113 Apr 7, 2024
1ee80e9
docs: Add worker doc links (#4636)
Sherlock113 Apr 7, 2024
534404f
docs: Add docs for bentoml.runner_service (#4637)
Sherlock113 Apr 7, 2024
54cf7e7
docs: Add sync to async doc (#4639)
Sherlock113 Apr 8, 2024
e072d4c
fix: handle __call__ on clients (#4618)
frostming Apr 8, 2024
96ab26d
fix(cli): `bentoml get` output in YAML format (#4638)
frostming Apr 8, 2024
6b0ca6b
fix: issue overriding default service config from config file (#4627)
frostming Apr 8, 2024
ab6e5a7
docs: added multi model load and store example (#4575)
lycheel1 Apr 8, 2024
d0149af
docs: inference graph (#4609)
lycheel1 Apr 9, 2024
db89457
docs: Update high-level BentoML messaging (#4644)
Sherlock113 Apr 9, 2024
a3bbb23
fix: delete trace error for timeout when deploying (#4649)
FogDong Apr 11, 2024
7aa3866
fix(cli): correct the comparison of upload status (#4643)
frostming Apr 12, 2024
be24395
docs: Add GPU inference doc (#4654)
Sherlock113 Apr 12, 2024
bbdd00a
chore: update quickstart (#4655)
ssheng Apr 12, 2024
97b71de
docs: Add JSON output for bentovllm (#4657)
Sherlock113 Apr 12, 2024
1ecb3b7
chore: cleanup quickstart (#4658)
ssheng Apr 12, 2024
515adb2
docs: Update help info (#4664)
Sherlock113 Apr 13, 2024
110b139
fix: remove the uvicorn server header (#4665)
frostming Apr 15, 2024
ac762b9
docs: Fix format (#4666)
Sherlock113 Apr 15, 2024
d72688a
docs: Add model composition doc (#4668)
Sherlock113 Apr 16, 2024
2dbd57a
docs: Update example project list (#4673)
Sherlock113 Apr 17, 2024
0dc552b
docs: Add the monitoring and data collection doc (#4662)
Sherlock113 Apr 17, 2024
e10f0ef
docs: Add add_asgi_middleware doc (#4672)
Sherlock113 Apr 17, 2024
e50050a
fix: delete useless enum and fix enum value (#4674)
FogDong Apr 17, 2024
b39fbcc
docs: Add RAG tutorial (#4675)
Sherlock113 Apr 18, 2024
f7a4b3a
docs: Update the clients doc (#4676)
Sherlock113 Apr 18, 2024
dc33ee9
docs: Add some explanations for bentoml.models.get (#4660)
Sherlock113 Apr 18, 2024
74936ed
docs: Add e2e test doc (#4679)
Sherlock113 Apr 18, 2024
606c975
fix(cloud client): various type error (#4680)
bojiang Apr 19, 2024
bd47504
fix(cli): bentoml cli verbosity not passed to the subprocess correctl…
frostming Apr 19, 2024
cab59c8
docs: fix indentation in build option docs (#4688)
jianshen92 Apr 23, 2024
a124df5
fix: bug: module 'bentoml' has no attribute 'build' (#4689)
frostming Apr 24, 2024
9661e04
docs: update autoscaling (#4691)
ssheng Apr 25, 2024
020552d
docs: init io-descriptors example (#4646)
lycheel1 Apr 29, 2024
a152a0a
fix: uncaught error missing trace headers (#4692)
frostming Apr 29, 2024
3cbc016
chore: remove outdated examples (#4694)
larme Apr 30, 2024
1ae61b0
fix: bypass /livez in traffic middleware (#4696)
frostming Apr 30, 2024
bf8f8e8
docs:Update credits (#4700)
Sherlock113 May 2, 2024
12f0a84
docs: Add model store reference in the Services doc (#4706)
Sherlock113 May 6, 2024
0cfb482
docs: Update example dir readme (#4707)
Sherlock113 May 6, 2024
655df9e
fix: fix table overflow with fold (#4677)
FogDong May 6, 2024
c1e2a94
fix: server socket binding on Windows (#4685)
frostming May 6, 2024
7789ee6
fix: correct the logic of bypassing infra endpoints in traffic middle…
frostming May 6, 2024
dd94c93
fix: add scaled to zero to ready status (#4708)
FogDong May 6, 2024
61b731d
chore(container): cache large pypi packages in layers (#4690)
bojiang May 6, 2024
3bf3385
feat: add uvicorn timeouts options (#4682)
gusghrlrl101 May 6, 2024
9b30551
fix: include models from config for new SDK bentos (#4705)
frostming May 6, 2024
75acab0
fix: annotation preparation list iteration bug (#4701)
adamliter May 6, 2024
e2c21b8
fix: tuple schema and websocket connection (#4709)
frostming May 6, 2024
6de2041
fix: show warning instead of hard failure when model is missing (#4693)
frostming May 6, 2024
e19f765
fix: add scaled to zero in client (#4712)
FogDong May 7, 2024
f6cd48e
ci: pre-commit autoupdate [skip ci] (#4713)
pre-commit-ci[bot] May 7, 2024
942e8c3
fix: serailization error when request with an invalid json input (#4714)
frostming May 8, 2024
614e8f4
fix: config pollution from other services (#4715)
frostming May 8, 2024
09db40b
fix: handle ssh git url without ref part (#4716)
frostming May 8, 2024
66321b8
fix: correct the default value of timeout-keep-alive (#4717)
frostming May 8, 2024
6e9b64d
fix: handle subdirectory in git ssh url (#4719)
frostming May 9, 2024
9221551
fix(build): make sure to parse pip_args in correct order (#4722)
aarnphm May 10, 2024
82d7789
docs: Add compound data types doc (#4721)
Sherlock113 May 10, 2024
dff954e
docs: Add docs for installing GitHub packages for Bento (#4720)
Sherlock113 May 10, 2024
30b1992
docs: Update deployment details explanations (#4726)
Sherlock113 May 13, 2024
3c33b4d
fix: load model aliases before loading new SDK service (#4727)
frostming May 14, 2024
7d380d2
docs: Fix cpu as strings (#4735)
Sherlock113 May 16, 2024
50a053c
docs: Update the services doc (#4734)
Sherlock113 May 16, 2024
2cf64ea
feat: add trace id to monitoring module (#4732)
jianshen92 May 16, 2024
950f709
feat: add a switch to opt-out packing git packages (#4729)
frostming May 16, 2024
8327b65
fix: missing components from output schema if it is a root model (#4733)
frostming May 16, 2024
078b137
feat: expose the service url as a property (#4730)
frostming May 16, 2024
0f06eb4
fix(container): preheat packages support markers (#4737)
bojiang May 16, 2024
d7412f1
docs: update model store (#4741)
ssheng May 17, 2024
028f087
docs: Add env var for mistral 7b docs (#4747)
Sherlock113 May 21, 2024
e8bfe83
refactor(tests): testing.util.async_request to client.AsyncHTTPClient…
sanspareilsmyn May 21, 2024
dd2b13d
docs: Update GitHub readme (#4749)
Sherlock113 May 21, 2024
a882bfb
chore(build): update build_config.py (#4751)
eltociear May 22, 2024
1977c42
docs: Add git package packing doc (#4750)
Sherlock113 May 22, 2024
2868cd1
fix: configure server logging before importing service (#4744)
frostming May 22, 2024
df2c7b8
docs: Add user roles docs (#4724)
Sherlock113 May 23, 2024
7d1db14
feat(batching): break batch into smaller partitions if it's larger th…
frostming May 27, 2024
dd51f1b
docs: Update the examples folder readme (#4748)
Sherlock113 May 27, 2024
31d09e4
docs: Add byoc setup docs (#4757)
Sherlock113 May 27, 2024
a6eb3f5
fix: new sdk e2e test (#4758)
xianml May 27, 2024
8d22bc7
fix: metrics did not include 4xx (#4756)
xianml May 28, 2024
1e0f07e
fix: should enable existing loggers in server logging config (#4759)
rickzx May 28, 2024
b5be34a
fix: client response deserialization when the output is string (#4762)
frostming May 29, 2024
c03f2d9
fix: middleware reorder (#4761)
xianml May 30, 2024
1cb5781
fix: log errors inside a streaming response and detect service name c…
frostming May 31, 2024
e8ab6c4
fix: don't try to validate non-bytes as Path (#4765)
frostming May 31, 2024
58c0882
docs: scale from zero (#4769)
ssheng Jun 3, 2024
7b54c45
ci: pre-commit autoupdate [skip ci] (#4772)
pre-commit-ci[bot] Jun 4, 2024
27619e4
docs: Update installation.rst (#4763)
parano Jun 4, 2024
8bfd059
docs: Add chatTTS to example project list (#4777)
Sherlock113 Jun 5, 2024
8abc7ad
fix: bad performance when walking the file tree and check includes (#…
frostming Jun 6, 2024
f8ea2c4
update readme to include chattts (#4786)
ssheng Jun 10, 2024
2699c3b
docs: Update README.md (#4785)
parano Jun 10, 2024
e40d1a8
fix: `FileExistsError: [Errno 17] File exists: '/root/bentoml'` (#4781)
tripathiarpan20 Jun 11, 2024
28e46c1
fix: set env to null if it is empty for merge override (#4783)
FogDong Jun 11, 2024
e574bc4
fix: add none check for env for deploy (#4792)
FogDong Jun 12, 2024
0cf7cb2
fix(pandas): use correct mime type for Parquet (#4780)
judahrand Jun 12, 2024
7c6eb0c
fix: add memoization to `pkg_version_info` to reduce cpu overhead (#4…
adrianlyjak Jun 12, 2024
89eb556
fix: bug: memory leak when using bentoml>=1.2 (#4775)
frostming Jun 12, 2024
8fc7497
fix: honor host and port config in service decorator (#4776)
frostming Jun 12, 2024
34fb9b4
fix(pandas): `Annotated[pd.DataFrame, DataframeSchema(columns=["a"])]…
judahrand Jun 14, 2024
5b83de0
fix: ensure relative path works within bento project (#4803)
aarnphm Jun 14, 2024
52171fe
fix: map error responses from HTTP client to bentoml exceptions (#4804)
frostming Jun 14, 2024
d3eef2e
fix(numpy): `numpy` annotation processing (#4795)
judahrand Jun 14, 2024
692a286
fix: populate bento name and version of server context (#4787)
frostming Jun 14, 2024
fe55d96
fix(cloud-client): consider httpcore timeout when getting status (#4740)
Haivilo Jun 14, 2024
32e7057
fix: cd into src instead of bento parent (#4805)
frostming Jun 14, 2024
ddb653d
feat: show image builder logs (#4796)
yetone Jun 14, 2024
9c61652
docs: Update diffusion model repos to the new one (#4797)
Sherlock113 Jun 17, 2024
e1efdc6
feat(monitoring): support GRPC LogExporter (#4808)
judahrand Jun 17, 2024
81b2df8
docs: Add Docker deployment for Bentos (#4812)
Sherlock113 Jun 18, 2024
08a15f8
docs: update examples service decorators with new features (#4798)
ssheng Jun 18, 2024
b08848b
doc: Custom Error Handling (#4811)
jianshen92 Jun 18, 2024
27386c0
doc: Wording change in error handling doc (#4813)
Sherlock113 Jun 18, 2024
4d85863
fix: ASCII animation was not working properly in the image builder lo…
yetone Jun 18, 2024
f5d283a
fix: avoid editing list in during iteration (#4809)
judahrand Jun 18, 2024
a066a24
docs: Add secrets doc (#4814)
Sherlock113 Jun 19, 2024
fc5c514
fix: improve the code of spinner and log tailer (#4815)
frostming Jun 20, 2024
6d44055
doc: Update the docs about multipart output (#4818)
frostming Jun 20, 2024
36654fd
docs: Add batch inference jobs doc (#4816)
Sherlock113 Jun 20, 2024
aa200ed
doc: Fix typo and format (#4821)
Sherlock113 Jun 20, 2024
ebae492
fix(cli): hanging issue when deployment ready (#4825)
frostming Jun 21, 2024
7132bd3
fix(deployment-client): add build process and extend url (#4790)
Haivilo Jun 21, 2024
9fee056
doc: Update vllm.rst (#4824)
Sherlock113 Jun 21, 2024
af3e53b
docs: Add custom models use case doc (#4819)
Sherlock113 Jun 21, 2024
da22538
docs: Reorg blip doc to multimodality section (#4826)
Sherlock113 Jun 21, 2024
65e7176
fix: inject prometheus multiproc_dir into env var when worker starts …
frostming Jun 23, 2024
16709da
docs: Add logging and tracing docs (#4725)
Sherlock113 Jun 25, 2024
0eff8e6
feat: --label option for bentoml build (#4832)
frostming Jul 1, 2024
6f74c43
docs: Update the concurrency doc (#4834)
Sherlock113 Jul 1, 2024
16f1b35
docs: Update services.rst (#4837)
vikramjit-sidhu Jul 2, 2024
885a08e
docs: Update concurrency links (#4840)
Sherlock113 Jul 2, 2024
0666d62
docs: Fix broken link (#4841)
Sherlock113 Jul 4, 2024
a7515a0
ci: pre-commit autoupdate [skip ci] (#4838)
pre-commit-ci[bot] Jul 5, 2024
a91ba14
fix: stop spinner before starting to stream logs (#4846)
frostming Jul 10, 2024
16a1742
docs: Add azure byoc setup doc (#4847)
Sherlock113 Jul 10, 2024
2cd0748
Update azure.rst
Sherlock113 Jul 10, 2024
f8fccde
docs: Update the BYOC architecture image (#4848)
Sherlock113 Jul 10, 2024
09cadf2
fix: fix error message with trace id (#4853)
FogDong Jul 11, 2024
247649e
doc: locking (#4850)
bojiang Jul 11, 2024
bb6447f
fix(containerize): command to create group and user in alpine base im…
frostming Jul 12, 2024
755895b
fix: encode special charaters in path (#4854)
frostming Jul 12, 2024
bc9cca9
doc: locking for platform (#4858)
frostming Jul 12, 2024
65b22ef
fix: correct the params passed to keras.save_model (#4857)
frostming Jul 12, 2024
5c77bc3
fix: change forbid extra keys to false for bentocloud (#4866)
FogDong Jul 18, 2024
b11cdbf
feat(dev): 1.3 (#4849)
frostming Jul 18, 2024
40c0fd4
fix: delete cluster and ns if it is first cluster (#4869)
FogDong Jul 18, 2024
fab310d
fix: auto login confirm ask logic (#4864)
xianml Jul 18, 2024
e41dc2c
fix: secret default value (#4870)
xianml Jul 18, 2024
94e4b66
fix: fix typo in error msg (#4871)
FogDong Jul 19, 2024
b3a5ea2
docs: Add 2 examples (#4872)
Sherlock113 Jul 21, 2024
25571e3
docs: update theme to match branding (#4874)
ssheng Jul 22, 2024
b6bf186
docs: Add task doc (#4873)
Sherlock113 Jul 22, 2024
49b66d7
fix: set prometheus env before importing service (#4875)
frostming Jul 23, 2024
9ca17f3
docs: Add API docs (#4877)
Sherlock113 Jul 23, 2024
8a89c94
fix: inject prometheus env from arbiter (#4878)
frostming Jul 24, 2024
9b361c7
fix: Don't run bentoml.build_bentofile in subprocess (#4876)
frostming Jul 24, 2024
2a6fd31
docs: update azure byoc instructions (#4881)
ssheng Jul 24, 2024
68d6ab4
docs(azure): update azure byoc instructions (#4882)
ssheng Jul 24, 2024
a148bb3
fix(framework): transformers vs 1.3.0 "TypeError: __init__() got an u…
frostming Jul 25, 2024
bd145ca
fix: silence git output (#4883)
frostming Jul 26, 2024
d34749f
fix: surface config error on bento build (#4888)
frostming Jul 30, 2024
59b4046
docs: Refactor tasks doc (#4890)
Sherlock113 Jul 31, 2024
72d20cf
Docs: Sync the BYOC doc with blog and update BentoCloud guides index …
Sherlock113 Jul 31, 2024
1764c69
fix: move user setup to base template to make custom base image work …
frostming Aug 2, 2024
51468b6
fix: Cannot define custom duration histogram buckets via `@bentoml.se…
frostming Aug 2, 2024
7e1f10c
fix: press text (#4898)
xianml Aug 6, 2024
bdaa41b
ci: pre-commit autoupdate (#4897)
pre-commit-ci[bot] Aug 6, 2024
be4abeb
docs: Update doc images (#4901)
Sherlock113 Aug 6, 2024
fca3489
fix: fix resource type (#4904)
FogDong Aug 7, 2024
ede50d3
fix: direct return response if tracer id is null (#4899)
FogDong Aug 7, 2024
03a7f85
docs: update azure byoc instructions (#4905)
ssheng Aug 7, 2024
29214bf
fix: metrics duration defined with min,max,factor not taking effect (…
frostming Aug 8, 2024
da6c30b
refactor: store the cloud context into the container instead of passi…
frostming Aug 8, 2024
87b7ccb
feat: support model loading preheat
rickzx Aug 5, 2024
bdaea53
feat: lazy model reference
frostming Aug 9, 2024
4b62006
feat: add huggingface endpoint
frostming Aug 12, 2024
da70440
fix: export members at top module
frostming Aug 13, 2024
5c9b977
feat: save huggingface models to BENTOML_HF_CACHE_DIR
frostming Aug 16, 2024
fc03f05
fix: freeze model version when serving a bento
frostming Aug 16, 2024
ab5768f
fix: memoize the resolved value
frostming Aug 16, 2024
87123e4
feat: create placeholders for non-bentoml models
frostming Aug 19, 2024
ce395e1
fix: hf models root
frostming Aug 19, 2024
3f641fd
fix: models push
frostming Aug 19, 2024
be7e326
fix: pulling model
frostming Aug 19, 2024
82c2e0d
fix: add endpoint and url to metadata
frostming Aug 19, 2024
7d844dd
feat: calc hf model size
frostming Aug 19, 2024
ea68ef3
fix: use revision
frostming Aug 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: show warning instead of hard failure when model is missing (bent…
…oml#4693)

Signed-off-by: Frost Ming <me@frostming.com>
  • Loading branch information
frostming authored May 6, 2024
commit 6de204116194e39a9ade73fbd2cec79b33d60049
10 changes: 9 additions & 1 deletion src/bentoml/_internal/bento/bento.py
Original file line number Diff line number Diff line change
@@ -420,7 +420,15 @@ def total_size(
continue
except NotFound:
pass
global_model = model_store.get(model.tag)
try:
global_model = model_store.get(model.tag)
except NotFound:
logger.warning(
"Bento: %s: Missing model %s",
self.tag,
model.tag,
)
continue
total_size += global_model.file_size
return total_size

7 changes: 7 additions & 0 deletions src/bentoml/_internal/log.py
Original file line number Diff line number Diff line change
@@ -23,15 +23,22 @@ def filter(self, record: logging.LogRecord) -> bool:
"version": 1,
"disable_existing_loggers": True,
"filters": {"infofilter": {"()": InfoFilter}},
"formatters": {
"simple": {
"format": "%(levelname)s: %(message)s",
}
},
"handlers": {
"bentomlhandler": {
"class": "logging.StreamHandler",
"filters": ["infofilter"],
"stream": "ext://sys.stdout",
"formatter": "simple",
},
"defaulthandler": {
"class": "logging.StreamHandler",
"level": logging.WARNING,
"formatter": "simple",
},
},
"loggers": {