DJL v0.27.0 Release

Key Changes

• Upgrades for engines
  • OnnxRuntime 1.17.1 #3019
• Enhancements for engines and API
  • Supports PyTorch stream imperative model load #2981
  • Support encode/decode String tensor #3034

Enhancement

• Suppress serial warning for JDK21 by @zachgk in #2935
• [api] Moves commons-compress dependency to standalone class. by @frankfliu in #2951
• [api] Allows to load .pt or .onnx file from jar url by @frankfliu in #2955
• [tokenizer] Return if exceed max token length by @frankfliu in #2957
• [tokenizer] Adds getters for HuggingfaceTokenizer by @frankfliu in #2958
• [pytorch] Upgrade android build to 0.26.0 by @frankfliu in #2975
• [pytorch] Avoid loading .lib file from PYTORCH_LIBRARY_PATH by @frankfliu in #2987
• [api] Adds utility method to Model for accessing properties by @frankfliu in #3007
• [api] Adds suffix to percentile metric name by @frankfliu in #3011
• [api] Adds dimension for prediction metric by @frankfliu in #3013
• Thread-safe FaceDetectionTranslator by @StefanOltmann in #3016
• [api] Upgrades commons compress to 1.26.0 for CVE by @frankfliu in #3018
• Avoid duplicated loading native library by @frankfliu in #3020
• [api] Allows to use relative jar uri for cache folder name by @frankfliu in #3026
• support includeTokenTypes in TextEmbeddingBatchTranslator by @morokosi in #3032
• [tokenizer] Adds includeTokenTypes for all translators by @frankfliu in #3035
• Updates dependencies version to latest by @frankfliu in #3040
• [pytorch] Allows to exclude certain DLL from pytorch directory by @frankfliu in #3043
• Update checkstyle tool version to 10.14.2 by @xyang16 in #3047
• Upgrade dependency version by @xyang16 in #3049

Bug Fixes

• [fix][ci] fix typo in publish metric workflow by @siddvenk in #2976
• [fix][ci] avoid early exit of script for failure case by @siddvenk in #2979
• [ci][fix] update path to android sdk manager cli by @siddvenk in #2980
• [dataset] Fixes broken link for mnist dataset by @frankfliu in #2984
• [database] Fixes mnist URL for local unitest by @frankfliu in #2988
• fix #2968 by @SidneyLann in #2986
• [dataset] Fixes wikitext-2 by @zachgk in #2996
• [spark] Fixes python tarslip security concern by @frankfliu in #2995
• Fixes failing CI by @ydm-amazon in #3001
• Fixes cases where the getEngine method in the EngineProvider class returns null when called concurrently. by @onaple in #3005
• [api] Fixes typo in CudaUtils by @frankfliu in #3008
• [model-zoo] Fixes typo in README by @fensch in #3009
• [ci] Fixes nightly build for onnx 1.17.1 by @frankfliu in #3021
• [pytorch] Fixes detecting wrong flavor on macOS issue by @frankfliu in #3027
• [bom] Fixes djl-serving packages in BOM by @frankfliu in #3039

Documentation

• Bump DJL version to 0.27.0 by @siddvenk in #2933
• [doc] include trtllm convert manual by @sindhuvahinis in #2941
• [docs] Updates README by @frankfliu in #2954
• [doc] Make LMI a separate tab and include I/O schema by @sindhuvahinis in #2960
• [docs] Fixes cuda version for pytorch native library by @frankfliu in #2963
• docs: add AWS Graviton3 PyTorch inference tuning details by @snadampal in #2982
• [docs] Update Huggingface tokenizer cache directory document by @frankfliu in #2994
• [docs] Disable progress bar for jupyter notebook convertion by @frankfliu in #3017
• [example] Adds document about how to trace gpt2 model by @frankfliu in #3028
• [docs] update mkdocs structure for new lmi documentation by @siddvenk in #3029

CI/CD

• removing pytorch 2.0.1 from 0.27.0 by @siddvenk in #2940
• Moves to Actions hosted M1 runner by @zachgk in #2948
• [ci] Disable run scheduled github actions in fork by @frankfliu in #2943
• [ci] add cloudwatch metrics for scheduled workflow failures by @siddvenk in #2966
• [ci] Upgrade github actions nodejs 16 to nodejs 2 by @frankfliu in #2967
• [ci] Upgrade codeql-actions to v3 by @frankfliu in #2973
• [ci] Upgrade aws-actions/configure-aws-credentials to v4 by @frankfliu in #2972
• [ci] refactor cloudwatch metric publishing to avoid needing changes i… by @siddvenk in #2974
• [ci] Downgrade github actions version for centos7 and amazonlinux by @frankfliu in #2977
• [ci] move cw publish step to github hosted runner by @siddvenk in #2978
• [CI] downgrade the version to V3 by @lanking520 in #2990
• [CI] change to cache v3 for the versions by @lanking520 in #2991
• Uses gradle dependency submission by @zachgk in #2983
• Excludes test dependencies from dependency submission by @zachgk in #2999
• Update continuous OSX to 13 by @zachgk in #3004
• Removes dependency submission by @zachgk in #3006

New Contributors

• @snadampal made their first contribution in #2982
• @ydm-amazon made their first contribution in #3001
• @onaple made their first contribution in #3005
• @fensch made their first contribution in #3009
• @StefanOltmann made their first contribution in #3016
• @morokosi made their first contribution in #3032

Full Changelog: v0.26.0...v0.27.0