v0.11.1

[laipz8200]

✨ What's New in v0.11.1? ✨

Important

Heads up! Starting with the next minor version, we'll no longer support Python 3.10. Make sure to upgrade to Python 3.11 or 3.12 to stay current with our updates.

We're back with some fresh features and crucial fixes in version 0.11.1. Let’s dive in and see what's changed:

🚀 New Features

• Vanna AI Base URL Configuration: You can now configure the base URL for VannaAI, allowing more flexibility in routing requests by @BenjaminX in feat(vannaai): add base_url configuration #10294.

• Anthropic Claude-3-5-Haiku Support via OpenRouter: Get ready to leverage the capabilities of Anthropic’s Claude-3-5-Haiku by @infinitnet in feat: add support for anthropic/claude-3-5-haiku through OpenRouter #10331.

• GitLab Tools Integration: Amp up your DevOps with the integration of GitLab tools by @wlrnet in Feat/tools/gitlab #10407.

• Video Understanding and CogVideo Tool Support: Your LLM can now understand videos, and with the new CogVideo tool, process them too! Thanks to @hjlarry in feat: support LLM understand video #9828 and feat: add cogVideo tool #10456.

• Tool Search Enhancement: You can now search for tools using the provider’s name, making it easier to find exactly what you need by @hjlarry in feat: support tool search also can search toolProvider's name #10518.

• Podcast Generator Tool Enhancements: Set the OpenAI base URL when using our podcast generation tool, thanks to @XiaoLey in feat(tools/podcast_generator): add support for setting openai base url with the podcast_generationor tool #10496 and feat(tools/podcast_generator): add support for setting openai base url with the podcast_generationor tool #10517.

⚙️ Enhancements

• SSRF Request Timeout Configuration: New configuration options to customize SSRF request timeout for better security by @gubinjie in feat: The SSRF request timeout configuration item is added #10292.

• PNG, GIF, and WebP Support: More image formats for your media needs by @ZuzooVn in feat: support png, gif, webp #7947.

• Iteration Node Enhancements: Parallel mode now maintains correct output order, and single run time per iteration is supported by @Nov1c444 in fix: correct output order in parallel mode for iteration nodes #10323 and Feat/iteration single run time #10512.

• Celery Worker Log Format: Logs now respect the LOG_FORMAT environment variable, making logs cleaner and more consistent by @liuhaoran1212 in celery worker log format following LOG_FORMAT env#9404 #10016.

🛠️ Bug Fixes

• ComfyUI Tool Prompt Fix: Special prompts are back in action for the ComfyUI tool by @hjlarry in fix: special prompt not work for comfyUI tool #10307.

• Workflow and Node Fixes: Various workflow-related bugs squashed, specifically handling optional values in workflow start nodes and ensuring no failures when variables go missing by @laipz8200 and @zxhlyh in feat(workflow-nodes): handle missing variables without failure #10471 and fix: workflow start node form optional value #10529.

---

Upgrade Guide

Docker compose deployments

1. Back up your customized docker-compose YAML file (optional)

   cd docker
   cp docker-compose.yaml docker-compose.yaml.$(date +%s).bak

2. Get the latest code from the main branch

   git checkout main
   git pull origin main

3. Stop the service，Command, please execute in the docker directory

   docker compose down

4. Back up data

   tar -cvf volumes-$(date +%s).tgz volumes

5. Upgrade services

   docker compose up -d

Source Code deployments

1. Stop API server, Worker and Web frontend Server.

2. Get the latest code from the release branch:

   git checkout 0.11.1

3. Update Python dependencies:

   cd api
   poetry install

4. Then, let's run the migration script:

   poetry run flask db upgrade

5. Finally, run API server, Worker and Web frontend Server again.

---

What's Changed

• fix: special prompt not work for comfyUI tool by @hjlarry in fix: special prompt not work for comfyUI tool #10307
• docs: remove the TOC part by @laipz8200 in docs: remove the TOC part #10324
• feat(vannaai): add base_url configuration by @BenjaminX in feat(vannaai): add base_url configuration #10294
• feat: add support for anthropic/claude-3-5-haiku through OpenRouter by @infinitnet in feat: add support for anthropic/claude-3-5-haiku through OpenRouter #10331
• feat: The SSRF request timeout configuration item is added by @gubinjie in feat: The SSRF request timeout configuration item is added #10292
• Gitee AI tools by @fchange in Gitee AI tools #10314
• Update README.md by @guchenhe in Update README.md #10332
• feat: support png, gif, webp by @ZuzooVn in feat: support png, gif, webp #7947
• fix(api): remove fixed source attribute from FileApi by @laipz8200 in fix(api): remove fixed source attribute from FileApi #10353
• chore(ci): separate vector store tests into new workflow by @laipz8200 in chore(ci): separate vector store tests into new workflow #10354
• chore: update translation for 'account' from '계좌' to '계정' by @comfuture in chore: update translation for 'account' from '계좌' to '계정' #10350
• chore: lazy import sagemaker by @bowenliang123 in chore: lazy import sagemaker #10342
• chore(ci): bring back poetry cache to speed up CI jobs by @bowenliang123 in chore(ci): bring back poetry cache to speed up CI jobs #10347
• fix: remove unsupported vision in OpenRouter Haiku 3.5 by @infinitnet in fix: remove unsupported vision in OpenRouter Haiku 3.5 #10364
• fix(model_runtime): remove vision from features for Claude 3.5 Haiku by @mazyu36 in fix(model_runtime): remove vision from features for Claude 3.5 Haiku #10360
• fix: remove duplicated category “recommended” by @hjlarry in fix: remove duplicated category “recommended” #10375
• fix typo: mMaximum -> Maximum by @y-omr in fix typo: mMaximum -> Maximum #10389
• Adjusted docker manifests and environment variables for OceanBase vector database by @powerfooI in Adjusted docker manifests and environment variables for OceanBase vector database #10395
• fixed: web api remote urls error by @luckylhb90 in fixed: web api remote urls error #10383
• refactor(question_classifier): improve error handling with custom exceptions by @laipz8200 in refactor(question_classifier): improve error handling with custom exceptions #10365
• refactor(tool-node): introduce specific exceptions for tool node errors by @laipz8200 in refactor(tool-node): introduce specific exceptions for tool node errors #10357
• refactor(knowledge-retrieval): improve error handling with custom exceptions by @laipz8200 in refactor(knowledge-retrieval): improve error handling with custom exceptions #10385
• refactor(iteration): introduce specific exceptions for iteration errors by @laipz8200 in refactor(iteration): introduce specific exceptions for iteration errors #10366
• fix(remote-files): fallback to get when remote server not support head method by @laipz8200 in fix(remote-files): fallback to get when remote server not support head method #10370
• fix(conversation-service): return success response after conversation… by @BenjaminX in fix(conversation-service): return success response after conversation… #10416
• chore: improve custom tool's display by @hjlarry in chore: improve custom tool's display #10410
• feat(Tools): add lark tools by @hgnulb in feat(Tools): add lark tools #10117
• fix typo: Retrieve Chunks API Docs by @huangyafei in fix typo: Retrieve Chunks API Docs #10412
• chore: use posixpath to wrapper filepath by @yaoice in chore: use posixpath to wrapper filepath #9976
• chore(lint): Use logging.exception instead of logging.error by @bowenliang123 in chore(lint): Use logging.exception instead of logging.error #10415
• Conversation delete issue by @BenjaminX in Conversation delete issue #10423
• fix: simplify Enter key handling and remove unused ref by @SuzukiKatsuma in fix: simplify Enter key handling and remove unused ref #10413
• fix: config violations when running db migtration ci tests by @bowenliang123 in fix: config violations when running db migtration ci tests #10428
• fix(http_request): send form data by @laipz8200 in fix(http_request): send form data #10431
• chore: use DEBUG in dify_config instead of parsing raw system environment variable in place by @bowenliang123 in chore: use DEBUG in dify_config instead of parsing raw system environment variable in place #10437
• fix: (chore: use DEBUG in dify_config instead of parsing raw system environment variable in place #10437 followup) fix conditions with DEBUG config by @bowenliang123 in fix: (#10437 followup) fix conditions with DEBUG config #10438
• Feat/tools/gitlab by @wlrnet in Feat/tools/gitlab #10407
• feat: support LLM understand video by @hjlarry in feat: support LLM understand video #9828
• fix(ops_tracing): enhance error handle in celery tasks. by @ZhouhaoJiang in fix(ops_tracing): enhance error handle in celery tasks. #10401
• fix: correct output order in parallel mode for iteration nodes by @Nov1c444 in fix: correct output order in parallel mode for iteration nodes #10323
• chore: add MULTIMODAL_SEND_VIDEO_FORMAT to docker's env by @hjlarry in chore: add MULTIMODAL_SEND_VIDEO_FORMAT to docker's env #10458
• feat: add cogVideo tool by @hjlarry in feat: add cogVideo tool #10456
• Fix conversation response issue by @BenjaminX in Fix conversation response issue #10450
• fix segment enable service api by @JohnJyong in fix segment enable service api #10445
• celery worker log format following LOG_FORMAT env#9404 by @liuhaoran1212 in celery worker log format following LOG_FORMAT env#9404 #10016
• embedding model check when init the knowledge by @JohnJyong in embedding model check when init the knowledge #10463
• feat: Add support for complete domain names in the new URL prefix. by @QuietlyChan in feat: Add support for complete domain names in the new URL prefix. #8893
• chore: make comfy workflow can generate image with a random seed by @hjlarry in chore: make comfy workflow can generate image with a random seed #10462
• chore(ci): avoid reinstall pipx and pin poetry version aligned with in api dockerfile by @bowenliang123 in chore(ci): avoid reinstall pipx and pin poetry version aligned with in api dockerfile #10426
• update document and segment word count by @JohnJyong in update document and segment word count #10449
• fix(migrations): correct schema reference in service API history migration by @laipz8200 in fix(migrations): correct schema reference in service API history migration #10452
• refactor(core): Remove extra_config from File. by @laipz8200 in refactor(core): Remove extra_config from File. #10203
• add create tidb serverless job control by @JohnJyong in add create tidb serverless job control #10467
• feat(workflow-nodes): handle missing variables without failure by @laipz8200 in feat(workflow-nodes): handle missing variables without failure #10471
• fix(api): replace Raw field with FilesContainedField in MessageListApi inputs by @laipz8200 in fix(api): replace Raw field with FilesContainedField in MessageListApi inputs #10472
• Fix/log tz by @crazywoola in Fix/log tz #10473
• fix(file_upload): correct validation method and add unit tests by @laipz8200 in fix(file_upload): correct validation method and add unit tests #10477
• fix: [VESSL-AI] edit some words in vessl_ai.yaml by @larcane97 in fix: [VESSL-AI] edit some words in vessl_ai.yaml #10417
• Fix: Correct the max tokens of Claude-3.5-Sonnet-20241022 for Bedrock and VertexAI by @fdb02983rhy in Fix: Correct the max tokens of Claude-3.5-Sonnet-20241022 for Bedrock and VertexAI #10508
• fix the error of unable to retrieve url from file by @XiaoLey in fix the error of unable to retrieve url from file #10498
• feat(tools/podcast_generator): add support for setting openai base url with the podcast_generationor tool by @XiaoLey in feat(tools/podcast_generator): add support for setting openai base url with the podcast_generationor tool #10496
• Revert "fix the error of unable to retrieve url from file" by @crazywoola in Revert "fix the error of unable to retrieve url from file" #10511
• feat(tools/podcast_generator): add support for setting openai base url with the podcast_generationor tool by @XiaoLey in feat(tools/podcast_generator): add support for setting openai base url with the podcast_generationor tool #10517
• feat: support tool search also can search toolProvider's name by @hjlarry in feat: support tool search also can search toolProvider's name #10518
• Support for incoming value modification by @charli117 in Support for incoming value modification #10525
• The list action node adds methods to extract specific list objects by @charli117 in The list action node adds methods to extract specific list objects #10421
• refactor(code_executor): update input type annotations to use Mapping for better type safety by @laipz8200 in refactor(code_executor): update input type annotations to use Mapping for better type safety #10478
• add jina rerank http timout parameter by @JohnJyong in add jina rerank http timout parameter #10476
• Feat/iteration single run time by @Nov1c444 in Feat/iteration single run time #10512
• fix: workflow start node form optional value by @zxhlyh in fix: workflow start node form optional value #10529
• chore: (dockerfile) upgrade perl version by @Nov1c444 in chore: (dockerfile) upgrade perl version #10534
• fix(model_runtime): ensure compatibility with O1 models by adjusting token parameters by @laipz8200 in fix(model_runtime): ensure compatibility with O1 models by adjusting token parameters #10537
• fix(gitee_ai): update English description for clarity and accuracy by @laipz8200 in fix(gitee_ai): update English description for clarity and accuracy #10540
• chore (vanna): update form parameter from 'form' to 'llm' in vanna.yaml by @BenjaminX in chore (vanna): update form parameter from 'form' to 'llm' in vanna.yaml #10488
• fix(extractor): temporary file by @laipz8200 in fix(extractor): temporary file #10543
• fix: iteration invalid output selector doesn't throw an error by @Nov1c444 in fix: iteration invalid output selector doesn't throw an error #10544
• chore: update version to 0.11.1 across all configurations and Docker images by @laipz8200 in chore: update version to 0.11.1 across all configurations and Docker images #10539

New Contributors

• @comfuture made their first contribution in chore: update translation for 'account' from '계좌' to '계정' #10350
• @huangyafei made their first contribution in fix typo: Retrieve Chunks API Docs #10412
• @SuzukiKatsuma made their first contribution in fix: simplify Enter key handling and remove unused ref #10413
• @liuhaoran1212 made their first contribution in celery worker log format following LOG_FORMAT env#9404 #10016
• @QuietlyChan made their first contribution in feat: Add support for complete domain names in the new URL prefix. #8893
• @fdb02983rhy made their first contribution in Fix: Correct the max tokens of Claude-3.5-Sonnet-20241022 for Bedrock and VertexAI #10508

Full Changelog: 0.11.0...0.11.1

---

This discussion was created from the release v0.11.1.

[XiaoLey]

@laipz8200 Uh... regarding the 'Bug Fixes' section, specifically the 'File URL Retrieval Issues', I actually resolved this issue, but not through this PR. This particular PR was a bit messy and got reverted. 😅 I made some adjustments, and it should actually be this PR: #10513.

[laipz8200]

Oh! I'll update it later. 🫣

[FBR65]

Hi, I just tried 0.11.1.

Uploading an image works now, but the name of the file on the server doesn't match the name or id which is given back.

[laipz8200]

For safety reasons, we don't use file names entered by users in the storage path. Instead, the actual file names are stored in the database and retrieved when needed.

[FBR65]

Uploading file to Dify (Image/png) and then the ID given back from the API should be used to transfer the file to the backend.

So if the ID, which is given back not corresponding to the filename, what should be done?

[laipz8200]

You just need to use the ID, and Dify will be able to find the right file for you.

[FBR65]

No, that doesn't work. I tried it yesterday with 0.11.0 and today with 0.11.1.

My file is uploaded by /files/upload and afterwards the ID is given to Dify Client for sending the file and the query to Qwen VL.
But I'm alsways getting an error back.

It works 0.10.1 but not in 0.11.0 and 0.11.1.

[nadirvishun]

Is 0.11.1 version already support Python 3.11 or 3.12 ?

[bowenliang123]

Yes, it does. Tested on 3.10, 3.11 and 3.12.

[JiesenSun]

After upgrading to version 0.11.1 through docker-compose, the following information is printed crazily in the log.

[fdb02983rhy]

Please have a check
#10555
#10563

[bowenliang123]

When and where have these logs are printed?
It seems you're running commands inside the worker service?