Release version 0.5.0: Major improvements and bug fixes #22
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Key updates: - **Fix markdown translation issues**: Resolved problems where code blocks and inline code were split across chunks during translation, causing incomplete translations and broken markdown structures. - Replaced code blocks ( ` ) and inline code ( ` ) with placeholders (e.g., @@CODE_BLOCK_x@@, @@INLINE_CODE_x@@) before translation, and restored them afterward to ensure no splitting occurs. - **Sequential markdown processing**: Improved translation logic to handle markdown files and their chunks sequentially, ensuring that every chunk is fully translated before moving to the next. This resolves issues with missing or skipped chunks during the process. - **Enhanced line break consistency check**: Added a mechanism to detect formatting issues by comparing line breaks between original and translated files. If the difference exceeds a predefined threshold (5 lines), the translation is flagged for review and retry. - **Improve generative AI disclaimer**: Updated the disclaimer message to better reflect that the translation is done by an AI model, ensuring users understand the limitations and context of the translation. - **Performance improvements**: Optimized the process for handling both markdown and image translations, and implemented retry logic for failed translations.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose
Key updates:
```) and inline code (``) with placeholders (e.g.,@@CODE_BLOCK_x@@,@@INLINE_CODE_x@@) before translation, and restored them afterward to ensure no splitting occurs.Important
All translation issues previously encountered in the Phi-3 CookBook, such as skipped chunks and incomplete translations, have been resolved in this version.
This release addresses several major issues related to markdown and image translation, providing more reliable and stable translation workflows. Due to the significance of these improvements, the version is upgraded to
0.5.0.Does this introduce a breaking change?
When developers merge from main and run the server, azd up, or azd deploy, will this produce an error?
If you're not sure, try it out on an old environment.
Type of change