Enhance: Add NonValueTransformer Reverse Conversion with NAN_VALUE Replacement #212
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Added a new method
replace_nan_value
within theNonValueTransformer
class to handle the replacement of specific "NAN_VALUE" placeholders with empty strings during the reverse conversion process.This method scans all rows and columns in the DataFrame and performs the replacement, enhancing the usability of the reverse-converted data.
Motivation and Context
This change is required to address the issue of placeholder values ("NAN_VALUE") persisting in the data after reverse conversion, which can lead to inaccuracies and confusion.
By implementing this, we ensure that the data returned after reverse conversion is cleaner and more representative of the original, intended data structure.
How has this been tested?
The new method
replace_nan_value
has been tested locally with various DataFrame structures and datasets to ensure it correctly identifies and replaces "NAN_VALUE" placeholders across different scenarios.Additionally, unit tests have been designed to include cases for this new functionality, verifying its integration and impact on the overall reverse conversion process.
Types of changes
Checklist: