Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update pseudo funcs and remove unnecessary abstractions #32

Merged
merged 2 commits into from
Feb 6, 2024

Conversation

bjornandre
Copy link
Contributor

@bjornandre bjornandre commented Feb 6, 2024

  • Use the new version of dapla-dlp-pseudo-func which can populate both mapped values and metadata in PseudoFuncOutput.
  • Remove RecordMapPseudonymizer since pseudonymization can be done using PseudoFuncs directly.
  • Deprecate FieldPseudonymizer, since it also can be replaced by using PseudoFuncs
  • Simplified StreamProcessor. The init method should not return any data, so it doesn't need a serializer.
  • Removed CsvStreamPseudonymizer since it has been deprecated for a long time and is no longer used.
  • Add a typed MetadataProcessor to RecordMapProcessor that can be used to collect metadata while processing the data.

See also statisticsnorway/dapla-dlp-pseudo-func#17

…g PseudoFuncs directly. Simplified StreamProcessor.
@bjornandre bjornandre requested a review from a team February 6, 2024 07:34
@bjornandre bjornandre changed the title Remove unnecessary abstractions Update pseudo funcs and remove unnecessary abstractions Feb 6, 2024
@bjornandre bjornandre merged commit d1097b5 into master Feb 6, 2024
2 checks passed
@bjornandre bjornandre deleted the simplify-pseudo-func branch February 6, 2024 14:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants