Skip to content

Commit

Permalink
Fidesops merge to unified fides 2 (#1214)
Browse files Browse the repository at this point in the history
* Bump pre-commit from 2.9.3 to 2.20.0 (#853) (#1373)

Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 2.9.3 to 2.20.0.
- [Release notes](https://github.com/pre-commit/pre-commit/releases)
- [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md)
- [Commits](pre-commit/pre-commit@v2.9.3...v2.20.0)

---
updated-dependencies:
- dependency-name: pre-commit
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* 1016 frontend ability for users to manually enter pii to an in progress subject request (#1377)

*  On successful connector creation the empty yaml text input displays a validation error

* Updated caniuse-lite NPM dependency

* Added min/max character limitation validation for Manual Webhook DSR Customization

* Prevented Chakra Divider component opacity from being overridden at runtime. User could not see visible horizontal line on UI before.

* Updated the Manual Processing detail form to not be submitted until the form is dirty.

* Removed form dirty check on ManualProcessingDetail component

* Update URL when user is navigating to DSR Customization screen when creating a Manual Webhook

* Enable retries on saas connectors for failures at the http request level (#1376)

* Add decorator to send method that retries throttles

* Fix black/mypy

* Fix pylint

* Add tests for authenticated client

* Small fixes and typos

* Update CHANGELOG.md

* Small changes. Update retry logic to not retry general exceptions

Co-authored-by: Eduardo Armendariz <[email protected]>

* Add Consent Request API (#1387)

Co-authored-by: Paul Sanders <[email protected]>

* Add new template for consent requets emails (#1405)

* Add new template for consent requets emails

* Remove analytics id

* Update subject

Co-authored-by: Paul Sanders <[email protected]>

* Add authenticated route to get consent preferences (#1402)


Co-authored-by: Paul Sanders <[email protected]>

* Backend: Updating or Deleting Access Webhooks [#1388][#1389] (#1394)

* If a manual webhook is deleted or disabled, check if there are any remaining active manual webhooks configured. If not, queue any Privacy Requests stuck in "requires_input" for processing.

* In the "view_uploaded_manual_webhook_data", load cached webhook data for a privacy request in strict mode. If it fails (no data saved, extra field saved, field missing), return checked=True, so the user knows they need to reupload data for this webhook before it can be submitted.

Return the data in non-strict mode, so we just show the overlap between the data saved and the fields defined.

* Update changelog.

* Move queue_requires_input_requests to the connection_endpoints where this is the only module it's being called - both where you update and delete a connection config.

* Clarify docstring.

* Braze Connector: Access Endpoints (#1248)

* [#1393] Update Fidesops config with sane defaults where necessary (#1395)

* add sane defaults

* make subsections of config with complete defaults optional

* lowercase database.enabled, set defaults for optional configs

* update return type

* updates changelog

* make PORT an env var

* cast env var to int

* remove unnecessary unpinned dependency

* bump fideslib version

* bump fideslib to 3.1.4

* add defaults for the non optional config subclasses

* set empty dict to default for config subclasses that require some fields

* use .get() in assemble URL for correct error message, correct comment

* update jwt_key type annotation

* Explain Privacy Request Execution [#1397] (#1396)

Co-authored-by: Cole <[email protected]>

* Update docker command on privacy center step 4 (#1410)

removing the typo ` . at the end of the command so that the command works.

* 1319 consent UI api integration (#1407)

* Add consent UI back in

* Finish initial integration with consent api

* WIP consent page

* Get initial consent updating working

* Improve button look and feel

* Add untracked files

* Format VerificationForm.tsx

* Remove comments

* Rename Privacy modal variables

* Rename variable

* 1401 admin UI persist redux store to localstorage (#1409)

* 1401 - Admin UI: Persist Redux store to localStorage

* Resolved React memory leak when user attempts to logout via the Subject Requests landing page

* Resolved UI unit test failure

* Rollback previous change

* Removed blacklist property from Redux store config

* Refactored due to recommended code review feedback

* update footer links (#1406)

* update footer links

* changelog

* Update CHANGELOG.md

Co-authored-by: Paul Sanders <[email protected]>

Co-authored-by: Sean Preston <[email protected]>
Co-authored-by: Paul Sanders <[email protected]>

* firebase auth integration (#1399)

* Initial implementation of firebase auth connector

Introduces firebase_admin sdk as a fidesops dependency
Leverages request overrides to define custom functionality

* Update changelog

* Minimize unused client config in firebase auth config

* Add user.photo_url as a supported Firebase Auth field

Improve readability in access implementation

* Fix field name to be more consistent with python SDK properties

* Add clarifying comment to unused function docstring

* Add photo_url field to firebase auth dataset

* Properly test provider data in firebase auth integration.

Also include test coverage for delete function, even thought it's
not being invoked by default saas config.

* Only add fields to result if popluated

* Fix empty attribute logic within provider data block

* Ignore pylint error for too many variables

* fix up provider data check

Co-authored-by: Adam Sachs <[email protected]>

* Add Braze connector registry entry (#1418)

* Braze SVG added

* Fixing change log message

Co-authored-by: Adrian Galvan <[email protected]>
Co-authored-by: Adam Sachs <[email protected]>

* Removing PII fields from conversations collection (#1386)

* Fidesops v1.8.1 Release Checklist (#1420)

* updates changelog

* add UI testing steps to release checklist

* DX Improvements from `v1.8.1` release (#1421)

* stop swallowing integrity errors on dataset update

* dont attach logging middleware if analytics opt_out is true

* handle diff correctly

* disable consider-using-f-string as we need this for logging statements to work effectively in fideslog

* Updated CHANGELOG.md file from prior merge

* get the server up and running

* fix test collection

* fix isort and black

* update dataset annotations

* Merge latest fidesops UI into unified ui

* Fixing post UI merge issues

* Fix formatting and import issues

* get all unit tests passing

* Fix cypress failure 🤞

* Remove auth.slice.test.ts

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Eduardo Armendariz <[email protected]>
Co-authored-by: Eduardo Armendariz <[email protected]>
Co-authored-by: Paul Sanders <[email protected]>
Co-authored-by: Paul Sanders <[email protected]>
Co-authored-by: Dawn Pattison <[email protected]>
Co-authored-by: Noonari <[email protected]>
Co-authored-by: Sean Preston <[email protected]>
Co-authored-by: Cole <[email protected]>
Co-authored-by: shawnplusplus <[email protected]>
Co-authored-by: Andrew Jackson <[email protected]>
Co-authored-by: Cole Isaac <[email protected]>
Co-authored-by: Adam Sachs <[email protected]>
Co-authored-by: Adam Sachs <[email protected]>
Co-authored-by: Adrian Galvan <[email protected]>
Co-authored-by: Thomas <[email protected]>
  • Loading branch information
17 people authored Oct 4, 2022
1 parent cd62aec commit 2463c82
Show file tree
Hide file tree
Showing 302 changed files with 8,102 additions and 37,208 deletions.
87 changes: 87 additions & 0 deletions .fides/db_dataset.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,31 @@ dataset:
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
retention: 1 year post employment
collections:
- name: accessmanualwebhook
description: 'Fides Generated Description for Table: accessmanualwebhook'
data_categories: []
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
fields:
- name: connection_config_id
description: 'Fides Generated Description for Column: connection_config_id'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: created_at
description: 'Fides Generated Description for Column: created_at'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: fields
description: 'Fides Generated Description for Column: fields'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: id
description: 'Fides Generated Description for Column: id'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: updated_at
description: 'Fides Generated Description for Column: updated_at'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: alembic_version
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
fields:
Expand Down Expand Up @@ -82,6 +107,39 @@ dataset:
data_categories:
- system.operations
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: consent
description: 'Fides Generated Description for Table: consent'
data_categories: []
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
fields:
- name: created_at
description: 'Fides Generated Description for Column: created_at'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: data_use
description: 'Fides Generated Description for Column: data_use'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: data_use_description
description: 'Fides Generated Description for Column: data_use_description'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: id
description: 'Fides Generated Description for Column: id'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: opt_in
description: 'Fides Generated Description for Column: opt_in'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: provided_identity_id
description: 'Fides Generated Description for Column: provided_identity_id'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: updated_at
description: 'Fides Generated Description for Column: updated_at'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: ctl_data_categories
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
fields:
Expand Down Expand Up @@ -876,6 +934,27 @@ dataset:
- name: updated_at
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: consentrequest
description: 'Fides Generated Description for Table: consentrequest'
data_categories: []
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
fields:
- name: created_at
description: 'Fides Generated Description for Column: created_at'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: id
description: 'Fides Generated Description for Column: id'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: provided_identity_id
description: 'Fides Generated Description for Column: provided_identity_id'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: updated_at
description: 'Fides Generated Description for Column: updated_at'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: datasetconfig
data_categories: []
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
Expand Down Expand Up @@ -996,6 +1075,10 @@ dataset:
- name: created_at
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: execution_timeframe
description: 'Fides Generated Description for Column: execution_timeframe'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: drp_action
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
Expand Down Expand Up @@ -1089,6 +1172,10 @@ dataset:
- name: created_at
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: due_date
description: 'Fides Generated Description for Column: due_date'
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
- name: external_id
data_categories: [system.operations]
data_qualifier: aggregated.anonymized.unlinked_pseudonymized.pseudonymized.identified
Expand Down
Loading

0 comments on commit 2463c82

Please sign in to comment.