Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix issue parsing structs #204

Merged
merged 4 commits into from
Aug 23, 2021

Conversation

SCouto
Copy link
Contributor

@SCouto SCouto commented Aug 16, 2021

resolves #202

Description

The issue was when parsing the schema, the current regex deal with inner struct fields as root fields, hence causing an error later because the column was not found (check issue #202 for a more detailed description)

Current one:
image

Proposed one:

image

Checklist

  • I have signed the CLA
  • I have run this code in development and it appears to resolve the stated issue
  • This PR includes tests (Modifyed)
  • I have updated the CHANGELOG.md and added information about my change to the "dbt next" section. (Not sure if I did this right, let me know if it's something else to improve)

@cla-bot cla-bot bot added the cla:yes label Aug 16, 2021
Copy link
Contributor

@jtcohen6 jtcohen6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this @SCouto!

@jtcohen6 jtcohen6 merged commit 3980e5c into dbt-labs:master Aug 23, 2021
jtcohen6 added a commit that referenced this pull request Aug 23, 2021
* fix issue parsing structs

* include contributor in changelog

* better error explanation

Co-authored-by: Jeremy Cohen <[email protected]>
jtcohen6 added a commit that referenced this pull request Aug 23, 2021
* fixed get_columns_in_relation for open source delta table (#207)

* fixed get_columns_in_relation for open source delta table

* fixed E501 linting error and added change log

* fix issue parsing structs (#204)

* fix issue parsing structs

* include contributor in changelog

* better error explanation

Co-authored-by: Jeremy Cohen <[email protected]>

Co-authored-by: Hariharan Banukumar <[email protected]>
Co-authored-by: Sergio <[email protected]>
leahwicz added a commit that referenced this pull request Sep 17, 2021
* Show more detailed feedback when pyodbc import fails (#192)

* Use exception chaining to get more detailed feedback when pyodbc is not installed

* Remove pyodbc referenced before assignment

* Set back try except

* Add flake ignore

* Add error message to RunTimeException

Error chaining does not show the message in `dbt debug`. Therefore we
explicitly add the message to the dbt.exceptions.RunTimeException

* Update change log

Add to change log that we print the import error when pyodbc can not be imported

* Fix parenthesis in change log

* Update changelog [skip ci]

* Update changelog [skip ci]

* Update changelog [skip ci]

* Add support for ODBC Server Side Parameters (#201)

* Add support for ODBC Server Side Parameters

* Update CHANGELOG

* Feature/able to retry all connections (#194)

* Code changes

* README changes

* Improve error message default

* Changelog

* Changelog corrections

* Restore accidental deletion

* Update dbt/adapters/spark/connections.py

Co-authored-by: Jeremy Cohen <[email protected]>

* Add myself to Contributors

Co-authored-by: Jeremy Cohen <[email protected]>

* fixed get_columns_in_relation for open source delta table (#207)

* fixed get_columns_in_relation for open source delta table

* fixed E501 linting error and added change log

* fix issue parsing structs (#204)

* fix issue parsing structs

* include contributor in changelog

* better error explanation

Co-authored-by: Jeremy Cohen <[email protected]>

* Add adapter unique_field (#211)

* Add adapter unique_field

* Fix flake8. Add changelog entry

* [Snyk] Fix for 2 vulnerabilities (#214)

* fix: requirements.txt to reduce vulnerabilities


The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-SQLPARSE-1584201
- https://snyk.io/vuln/SNYK-PYTHON-THRIFT-474615

* Removing Thrift conflict with versions over 12

Co-authored-by: leahwicz <[email protected]>

* 0.21.0b1 Release

* Bumping version to 0.21.0b1

* Bumping to 0.21.0b2

* Bumping version to 0.21.0b2

Co-authored-by: Cor <[email protected]>
Co-authored-by: Jeremy Cohen <[email protected]>
Co-authored-by: Jethro Nederhof <[email protected]>
Co-authored-by: gregingenii <[email protected]>
Co-authored-by: Jeremy Cohen <[email protected]>
Co-authored-by: Hariharan Banukumar <[email protected]>
Co-authored-by: Sergio <[email protected]>
Co-authored-by: Snyk bot <[email protected]>
Co-authored-by: Ian Knox <[email protected]>
Co-authored-by: Leah Antkiewicz <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Error in incremental models when using struct columns
2 participants