MINOR - Pin pandas version to 2.0.x for Databricks client

[TeddyCr]

Describe your changes:

Why not use databricks-sql-python 3.0
databricks-sql-python==3.0 has a dependency on sqlalchemy 2.x.x . We'll be able to migrate to this library version when upgrading to sqlalchemy 2.x.x.

In the meantime we'll keep using 2.9.x and pin pandas to 2.1.x as recommended in this issue

Type of change:

• Bug fix
• Improvement
• New feature
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Documentation

Checklist:

• I have read the CONTRIBUTING document.
• My PR title is Fixes <issue-number>: <short explanation>
• I have commented on my code, particularly in hard-to-understand areas.
• For JSON Schema changes: I updated the migration scripts or explained why it is not needed.

Bug fix

• I have added a test that covers the exact scenario we are fixing. For complex issues, comment the issue number in the test for future reference.

[sonarqubecloud]

Quality Gate passed for 'open-metadata-ingestion'

Issues
0 New issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarCloud