feat: Postgres supported as Registry, Online store, and Offline store

[nossrannug]

Signed-off-by: Gunnar Sv Sigurbjörnsson [email protected]

What this PR does / why we need it:
Adds support for postgres as Registry, and Online and Offline stores.

[felixwang9817]

@nossrannug looking good overall! left some comments for you (no rush at all)

would also suggest that you add in a template so that users can easily initialize a postgres-based feature repo with feast init -t postgres, see https://github.com/feast-dev/feast/pull/2349/files for an example of Spark PR adding in a template

would also recommend adding some docs so folks know how to use postgres properly! once again see Spark PR for how to add docs

[achals]

Hi @nossrannug, are you still planning on working on this PR? Is there anything we can do to help?

[nossrannug]

Hi @nossrannug, are you still planning on working on this PR? Is there anything we can do to help?

Yes, I would like to see this PR completed. Real life stuff and lack of motivation have been my biggest blockers. I'll take a stab at it today and see how it goes.

[achals]

Hi @nossrannug, are you still planning on working on this PR? Is there anything we can do to help?

Yes, I would like to see this PR completed. Real life stuff and lack of motivation have been my biggest blockers. I'll take a stab at it today and see how it goes.

Totally understand - let us know if there's anything we can do to help!

[nossrannug]

Thanks, @achals, I greatly appreciate it.

I took a quick look at it over easter. I'm able to run:

feast init -t postgres random_folder
cd random_folder
feast apply
feast materialize-incremental $(date -u +"%Y-%m-%dT%H:%M:%S")
python test.py

I can also run make test-python-universal-postgres. Although I'm intentionally skipping some tests like persisting a tmp table for the results because I haven't implemented that functionality.

I think the main thing left now is to update the version lock files. I'll see if I can get that done later today and then I don't know if there is much left. I'll give you and @felixwang9817 a ping when I think I've covered everything to ask for your review.

[kevjumba]

@nossrannug let me see if I can get the unit test builds to work really quickly.

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

Attention: Patch coverage is 38.74346% with 234 lines in your changes missing coverage. Please review.

Project coverage is 82.24%. Comparing base (f372981) to head (72e9e3e).
Report is 1146 commits behind head on master.

Files with missing lines	Patch %	Lines
..._stores/contrib/postgres_offline_store/postgres.py	33.33%	96 Missing ⚠️
...thon/feast/infra/online_stores/contrib/postgres.py	30.00%	70 Missing ⚠️
.../contrib/postgres_offline_store/postgres_source.py	48.07%	27 Missing ⚠️
sdk/python/feast/type_map.py	25.00%	15 Missing ⚠️
...hon/feast/infra/utils/postgres/connection_utils.py	48.00%	13 Missing ⚠️
...n/feature_repos/universal/data_sources/postgres.py	53.57%	13 Missing ⚠️

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2401      +/-   ##
==========================================
- Coverage   83.68%   82.24%   -1.45%     
==========================================
  Files         147      154       +7     
  Lines       12353    12735     +382     
==========================================
+ Hits        10338    10474     +136     
- Misses       2015     2261     +246     

Flag	Coverage Δ
integrationtests	72.53% <25.00%> (-0.55%)	⬇️
unittests	59.83% <38.74%> (-0.66%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[kevjumba]

@nossrannug let me see if I can get the unit test builds to work really quickly.

Unit tests should be working now.

[achals]

/lgtm

[feast-ci-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: achals, nossrannug

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [achals]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment