Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix database does not exists error when is_member(), schema_id() function gets called in parallel query mode. #289

Conversation

ahmed-shameem
Copy link
Contributor

@ahmed-shameem ahmed-shameem commented Jan 10, 2024

Description

This PR intends to solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialised as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist

So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialisation (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Signed-off-by: Shameem Ahmed [email protected]

Issues Resolved

BABEL-4538, BABEL-4481, BABEL-4421

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is under the terms of the PostgreSQL license, and grant any person obtaining a copy of the contribution permission to relicense all or a portion of my contribution to the PostgreSQL License solely to contribute all or a portion of my contribution to the PostgreSQL open source project.

For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…ema_id() function gets called in parallel query mode.

Signed-off-by: Shameem Ahmed <[email protected]>
Signed-off-by: Shameem Ahmed <[email protected]>
src/backend/access/transam/parallel.c Outdated Show resolved Hide resolved
src/backend/access/transam/parallel.c Outdated Show resolved Hide resolved
src/backend/access/transam/parallel.c Outdated Show resolved Hide resolved
Signed-off-by: Shameem Ahmed <[email protected]>
src/backend/access/transam/parallel.c Outdated Show resolved Hide resolved
src/backend/access/transam/parallel.c Outdated Show resolved Hide resolved
Signed-off-by: Shameem Ahmed <[email protected]>
Signed-off-by: Shameem Ahmed <[email protected]>
@shardgupta shardgupta merged commit 2e7abaf into babelfish-for-postgresql:BABEL_3_X_DEV__PG_15_X Jan 18, 2024
2 checks passed
@shardgupta shardgupta deleted the babel-4538 branch January 18, 2024 05:44
shardgupta pushed a commit to babelfish-for-postgresql/babelfish_extensions that referenced this pull request Jan 18, 2024
…tion gets called in parallel query mode. (#2242)

This commit solves the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialised as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialisation (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Engine PR: babelfish-for-postgresql/postgresql_modified_for_babelfish#289 
Issues Resolved
BABEL-4538, BABEL-4481, BABEL-4421

Signed-off-by: Shameem Ahmed <[email protected]>
ahmed-shameem added a commit to amazon-aurora/postgresql_modified_for_babelfish that referenced this pull request Jan 18, 2024
…tion gets called in parallel query mode. (babelfish-for-postgresql#289)

This commit solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialized as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialization (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Issues Resolved: 
BABEL-4538, BABEL-4481, BABEL-4421

Signed-off-by: Shameem Ahmed <[email protected]>
ahmed-shameem added a commit to amazon-aurora/babelfish_extensions that referenced this pull request Jan 18, 2024
…tion gets called in parallel query mode. (babelfish-for-postgresql#2242)

This commit solves the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialised as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialisation (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Engine PR: babelfish-for-postgresql/postgresql_modified_for_babelfish#289
Issues Resolved
BABEL-4538, BABEL-4481, BABEL-4421

Signed-off-by: Shameem Ahmed <[email protected]>
ahmed-shameem added a commit to amazon-aurora/postgresql_modified_for_babelfish that referenced this pull request Jan 18, 2024
…tion gets called in parallel query mode. (babelfish-for-postgresql#289)

This commit solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialized as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialization (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Issues Resolved:
BABEL-4538, BABEL-4481, BABEL-4421

Signed-off-by: Shameem Ahmed <[email protected]>
ahmed-shameem added a commit to amazon-aurora/babelfish_extensions that referenced this pull request Jan 18, 2024
…tion gets called in parallel query mode. (babelfish-for-postgresql#2242)

This commit solves the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialised as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialisation (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Engine PR: babelfish-for-postgresql/postgresql_modified_for_babelfish#289
Issues Resolved
BABEL-4538, BABEL-4481, BABEL-4421

Signed-off-by: Shameem Ahmed <[email protected]>
Deepesh125 pushed a commit that referenced this pull request Jan 19, 2024
…tion gets called in parallel query mode. (#289) (#297)

This commit solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialized as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialization (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Issues Resolved:
BABEL-4538, BABEL-4481, BABEL-4421
Signed-off-by: Shameem Ahmed <[email protected]>
Deepesh125 pushed a commit to babelfish-for-postgresql/babelfish_extensions that referenced this pull request Jan 19, 2024
…tion gets called in parallel query mode. (#2262)

This commit solves the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialised as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialisation (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Engine PR: babelfish-for-postgresql/postgresql_modified_for_babelfish#289

Task: BABEL-4538, BABEL-4481, BABEL-4421
Signed-off-by: Shameem Ahmed <[email protected]>
Deepesh125 pushed a commit to babelfish-for-postgresql/babelfish_extensions that referenced this pull request Jan 19, 2024
…tion gets called in parallel query mode. (#2261)

This commit solves the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialised as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialisation (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Engine PR: babelfish-for-postgresql/postgresql_modified_for_babelfish#289
Task: BABEL-4538, BABEL-4481, BABEL-4421
Signed-off-by: Shameem Ahmed <[email protected]>
Deepesh125 pushed a commit to amazon-aurora/postgresql_modified_for_babelfish that referenced this pull request Jan 22, 2024
…tion gets called in parallel query mode. (babelfish-for-postgresql#289) (babelfish-for-postgresql#297)

This commit solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialized as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialization (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Issues Resolved:
BABEL-4538, BABEL-4481, BABEL-4421
Signed-off-by: Shameem Ahmed <[email protected]>
roshan0708 pushed a commit to amazon-aurora/postgresql_modified_for_babelfish that referenced this pull request Oct 15, 2024
…() function gets called in parallel query mode. (babelfish-for-postgresql#289) (babelfish-for-postgresql#297)

This commit solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialized as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialization (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Issues Resolved:
BABEL-4538, BABEL-4481, BABEL-4421
Signed-off-by: Shameem Ahmed <[email protected]>
roshan0708 pushed a commit to amazon-aurora/postgresql_modified_for_babelfish that referenced this pull request Oct 18, 2024
…() function gets called in parallel query mode. (babelfish-for-postgresql#289) (babelfish-for-postgresql#297)

This commit solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialized as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialization (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Issues Resolved:
BABEL-4538, BABEL-4481, BABEL-4421
Signed-off-by: Shameem Ahmed <[email protected]>
roshan0708 pushed a commit to amazon-aurora/postgresql_modified_for_babelfish that referenced this pull request Oct 18, 2024
…() function gets called in parallel query mode. (babelfish-for-postgresql#289) (babelfish-for-postgresql#297)

This commit solve the issue of parallel worker not being able to obtain correct logical database name. Whenever get_cur_db_name() is called, it returns static char current_db_name[] which is initialized as empty. Now, parallel workers are not aware of the database name. For them, it is empty whenever get_cur_db_name() gets called. Hence, we were getting the following error:

database "" does not exist
So, to communicate the logical database name and more data related to babelfish we have introduced a struct BabelfishFixedParallelState. Currently BabelfishFixedParallelState has only 1 field, i.e., logical_db_name, we can add more fields to it whenever necessary. Then we will write the logical_db_name in DSM during initialization (in InitializeParallelDSM) using a hook. Another hook is used while trying to fetch the logical database name in ParallelWorkerMain().

In this way we are introduction a mechanism through which we can communicate any babelfish related information to parallel workers.

Issues Resolved:
BABEL-4538, BABEL-4481, BABEL-4421
Signed-off-by: Shameem Ahmed <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants