Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug report] Iceberg will use upper table to access gravitino server sometimes #3772

Closed
jerqi opened this issue Jun 4, 2024 · 1 comment · Fixed by #3774
Closed

[Bug report] Iceberg will use upper table to access gravitino server sometimes #3772

jerqi opened this issue Jun 4, 2024 · 1 comment · Fixed by #3774
Assignees
@FANNG1
Labels
bug Something isn't working

Comments

@jerqi
Copy link
Contributor

jerqi commented Jun 4, 2024

Version

main branch

Describe what's wrong

Iceberg will use upper table to access gravitino server sometimes. The entity data will be ineffective.

Error message and/or stacktrace

4-06-04 20:56:10 INFO [Test worker] BaseMetastoreCatalog:67 - Table loaded by catalog: iceberg.default_db.test_column_type
2024-06-04 20:56:10 INFO [Gravitino-webserver-525] TableOperations:142 - Received load table request for table: test.iceberg.default_db.TEST_COLUMN_TYPE
2024-06-04 20:56:10 INFO [Gravitino-webserver-525] BaseMetastoreTableOperations:199 - Refreshing table metadata from new version: hdfs://10.20.30.2:9000/user/hive/default_db/test_column_type/metadata/00000-c08f1baa-dc07-42da-9dd2-3be8acc8bf12.metadata.json
2024-06-04 20:56:10 INFO [Gravitino-webserver-525] BaseMetastoreCatalog:67 - Table loaded by catalog: hive.default_db.TEST_COLUMN_TYPE
2024-06-04 20:56:10 INFO [Gravitino-webserver-525] IcebergCatalogOperations:345 - Loaded Iceberg table TEST_COLUMN_TYPE
2024-06-04 20:56:10 ERROR [Gravitino-webserver-525] OperationDispatcher:231 - Entity for test.iceberg.default_db.TEST_COLUMN_TYPE doesn't exist in Gravitino, this is unexpected if this is created by Gravitino. With this situation the returned object will not contain the metadata from Gravitino
2024-06-04 20:56:10 INFO [Gravitino-webserver-525] BaseMetastoreTableOperations:199 - Refreshing table metadata from new version: hdfs://10.20.30.2:9000/user/hive/default_db/test_column_type/metadata/00000-c08f1baa-dc07-42da-9dd2-3be8acc8bf12.metadata.json
2024-06-04 20:56:10 INFO [Gravitino-webserver-525] BaseMetastoreCatalog:67 - Table loaded by catalog: hive.default_db.TEST_COLUMN_TYPE
2024-06-04 20:56:10 INFO [Gravitino-webserver-525] IcebergCatalogOperations:345 - Loaded Iceberg table TEST_COLUMN_TYPE
2024-06-04 20:56:10 ERROR [Gravitino-webserver-525] OperationDispatcher:231 - Entity for test.iceberg.default_db.TEST_COLUMN_TYPE doesn't exist in Gravitino, this is unexpected if this is created by Gravitino. With this situation

How to reproduce

Run the SparkIcebergCatalogRestBackendIT34

Additional context

No response
@jerqi jerqi added the bug Something isn't working label Jun 4, 2024
@jerqi
Copy link
Contributor Author

jerqi commented Jun 4, 2024

@FANNG1 Could you take a look?

@FANNG1 FANNG1 mentioned this issue Jun 4, 2024
Merged
@qqqttt123 qqqttt123 added the 0.6.0 label Jun 5, 2024
qqqttt123 pushed a commit that referenced this issue Jun 5, 2024
@FANNG1
[#3772] fix(spark-connector): Iceberg will use upper table to access …
26b5cb6 
…gravitino server sometimes #3772 (#3774)

### What changes were proposed in this pull request?
table name is upper for using `%S`

### Why are the changes needed?

Fix: #3772 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
existing tests
diqiu50 pushed a commit to diqiu50/gravitino that referenced this issue Jun 13, 2024
@FANNG1 @diqiu50
[apache#3772] fix(spark-connector): Iceberg will use upper table to a…
c302cd1 
…ccess gravitino server sometimes apache#3772 (apache#3774)

### What changes were proposed in this pull request?
table name is upper for using `%S`

### Why are the changes needed?

Fix: apache#3772 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
existing tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@FANNG1 FANNG1

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
3 participants
@FANNG1 @jerqi @qqqttt123