Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] support iceberg metadataColumns #2587

Closed
caican00 opened this issue Mar 19, 2024 · 0 comments · Fixed by #2717 or #3180
Closed

[Subtask] support iceberg metadataColumns #2587

caican00 opened this issue Mar 19, 2024 · 0 comments · Fixed by #2717 or #3180
Assignees
@caican00
Labels
0.5.1 Release v0.5.1 0.6.0 Release v0.6.0 subtask Subtasks of umbrella issue

Comments

@caican00
Copy link
Collaborator

Describe the subtask

support iceberg metadata columns, such as _spec_id, _partition, _file, etc.

Parent issue

#1571
@caican00 caican00 added the subtask Subtasks of umbrella issue label Mar 19, 2024
caican00 added a commit to caican00/gravitino that referenced this issue Mar 28, 2024
@caican00
[apache#2587] feat(spark-connector): support iceberg metadataColumnsspo
b7b2b06
caican00 added a commit to caican00/gravitino that referenced this issue Mar 28, 2024
@caican00
[apache#2587] feat(spark-connector): Support iceberg metadataColumns
682b942
caican00 added a commit to caican00/gravitino that referenced this issue Mar 28, 2024
@caican00
[apache#2587] feat(spark-connector): Support iceberg metadataColumns
a9dcdbc
caican00 added a commit to caican00/gravitino that referenced this issue Mar 28, 2024
@caican00
[apache#2587] feat(spark-connector): Support iceberg metadataColumns
cfdeb56
caican00 added a commit to caican00/gravitino that referenced this issue Mar 28, 2024
@caican00
[apache#2587] feat(spark-connector): Support iceberg metadataColumns
0aba061
caican00 added a commit to caican00/gravitino that referenced this issue Mar 28, 2024
@caican00
[apache#2587] feat(spark-connector): Support iceberg metadataColumns
d0bd521
@caican00 caican00 mentioned this issue Mar 28, 2024
Merged
@FANNG1 FANNG1 added the 0.6.0 Release v0.6.0 label Apr 24, 2024
FANNG1 pushed a commit that referenced this issue Apr 24, 2024
@caican00
[#2587] feat(spark-connector): Support iceberg metadataColumns (#2717)
b11c739 
### What changes were proposed in this pull request?
Support retrieve iceberg metadataColumns, such as `_spec_id`,
`_partition`, `_file`, `_pos`, `_deleted`.

### Why are the changes needed?

Support retrieve iceberg metadataColumns, row-level operations depend on
this.

Fix: #2587

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

New integration test.
caican00 added a commit to caican00/gravitino that referenced this issue Apr 24, 2024
@caican00
[apache#2587] feat(spark-connector): Support iceberg metadataColumns (a…
58b017e 
…pache#2717)

Support retrieve iceberg metadataColumns, such as `_spec_id`,
`_partition`, `_file`, `_pos`, `_deleted`.

Support retrieve iceberg metadataColumns, row-level operations depend on
this.

Fix: apache#2587

No.

New integration test.
@caican00 caican00 mentioned this issue Apr 24, 2024
Merged
caican00 added a commit to caican00/gravitino that referenced this issue Apr 24, 2024
@caican00
[apache#2587] feat(spark-connector): Support iceberg metadataColumns (a…
b0ef1af 
…pache#2717)

### What changes were proposed in this pull request?
Support retrieve iceberg metadataColumns, such as `_spec_id`,
`_partition`, `_file`, `_pos`, `_deleted`.

### Why are the changes needed?

Support retrieve iceberg metadataColumns, row-level operations depend on
this.

Fix: apache#2587

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

New integration test.
@jerryshao jerryshao added the 0.5.1 Release v0.5.1 label Apr 24, 2024
jerryshao pushed a commit that referenced this issue Apr 24, 2024
@caican00
[#2587] feat(spark-connector): Support iceberg metadataColumns (#3180)
e2778d7 
### What changes were proposed in this pull request?
Support retrieve iceberg metadataColumns, such as `_spec_id`,
`_partition`, `_file`, `_pos`, `_deleted`.

### Why are the changes needed?

Support retrieve iceberg metadataColumns, row-level operations depend on
this.

Fix: #2587

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

New integration test.
diqiu50 pushed a commit to diqiu50/gravitino that referenced this issue Jun 13, 2024
@caican00 @diqiu50
[apache#2587] feat(spark-connector): Support iceberg metadataColumns (a…
5ea0ca1 
…pache#2717)

### What changes were proposed in this pull request?
Support retrieve iceberg metadataColumns, such as `_spec_id`,
`_partition`, `_file`, `_pos`, `_deleted`.

### Why are the changes needed?

Support retrieve iceberg metadataColumns, row-level operations depend on
this.

Fix: apache#2587

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

New integration test.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@caican00 caican00

Labels
0.5.1 Release v0.5.1 0.6.0 Release v0.6.0 subtask Subtasks of umbrella issue
Projects
None yet
Milestone
No milestone
3 participants
@jerryshao @FANNG1 @caican00