-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ARROW-60: [C++] Struct type builder API #66
Conversation
73eb5c2
to
b80cea2
Compare
Hi it looks like this change failed CI. Could you please make sure it passes? If you need help diagnosing the failure please post a comment. |
@@ -71,6 +72,20 @@ Status MakeBuilder(MemoryPool* pool, const std::shared_ptr<DataType>& type, | |||
} | |||
} | |||
|
|||
Status MakeStructBuilder(MemoryPool* pool, const std::shared_ptr<DataType>& type, | |||
const std::vector<std::shared_ptr<Field>>& fields, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
use FieldPtr you typedefed.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why are you defining this in terms of Fields instead of DataTypes? This is incongruent with other builder APIs I believe.
@fengguangyuan can you rebase (due to ARROW-209) and let me know when the build is passing? Thank you |
Implement the basic classes, StructArray and StructBuilder, meanwhile, add the perspective test cases for them. Other necessary methods will be added subsequetly.
Refine the previous committed patch. Add validate methods for testing StructArray and StructBuilder. TODO, Equals methods also need to be tested, but now it's not convient to do it.
Modify Validate() refered to the specification.
Add RangeEquals method to implement Equals method.
Add field index and TODO comment.
@wesm |
+1 thank you |
Exporting supported data types and functions from Gandiva. Added a JNI bridge to access this from the java layer.
Exporting supported data types and functions from Gandiva. Added a JNI bridge to access this from the java layer.
Exporting supported data types and functions from Gandiva. Added a JNI bridge to access this from the java layer.
Exporting supported data types and functions from Gandiva. Added a JNI bridge to access this from the java layer.
…ocalFileSource I also added the `file_descriptor` API so that we can verify that dtors elsewhere successfully close open files. Closes apache#56 Author: Wes McKinney <[email protected]> Closes apache#66 from wesm/PARQUET-520 and squashes the following commits: 9d638ba [Wes McKinney] Add memory-mapping option to ParquetFileReader::OpenFile. Add --no-memory-map flag to parquet_reader 6389683 [Wes McKinney] Add Read API tests dbf6a45 [Wes McKinney] Test some failure modes for LocalFileSource / MemoryMapSource 01a7d64 [Wes McKinney] Add a MemoryMapSource and use this by default for SerializedFileReader
Exporting supported data types and functions from Gandiva. Added a JNI bridge to access this from the java layer.
…ocalFileSource I also added the `file_descriptor` API so that we can verify that dtors elsewhere successfully close open files. Closes apache#56 Author: Wes McKinney <[email protected]> Closes apache#66 from wesm/PARQUET-520 and squashes the following commits: 9d638ba [Wes McKinney] Add memory-mapping option to ParquetFileReader::OpenFile. Add --no-memory-map flag to parquet_reader 6389683 [Wes McKinney] Add Read API tests dbf6a45 [Wes McKinney] Test some failure modes for LocalFileSource / MemoryMapSource 01a7d64 [Wes McKinney] Add a MemoryMapSource and use this by default for SerializedFileReader Change-Id: I467fcda7439d36c244d74bf5fec0ae61f6b674f0
…ocalFileSource I also added the `file_descriptor` API so that we can verify that dtors elsewhere successfully close open files. Closes apache#56 Author: Wes McKinney <[email protected]> Closes apache#66 from wesm/PARQUET-520 and squashes the following commits: 9d638ba [Wes McKinney] Add memory-mapping option to ParquetFileReader::OpenFile. Add --no-memory-map flag to parquet_reader 6389683 [Wes McKinney] Add Read API tests dbf6a45 [Wes McKinney] Test some failure modes for LocalFileSource / MemoryMapSource 01a7d64 [Wes McKinney] Add a MemoryMapSource and use this by default for SerializedFileReader Change-Id: I467fcda7439d36c244d74bf5fec0ae61f6b674f0
…ocalFileSource I also added the `file_descriptor` API so that we can verify that dtors elsewhere successfully close open files. Closes apache#56 Author: Wes McKinney <[email protected]> Closes apache#66 from wesm/PARQUET-520 and squashes the following commits: 9d638ba [Wes McKinney] Add memory-mapping option to ParquetFileReader::OpenFile. Add --no-memory-map flag to parquet_reader 6389683 [Wes McKinney] Add Read API tests dbf6a45 [Wes McKinney] Test some failure modes for LocalFileSource / MemoryMapSource 01a7d64 [Wes McKinney] Add a MemoryMapSource and use this by default for SerializedFileReader Change-Id: I467fcda7439d36c244d74bf5fec0ae61f6b674f0
…ocalFileSource I also added the `file_descriptor` API so that we can verify that dtors elsewhere successfully close open files. Closes apache#56 Author: Wes McKinney <[email protected]> Closes apache#66 from wesm/PARQUET-520 and squashes the following commits: 9d638ba [Wes McKinney] Add memory-mapping option to ParquetFileReader::OpenFile. Add --no-memory-map flag to parquet_reader 6389683 [Wes McKinney] Add Read API tests dbf6a45 [Wes McKinney] Test some failure modes for LocalFileSource / MemoryMapSource 01a7d64 [Wes McKinney] Add a MemoryMapSource and use this by default for SerializedFileReader Change-Id: I467fcda7439d36c244d74bf5fec0ae61f6b674f0
Exporting supported data types and functions from Gandiva. Added a JNI bridge to access this from the java layer.
Exporting supported data types and functions from Gandiva. Added a JNI bridge to access this from the java layer.
* Support casting boolean to bigint (apache#60) * remove log4j as it's not used (apache#61) Signed-off-by: Yuan Zhou <[email protected]> * Add stripe iteration support for batch_size reading in the ORC Scanner (apache#63) * Install re2 headers (apache#66) Co-authored-by: PHILO-HE <[email protected]> Co-authored-by: zhixingheyi-tian <[email protected]>
Implement the basic classes,
StructArray
andStructBuilder,
meanwhile,add the perspective test cases for them.
Other necessary methods will be added subsequently.