Skip to content

Release 0.6.1: MetaFields and CSV import-export solution

Compare
Choose a tag to compare
@datancoffee datancoffee released this 13 Dec 05:40
· 20 commits to master since this release

Release 0.6.1

BigQuery:

  • added the MetaFields field to webresource table for source-specific metadata fields accessible via SAFE_OFFSET(0-base index).

Java code:

  • Added propagation of MetaFields field from sources all the way to the BigQuery dataset
  • added the solutions package and as the first solution added the FileIndexerPipeline that takes a CSV file, indexes it, and writes a CSV file
  • added dependency on Commons CSV package that helps with CSV processing