0.12.5a9

What's Changed

• AWS Credentials Refresh when Not Assuming Roles by @zprobst in #335

Full Changelog: 0.12.5.a8...0.12.5a9

0.12.7a8

What's Changed

• Interpreter Schema Generation v2 by @angelosantos4 in #333

Full Changelog:

• Pre-initialization check for schema correctness given VALIDATE_PIPELINE_SCHEMA environment variable is set. This schema introspection fix assumes that there is only one source node to be interpreted under any ingest. A check is made for the following:

  • Interpreter: Only one of the before iteration phase or interpretations phase can generate source nodes.
  • MultipleInterpretationPass: If one of the passes contains a source node, all of the other passes must contain a source node.
  • InterpretationPass: Only one of the interpretations can assign a source node.
  • SwitchInterpretations: If one of the branches contains a source node, all of the other passes including the default branch must contain a source node.

• For GraphQL schema generation, LocalDateTime objects are now DateTime objects.

• The before iteration interpretations are now accounted for within the schema introspection. (We acknowledge that either the before iteration and interpretation phases can act as source node creators.)

• Introspection is now broken down into context levels for each component that expands schema from children. For example:

  1. Each pipeline has their own isolated context level.
  2. For a Multiple Interpretation pass, each interpretation pass has their own context level that is distinct but inherits data from the interpreter (i.e if there is a before iteration phase with relationships).
  3. For a switch interpretation, each {key: interpretations}, has their own context, ONLY if it is a source node generator. otherwise, each pass is added to the overall interpreter context.

• The switch interpretation now represents the interpretations for each key as an interpretation pass.

• Source node creators are now added to the end of the schema generation process.

0.12.5a7

What's Changed

• Cardinality Overrides by @angelosantos4 in #330
• Fix S3 Extractor object_format by @grantleehoffman in #331
• Create pre-release by @grantleehoffman in #332

Full Changelog: 0.12.5a6...0.12.5a7

0.12.5a6

What's Changed

• DynamoDB Extractor by @angelosantos4 in #323
• fix message deletion by @grantleehoffman in #328
• Bump pre-release version by @grantleehoffman in #329

Full Changelog: 0.12.5a5...0.12.5a6

0.12.5a5

What's Changed

• add gzip and bz2 compressed file format support by @grantleehoffman in #320
• Update Version to 0.12.5a5 by @grantleehoffman in #325

Full Changelog: 0.12.5a4...0.12.5a5

0.12.5a4

What's Changed

• ValueProvider errors to have helpful error messages by @yasonk in #321
• Rev to 0.12.5a4 by @zprobst in #324

Full Changelog: 0.12.5a3...0.12.5a4

0.12.5a3

What's Changed

• Automatically Release with OIDC and Attestations by @zprobst in #315
• Introduce Better LLM Compatible Format by @zprobst in #317
• Add sqs queue extractor by @grantleehoffman in #318
• pre-release by @grantleehoffman in #319

Full Changelog: 0.12.5a2...0.12.5a3

0.12.5a2

What's Changed

• Release 0.12.4 by @zprobst in #313
• Bump to Node 20 Based Actions by @zprobst in #314
• Adding the scope to all log messages. by @angelosantos4 in #316

Full Changelog: 0.12.4...0.12.5a2

0.12.5a1

What's Changed

• Bump to Node 20 Based Actions by @zprobst in #314
• Adding the scope to all log messages. by @angelosantos4 in #316

Full Changelog: 0.12.4...0.12.5a1

0.12.4

What's Changed

• Search for matches anywhere in the string by @yasonk in #305
• Fix Migrator Resiliency Issues by @zprobst in #312

Full Changelog: 0.12.3...0.12.4