Skip to content

Releases: neptune-ai/kedro-neptune

0.6.0

05 Aug 10:50
07815bc
Compare
Choose a tag to compare

What's Changed

Features

  • Get Neptune configuration from selected kedro environment by @turn1a in #86

Full Changelog: 0.5.0...0.6.0

0.5.0

06 Jun 14:55
9aa82b1
Compare
Choose a tag to compare

Features

Better support for distributed, async workflows

By @turn1a in #81

The kedro-neptune plugin now respects the NEPTUNE_CUSTOM_RUN_ID environmental variable.

Previously, the plugin could not be used in a distributed asynchronous workflow (such as Kubeflow, AWS Batch, etc.), where multiple containers run independently as each container would create a new run in Neptune to log into during the after_catalog_created() execution in NeptuneHooks.

With this change, you can set NEPTUNE_CUSTOM_RUN_ID to the same value for each container before the kedro run execution and Neptune will only create one run for each Custom Run ID, letting multiple nodes executed asynchronously to log into the same Neptune run.

More about the Custom Run ID in the docs.

Enhanced pipeline execution status tracking

By @SiddhantSadangi in #82

We have added new fields to better track pipeline execution status in realtime:

  • The log field shows which nodes have run and are currently running
    image

  • The execution_order field exports a description of the pipeline (pipeline.describe()), showing the order of execution of the nodes, and expected free input and output variables
    image

  • Finally, each node now has a status field that shows if the node is "running" or "done".

Fixes

  • Fixed the case when node input parameters were not logged to Neptune if passed as a list (by @SiddhantSadangi in #82)

New Contributors

Full Changelog: 0.4.0...0.5.0

0.4.0

16 Feb 13:24
6ed4b10
Compare
Choose a tag to compare

What's Changed

Features

Fixes

  • Replaced *DataSet and data_set with *Dataset and dataset respectively by @SiddhantSadangi in #79

Full Changelog: 0.3.0...0.4.0

0.3.0

10 Nov 12:44
978564b
Compare
Choose a tag to compare

What's Changed

Features

Fixes

  • Replaced AbstractDataSet, TextDataSet and CSVDataSet with AbstractDataset, TextDataset and CSVDataSet respectively by @SiddhantSadangi (#73)
  • Replaced kedro.extras.datasets with kedro_datasets by @SiddhantSadangi (#73)

Changes

Full Changelog: 0.2.0...0.3.0

0.2.0

12 Jun 11:58
423ef49
Compare
Choose a tag to compare

Fixes

  • If neptune 'enabled' flag in the config is set to false, no neptune-related actions are taken (#68)

0.1.6

31 Mar 14:46
f6282dc
Compare
Choose a tag to compare
  • Update docstrings (#63)

0.1.5

10 Mar 07:54
273f6db
Compare
Choose a tag to compare

Fixes

  • Fixed some of latest neptune-client warning messages (#58)
  • Fixed failing run on latest MacOS 12 (#58)

Changes

  • Removed neptune and neptune-client from base requirements for backward compatibility (#62)
  • Simplified example project and removed unrelated files (#58)
  • Better life-time of the internally created Run in NeptuneRunDataSet (#58)
  • Updated the integration for compatibility with neptune-client 1.0.0. (#59)

0.1.4

07 Nov 14:30
02c6ab3
Compare
Choose a tag to compare

Changes

  • Moved kedro_neptune package to src directory (#50)
  • Poetry as a package builder (#56)

0.1.3

12 Sep 13:09
bfe4da4
Compare
Choose a tag to compare

Changes

  • Changed integrations utils to be imported from non-internal package

0.1.2

25 Aug 11:58
44e3d95
Compare
Choose a tag to compare

Fixes

  • Fixed custom run id generation on catalog creation
  • Fixed parsing of NEPTUNE_ENABLED flag