Skip to content

Commit

Permalink
Bump minor version to 1.2.0 (#841)
Browse files Browse the repository at this point in the history
  • Loading branch information
SebastianNiehusAA authored May 15, 2024
1 parent 0d25e19 commit 843f36a
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 7 deletions.
17 changes: 11 additions & 6 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,17 @@

## Unreleased

### Breaking Changes
...
### New Features
...
### Fixes
...
### Deprecations
...

## 1.2.0

We did a major revamp of the `ArgillaEvaluator` to separate an `AsyncEvaluator` from the normal evaluation scenario.
This comes with easier to understand interfaces, more information in the `EvaluationOverview` and a simplified aggregation step for Argilla that is no longer dependent on specific Argilla types.
Check the how-to for detailed information [here](./src/documentation/how_tos/how_to_human_evaluation_via_argilla.ipynb)
Expand All @@ -18,7 +29,6 @@ Check the how-to for detailed information [here](./src/documentation/how_tos/how
- rename: `start` is now called `start_date` and no longer optional
- we refactored the internals of `Evaluator`. This is only relevant if you subclass from it. Most of the typing and data handling is moved to `EvaluatorBase`


### New Features
- Add `ComparisonEvaluation` for the elo evaluation to abstract from the Argilla record
- Add `AsyncEvaluator` for human-feedback evaluation. `ArgillaEvaluator` inherits from this
Expand All @@ -28,15 +38,10 @@ Check the how-to for detailed information [here](./src/documentation/how_tos/how
- Add `AsyncEvaluationRepository` to store and retrieve `PartialEvaluationOverview`. Also added `AsyncFileEvaluationRepository` and `AsyncInMemoryEvaluationRepository`
- Add `EvaluatorBase` and `EvaluationLogicBase` for base classes for both async and synchronous evaluation.



### Fixes
- Improve description of using artifactory tokens for installation of IL
- Change `confusion_matrix` in `SingleLabelClassifyAggregationLogic` such that it can be persisted in a file repository

### Deprecations
...

## 1.1.0

### New Features
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ build-backend = "poetry.core.masonry.api"

[tool.poetry]
name = "intelligence-layer"
version = "1.1.0"
version = "1.2.0"
description = ""
authors = ["Aleph Alpha Engineering <[email protected]>"]
readme = "README.md"
Expand Down

0 comments on commit 843f36a

Please sign in to comment.