Skip to content

Test Suites with Individual Tests and Test Presets

Pre-release
Pre-release
Compare
Choose a tag to compare
@emeli-dral emeli-dral released this 07 Jul 11:51
v0.1.52.dev0
8d17bea
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Implemented new interfaces to test data and models in a batch: Test Suite.

Implemented the following Individual tests:

  • TestNumberOfColumns()
  • TestNumberOfRows()
  • TestColumnNANShare()
  • TestShareOfOutRangeValues()
  • TestNumberOfOutListValues()
  • TestMeanInNSigmas()
  • TestMostCommonValueShare()
  • TestNumberOfConstantColumns()
  • TestNumberOfDuplicatedColumns()
  • TestNumberOfDuplicatedRows()
  • TestHighlyCorrelatedFeatures()
  • TestTargetFeaturesCorrelations()
  • TestShareOfDriftedFeatures()
  • TestValueDrfit()
  • TestColumnsType()

Implemented the following test presets:

  • Data Quality. This preset is focused on the data quality issues like duplicate rows or null values.  
  • Data Stability. This preset identifies the changes in the data or differences between the batches.
  • Data Drift. This one compares feature distributions using statistical tests and distance metrics.  
  • NoTargetPerformance. This preset combines several checks to run when there are model predictions, there are no actuals or ground truth labels. This includes checking for prediction drift and some of the data quality and stability checks.
Assets 2
Loading