Skip to content

MediaPipe v0.10.9

Compare
Choose a tag to compare
@ayushgdev ayushgdev released this 13 Dec 13:46
· 1326 commits to release since this release

Build changes

  • Add libtext and libvision build rules
  • Add lib targets for all C vision tasks

Framework and core calculator improvements

  • Added files for the Image Embedder C API and tests
  • Pass Model Asset Buffer as byte array + length
  • Drop default arguments in C API
  • Updated the Image Embedder C API and added tests for cosine similarity
  • Drop default arguments in Image Embedder C API
  • Remove const from input types of C API
  • Resolved issues and added a common header to hold all the necessary structures for the vision tasks
  • Refactor OpenCV path out of TensorsToSegmentationCalculator main file.
  • Add some convenience getters to EglManager.
  • Added files for the Object Detector C Tasks API
  • Explicitly delete some copy operations to improve compile errors.
  • Extract CPU conversion methods into a separate library & add test
  • Updated components and their tests in the C Tasks API
  • Ensure that releaseGl() is called if prepapreGl throws
  • Adding a GpuTestWithParamBase test class to support value parameterized tests
  • Added Gesture Recognizer C API and tests
  • Holistic Landmarker C++ Graph
  • Revised Gesture Recognizer API implementation and associated tests
  • Added FreeMemory test for GestureRecognizerResult
  • Refactor GestureRecognizerResult conversion for default initialization
  • Move LanguageDetectorResult converter to LanguageDetector task
  • Add TensorsToSegmentationCalculator test utilities.
  • Added Hand Landmarker C Tasks API and tests
  • Export java package for hand_roi_refinement_graph_options.
  • Fix naming in different files
  • Create an explicit GlRuntimeException class

MediaPipe Tasks update

This section should highlight the changes that are done specifically for any platform and don't propagate to
other platforms.

Android

  • Create shared utilities to construct category lists
  • Create shared utilities to construct landmark lists
  • Add the result class for the HolisticLandmarker Java API
  • HolisticLandmarker Java API
  • Add dependency on hand_roi_refinement_graph_options_proto
  • Use Java Proto Lite Target for Hand ROI Refinement proto
  • Move hand_roi_refinement_graph_options_java_proto_lite to vision lib

iOS

  • Added iOS MPPPoseLandmarker.mm
  • Added null check for segmentation masks in pose landmarker helper initializer
  • Added pose landmarker protobuf utils
  • Fixed graph name in iOS language detector
  • Added iOS language detector tests
  • Added iOS Objective C Pose Landmarker Tests
  • Added iOS interactive segmenter options
  • Added iOS region of interest
  • Added iOS region of interest helpers
  • Updated iOS vision/core to add methods for processing region of interest
  • Added iOS interactive segmenter header

Javascript

  • Creates GpuBuffers around pre-allocated AHardware_Buffer objects.
  • Add drawConfidenceMask() to our public API
  • Use gl.LINEAR interpolation for confidence masks
  • Add missing export declarations to DrawingUtils

Python

  • Example updated for mp.Image in documentation
  • Added image classifier benchmark
  • Updated copyright
  • Documented the return value and added percentile to argparser
  • Allowed a default value for the model argument
  • Added more benchmark scripts for the Tasks Python API
  • Code cleanup and revised benchmarking API
  • Removed unused param

Model Maker changes

  • Add option to omit the checkpoint callback in text classifier.
  • Add BinaryAUC metric and Best Checkpoint callback to Text Classifier
  • Remove batch dimension from the output of tflite_with_tokenizer in text classifier.