Skip to content

Latest commit

 

History

History
99 lines (76 loc) · 3.73 KB

TODO.md

File metadata and controls

99 lines (76 loc) · 3.73 KB
Raw

To-Do list for Human library

Work-in-Progress


Exploring


Known Issues & Limitations

Face with Attention

FaceMesh-Attention is not supported when using WASM backend due to missing kernel op in TFJS
No issues with default model FaceMesh

Object Detection

NanoDet model is not supported when using WASM backend due to missing kernel op in TFJS
No issues with default model MB3-CenterNet

WebGPU

Experimental support only until support is officially added in Chromium
Enable via chrome://flags/#enable-unsafe-webgpu

Firefox

Running in web workers requires OffscreenCanvas which is still disabled by default in Firefox
Enable via about:config -> gfx.offscreencanvas.enabled
Details

Safari

No support for running in web workers as Safari still does not support OffscreenCanvas
Details


Pending Release Changes

Optimizations:

  • Enabled high-resolution optimizations
    Internal limits are increased from 2k to 4k
  • Enhanced device capabilities detection
    See human.env.[agent, wasm, webgl, webgpu] for details
  • If config.backend is not set, Human will auto-select best backend
    based on device capabilities
  • Enhanced support for webgpu
  • Reduce build dependencies
    Human is now 30% smaller :)
    As usual, Human has zero runtime dependencies,
    all devDependencies are only to rebuild Human itself

Features:

  • Add draw label templates
  • Add config.filter.autoBrightness (enabled by default)
    Per-frame video on-the-fly brightness adjustments
    Which significantly increases performance and precision in poorly lit scenes
  • Improved config.filter.equalization (disabled by default)
    Image and video on-demand histogram equalization
  • Support selecting specific video source when multiple cameras are present
    See human.webcam.enumerate()
  • Updated algorithm to determine distance from camera based on iris size
    See human.result.face[n].distance

Architecture:

  • Upgrade to TFJS 4.1 with strong typing
    see notes on how to use
  • TypeDef refactoring
  • Re-architect human.models namespace for better dynamic model handling
    Added additional methods load, list, loaded, reset
  • Repack external typedefs
    Removes all external typedef dependencies
  • Refactor namespace exports
    Better TypeDoc specs
  • Add named export for improved bundler support when using non-default imports
  • Cleanup Git history for dist/typedef/types
  • Support for NodeJS v19
  • Upgrade to TypeScript 4.9

Breaking changes:

  • Replaced result.face[n].iris with result.face[n].distance
  • Replaced human.getModelStats() with human.models.stats()
  • Moved human.similarity, human.distance and human.match to namespace human.match.*
  • Obsolete human.enhance()
  • Obsolete human.gl