[WIP] neural biasing with early context injection and text perturbation #1763

huangruizhe · 2024-09-30T13:34:43Z

This PR implements the paper: Improving Neural Biasing for Contextual Speech Recognition by Early Context Injection and Text Perturbation
. This also addresses issue #1709 .

This codes can replicate the paper, but it is still a WIP -- needing codes refactoring and cleaning up.

TODO:

Make soft links to the original standard ASR recipe -- avoid copying scripts
Expose neural biasing and so on as an external function call to contextualize the models
Simplify the scripts for loading contexts -- only need an example for librispeech
Get evaluation scripts for common/rare words as in the contextual librispeech setup

…rly context injection and text perturbation; the codes runs well on the grid; however, it needs pretty much cleaning up and refactoring before maki a reasonable PR

This is the initial commits for neural biasing implementation with ea…

78b7ef3

…rly context injection and text perturbation; the codes runs well on the grid; however, it needs pretty much cleaning up and refactoring before maki a reasonable PR

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[WIP] neural biasing with early context injection and text perturbation #1763

[WIP] neural biasing with early context injection and text perturbation #1763

huangruizhe commented Sep 30, 2024 •

edited

Loading

[WIP] neural biasing with early context injection and text perturbation #1763

Are you sure you want to change the base?

[WIP] neural biasing with early context injection and text perturbation #1763

Conversation

huangruizhe commented Sep 30, 2024 • edited Loading

huangruizhe commented Sep 30, 2024 •

edited

Loading