Code for prefix beam search tutorial by @borgholt (FKA @labodk)
This repository contains two files with Python code:
prefix_beam_search.pycontains all the code that is explained in the tutorial. I.e., the actual prefix beam search algorithm.test.pywill load a language model, perform beam search on three examples and print the result along with the output from a greedy decoder for comparison.
The examples folder contains three examples of CTC output (2D NumPy arrays) from a CNN-based acoustic model. The model is trained on the LibriSpeech corpus (http://www.openslr.org/12). When executing test.py you should get the following output:
examples/example_2002.p
BEFORE:
alloud laugh followed at chunkeys expencs
AFTER:
a loud laugh followed at chunkys expense
examples/example_99.p
BEFORE:
but no ghoes tor anything else appeared upon the angient wall
AFTER:
but no ghost or anything else appeared upon the ancient walls
examples/example_1518.p
BEFORE:
mister qualter as the apostle of the middle classes and we re glad twelcomed his gospe
AFTER:
mister quilter is the apostle of the middle classes and we are glad to welcome his gospel
Notice that each of these examples are handpicked. Thus, the transcript resulting from the prefix beam search is also the true transcript.
The language_model.p contains a dictionary mapping between all relevant prefixes queried during decoding of the three examples and the corresponding language model probabilities. Thus, this "language model" will only work for the three provided examples. The original language model file was too large to upload here. However, a range of similar pre-trained models can be found on the LibriSpeech website (http://www.openslr.org/11). The original model used in this tutorial was trained with the KenLM Language Model Toolkit (https://kheafield.com/code/kenlm/) on the additional language modeling data of the LibriSpeech corpus.
numpy