Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DRAFT] Token level timestamps with DTW (#375) #1485

Merged
merged 20 commits into from
Mar 20, 2024
Merged

[DRAFT] Token level timestamps with DTW (#375) #1485

merged 20 commits into from
Mar 20, 2024
+652 −21

Commits on Mar 12, 2024

  1. whisper.cpp: impl dtw algo

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    cd52c5a View commit details
    Browse the repository at this point in the history

  2. WIP: producing and placing DTW timestamps on tokens

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    b69f5b4 View commit details
    Browse the repository at this point in the history

  3. Fix compile and assertion errors. Attempt to DTW timestamp with singl… 

    …e_segment=false.
    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    f11ff92 View commit details
    Browse the repository at this point in the history

  4. Fix mistake causing incorrect alignment of dtw timestamps

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    93eb345 View commit details
    Browse the repository at this point in the history

  5. implement N_TOP_MOST and CUSTOM alignment heads setting

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    3a5f368 View commit details
    Browse the repository at this point in the history

  6. whisper: fix typo on alignment heads enum

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    dfb24a4 View commit details
    Browse the repository at this point in the history

  7. Fix issues related to changes in whisper.cpp

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    4de1ed4 View commit details
    Browse the repository at this point in the history

  8. Fixed excessive memory use when using DTW timestamps. Other minor fix… 

    …es to DTW timestamping function
    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    641fb2c View commit details
    Browse the repository at this point in the history

  9. decoder: save cross QKs only if requested

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    9a19200 View commit details
    Browse the repository at this point in the history

  10. Calling median filter with ggml_map_custom1

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    3016444 View commit details
    Browse the repository at this point in the history

  11. Reimpl aheads n_top_most and custom. Sanity checks on chosen aheads

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    eb531c7 View commit details
    Browse the repository at this point in the history

  12. Copying cross QKs from decoder backend correctly

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    87f2620 View commit details
    Browse the repository at this point in the history

  13. dtw: cleanup

    @denersc
    denersc committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    10b0304 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Fix incorrect n_frames passed to dtw when near end of audio

    @denersc
    denersc committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    9fa298f View commit details
    Browse the repository at this point in the history

  2. Fix aheads_masks_init for backend != CPU

    @denersc
    denersc committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    5610253 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. whisper : minor style

    @ggerganov
    ggerganov committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    d9bfe29 View commit details
    Browse the repository at this point in the history

  2. main : add dtw (wip)

    @ggerganov
    ggerganov committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    c46712b View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. whisper: fix invalid memory access in aheads_masks_init

    @denersc
    denersc committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    59c133a View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. main : add dtw (cont)

    @ggerganov
    ggerganov committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    b55925d View commit details
    Browse the repository at this point in the history

  2. whisper : minor

    @ggerganov
    ggerganov committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    a3c94f3 View commit details
    Browse the repository at this point in the history