Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TensorRT - TensorRT - Complete RoPE & repeat_KV implementation. #616

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

TensorRT - TensorRT - Complete RoPE & repeat_KV implementation. #616

wants to merge 12 commits into from

Commits on Sep 20, 2023

  1. Added profiling script to generate.py

    @Com1t
    Com1t committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    66314ed View commit details
    Browse the repository at this point in the history

  2. Added model structure

    @Com1t
    Com1t committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    76c18e1 View commit details
    Browse the repository at this point in the history

  3. Added trt example and silu transform result

    @Com1t
    Com1t committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    4371010 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Implemented MLP transformation

    @Com1t
    Com1t committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    ba98c3f View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. Implemented RMSNorm Layer

    @HengJayWang
    HengJayWang committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9ed5f4d View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Merge pull request #1 from HengJayWang/tensorRT 

    Implemented RMSNorm Layer
    @Com1t
    Com1t authored Oct 17, 2023
    Configuration menu
    Copy the full SHA
    898ad22 View commit details
    Browse the repository at this point in the history

  2. Fixed add epsilon issue of RMSNorm implementation.

    @HengJayWang
    HengJayWang committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    a8ae165 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Fixed tensor shape issue, change Mean_layer oprator of TensorRT

    @HengJayWang
    HengJayWang committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    901bef9 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Basic RoPE implementation with tensorRT.

    @HengJayWang
    HengJayWang committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    ca3801d View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. Complete RoPE & repeat_KV implementation. 

    Complete RoPE & repeat_KV with TensorRT
    @HengJayWang
    HengJayWang committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    6ca8267 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. Merge pull request Com1t#2 from HengJayWang/tensorRT 

    Fixed add epsilon issue of RMSNorm implementation.
    @Com1t
    Com1t authored Jan 24, 2024
    Configuration menu
    Copy the full SHA
    fb0177b View commit details
    Browse the repository at this point in the history

  2. Merge pull request #1 from Com1t/tensorRT 

    TensorRT - Complete RoPE & repeat_KV implementation.
    @HengJayWang
    HengJayWang authored Jan 24, 2024
    Configuration menu
    Copy the full SHA
    b5e6cbc View commit details
    Browse the repository at this point in the history