Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implemented basic pipeline for Refitting #2886

Merged
merged 71 commits into from
Jul 2, 2024
Merged

Implemented basic pipeline for Refitting #2886

merged 71 commits into from
Jul 2, 2024

Commits on Jun 4, 2024

  1. Implemented basic pipeline for Refitting

    @cehongwang
    cehongwang committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    dc98f23 View commit details
    Browse the repository at this point in the history

  2. Organized code for refitting

    @cehongwang
    cehongwang committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    74d458e View commit details
    Browse the repository at this point in the history

  3. Renamed function

    @cehongwang
    cehongwang committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    c47bef3 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Supported multi-engine

    @cehongwang
    cehongwang committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    869aaad View commit details
    Browse the repository at this point in the history

  2. Support both TRTModules and return a new copy

    @cehongwang
    cehongwang committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    e4cb669 View commit details
    Browse the repository at this point in the history

  3. Enabled module saving with settings

    @cehongwang
    cehongwang committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    388dadc View commit details
    Browse the repository at this point in the history

  4. Enabled three types of runtime. Build an interface for user to easy r… 

    …efit. Support setting loading
    @cehongwang
    cehongwang committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    f822b28 View commit details
    Browse the repository at this point in the history

  5. Reorganized the code

    @cehongwang
    cehongwang committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    56eb549 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Added weight type check and number check

    @cehongwang
    cehongwang committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    94483a8 View commit details
    Browse the repository at this point in the history

  2. Deleted the save in compilation

    @cehongwang
    cehongwang committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    4ba84b7 View commit details
    Browse the repository at this point in the history

  3. deleted more compilation save

    @cehongwang
    cehongwang committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    ee6f123 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Supported different dtypes. Support all possible layers. Support deep… 

    … copy.
    @cehongwang
    cehongwang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    bc23ddb View commit details
    Browse the repository at this point in the history

  2. Delete the outdated file

    @cehongwang
    cehongwang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    501e5d9 View commit details
    Browse the repository at this point in the history

  3. Deleted setting loading

    @cehongwang
    cehongwang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    bd5fb55 View commit details
    Browse the repository at this point in the history

  4. Fixed bugs when handling multiple engines. Tested with custom module … 

    …and Bert
    @cehongwang
    cehongwang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    578927c View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Fixed dtype bugs

    @cehongwang
    cehongwang committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    82cd252 View commit details
    Browse the repository at this point in the history

  2. Made a note to add INormalization Layer

    @cehongwang
    cehongwang committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    e3cf823 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Update the unsupported torch module weights

    @cehongwang
    cehongwang committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    c3b0862 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Cleaned up the code. Added refitting outcome check

    @cehongwang
    cehongwang committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    400bcac View commit details
    Browse the repository at this point in the history

  2. Use enums to change dtype from np to trt

    @cehongwang
    cehongwang committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    6f08664 View commit details
    Browse the repository at this point in the history

  3. Moved check output to util and added a gated flag

    @cehongwang
    cehongwang committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    2250239 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. fixed a bug in check_output function. Changed to only check once afte… 

    …r all refitting
    @cehongwang
    cehongwang committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    c906d0e View commit details
    Browse the repository at this point in the history

  2. reverse the main function

    @cehongwang
    cehongwang committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    51cba6f View commit details
    Browse the repository at this point in the history

  3. Added support to inline module w/ or w/o graph break

    @cehongwang
    cehongwang committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    e3576fa View commit details
    Browse the repository at this point in the history

  4. Added an extra attribute to TRT engine in cpp

    @cehongwang
    cehongwang committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    cde8fe9 View commit details
    Browse the repository at this point in the history

  5. Added an attribute in TorchTRTModule in python.

    @cehongwang
    cehongwang committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    b575105 View commit details
    Browse the repository at this point in the history

  6. Fixed a type

    @cehongwang
    cehongwang committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    9923125 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Fixed a bug for inline_module refit

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    e25941e View commit details
    Browse the repository at this point in the history

  2. Added refit example documentation

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    646da9e View commit details
    Browse the repository at this point in the history

  3. Added backward compatibility

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    924f4a8 View commit details
    Browse the repository at this point in the history

  4. Rename the setting enum

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    3c25a3a View commit details
    Browse the repository at this point in the history

  5. Cleaned up cpp constructors

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    0c9637d View commit details
    Browse the repository at this point in the history

  6. Fixed a type of setting storage checking

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    bb5fdba View commit details
    Browse the repository at this point in the history

  7. Renamed settings to metadata

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    e47bcb2 View commit details
    Browse the repository at this point in the history

  8. Added refit to __init__ of dynamo

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    e6e71ca View commit details
    Browse the repository at this point in the history

  9. Added docstring. Added support for dynamic shape

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    cf43a79 View commit details
    Browse the repository at this point in the history

  10. Chagned the check_output function to return a boolean

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    cfeb6bf View commit details
    Browse the repository at this point in the history

  11. Chagned get_settings to a static method in TorchTensorRTModule

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    a092229 View commit details
    Browse the repository at this point in the history

  12. Simplified the code

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    4819a6d View commit details
    Browse the repository at this point in the history

  13. Added three testcases

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    bd77f22 View commit details
    Browse the repository at this point in the history

  14. Supported torch ops in settings

    @cehongwang
    cehongwang committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    1b3a769 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. Updated the example

    @cehongwang
    cehongwang committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    1456ad9 View commit details
    Browse the repository at this point in the history

  2. Wrote 6 test cases for refitting feature to cover different scenarios

    @cehongwang
    cehongwang committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    1acfe31 View commit details
    Browse the repository at this point in the history

  3. Fixed a bug in tests

    @cehongwang
    cehongwang committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    d38e422 View commit details
    Browse the repository at this point in the history

  4. Delete settings check

    @cehongwang
    cehongwang committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    880afde View commit details
    Browse the repository at this point in the history

  5. Fixed a bug of modifing settings inplace

    @cehongwang
    cehongwang committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    2dc5bfa View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. added it to //docsrc/py_api/dynamo.rst so that it gets rendered in th… 

    …e docs
    @cehongwang
    cehongwang committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    410689c View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Added reference to doc

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    381f14a View commit details
    Browse the repository at this point in the history

  2. Changed the default outputcheck to false

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    eebe883 View commit details
    Browse the repository at this point in the history

  3. Chagned the assertion

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    2a3d567 View commit details
    Browse the repository at this point in the history

  4. Renamed the imported name

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    003380a View commit details
    Browse the repository at this point in the history

  5. Renamed

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    323db97 View commit details
    Browse the repository at this point in the history

  6. Fixed a bug of serialized info signature

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    de0ab94 View commit details
    Browse the repository at this point in the history

  7. Changed the refit condition check

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    de3da26 View commit details
    Browse the repository at this point in the history

  8. Changed the file path in test file

    @cehongwang
    cehongwang committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    91c6036 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Fixed minor format

    @cehongwang
    cehongwang committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    bd43882 View commit details
    Browse the repository at this point in the history

  2. Deleted setting repetitions

    @cehongwang
    cehongwang committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    5ef9af7 View commit details
    Browse the repository at this point in the history

  3. Changed min_block_size to 1

    @cehongwang
    cehongwang committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    8882425 View commit details
    Browse the repository at this point in the history

  4. Added comments

    @cehongwang
    cehongwang committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    7f1f958 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Merged two if statements

    @cehongwang
    cehongwang committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b8e023d View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. Chagned the weight type

    @cehongwang
    cehongwang committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    df9cd39 View commit details
    Browse the repository at this point in the history

  2. Fixed hardcoded index

    @cehongwang
    cehongwang committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    b33fa0f View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Fixed a type causing extra overhead

    @cehongwang
    cehongwang committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    911984d View commit details
    Browse the repository at this point in the history

  2. Added comments and repaced the index to enum

    @cehongwang
    cehongwang committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    0a1c8ca View commit details
    Browse the repository at this point in the history

  3. Fixed inline module check

    @cehongwang
    cehongwang committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    257db26 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Added deprecate warning. Renamed refit flag to make_refitable

    @cehongwang
    cehongwang committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    fef6766 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge branch 'main' into refitter-support

    @cehongwang
    cehongwang committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    d6dbdd4 View commit details
    Browse the repository at this point in the history

  2. Updated lowering process to conform with latest main branch

    @cehongwang
    cehongwang committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    7381221 View commit details
    Browse the repository at this point in the history

  3. Handled default setting usecases

    @cehongwang
    cehongwang committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    e7768f7 View commit details
    Browse the repository at this point in the history

  4. Fixed circular import bugs

    @cehongwang
    cehongwang committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    51a03c9 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Changed deprecated behavior

    @cehongwang
    cehongwang committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    33bde0f View commit details
    Browse the repository at this point in the history