Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: model compression #2636

Open
rkuester opened this issue Jul 24, 2024 · 3 comments
Open

feature: model compression #2636

rkuester opened this issue Jul 24, 2024 · 3 comments
Assignees
@rkuester

Comments

@rkuester
Copy link
Contributor

rkuester commented Jul 24, 2024 •
edited
Loading

An issue to track the implementation of model compression.

Merge Queue

  1. PRs from rkuester/feat-compression are open for approval and merging. Because of our one-commit-per-PR policy, there is typically only one PR open at a time.
  2. Commits along the branch rkuester/feat-compression-next are queued, so to speak, for submission as PRs. Looking at this branch might give context for the open PR in feat-compression, see above. Be aware—this branch is rebased often.
  3. The branch rkuester/compress-testing typically contains the final result once all PRs for the model compression feature are merged. This is the Oort cloud from which commits along feat-compression-next, which turn into PRs from feat-compression, are formed. Explore this branch or compare it to main to see the full model compression feature implementation and understand the queued PRs in context.
@rkuester rkuester mentioned this issue Jul 24, 2024
Merged
mergify bot pushed a commit that referenced this issue Jul 24, 2024
@rkuester
build(py): add hexdump requirement (#2637)
569ed29 
Add the Python distribution package `hexdump`, to be used in tests
and utilities which display raw memory.

BUG=#2636
@rkuester rkuester mentioned this issue Jul 24, 2024
Merged
mergify bot pushed a commit that referenced this issue Jul 24, 2024
@rkuester
refactor: move tflite::Span to independent header (#2638)
d619ad8 
Hoist the universally-useful tflite::Span out of
codegen/runtime/micro_codegen_context.h and into an independent header
usable from elsewhere in the project.

BUG=#2636
@rkuester rkuester mentioned this issue Jul 25, 2024
Merged
mergify bot pushed a commit that referenced this issue Aug 7, 2024
@rkuester
feat: add fixed-capacity, statically-allocated type tflite::StaticVec…
d3475aa 
…tor (#2642)

Add a type, tflite::StaticVector, which behaves like std::vector, but
which avoids heap memory allocation.

BUG=#2636
@rkuester rkuester mentioned this issue Aug 7, 2024
Closed
@rkuester rkuester mentioned this issue Sep 26, 2024
Closed
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Oct 3, 2024

"This issue is being marked as stale due to inactivity. Remove label or comment to prevent closure in 5 days."

@github-actions github-actions bot added the Stale label Oct 3, 2024
@rkuester
Copy link
Contributor Author

rkuester commented Oct 3, 2024

This task remains open; PRs and issues link to it for tracking purposes regularly.

@github-actions github-actions bot removed the Stale label Oct 4, 2024
@github-actions GitHub Actions
Copy link
Contributor

"This issue is being marked as stale due to inactivity. Remove label or comment to prevent closure in 5 days."

@github-actions github-actions bot added the Stale label Oct 29, 2024
@rkuester rkuester removed the Stale label Oct 29, 2024
@rkuester rkuester mentioned this issue Oct 30, 2024
Merged
mergify bot pushed a commit that referenced this issue Nov 5, 2024
@rkuester
chore: remove obsolete ci/temp_patches (#2744)
694d250 
chore: remove obsolete ci/temp_patches

Remove ci/temp_patches, which was obsoleted in 23f608f once it
was no longer used by the sync script. It should have been
deleted then.

Remove it not only to clean up dead code, but because it contains
a reference to `micro_copts`, which is about to be refactored
away, and we don't want to leave stray references to it in the
tree.

BUG=#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 13, 2024
@rkuester
build(bazel): introduce tflm_cc_* macros, refactoring away micro_copts
23eecbd 
Remove micro_copts() by replacing every cc_* target that used
them with a tflm_cc_* equivalent, and setting those common copts
in one place, inside the tflm_cc_* macro.

This is the first of several commits introducing tflm_cc_* macros
in place of cc_binary, cc_library, and cc_test. Motivated by the
upcoming need to support conditional compilation, the objective
is to centralize build configuration rather than requiring (and
remembering that) each cc_* target in the project add the same
common attributes such as compiler options and select()ed

Alternatives such as setting global options on the command line
or in .bazelrc, even if simplified with a --config option, fail
to preserve flags and hooks for configuration in the case TFLM is
used as an external repository by an application project. Nor is
it easy in that case for individual targets to override an
otherwise global setting.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 13, 2024
Merged
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 13, 2024
@rkuester
build(bazel): replace cc_* with tflm_cc_* in remaining TFLM code
1fe5de3 
Replace cc_* targets remaining in TFLM code with tflm_cc_*
targets. These are targets which did not formerly use the common
copts. Avoid changing imported TFLite code, if for no other
reason than to avoid merge conflicts during the automatic sync
with upstream TFLite.

BUG=tensorflow#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 14, 2024
@rkuester
build(bazel): replace cc_* with tflm_cc_* in remaining TFLM code
e9b7433 
Replace cc_* targets remaining in TFLM code with tflm_cc_*
targets. These are targets which did not formerly use the common
copts. Avoid changing imported TFLite code, if for no other
reason than to avoid merge conflicts during the automatic sync
with upstream TFLite.

BUG=tensorflow#2636
mergify bot pushed a commit that referenced this issue Nov 14, 2024
@rkuester
build(bazel): introduce tflm_cc_* macros, refactoring away micro_copts (
11b15b3 
#2765)

Remove micro_copts() by replacing every cc_* target that used
them with a tflm_cc_* equivalent, and setting those common copts
in one place, inside the tflm_cc_* macro.

This is the first of several commits introducing tflm_cc_* macros
in place of cc_binary, cc_library, and cc_test. Motivated by the
upcoming need to support conditional compilation, the objective
is to centralize build configuration rather than requiring (and
remembering that) each cc_* target in the project add the same
common attributes such as compiler options and select()ed

Alternatives such as setting global options on the command line
or in .bazelrc, even if simplified with a --config option, fail
to preserve flags and hooks for configuration in the case TFLM is
used as an external repository by an application project. Nor is
it easy in that case for individual targets to override an
otherwise global setting.

BUG=#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 15, 2024
@rkuester
build(bazel): replace cc_* with tflm_cc_* in remaining TFLM code
a2ad7bf 
Replace cc_* targets remaining in TFLM code with tflm_cc_*
targets. These are targets which did not formerly use the common
copts. Avoid changing imported TFLite code, if for no other
reason than to avoid merge conflicts during the automatic sync
with upstream TFLite.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 15, 2024
Merged
mergify bot pushed a commit that referenced this issue Nov 15, 2024
@rkuester
build(bazel): replace cc_* with tflm_cc_* in remaining TFLM code (#2768)
b68c655 
Replace cc_* targets remaining in TFLM code with tflm_cc_*
targets. These are targets which did not formerly use the common
copts. Avoid changing imported TFLite code, if for no other
reason than to avoid merge conflicts during the automatic sync
with upstream TFLite.

BUG=#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 15, 2024
@rkuester
feat: add a tflite::hexdump() for printing raw memory
8ff28fa 
Add tflite::hexdump() for printing raw memory to output streams.
Copy the output format of Python's hexdump module.

BUG=tensorflow#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 15, 2024
@rkuester
feat: add compression metadata flatbuffer schema and tests
16e101e 
Add a flatbuffer schema for describing compressed models.
Flatbuffers with this schema are to be used as the value in a
.tflite model flatbuffer metadata field, and contain the extra
information necessary to describe a compressed model.

Include tests to ensure basic functionality and demonstrate
integration with C++, Python, and Bazel.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 15, 2024
Merged
mergify bot pushed a commit that referenced this issue Nov 15, 2024
@rkuester
feat: add a tflite::hexdump() for printing raw memory (#2769)
b238649 
Add tflite::hexdump() for printing raw memory to output streams.
Copy the output format of Python's hexdump module.

BUG=#2636
@rkuester rkuester mentioned this issue Nov 19, 2024
Merged
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 19, 2024
@rkuester
feat(compression): add facade for working with tflite.Model
e526f65 
Add a module that provides convenient navigation, data type
conversions, and utilities for working with a tflite.Model, which
can be tedious and verbose to work with directly.

BUG=tensorflow#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 19, 2024
@rkuester
feat(compression): add model compression tool
65e8e8c 
Add a library and CLI for compressing models.

Add bitarray to the Python third-party package dependencies.

BUG=tensorflow#2636
mergify bot pushed a commit that referenced this issue Nov 19, 2024
@rkuester
feat(compression): add module for defining test .tflite models (#2798)
dac389e 
Add a module that provides tools for constructing .tflite
flatbuffers from a Python dictionary representation of a model.
This is useful for declaratively defining model flatbuffers for
testing, which is faster and clearer than building up model
flatbuffers programmatically.

The implementation should stay low-level and independent from any
helpers in this project which make constructing model and
flatbuffers easier, because this module is used to define tests
for those helpers.

BUG=#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 19, 2024
@rkuester
feat(compression): add facade for working with tflite.Model
18d116a 
Add a module that provides convenient navigation, data type
conversions, and utilities for working with a tflite.Model, which
can be tedious and verbose to work with directly.

BUG=tensorflow#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 19, 2024
@rkuester
feat(compression): add model compression tool
4186ad7 
Add a library and CLI for compressing models.

Add bitarray to the Python third-party package dependencies.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 19, 2024
Merged
mergify bot pushed a commit that referenced this issue Nov 19, 2024
@rkuester
feat(compression): add facade for working with tflite.Model (#2821)
cac6c98 
Add a module that provides convenient navigation, data type
conversions, and utilities for working with a tflite.Model, which
can be tedious and verbose to work with directly.

BUG=#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 19, 2024
@rkuester
feat(compression): add model compression tool
72ec510 
Add a library and CLI for compressing models.

Add bitarray to the Python third-party package dependencies.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 19, 2024
Merged
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 21, 2024
@rkuester
ci(bazel): add test jobs for compression
996d979 
Add GitHub CI jobs that run `bazel test` with compression
enabled. Add as new jobs, as opposed to additional steps
within the existing jobs, so they can run in parallel.

Similar additions for the Make build system will follow in future
commits.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 21, 2024
Merged
suleshahid pushed a commit that referenced this issue Nov 21, 2024
@rkuester
ci(bazel): add test jobs for compression (#2924)
02011b3 
Add GitHub CI jobs that run `bazel test` with compression
enabled. Add as new jobs, as opposed to additional steps
within the existing jobs, so they can run in parallel.

Similar additions for the Make build system will follow in future
commits.

BUG=#2636
ddavis-2015 added a commit to ddavis-2015/tflite-micro that referenced this issue Nov 25, 2024
@ddavis-2015
Squashed commit of the following:
defad29 
commit 414a55a
Author: ddavis-2015 <[email protected]>
Date:   Thu Nov 21 18:15:40 2024 -0800

    last merge missed xtensa.inc file

commit 1110543
Author: ddavis-2015 <[email protected]>
Date:   Thu Nov 21 18:06:45 2024 -0800

    Squashed commit of the following:

    commit 300751d
    Author: ddavis-2015 <[email protected]>
    Date:   Wed Nov 20 12:03:16 2024 -0800

        Update to latest Cadence code.  Int8 any bitwidth on normal quant axis updated.

    commit 0a49b2a
    Author: ddavis-2015 <[email protected]>
    Date:   Wed Nov 20 10:50:30 2024 -0800

        Add input tensor CRC to Generic Benchmark application.
        Only use -O3 -LNO:simd with the xtensa decompress.cc target.

    commit 83dafce
    Author: ddavis-2015 <[email protected]>
    Date:   Mon Nov 18 17:23:58 2024 -0800

        cleanup

    commit 2f8cead
    Author: ddavis-2015 <[email protected]>
    Date:   Mon Nov 18 13:29:33 2024 -0800

        Revert FakeMicroContext changes for alternate profiler.
        Add default alternate profiler implementation to MicroContext.

    commit fddf003
    Author: ddavis-2015 <[email protected]>
    Date:   Mon Nov 18 12:29:26 2024 -0800

        Fix typo.

    commit ae6a207
    Author: ddavis-2015 <[email protected]>
    Date:   Mon Nov 18 12:29:06 2024 -0800

        Implement alternate profiler for MicroInterpreter.
        Enable use of alternate profiler by decompression code.
        Enable use of alternate profiler by Generic Benchmark application.

    commit 5e1a1c9
    Author: ddavis-2015 <[email protected]>
    Date:   Sun Nov 10 18:24:02 2024 -0800

        changes to make the memory planner debug output easier to interpret

    commit f651c88
    Author: ddavis-2015 <[email protected]>
    Date:   Sun Nov 10 04:27:29 2024 -0800

        single pending ops queue
        process pending ops recursively

    commit cfd9890
    Author: ddavis-2015 <[email protected]>
    Date:   Sun Nov 10 00:26:14 2024 -0800

        expand model_facade
        redo var handle tracking

    commit 7776cda
    Author: ddavis-2015 <[email protected]>
    Date:   Tue Nov 5 13:24:58 2024 -0800

        remove [[maybe_unused]]

    commit 40e7530
    Author: ddavis-2015 <[email protected]>
    Date:   Mon Nov 4 11:17:43 2024 -0800

        fix arena

    commit 0d889e0
    Author: ddavis-2015 <[email protected]>
    Date:   Sat Nov 2 14:18:55 2024 -0700

        Fix MicroProfiler bug with ClearEvents().
        Add pre-inference profiling to the Generic Benchmark.

commit bd04eb2
Author: ddavis-2015 <[email protected]>
Date:   Wed Nov 20 18:40:42 2024 -0800

    Pre-rebase empty commit

commit 661ad5e
Author: Ryan Kuester <[email protected]>
Date:   Thu Nov 14 11:31:23 2024 -0600

    feat(compression): update model compression tools

commit 6eac102
Author: Ryan Kuester <[email protected]>
Date:   Thu Nov 14 00:31:56 2024 -0600

    feat: add model compression draft

    Add a feature-complete draft of the model compression feature in
    a single commit. This commit isn't intended for merging into
    mainline; it exists solely for reviewers and testers to take an
    early look.

commit f91dd91
Author: Ryan Kuester <[email protected]>
Date:   Wed Nov 13 16:46:20 2024 -0600

    build(codegen): suppress noise in console output (tensorflow#2742)

    build(codegen): suppress noise in console output

    Redirect output from the code_generator binary so that when it's
    used within the build system, it doesn't print unexpected,
    distracting noise to the console. Generally, compiler or
    generator commands don't print output unless there's an error.

    This reverts "build(codegen): suppress noise in console output
    (tensorflow#2708)", commit d249577, which attempted to fix the same
    problem by adding a --quiet flag. A subsequent upgrade to the
    Tensorflow Python package caused new noise that wasn't possible
    to suppress with the flag.

    BUG=description

commit 182c8c7
Author: Adrian Lundell <[email protected]>
Date:   Tue Nov 12 23:34:09 2024 +0100

    Update CMSIS-NN Transpose conv function call (tensorflow#2760)

    Also removes OPTIMIZE_FOR_SIZE compiler option as the new implementation is more space efficient.

    BUG=CMSIS-NN update

commit d7c42b9
Author: suleshahid <[email protected]>
Date:   Tue Nov 12 12:40:15 2024 -0800

    Add SQRT to Requantize Flatbuffer. (tensorflow#2756)

    BUG=Add more support for tool.

commit 26ada36
Author: Jae H. Yoo <[email protected]>
Date:   Tue Nov 12 12:14:54 2024 -0800

    Update numpy_utils.cc to support ml_dtypes.bfloat16 (tensorflow#2758)

    This commit adds NPY_USERDEF for ml_dtypes.bfloat16 only. Other types are not supported yet.

    BUG=tensorflow#2759
    BUG=2759

commit 79c3fde
Author: Ryan Kuester <[email protected]>
Date:   Tue Nov 12 13:40:59 2024 -0600

    ci(bazel): improve logging of bazel CI tests (tensorflow#2749)

    Improve the logging of Bazel commands run in CI by setting several
    options that turn off, e.g., progress messages intended for interactive
    shells, and turn on, e.g., more verbose output when something fails.

    BUG=tensorflow#2742

commit 9245002
Author: Ryan OShea <[email protected]>
Date:   Wed Nov 6 20:18:28 2024 +0100

    Fix issue with transposing shape in CMSIS-NN batch matmul (tensorflow#2741)

    BUG=tensorflow#2740

commit 4bb78c7
Author: Ryan Kuester <[email protected]>
Date:   Tue Nov 5 19:11:45 2024 -0600

    fix(create_tflm_tree): remove recent tests from exported tree (tensorflow#2751)

    Remove the recently added span_test.cc and static_vector_test.cc from
    the files exported by the create_tflm_tree.py project generation process
    by adding them to the list of tests in the Makefile. Unit tests are not
    meant to be included in exported trees; they may include files that are
    not exported.

    This change also ensures that these tests are included when `make test`
    is run.

    BUG=fixes tensorflow#2718

commit 45cd79b
Author: Måns Nilsson <[email protected]>
Date:   Tue Nov 5 23:13:20 2024 +0100

    Replace CoreDebug with DCB (tensorflow#2746)

    BUG=The CMSIS CoreDebug macro is deprecated.

commit 694d250
Author: Ryan Kuester <[email protected]>
Date:   Tue Nov 5 15:48:52 2024 -0600

    chore: remove obsolete ci/temp_patches (tensorflow#2744)

    chore: remove obsolete ci/temp_patches

    Remove ci/temp_patches, which was obsoleted in 23f608f once it
    was no longer used by the sync script. It should have been
    deleted then.

    Remove it not only to clean up dead code, but because it contains
    a reference to `micro_copts`, which is about to be refactored
    away, and we don't want to leave stray references to it in the
    tree.

    BUG=tensorflow#2636

commit 8eb6b23
Author: Ryan Kuester <[email protected]>
Date:   Fri Nov 1 17:10:05 2024 -0500

    build(bazel): add integrity check to nnlib_hifi4 download (tensorflow#2743)

    build(bazel): add integrity check to nnlib_hifi4 download

    Add an integrity check to the http_archive() download of nnlib_hifi4 in
    order to make the build more hermetic, reduce the security risk that a
    remote file changes, and silence the noisy warning on the console during
    the build:

        DEBUG: Rule 'nnlib_hifi4' indicated that a canonical reproducible
        form can be obtained by modifying arguments integrity[....]

    BUG=description

commit 5a46ab0
Author: Måns Nilsson <[email protected]>
Date:   Fri Nov 1 20:57:00 2024 +0100

    Add kernels optimized for size flag to FC and SVDF (tensorflow#2734)

    The kernels optimized for size flag provides an alternative implementation where size is prioritized over latency.

    For size option (speed option is default) it means the CMSIS-NN kernels are calculating kernel sums during inference.

    BUG=no bug but this will let users prioritize speed vs size even more

commit 389e775
Author: suleshahid <[email protected]>
Date:   Tue Oct 29 13:57:29 2024 -0700

    Fix upstream sync (tensorflow#2728)

    * .

    * nl add

    * Sync from upstream TF.

    * fix include

    ---------

    Co-authored-by: TFLM-bot <[email protected]>

commit e440f0a
Author: Måns Nilsson <[email protected]>
Date:   Mon Oct 28 20:16:43 2024 +0100

    Update CMSIS third party download (tensorflow#2716)

    CMSIS is updated from CMSIS_5 to CMSIS_6.

    BUG=It is recommended to upgrade from CMSIS_5 to CMSIS_6

commit 1b975d9
Author: suleshahid <[email protected]>
Date:   Mon Oct 28 11:27:23 2024 -0700

    Update deprecated mergify rules (tensorflow#2732)

    * .

    * nl add

    * update mergify

commit 78e5467
Author: Ryan Kuester <[email protected]>
Date:   Fri Oct 25 18:27:21 2024 -0500

    fix(python): add compatibility with NumPy 2 (tensorflow#2733)

    Upgrade the pinned packages used in the Bazel build environment to make
    the Python extension module compatible with NumPy 2 in addition to NumPy
    1. Modules built against NumPy 1 are not compatible with runtime
    environments that use NumPy 2, but modules built against NumPy 2 should
    be compatible with both.

    The python_requirements.txt defining the Bazel build environment is was
    upgraded via the command:

        bazel run //third_party:python_requirements.update -- --upgrade

    See third_party/python_requirements.in for details.

    This change upgraded a number of other packages as well, notably
    Tensorflow, from 2.17 to 2.18. In fact, Tensorflow 2.18 is also required
    for compatibility with NumPy 2.

    Also update the path to the header files within the NumPy wheel, used by
    the :numpy_cc_deps target. Our method of including header files shipped
    in Python packages is sensitive to the internal details of those
    packages, and NumPy moved their headers during this major version
    change.

    This fixes tensorflow#2731, in which //python/tflite_micro:whl_test began failing.
    :whl_test installs the newly built tflite_micro package, which packages
    our Python extension module, and its dependencies into a clean virtual
    environment and performs tests. The tflite_micro package has unversioned
    dependencies on the tensorflow and numpy packages. Within the last 24
    hours, tensorflow in PyPI was upgraded from 2.17 to 2.18. The 2.18
    release upgraded tensorflow's versioned dependency on numpy from 1 to 2,
    forcing the environment created by :whl_test to use NumPy 2 instead of
    NumPy 1; thereby exposing the incompatibility of the extension module
    that was built against NumPy 1, and causing :whl_test to fail.

    BUG=tensorflow#2731

commit e86d97b
Author: RJ Ascani <[email protected]>
Date:   Mon Oct 7 10:36:26 2024 -0700

    Replace rascani with suleshahid on OWNERS (tensorflow#2715)

    BUG=none

commit e3f6dc1
Author: David Davis <[email protected]>
Date:   Thu Oct 3 10:45:00 2024 -0700

    Compression documentation (tensorflow#2711)

    @tensorflow/micro

    Add documentation describing some compression/decompression internals and makefile build procedures.

    bug=tensorflow#2710

commit b3967a9
Author: Ryan Kuester <[email protected]>
Date:   Wed Oct 2 13:36:01 2024 -0500

    style: add .style.yapf to control yapf styling of Python code (tensorflow#2709)

    Add a .style.yapf file so yapf can be used to style Python code without
    passing the project's style via command line option. Remove the
    corresponding patch to pigweed's call to yapf, used by CI, and instead
    let it too rely on .style.yapf. Remove the developer documentation's
    instruction to use the command line option.

    BUG=description

commit d249577
Author: Ryan Kuester <[email protected]>
Date:   Tue Oct 1 16:16:45 2024 -0500

    build(codegen): suppress noise in console output (tensorflow#2708)

    Add a --quiet option to the code_generator binary so that when it's used
    within the build system, it doesn't print unexpected, distracting noise
    to the console. Generally, compiler or generator commands don't print
    output unless there's an error.

    BUG=description
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 26, 2024
@rkuester
feat(compression): add model compression tool
2f7b746 
Add a library and CLI for compressing models.

Add bitarray to the Python third-party package dependencies.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 26, 2024
Merged
mergify bot pushed a commit that referenced this issue Nov 26, 2024
@rkuester
feat(compression): add model compression tool (#2939)
233e936 
Add a library and CLI for compressing models.

Add bitarray to the Python third-party package dependencies.

BUG=#2636
@rkuester rkuester mentioned this issue Nov 27, 2024
Merged
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 27, 2024
@rkuester
build(bazel): include compression code when --//:with_compression
5a7e8c4 
Conditionally include support for compressed tensors when the
option --//:with_compression is given.

BUG=tensorflow#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 27, 2024
@rkuester
build(bazel): include compression code when --//:with_compression
1b36659 
Conditionally include support for compressed tensors when the
option --//:with_compression is given.

BUG=tensorflow#2636
mergify bot pushed a commit that referenced this issue Nov 27, 2024
@rkuester
refactor: revert additions which break build with USE_TFLM_COMPRESSION (
a022005 
#2942)

For now, revert two commits that added conditionally included
code using USE_TFLM_COMPRESSION which break the build when
USE_TFLM_COMPRESSION is enabled. This code will be restored in
chunks that do not break the build and tests.

This reverts commit f309046 (#2647).
This reverts commit 2b127fd (#2658).

BUG=#2636
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 27, 2024
@rkuester
build(bazel): include compression code when --//:with_compression
0a4cbda 
Conditionally include support for compressed tensors when the
option --//:with_compression is given.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 27, 2024
Merged
mergify bot pushed a commit that referenced this issue Nov 27, 2024
@rkuester
build(bazel): include compression code when --//:with_compression (#2943
1276385 
)

Conditionally include support for compressed tensors when the
option --//:with_compression is given.

BUG=#2636
@rkuester rkuester mentioned this issue Nov 27, 2024
Merged
mergify bot pushed a commit that referenced this issue Nov 27, 2024
@rkuester
feat(python): don't check .sparsity in interpreter (#2944)
c28b493 
Remove the check for sparse tensors in the Python interpreter wrapper.
This fixes a broken build when TF_LITE_STATIC_MEMORY is set, which
should always be the case in TFLM. TfLiteTensor objects don't have a
.sparsity member when TF_LITE_STATIC_MEMORY is set, so this check
can't be made.

This prepares for an upcoming commit setting TF_LITE_STATIC_MEMORY
during Bazel builds. This hasn't caused build failures in Make builds,
which have always set TF_LITE_STATIC_MEMORY, because Make builds don't
build the Python interpreter wrapper.

BUG=#2636
@rkuester rkuester mentioned this issue Nov 27, 2024
Open
rkuester added a commit to rkuester/tflite-micro that referenced this issue Nov 28, 2024
@rkuester
fix(py runtime_test): remove test for zero-initialized output tensor
5b7afc3 
Remove the test that incorrectly asserts the output tensor is
initially all zeros. The tensor is allocated from a shared memory
arena, and its initial state is not guaranteed to be zero. This
test eventually failed due to variations in memory allocation
during build and runtime; see the failed checks in tensorflow#2945.

BUG=tensorflow#2636
@rkuester rkuester mentioned this issue Nov 28, 2024
Merged
mergify bot pushed a commit that referenced this issue Dec 2, 2024
@rkuester
fix(py runtime_test): remove test for zero-initialized output tensor (#…
17f5844 
…2946)

Remove the test that incorrectly asserts the output tensor is
initially all zeros. The tensor is allocated from a shared memory
arena, and its initial state is not guaranteed to be zero. This
test eventually failed due to variations in memory allocation
during build and runtime; see the failed checks in #2945.

BUG=#2636
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rkuester rkuester

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@rkuester