Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support weight only for ONNX #1055

Merged
merged 29 commits into from
Aug 7, 2023
Merged
Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
8d9f7ae
Support weight only for ONNX
mengniwang95 Jun 30, 2023
e205bc6
update
mengniwang95 Jul 5, 2023
6e219b5
update AWQ
mengniwang95 Jul 11, 2023
41854e6
add ut and fix bug
mengniwang95 Jul 11, 2023
9d34344
Update weight_only.py
mengniwang95 Jul 11, 2023
e29c479
Update weight_only.py
mengniwang95 Jul 12, 2023
b5152ad
Update quantization_weight_only.md
mengniwang95 Jul 12, 2023
55ca0fe
Update onnxrt.py
mengniwang95 Jul 13, 2023
141659f
Update weight_only.py
mengniwang95 Jul 14, 2023
ecea0ae
Update quantization_weight_only.md
mengniwang95 Jul 14, 2023
1975450
Update onnxrt.yaml
mengniwang95 Jul 14, 2023
4a9b1c8
Update requirements.txt
mengniwang95 Jul 14, 2023
55193d6
Update weight_only.py
mengniwang95 Jul 14, 2023
d4e8187
Update weight_only.py
mengniwang95 Jul 14, 2023
ac17073
Update weight_only.py
mengniwang95 Jul 14, 2023
bbe70ae
Update weight_only.py
mengniwang95 Jul 14, 2023
3ba9f78
Update weight_only.py
mengniwang95 Jul 18, 2023
20a354c
Update onnx_model.py
mengniwang95 Jul 18, 2023
71e42a2
Update weight_only.py
mengniwang95 Jul 18, 2023
96e8ea9
Update weight_only.py
mengniwang95 Jul 18, 2023
7d3568e
add gptq
mengniwang95 Jul 20, 2023
1f8d7a9
fix bug
mengniwang95 Jul 21, 2023
3076ebb
Update weight_only.py
mengniwang95 Aug 4, 2023
472d3dc
Update test_weight_only_adaptor.py
mengniwang95 Aug 4, 2023
9506e4a
Update quantization_weight_only.md
mengniwang95 Aug 4, 2023
70fbde9
Merge branch 'master' into mengni/weight_only
mengniwang95 Aug 4, 2023
f85d70f
Update weight_only.py
mengniwang95 Aug 4, 2023
2c1784a
Update weight_only.py
mengniwang95 Aug 4, 2023
aebdfca
fix ut
mengniwang95 Aug 4, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update test_weight_only_adaptor.py
mengniwang95 authored Aug 4, 2023

Verified

This commit was signed with the committer’s verified signature. The key has expired.
DigitalBrains1 Peter Lebbing
commit 472d3dca5953f8db72a7271765cf13e65a152569
6 changes: 3 additions & 3 deletions test/adaptor/onnxrt_adaptor/test_weight_only_adaptor.py
Original file line number Diff line number Diff line change
@@ -30,9 +30,9 @@ class TestWeightOnlyAdaptor(unittest.TestCase):

@classmethod
def setUpClass(self):
#cmd = 'optimum-cli export onnx --model hf-internal-testing/tiny-random-gptj --task text-generation gptj/'
#p = subprocess.Popen(cmd, preexec_fn=os.setsid, stdout=subprocess.PIPE, stderr=subprocess.PIPE, shell=True) # nosec
#p.communicate()
cmd = 'optimum-cli export onnx --model hf-internal-testing/tiny-random-gptj --task text-generation gptj/'
p = subprocess.Popen(cmd, preexec_fn=os.setsid, stdout=subprocess.PIPE, stderr=subprocess.PIPE, shell=True) # nosec
p.communicate()

self.model = onnx.load('gptj/decoder_model.onnx')
self.dataloader = DummyNLPDataloader('hf-internal-testing/tiny-random-gptj')