Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Changed positional arg to keyword arg for compatibility with auto-gptq #36

Closed
wants to merge 1 commit into from
Closed

Changed positional arg to keyword arg for compatibility with auto-gptq #36

wants to merge 1 commit into from

Conversation

mhillebrand
Copy link

@mhillebrand mhillebrand commented Aug 18, 2023 •
edited
Loading

This PR addresses an incompatibility with the auto-gptq library:

  File "/home/matt/miniconda3/envs/gptq/lib/python3.11/site-packages/jsonformer/main.py", line 112, in generate_string
    response = self.model.generate(
               ^^^^^^^^^^^^^^^^^^^^
TypeError: BaseGPTQForCausalLM.generate() takes 1 positional argument but 2 were given

@mhillebrand mhillebrand mentioned this pull request Aug 18, 2023
Open
@mhillebrand mhillebrand changed the title Changed positional args to kwargs for compatibility with auto-gptq Changed positional arg to keyword arg for compatibility with auto-gptq Aug 18, 2023
@tmwstw7
Copy link

tmwstw7 commented Sep 1, 2023

@1rgs This one is must-have

@mhillebrand mhillebrand closed this by deleting the head repository Jan 28, 2024
@projects-g
Copy link

This was never merged. Any workarounds ?

@mhillebrand
Copy link
Author

This was never merged. Any workarounds ?

Yes. Outlines and Instructor both come to mind.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@mhillebrand @tmwstw7 @projects-g