Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

不知道可否支持 MLX #979

Open
yibie opened this issue Nov 16, 2024 · 1 comment
Open

不知道可否支持 MLX #979

yibie opened this issue Nov 16, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@yibie
Copy link

yibie commented Nov 16, 2024

Is your feature request related to a problem? Please describe.
您的特性请求是否与某个问题相关?请描述。
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
对存在的问题进行清晰且简洁的描述。例如:我一直很困扰的是 [...]

昨晚试用 MinerU,转录一个 300 多页的 PDF,用时 30 分钟甚至以上。这么看,CPU 的执行效率不高。

Describe the solution you'd like
描述您期望的解决方案
A clear and concise description of what you want to happen.
清晰且简洁地描述您希望实现的内容。

苹果也针对大模型的加速方案,可以充分发挥 M 系列芯片的性能。
一个例子:https://github.com/vegaluisjose/mlx-rag/tree/main

Describe alternatives you've considered
描述您已考虑的替代方案
A clear and concise description of any alternative solutions or features you've considered.
清晰且简洁地描述您已经考虑过的任何替代解决方案。

暂时没更好的替代方案。

Additional context
提供更多细节
Add any other context or screenshots about the feature request here.
请附上任何相关截图、链接或文件,以帮助我们更好地理解您的请求。

@yibie yibie added the enhancement New feature or request label Nov 16, 2024
@drunkpig
Copy link
Collaborator

我们曾经尝试过支持M系列,但是由于适配环境太多人不足放弃了。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants