Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Add official support for onnxruntime-gpu on ARM64/aarch64 platforms #22903

Open
abhishek-iitmadras opened this issue Nov 20, 2024 · 1 comment
Labels
feature request request for unsupported feature or enhancement

Comments

@abhishek-iitmadras
Copy link

Describe the feature request

Issue Description
Currently, onnxruntime-gpu package lacks official support for ARM64/aarch64 architecture, limiting GPU acceleration capabilities on increasingly popular ARM-based platforms.

Current Situation

No official pre-built wheels for onnxruntime-gpu on ARM64/aarch64
Limited documentation for ARM64 GPU deployment

Technical Details

  • Environment:
    Architecture: ARM64/aarch64
    Platform: Various (like AWS Graviton, etc.)
    Python Versions: 3.8+ compatibility needed

Proposed Solution

Official pre-built wheels for ARM64/aarch64
CI/CD pipeline additions for ARM64 builds

Would appreciate any feedback or guidance on how to make this happen?

Describe scenario use case

Use Case :
Growing adoption of ARM64 in edge/hpc computing.
Cloud deployments on ARM64-based servers (AWS Graviton, etc.)
Machine learning workloads on newer ARM-based development machines
IoT and embedded systems requiring GPU acceleration

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request request for unsupported feature or enhancement
Projects
None yet
Development

No branches or pull requests

1 participant