Running Microsoft's BitNet via Astro, React & Electron!
- Run Microsoft BitNet model inference
- Benchmark BitNet models
- Calculate BitNet model perplexity
- Switch between multiple languages
- Use python to prepare 1-bit models
- Follow Microsoft's instructions, installing visual studio 2022 (including c++ desktop build tools & clang build tools) and preparing the 1-bit model for use.
- Supports generated gguf models.
- Run the commands below to build and run the app
| Command | Action |
|---|---|
npm install |
Installs dependencies |
npm run dev |
Starts local dev server at localhost:4321 |
npm run build:astro |
Builds the production site at ./dist/ |
npm run build:astro | npm run start |
Builds then runs the electorn app in dev mode. |
npm run dist:windows-latest |
Builds the windows application. |
Reference project: https://github.com/microsoft/BitNet
Note: At the moment only Windows is supported, Linux support may come in the future.
Prefer to use an installer? Check out the latest windows releases!