Bob 是一款 macOS 平台的翻译和 OCR 软件。

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

批量为视频或者音频生成字幕，并可批量将字幕翻译成其它语言。这是一个客户端工具, 跨平台支持 mac 和 windows 系统, 支持百度，火山，deeplx, openai, deepseek, ollama 等多个翻译服务

🚀 DeepSeek-V2大模型逆向API白嫖测试【特长：GPT4平替】，支持高速流式输出、多轮对话，零配置部署，多路token支持。

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

BigCodeBench: Benchmarking Code Generation Towards AGI

A Reactive CLI that generates git commit messages with Ollama, ChatGPT, Gemini, Claude, Mistral and other AI

基于NineAi2.4.2的二开版本，含编译包和整合包，无需授权，全套源码，开箱即用，喜欢的给个Star~

PowerShell module that enables you to use AI Code Completion in the command line.

这是一个基于 Next.js 构建的多语言 AI 模型评估平台，支持多模型对比和实时流式响应。A multilingual AI model evaluation platform built with Next.js, allowing users to compare responses from multiple models and receive a final judgment.

💭 一个可二次开发 Chat Bot 对话 Web 端 MVP 原型模板, 基于 Vue3、Vite 5、TypeScript、Naive UI 、UnoCSS 等主流技术构建, 🧤简单集成大模型 API, 采用单轮 AI 问答对话模式, 每次提问独立响应, 无需上下文, 支持打字机效果流式输出, 集成 markdown-it 预览, 💼 易于定制和快速搭建 Chat 类大语言模型产品 (附示例截图)

Obsidian plugin that supports text generation based on tag suggestions, using services like Claude, OpenAI, Ollama, Kimi, Doubao, Qwen, Zhipu, DeepSeek, QianFan & more. 插件基于标签建议进行文本生成，支持 Claude、OpenAI、Ollama、Kimi、豆包、阿里千问、智谱、深度求索、百度千帆等

百聆 是一个类似GPT-4o的语音对话机器人，通过ASR+LLM+TTS实现，时延低至800ms，低配置也可运行，支持打断

A LLM RAG system runs on your laptop. 大模型检索增强生成系统，可以轻松部署在笔记本电脑上，实现本地知识库智能问答。

Interact with any LLM service

Chatbot-GPT, powered by OpenIM’s webhooks, seamlessly integrates with various messaging platforms. This tool enables private and group chats with bots, enhancing interactive communication. It delivers quick, automated responses, ideal for optimizing customer service and dynamic discussions, meeting diverse communication needs.

Deepseek-CoT

This repository provides an unofficial, reverse-engineered API for DeepSeek Chat & Coder (v2), allowing free and unlimited access to its powerful features.

Prompt, run, edit, and deploy full-stack web applications with multi-LLM support! Extends bolt.new with OpenAI, Google, Together AI, OpenRouter, Ollama, LMStudio, Groq, DeepSeek, and Mistral integrations. Enhanced with chat file uploads, improved file editor UX, and intelligent error handling with auto-fix suggestions.