A robust, modular Python framework for building advanced chat applications with Ollama models, featuring asynchronous processing, streaming responses, and comprehensive task management.
- Asynchronous Processing: Built with Python's asyncio for efficient task handling
- Streaming Responses: Real-time streaming of model outputs
- Multi-Model Support: Compatible with various Ollama models
- Task Management: CSV-based task organization and tracking
- Code Generation: Support for multiple programming languages
- Modular Design: Clean, maintainable, and extensible architecture
- Comprehensive Logging: Detailed activity and performance tracking
- Python 3.8+
- Ollama installed and running
- Git (for version control)
# Clone the repository
git clone https://github.com/MontyCraig/Ollama_Presentation.git
cd Ollama_Presentation
# Create and activate virtual environment
python -m venv venv
source venv/bin/activate # On Windows: venv\Scripts\activate
# Install dependencies
pip install -r requirements.txt
# Run with default settings
python async-chat-stream_2_main_v1.0/main.py
# Enable text-to-speech
python async-chat-stream_2_main_v1.0/main.py --speak
# Use specific model
python async-chat-stream_2_main_v1.0/main.py --model qwen2:7b
async-chat-stream_2_main_v1.0/
├── modules/ # Core functionality
├── legacy/ # Previous versions
└── docs/ # Documentation
chat_bot/
├── core/ # Core components
└── utils/ # Utility functions
- CSV-based task organization
- Interactive task selection
- Progress tracking
- Task completion persistence
- Structured file organization
- Multiple output formats
- Version control
- Metadata tracking
- Asynchronous client implementation
- Streaming response handling
- Context management
- Token counting
- Fork the repository
- Create a feature branch (
git checkout -b feature/AmazingFeature
) - Commit your changes (
git commit -m 'Add some AmazingFeature'
) - Push to the branch (
git push origin feature/AmazingFeature
) - Open a Pull Request
[Specify License]
- Ollama team for the excellent model framework
- Contributors and testers
- Open source community
Monty Craig - [Your Contact Info]
Project Link: https://github.com/MontyCraig/Ollama_Presentation