Skip to content

πŸ€– Mini-AutoGPT: A compact, Telegram-connected AI demonstrating the capabilities of local LLMs. Autonomous and experimental Proof of Concept

Notifications You must be signed in to change notification settings

Wladastic/mini_autogpt

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

7 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Mini-AutoGPT πŸ€–πŸš€

Welcome to the home of Mini-AutoGPT, the pocket-sized AI with the heart of a giant. Here to demonstrate that local LLMs can still rock your digital world, Mini-AutoGPT runs on pure Python 3.11 and communicates through the magic of python-telegram-bot. It's experimental, autonomous, and always ready to chatβ€”what more could you ask for in a desktop companion?

This Repository is mainly a demonstration for using local LLMs for fully autonomous AI. It is meant as a guide for readers of my Book "Unlocking the Power of Auto-GPT and Its Plugins"

This Repository is also a Preview of Sophie-AI, a fully autonomous AI that runs on your local machine and can be used for various tasks, which acomplishes more complex thoughts and tasks than Mini-AutoGPT.

Table of Contents πŸ“š

What's Cooking?

Mini-AutoGPT isn't just a stripped-down version of some monolithic AIβ€”it's your friendly neighborhood bot that lives right in your Telegram! It’s designed to be simple enough for anyone to tinker with, yet robust enough to handle the sophisticated needs of modern chat applications.

Due to the nature of local LLMs (3B, 4B, 7B, 8B etc.) being smaller than their cloud counterparts, Mini-AutoGPT is a great way to experiment with AI on your local machine without having to pay for cloud services.

Here's a sneak peek of its main ingredients:

  • Python 3.11: Fresh and powerful.
  • python-telegram-bot: Connects you directly to your users via Telegram.
  • Autonomy: Runs fully on its own, no hand-holding required.

Setup

To get started, you'll need:

  1. Python 3.11 installed on your machine.

  2. A Telegram bot token (get yours from @BotFather).

  3. Clone this repository and install dependencies:

    git clone https://github.com/yourusername/mini-autogpt.git
    cd mini-autogpt
    pip install -r requirements.txt
  4. Update the .env file with your Telegram bot token.

  5. Run any of those local LLM servers with API enabled:

    • LMStudio
    • oobabooga/textgeneration-webui
  6. Update .env file with the API URL of your local LLM.

LLM Models known to work with Mini-AutoGPT

  • Meta/LLama-3-8B-Instruct (preferable a variation with more context length)
  • NousResearch/Hermes-2-Pro-Mistral-7B
  • argilla/CapybaraHermes-2.5-Mistral-7B
  • Intel/neural-chat-7b-v3-1
  • Nexusflow/Starling-LM-7B-beta
  • mistralai/Mixtral-8x7B-Instruct-v0.1

Usage πŸ”§

Just run the script, and your bot will come to life:

./run.sh

or

python3.11 main.py

Experimental Notice πŸ§ͺ

Mini-AutoGPT is still experimental. It might get a little too excited and repeat what you say or surprise you with unexpected wisdom. Handle it with care and affection!

Contributing 🀝

Feel free to fork, star, and submit pull requests. Bugs can be reported in the issues section. Help Mini-AutoGPT learn the ways of this vast digital universe!

Mini-AutoGPT in Action 🎬

Here's a snippet of what to expect when you fire up Mini-AutoGPT:

                           
                                                 
                         β–‘β–“β–ˆβ–“β–‘β–‘                          
         β–’β–’β–’      β–ˆβ–ˆβ–‘ β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘ β–‘β–‘β–ˆβ–ˆβ–‘      β–’β–‘           
         β–’β–’β–’β–‘ β–‘β–ˆβ–‘β–‘β–’β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘     β–‘β–‘β–‘β–’ β–‘β–ˆ   β–‘β–’β–‘β–‘          
      β–’β–‘    β–‘β–ˆ β–’β–’β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–’β–’β–’ β–ˆ      β–‘β–’       
     β–‘β–’β–’β–‘  β–’β–‘β–’β–’β–’β–‘β–ˆβ–ˆβ–ˆβ–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–ˆβ–ˆβ–ˆβ–‘β–’β–’β–‘β–“β–‘  β–’β–’β–’β–‘β–’β–’     
      β–‘   β–’β–‘β–’β–’β–’β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–’β–’β–’β–‘    β–‘β–’       
          β–ˆβ–’β–’β–‘β–‘β–ˆβ–ˆβ–‘β–‘β–‘β–’β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–ˆβ–ˆβ–‘β–‘β–’β–’β–ˆ            
   β–’β–‘β–‘β–’  β–ˆβ–‘β–’β–’β–‘β–ˆβ–‘β–ˆβ–“β–‘   β–ˆβ–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–ˆ   β–ˆβ–’β–ˆβ–‘β–ˆβ–‘β–’β–’β–‘β–‘           
         β–ˆβ–‘β–’β–’β–ˆβ–‘β–ˆβ–ˆβ–ˆβ–ˆ   β–ˆβ–ˆβ–‘β–‘β–‘β–‘β–‘β–‘β–‘β–ˆβ–ˆ  β–‘β–ˆβ–ˆβ–ˆβ–ˆβ–‘β–ˆβ–’β–’β–‘β–ˆ  β–’β–‘β–‘β–’     
         β–ˆβ–‘β–’β–’β–ˆ β–ˆβ–“β–‘β–‘β–ˆβ–’β–‘β–“β–ˆβ–‘β–ˆβ–‘β–‘β–“β–“β–‘β–ˆβ–“β–‘β–ˆβ–ˆβ–‘β–ˆβ–“β–ˆ β–’β–’β–’β–‘β–‘    β–‘      
         β–‘β–ˆβ–’β–’β–’β–‘ β–“β–‘β–‘β–‘β–‘β–‘β–ˆβ–‘β–‘β–‘β–’β–’β–’β–‘β–‘β–‘β–ˆβ–‘β–‘β–‘β–‘β–“β–‘ β–‘β–’β–’β–‘β–ˆ            
    β–‘β–ˆβ–‘β–ˆβ–‘ β–‘β–ˆβ–’β–’β–’β–“β–’β–‘β–’β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–’β–“β–“β–’β–’β–’β–‘β–ˆ  β–’β–‘β–‘β–ˆβ–‘      
   β–ˆβ–‘β–‘β–‘β–ˆ    β–ˆβ–‘β–’β–’β–’β–’β–’β–’β–’β–’β–’β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–’β–’β–’β–’β–’β–’β–’β–’β–‘β–ˆ   β–‘β–ˆβ–‘β–‘β–‘β–ˆ     
   β–ˆβ–“β–’β–‘β–‘ β–ˆβ–ˆβ–ˆβ–ˆβ–“β–ˆβ–ˆβ–’β–’β–“β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–’β–“β–’β–’β–ˆβ–ˆβ–“β–ˆβ–ˆβ–ˆβ–ˆβ–‘β–‘β–‘β–’β–“β–ˆ     
   β–ˆβ–’β–’β–“β–’β–‘β–’β–’β–’β–’β–“β–ˆβ–“β–’β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–“β–’β–“β–ˆβ–’β–’β–’β–’β–’β–‘β–’β–“β–“β–’β–“     
    β–“β–’β–ˆβ–ˆβ–‘β–‘   β–‘β–‘β–‘β–‘β–‘β–‘β–“β–“β–’β–‘β–‘β–‘β–‘β–“β–“β–“β–‘β–‘β–‘β–‘β–’β–“β–“β–‘β–‘β–‘β–‘β–‘β–‘    β–‘β–ˆβ–ˆβ–’β–‘      
    β–ˆβ–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–’β–“β–ˆβ–‘β–’β–‘β–‘β–‘β–‘β–’β–“β–’β–‘β–‘β–‘β–‘β–’β–‘β–ˆβ–“β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–ˆ      
    β–ˆβ–“β–‘β–‘β–“β–“β–’β–’β–’β–ˆβ–‘β–‘β–‘β–‘β–‘β–ˆβ–‘β–‘β–‘β–‘β–‘β–’β–“β–“β–“β–’β–‘β–‘β–‘β–‘β–‘β–ˆβ–‘β–‘β–‘β–‘β–‘β–ˆβ–’β–’β–’β–’β–“β–‘β–‘β–’β–ˆ      
     β–ˆβ–ˆβ–ˆβ–‘β–‘β–“β–“β–ˆβ–’β–“β–’β–’β–’β–‘β–‘β–‘β–‘β–‘β–’β–’β–“β–’β–ˆβ–“β–“β–’β–‘β–‘β–‘β–‘β–‘β–‘β–’β–’β–“β–“β–’β–“β–“β–“β–‘β–‘β–“β–ˆβ–ˆ       
     β–‘β–‘β–‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–“β–’β–‘β–’β–’β–‘β–’β–’β–’β–’β–’β–’β–’β–ˆβ–‘β–ˆβ–“β–’β–’β–’β–’β–’β–’β–’β–’β–“β–’β–‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‘β–‘β–‘       
      β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–ˆβ–ˆβ–‘β–‘β–ˆβ–“β–‘β–’β–’β–‘β–ˆβ–‘β–‘β–‘β–‘β–‘β–ˆβ–‘β–ˆβ–‘β–‘β–ˆβ–’β–‘β–’β–ˆβ–ˆβ–‘β–‘β–‘β–‘β–‘β–‘β–‘         
             β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘                             
              

Hello my friend!
I am Mini-Autogpt, a small version of Autogpt for smaller llms.
I am here to help you and will try to contact you as soon as possible!

Note: I am still in development, so please be patient with me! <3

Forgetting everything...
My memory is empty now, I am ready to learn new things! 

*** I am thinking... ***

Mini-AutoGPT is the small bot with a big dream: to make LLMs accessible on your local machine. Join us in nurturing this tiny digital marvel!

Mini-AutoGPT: Small in size, big on personality. 🌟

License πŸ“œ

This project is licensed under the MIT License. For more information, please refer to the LICENSE file.

About

πŸ€– Mini-AutoGPT: A compact, Telegram-connected AI demonstrating the capabilities of local LLMs. Autonomous and experimental Proof of Concept

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages