Skip to content

Large Language Model with pytorch, fastapi and vector databases

Notifications You must be signed in to change notification settings

tomaszbk/LLM-RAG-Chatbot

Repository files navigation

NLP Discord Chatbot using RAG Architecture

Introduction

This is a simple chatbot that uses the RAG architecture to answer questions. Every prompt is used to retrieve context from a vector database, and the answer is generated using the retrieved context and the question.

Currently uses llama3

Made with

  • Python (Fastapi, Pytorch, Hugging face Transformers)
  • Chroma vector database
  • Docker

About

Large Language Model with pytorch, fastapi and vector databases

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published