LIbreChat One click installation

[ctwhome]

@andrasbacsai and @danny-avila It would be awesome to have the LibreChat template running here. https://www.librechat.ai/
It allows to use almost any common LLM with user managment, custom promts.. etc.

There is a docker-compose with .env files but i can't get it to work as seen in this discussion.

Many thanks!

[sarvesh-astrophile]

Yes, can you help we are struggling to deploy it. Let me know if you want specific details

[afaraha8403]

Having the same issue here! Would be amazing to add this as a template...

[chymian]

@sarvesh-astrophile and @afaraha8403
guys, did you succeed and can share a how to?

[sarvesh-astrophile]

use the hugging face still facing the issue

[stewnight]

It's not perfect, but I was able to get a few features working in a single docker-compose. Librechat is running and all, working with ChatGPT, I just need to do further testing for RAG, web search etc - But am running out of time, so sharing in case it helps:

services:
  librechat:
    image: ghcr.io/danny-avila/librechat-dev:latest
    restart: always
    user: "${UID:-1000}:${GID:-1000}"
    environment:
      - HOST=0.0.0.0
      - PORT=3080
      - DOMAIN_CLIENT=http://localhost:3080
      - DOMAIN_SERVER=http://localhost:3080
      - SERVICE_FQDN_LIBRECHAT_3080
      - MONGO_URI=mongodb://mongodb:27017/LibreChat
      - MEILI_HOST=http://meilisearch:7700
      - MEILI_NO_ANALYTICS=true
      - MEILI_MASTER_KEY=${MEILI_MASTER_KEY}
      - RAG_PORT=${RAG_PORT:-8000}
      - RAG_API_URL=http://rag_api:${RAG_PORT:-8000}
      - DEBUG_LOGGING=true
      - NO_INDEX=true
      - ALLOW_EMAIL_LOGIN=true
      - ALLOW_REGISTRATION=true
      - ALLOW_SOCIAL_LOGIN=false
      - ALLOW_SOCIAL_REGISTRATION=false
      - ALLOW_PASSWORD_RESET=false
      - ALLOW_UNVERIFIED_EMAIL_LOGIN=true
      - JWT_SECRET=16f8c0ef4a5d391b26034086c628469d3f9f497f08163ab9b40137092f2909ef
      - JWT_REFRESH_SECRET=eaa5191f2914e30b9387fd84e254e4ba6fc51b4654968a9b0803b456a54b8418
      - CREDS_KEY=f34be427ebb29de8d88c107a71546019685ed8b241d8f2ed00c3df97ad2566f0
      - CREDS_IV=e2341419ec3dd3d19b13a1a87fafcbfb
      - SEARCH=true
      - APP_TITLE=LibreChat
      - OPENAI_API_KEY=user_provided
      - ANTHROPIC_API_KEY=user_provided
      - GOOGLE_KEY=user_provided
      - BINGAI_TOKEN=user_provided
      - ASSISTANTS_API_KEY=user_provided
      - MISTRAL_API_KEY=user_provided
      - GROQ_API_KEY=user_provided
      - PERPLEXITY_API_KEY=user_provided
      - ANYSCALE_API_KEY=user_provided
      - TOGETHERAI_API_KEY=user_provided
      - DEEPSEEK_API_KEY=user_provided
    volumes:
      - librechat-api-images:/app/client/public/images
      - librechat-api-logs:/app/api/logs
  mongodb:
    image: "docker.io/bitnami/mongodb:5.0"
    volumes:
      - "mongodb-data:/bitnami/mongodb"
    environment:
      - MONGODB_REPLICA_SET_MODE=primary
      - "MONGODB_REPLICA_SET_NAME=${MONGODB_REPLICA_SET_NAME:-rs0}"
      - "MONGODB_PORT_NUMBER=${MONGODB_PORT_NUMBER:-27017}"
      - "MONGODB_INITIAL_PRIMARY_HOST=${MONGODB_INITIAL_PRIMARY_HOST:-mongodb}"
      - "MONGODB_INITIAL_PRIMARY_PORT_NUMBER=${MONGODB_INITIAL_PRIMARY_PORT_NUMBER:-27017}"
      - "MONGODB_ADVERTISED_HOSTNAME=${MONGODB_ADVERTISED_HOSTNAME:-mongodb}"
      - "MONGODB_ENABLE_JOURNAL=${MONGODB_ENABLE_JOURNAL:-true}"
      - "ALLOW_EMPTY_PASSWORD=${ALLOW_EMPTY_PASSWORD:-yes}"
    healthcheck:
      test: "echo 'db.stats().ok' | mongo localhost:27017/test --quiet"
      interval: 2s
      timeout: 10s
      retries: 15

  meilisearch:
    image: "getmeili/meilisearch:latest"
    environment:
      - SERVICE_FQDN_MEILISEARCH_7700
      - "MEILI_NO_ANALYTICS=${MEILI_NO_ANALYTICS:-true}"
      - "MEILI_ENV=${MEILI_ENV:-production}"
      - "MEILI_MASTER_KEY=${SERVICE_PASSWORD_MEILISEARCH}"
    volumes:
      - "meilisearch-data:/meili_data"
    restart: always
    healthcheck:
      test:
        - CMD
        - curl
        - "-f"
        - "http://127.0.0.1:7700/health"
      interval: 2s
      timeout: 10s
      retries: 15

  vectordb:
    image: ankane/pgvector:latest
    environment:
      POSTGRES_DB: mydatabase
      POSTGRES_USER: myuser
      POSTGRES_PASSWORD: mypassword
    restart: always
    volumes:
      - pgdata2:/var/lib/postgresql/data

  rag_api:
    image: ghcr.io/danny-avila/librechat-rag-api-dev-lite:latest
    environment:
      - DB_HOST=vectordb
      - RAG_PORT=${RAG_PORT:-8000}
      - OPENAI_API_KEY=user_provided
    restart: always
    depends_on:
      - vectordb

volumes:
  librechat-api-images:
  librechat-api-logs:
  mongodb-data:
  meilisearch-data:
  pgdata2:

Please use https://www.librechat.ai/toolkit/creds_generator to generator random keys.

I will be adding ollama to this docker file for self hosted models too.
Please let me know if there is anything I should be changing. Prob don't need meilisearch's FQDN, but I just copied from the default one-click install for the time.

[stewnight]

Made a few changes so that it is tidier inside of Coolify, I was able to create this as a new project and running it without problems after adding the creds keys. Moved all AI model keys to be a environment variable, defaulting to user provided keys. Just for ease of use.

So the only Environment variables you need to fill out are the ones you can generate here: https://www.librechat.ai/toolkit/creds_generator

I also removed the URL from meilisearch.
The only changes that might be worthy is using ${SERVICE_PASSWORD_CRED_KEY} etc so that the keys show on the Service Stack tab of Coolify to make it more obvious - but I'd say @andrasbacsai can auto generate the keys if this does become a One Click install. I'm not very familiar yet with the default coolify variables.

Here is the latest docker-compose:

services:
  librechat:
    image: ghcr.io/danny-avila/librechat-dev:latest
    restart: always
    user: "1000:1000"
    environment:
      - HOST=0.0.0.0
      - PORT=3080
      - DOMAIN_CLIENT=http://localhost:3080
      - DOMAIN_SERVER=http://localhost:3080
      - SERVICE_FQDN_LIBRECHAT_3080
      - MONGO_URI=mongodb://mongodb:27017/LibreChat
      - MEILI_HOST=http://meilisearch:7700
      - MEILI_NO_ANALYTICS=true
      - MEILI_MASTER_KEY=${MEILI_MASTER_KEY}
      - RAG_PORT=8000
      - RAG_API_URL=http://rag_api:8000
      - DEBUG_LOGGING=true
      - NO_INDEX=true
      - ALLOW_EMAIL_LOGIN=${ALLOW_EMAIL_LOGIN:-true}
      - ALLOW_REGISTRATION=${ALLOW_REGISTRATION:-true}
      - ALLOW_SOCIAL_LOGIN=${ALLOW_SOCIAL_LOGIN:-false}
      - ALLOW_SOCIAL_REGISTRATION=${ALLOW_SOCIAL_REGISTRATION:-false}
      - ALLOW_PASSWORD_RESET=${ALLOW_PASSWORD_RESET:-false}
      - ALLOW_UNVERIFIED_EMAIL_LOGIN=${ALLOW_UNVERIFIED_EMAIL_LOGIN:-true}
      - JWT_SECRET=${JWT_SECRET}
      - JWT_REFRESH_SECRET=${JWT_REFRESH_SECRET}
      - CREDS_KEY=${CREDS_KEY}
      - CREDS_IV=${CREDS_IV}
      - SEARCH=true
      - APP_TITLE=${APP_TITLE:-LibreChat}
      - OPENAI_API_KEY=${OPENAI_API_KEY:-user_provided}
      - ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY:-user_provided}
      - GOOGLE_KEY=${GOOGLE_KEY:-user_provided}
      - BINGAI_TOKEN=${BINGAI_TOKEN:-user_provided}
      - ASSISTANTS_API_KEY=${ASSISTANTS_API_KEY:-user_provided}
      - MISTRAL_API_KEY=${MISTRAL_API_KEY:-user_provided}
      - GROQ_API_KEY=${GROQ_API_KEY:-user_provided}
      - PERPLEXITY_API_KEY=${PERPLEXITY_API_KEY:-user_provided}
      - ANYSCALE_API_KEY=${ANYSCALE_API_KEY:-user_provided}
      - TOGETHERAI_API_KEY=${TOGETHERAI_API_KEY:-user_provided}
      - DEEPSEEK_API_KEY=${DEEPSEEK_API_KEY:-user_provided}
    volumes:
      - librechat-api-images:/app/client/public/images
      - librechat-api-logs:/app/api/logs
  mongodb:
    image: "docker.io/bitnami/mongodb:5.0"
    volumes:
      - "mongodb-data:/bitnami/mongodb"
    environment:
      - MONGODB_REPLICA_SET_MODE=primary
      - "MONGODB_REPLICA_SET_NAME=rs0"
      - "MONGODB_PORT_NUMBER=27017"
      - "MONGODB_INITIAL_PRIMARY_HOST=mongodb"
      - "MONGODB_INITIAL_PRIMARY_PORT_NUMBER=27017"
      - "MONGODB_ADVERTISED_HOSTNAME=mongodb"
      - "MONGODB_ENABLE_JOURNAL=${MONGODB_ENABLE_JOURNAL:-true}"
      - "ALLOW_EMPTY_PASSWORD=${ALLOW_EMPTY_PASSWORD:-yes}"
    healthcheck:
      test: "echo 'db.stats().ok' | mongo localhost:27017/test --quiet"
      interval: 2s
      timeout: 10s
      retries: 15

  meilisearch:
    image: "getmeili/meilisearch:latest"
    environment:
      - "MEILI_NO_ANALYTICS=${MEILI_NO_ANALYTICS:-true}"
      - "MEILI_ENV=production"
      - "MEILI_MASTER_KEY=${MEILI_MASTER_KEY}"
    volumes:
      - "meilisearch-data:/meili_data"
    restart: always
    healthcheck:
      test:
        - CMD
        - curl
        - "-f"
        - "http://127.0.0.1:7700/health"
      interval: 2s
      timeout: 10s
      retries: 15

  vectordb:
    image: ankane/pgvector:latest
    environment:
      POSTGRES_DB: mydatabase
      POSTGRES_USER: myuser
      POSTGRES_PASSWORD: mypassword
    restart: always
    volumes:
      - pgdata2:/var/lib/postgresql/data

  rag_api:
    image: ghcr.io/danny-avila/librechat-rag-api-dev-lite:latest
    environment:
      - DB_HOST=vectordb
      - RAG_PORT=8000
      - OPENAI_API_KEY=${OPENAI_API_KEY:-user_provided}
    restart: always
    depends_on:
      - vectordb

volumes:
  librechat-api-images:
  librechat-api-logs:
  mongodb-data:
  meilisearch-data:
  pgdata2:

Again, please correct me where I'm wrong as I'm still learning. I just hope this helps :)

[ClickSnd]

Really helpful, just noting that I cant seem to get RAG to work right, so chats cant read txt files

Update:
I added a few things
environment:
- HOST=0.0.0.0
- PORT=3080
- DOMAIN_CLIENT=http://localhost:3080
- DOMAIN_SERVER=http://localhost:3080
- SERVICE_FQDN_LIBRECHAT_3080
- MONGO_URI=mongodb://mongodb:27017/LibreChat
- MEILI_HOST=http://meilisearch:7700
- MEILI_NO_ANALYTICS=true
- MEILI_MASTER_KEY=${MEILI_MASTER_KEY}
- RAG_PORT=8000
- RAG_API_URL=http://rag_api:8000
- DEBUG_LOGGING=true
- NO_INDEX=true.... and so on until

  rag_api:
image: ghcr.io/danny-avila/librechat-rag-api-dev-lite:latest
environment:
  - DB_HOST=vectordb
  - RAG_PORT=${RAG_PORT:-8000}
  - RAG_API_URL=http://rag_api:${RAG_PORT:-8000}
  - OPENAI_API_KEY=sk....
  
  For my env variables
  RAG_API_URL=http://host.docker.internal:8000
  RAG_OPENAI_API_KEY=sk....
  EMBEDDINGS_PROVIDER=openai
  EMBEDDINGS_MODEL=text-embedding-3-small
  
  I pasted my open AI key everywhere. I also   made sure there were a couple dollars in my openAI fund. 
  
  And there you go, LibreChat working in Coolify

[akilicarslan]

Perfect conversation, thanks for everyone's helping here!