Skip to content
This repository has been archived by the owner on Oct 18, 2023. It is now read-only.

bottomless: add read-only replicas that read from S3 #324

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Commits on Apr 7, 2023

  1. bottomless: add read-only replicas that read from S3

    This commit adds support for using bottomless in "read-only replica"
    mode. In this mode, all data is read exclusively from S3
    and nothing gets restored to disk.
    
    FIXME: it also contains a terrible, terrible hack in order
    to work - on startup, the first page of the database is restored
    from S3, and the database file is truncated to match the original
    DB size, thus making libSQL think it's a properly structured
    database file. After that, all data is read only from S3.
    
    A proper solution is to ship bottomless WAL with a bottomless VFS
    implementation - with the VFS set up to read pages from S3.
    Effectively, it will only ever read the first db page from there,
    and from then on it will just read everything from S3.
    psarna committed Apr 7, 2023
    Configuration menu
    Copy the full SHA
    41e7e8c View commit details
    Browse the repository at this point in the history