Local Ledger Deployment

[shiqizng]

Summary

This PR adds a simple migration process for local ledger. Migration completes when latest round in ledger matches the round in postgres db. Indexer exits with code 1 if SIGTERM or SIGINT is received during the migration. When indexer restarts, ledger migration continues from round ledger.latest()+1.

Test Plan

Unit tests for the core migration logic in RunMigration. Run a migration on a remote server using a mainnet db snapshot.

[codecov]

Codecov Report

❗ No coverage uploaded for pull request base (localledger/integration@12f8c2f). Click here to learn what that means.
The diff coverage is n/a.

@@                    Coverage Diff                     @@
##             localledger/integration    #1013   +/-   ##
==========================================================
  Coverage                           ?   59.54%           
==========================================================
  Files                              ?       47           
  Lines                              ?     8654           
  Branches                           ?        0           
==========================================================
  Hits                               ?     5153           
  Misses                             ?     3017           
  Partials                           ?      484           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 12f8c2f...7dd1d65. Read the comment docs.

[winder]

This looks like it should work. I think it's diverged a little from the first PR.

[winder]

Technically AlgodDataDir resolves to AlgodToken / AlgodAddr, so we could remove AlgodDataDir.

[shiqizng]

I thought both were needed since there are 2 ways for the fetcher to create an algod client,

indexer/idb/postgres/internal/migrations/local_ledger/migration.go

Lines 50 to 63 in df6bcb6

	// create algod client
	if opts.AlgodDataDir != "" {
	bot, err = fetcher.ForDataDir(opts.AlgodDataDir, logger)
	if err != nil {
	return fmt.Errorf("RunMigration() err: %w", err)
	}
	} else if opts.AlgodAddr != "" && opts.AlgodToken != "" {
	bot, err = fetcher.ForNetAndToken(opts.AlgodAddr, opts.AlgodToken, logger)
	if err != nil {
	return fmt.Errorf("RunMigration() err: %w", err)
	}
	} else {
	return fmt.Errorf("RunMigration() err: unable to create algod client")
	}

[winder]

The ForDataDir would do something like resolve the address/token and then call ForNetAndToken

[winder]

LGTM