Code

feat: Pre-Fetch Streamer Messages#269

Code

Merged

darunrs merged 24 commits intomainnear/queryapi:mainfrom cacheHistoricalnear/queryapi:cacheHistoricalCopy head branch name to clipboardNov 8, 2023

+545-488

Commits

Commits on Nov 8, 2023

• MVP of Pre Fetching Historical

  darunrs

  committed
  bddfd0e

  Copy full SHA for bddfd0e

• Implement producer and consumer loops

  darunrs

  committed
  1160091

  Copy full SHA for 1160091

• Updates to allow for test metrics without deleting messages

  darunrs

  committed
  a555058

  Copy full SHA for a555058

• Add some metrics for more testing

  darunrs

  committed
  79374f9

  Copy full SHA for 79374f9

• Migrated S3 code to new class

  darunrs

  committed
  c897125

  Copy full SHA for c897125

• Add more Instrumentation

  darunrs

  committed
  cd0d2e5

  Copy full SHA for cd0d2e5

• Clean up code

  darunrs

  committed
  9d17c22

  Copy full SHA for 9d17c22

• Encapsulate streamer message builder function

  darunrs

  committed
  b790af1

  Copy full SHA for b790af1

• Ensure Unit Tests Pass

  darunrs

  committed
  e3a3869

  Copy full SHA for e3a3869

• Undo local testing changes

  darunrs

  committed
  c32290f

  Copy full SHA for c32290f

• Address Offline Comments

  darunrs

  committed
  4041869

  Copy full SHA for 4041869

• Implement Morgan's Metrics Fix

  darunrs

  committed
  607cd37

  Copy full SHA for 607cd37

• Prepare Code for PR

  darunrs

  committed
  a0ab89b

  Copy full SHA for a0ab89b

• Complete Lake Client Tests

  darunrs

  committed
  044dd27

  Copy full SHA for 044dd27

• Finalize Metrics for PR

  darunrs

  committed
  00132ab

  Copy full SHA for 00132ab

• Tune parameters for waiting

  darunrs

  committed
  6321526

  Copy full SHA for 6321526

• Address unit test failures

  darunrs

  committed
  0e3e26e

  Copy full SHA for 0e3e26e

• Perform Block conversion in Lake Client and address cleanliness comments

  darunrs

  committed
  b155dc3

  Copy full SHA for b155dc3

• Remove Unrelated Metrics

  darunrs

  committed
  1aa3627

  Copy full SHA for 1aa3627

• Eliminate Global Variables and Clean Up Code

  darunrs

  committed
  b050e4c

  Copy full SHA for b050e4c

• Experiment with Blocking

  darunrs

  committed
  7847eb0

  Copy full SHA for 7847eb0

• Address More Comments

  darunrs

  committed
  43911fd

  Copy full SHA for 43911fd

• Undo Blocking for XRead

  darunrs

  committed
  19e9406

  Copy full SHA for 19e9406

• Fix failing tests

  darunrs

  committed
  6cb07b1

  Copy full SHA for 6cb07b1