Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce Segment Schema Publishing and Polling for Efficient Datasource Schema Building #4

Closed
wants to merge 114 commits into from

Commits on Aug 27, 2023

  1. move smc to coordinator

    findingrish committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    294556d View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Configuration menu
    Copy the full SHA
    d1c0dca View commit details
    Browse the repository at this point in the history
  2. minor change

    findingrish committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    a48d2fe View commit details
    Browse the repository at this point in the history
  3. Revert "refactor CoordinatorServerView"

    This reverts commit d1c0dca.
    findingrish committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    5e7756f View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. Configuration menu
    Copy the full SHA
    a9ff640 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. Configuration menu
    Copy the full SHA
    105bda9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3aad095 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Configuration menu
    Copy the full SHA
    14baf19 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    857f056 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Configuration menu
    Copy the full SHA
    95389b1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fb72888 View commit details
    Browse the repository at this point in the history
  3. minor change

    findingrish committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    bc8396c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    fbab4c8 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. Configuration menu
    Copy the full SHA
    151b0b1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8dbea5b View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. Configuration menu
    Copy the full SHA
    e630b9b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    17c3514 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f0baf33 View commit details
    Browse the repository at this point in the history
  4. Fix intellij inspections

    findingrish committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    f18c060 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    03383e6 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    dc6aa6e View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    e5c4b39 View commit details
    Browse the repository at this point in the history
  8. Add comments

    findingrish committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    45378d5 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    2327b12 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Configuration menu
    Copy the full SHA
    d4ece6a View commit details
    Browse the repository at this point in the history
  2. fix checkstyle issue

    findingrish committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    eb1771f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1440dac View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    10068b6 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    032734a View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    9a04173 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    80f4424 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    33a8dd5 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Add class to manage druid table information in SegmentMetadataCache, …

    …add javadocs for classes
    findingrish committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    7a7ca55 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    eb6a145 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    b9fb83d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    aa2bfe7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e97dcda View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    7badce1 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    25cdce6 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    5f5ad18 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Configuration menu
    Copy the full SHA
    08e949e View commit details
    Browse the repository at this point in the history
  2. Minor changes

    findingrish committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    80fc09d View commit details
    Browse the repository at this point in the history
  3. Minor change

    findingrish committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    4217cd8 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8b7e483 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d6ac350 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. Configuration menu
    Copy the full SHA
    533236b View commit details
    Browse the repository at this point in the history
  2. update the logic to determine is_active status in segments table for …

    …segment polled from coordiantor
    findingrish committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    70f0888 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a176bfe View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b32dfd6 View commit details
    Browse the repository at this point in the history
  5. Rename config druid.coordinator.segmentMetadataCache.enabled to druid…

    ….coordinator.centralizedSchemaManagement.enabled
    findingrish committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    17417b5 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. Configuration menu
    Copy the full SHA
    6a395a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Configuration menu
    Copy the full SHA
    907ace3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    cf68c38 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    441f37a View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Add auth check in api to return dataSourceInformation, report metrics…

    … for broker-coordinator communication
    findingrish committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    bd5b048 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    933d8d1 View commit details
    Browse the repository at this point in the history
  3. Minor change

    findingrish committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    9e7e364 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Configuration menu
    Copy the full SHA
    e7356ce View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2023

  1. Configuration menu
    Copy the full SHA
    5d16148 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d8884be View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0f0805a View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. Configuration menu
    Copy the full SHA
    e129d3e View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Configuration menu
    Copy the full SHA
    b4042c6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    01c27c9 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2023

  1. Remove QueryableCoordinatorServerView, add a new QuerySegmentWalker i…

    …mplementation for segment metadata queries on coordinator
    findingrish committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    87c9873 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    971b347 View commit details
    Browse the repository at this point in the history
  3. fix build

    findingrish committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    89d3845 View commit details
    Browse the repository at this point in the history
  4. fix build

    findingrish committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    270dbd5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    2da23b8 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    6f568a6 View commit details
    Browse the repository at this point in the history
  7. minor changes

    findingrish committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    fe229c0 View commit details
    Browse the repository at this point in the history
  8. Fix typo in metric name

    findingrish committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    473b25c View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2023

  1. Configuration menu
    Copy the full SHA
    39fb248 View commit details
    Browse the repository at this point in the history
  2. fix checkstyle issue

    findingrish committed Oct 15, 2023
    Configuration menu
    Copy the full SHA
    cac695a View commit details
    Browse the repository at this point in the history
  3. Changes in CliCoordinator to conditionally add segment metadata cache…

    … related modules instead of installing them
    findingrish committed Oct 15, 2023
    Configuration menu
    Copy the full SHA
    eb3e3c1 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Configuration menu
    Copy the full SHA
    30438f4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e88ad00 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    61d130b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    2e4c45b View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Configuration menu
    Copy the full SHA
    255cf2c View commit details
    Browse the repository at this point in the history
  2. Add IT for the feature

    findingrish committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    1a6dfc5 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a961501 View commit details
    Browse the repository at this point in the history
  4. Merge branch 'coordinator_builds_ds_schema' of github.com:findingrish…

    …/druid into coordinator_builds_ds_schema
    findingrish committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    2e65726 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. Changes in BrokerSegmentMetadataCache to poll schema for all the loca…

    …l datasources in each refresh cycle
    findingrish committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    4b51c42 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. Address review comments

    findingrish committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    a4e2097 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3ca03c9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    902abd3 View commit details
    Browse the repository at this point in the history
  4. Address feedback

    findingrish committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    bcab458 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    32a4065 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    6b04ee7 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    cb93e43 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    152c480 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Configuration menu
    Copy the full SHA
    80c6d26 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2023

  1. Configuration menu
    Copy the full SHA
    9cca98e View commit details
    Browse the repository at this point in the history
  2. Minor changes

    findingrish committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    bb69cde View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. Configuration menu
    Copy the full SHA
    a604e65 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f2d8a5e View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. Configuration menu
    Copy the full SHA
    37ac4a7 View commit details
    Browse the repository at this point in the history
  2. fix conflicts

    findingrish committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    629f3ad View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    af34c34 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    4a4f1b0 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. Initial commit

    findingrish committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    b142b29 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. Outline

    findingrish committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    035a884 View commit details
    Browse the repository at this point in the history
  2. Revert some changes

    findingrish committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    7935349 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    26ee22f View commit details
    Browse the repository at this point in the history
  4. minor changes

    findingrish committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    1555592 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    ccd2c42 View commit details
    Browse the repository at this point in the history
  6. Minor changes

    findingrish committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    900dad5 View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2024

  1. Configuration menu
    Copy the full SHA
    45423fc View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. Configuration menu
    Copy the full SHA
    33cfb75 View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2024

  1. Configuration menu
    Copy the full SHA
    6c7e0d5 View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2024

  1. Update schema table

    findingrish committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    85594a7 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. Fix build

    findingrish committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    72f671c View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. Changes to publish realtime segment schema, poll, cache and use it fo…

    …r building table schema
    findingrish committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    ecc8fc4 View commit details
    Browse the repository at this point in the history