Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add min/max range of the event.ingested field to cluster state for searchable snapshots #106252

Merged
merged 124 commits into from
Jun 26, 2024
Merged

Add min/max range of the event.ingested field to cluster state for searchable snapshots #106252

merged 124 commits into from
Jun 26, 2024

Commits on Mar 13, 2024

  1. Add event.ingested min/max to cluster state for searchable snapshots

    @quux00
    quux00 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    f4b397c View commit details
    Browse the repository at this point in the history

  2. Added DateFieldRange to CoordinatorRewriteContext and field names to … 

    …each method on that class
    @quux00
    quux00 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    a2d8fb8 View commit details
    Browse the repository at this point in the history

  3. Changed mappingSupplier in CoordinatorRewriteContextProvider to take … 

    …Map<String, DateFieldMapper.DateFieldType>>
    @quux00
    quux00 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    0f424ba View commit details
    Browse the repository at this point in the history

  4. ShardStateAction now supports eventIngestedRange (no new tests however) 

    ShardStateAction.execute updates eventIngestedRange
and StartedShardEntry now has ShardLongFieldRange eventIngestedRange
but it is not yet populated (set to UNKNOWN) - addressed in next commit
    @quux00
    quux00 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    f5f6365 View commit details
    Browse the repository at this point in the history

  5. Added eventIngestedRange to ShardStateAction constructor and all knoc… 

    …k-on changes related.

No testing against eventIngestedRange yet.
Also see now that I need to add eventIngested support to RecoveryListener.onRecoveryDone intf
    @quux00
    quux00 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    1b238cc View commit details
    Browse the repository at this point in the history

  6. Added eventIngestedMillisFieldRange to onRecoveryDone 

    Next need to implement getEventIngestedRange on concrete impls of
IndicesClusterStateService.Shard interface
    @quux00
    quux00 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    5f5cfee View commit details
    Browse the repository at this point in the history

  7. Implement getEventIngestedRange on concrete impls of IndicesClusterSt… 

    …ateService.Shard interface
    @quux00
    quux00 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    7aa4b20 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    72eda9e View commit details
    Browse the repository at this point in the history

  2. Added IT tests for event.ingested. SearchableSnapshot based tests are… 

    … failing
    @quux00
    quux00 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    c9cae37 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    156f8b2 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. Uncommented failing line in SearchableSnapshotsCanMatchOnCoordinatorI… 

    …ntegTests
    @quux00
    quux00 committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    126eb4d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    d236bc6 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    db29f51 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    a298958 View commit details
    Browse the repository at this point in the history

  2. Added missing this.eventIngestedRange = indexMetadata.eventIngestedRa… 

    …nge; to IndexMetadata.Builder

Removed null checks in IndexMetadata
Added eventIngestedRangeInfo to AbstractBuilderTestCase
    @quux00
    quux00 committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    bd72a91 View commit details
    Browse the repository at this point in the history

  3. Fixed logic error in SearchableSnapshotsCanMatchOnCoordinatorIntegTests 

    Added reading/writing of event.ingested in serialization code of static IndexMetadata.readFrom method and writeTo method
    @quux00
    quux00 committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    5f2b747 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    3f01e60 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. Changed from hardcoded "event.ingested" to IndexMetadata.EVENT_INGEST… 

    …ED_FIELD_NAME

Updated javadoc in CoordinatorRewriteContext
    @quux00
    quux00 committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    932c4e9 View commit details
    Browse the repository at this point in the history

  2. Updated javadoc. Improved SearchableSnapshotsCanMatchOnCoordinatorInt… 

    …egTests.

One test seed that consistently fails with this code:
./gradlew -p x-pack/plugin/frozen-indices internalClusterTest --tests "org.elasticsearch.index.engine.frozen.FrozenIndexIT.testTimestampFieldTypeExposedByAllIndicesServices" -Dtests.seed=93869665C2B3B240
    @quux00
    quux00 committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    99969dd View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    3121bbb View commit details
    Browse the repository at this point in the history

  2. Changes to ShardStateAction, based on PR feedback. 

    ShardStartedClusterStateTaskExecutor.execute now checks min
transport version against TransportVersions.EVENT_INGESTED_RANGE_IN_CLUSTER_STATE
before assigning a value to the event.ingested range. If min version is not met, then
event.ingested range is set to UNKNOWN.
    @quux00
    quux00 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    6750f11 View commit details
    Browse the repository at this point in the history

  3. event.ingested added to from/toXContent of IndexMetadata 

    Unfortunately this now causes tests that were passing to fail. Proper solution for this not yet known.
    @quux00
    quux00 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    5c178e6 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Removed TODO

    @quux00
    quux00 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    3ed1913 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    e987c60 View commit details
    Browse the repository at this point in the history

  2. Hardcoded index=true in SearchableSnapshotsIntegTests to get help deb… 

    …ugging why the test fails
    @quux00
    quux00 committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    d259e7d View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Fixed minor assert bug in ShardStateAction around event.ingested. Upd… 

    …ated javadocs in ShardStateAction
    @quux00
    quux00 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    4dbb5cf View commit details
    Browse the repository at this point in the history

  2. Added eventIngestedRange to RestoreService

    @quux00
    quux00 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    08155b8 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    d4d62a7 View commit details
    Browse the repository at this point in the history

  4. Fixed ClusterStateTests

    @quux00
    quux00 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    238987d View commit details
    Browse the repository at this point in the history

  5. Fixed typo in ClusterStateTests

    @quux00
    quux00 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    4438c18 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    227989f View commit details
    Browse the repository at this point in the history

  2. Fixed additional tests

    @quux00
    quux00 committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    974e452 View commit details
    Browse the repository at this point in the history

  3. Fixed ShardStartedClusterStateTaskExecutorTests to pass

    @quux00
    quux00 committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    1dfe9e7 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    9bcd395 View commit details
    Browse the repository at this point in the history

  2. Fixed failing FrozenIndexIT test by adding event.ingested handling to… 

    … MetadataIndexStateService, which was missed in earlier passes
    @quux00
    quux00 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    d36e212 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    2e84f81 View commit details
    Browse the repository at this point in the history

  4. Added new test in FrozenIndexIT

    @quux00
    quux00 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    7cd7863 View commit details
    Browse the repository at this point in the history

  5. Added event.ingested to ShardStartedClusterStateTaskExecutorTests; ge… 

    …neral clean up for initial review
    @quux00
    quux00 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    ed31a88 View commit details
    Browse the repository at this point in the history

  6. Update docs/changelog/106252.yaml

    @quux00
    quux00 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    9d2c94b View commit details
    Browse the repository at this point in the history

  7. Fixed changelog added by GitHub

    @quux00
    quux00 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    0d0200a View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    d728a9d View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    079900d View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    d7bad67 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    c83b940 View commit details
    Browse the repository at this point in the history

  2. Removed assert in ShardStateAction that requires event.ingested to ha… 

    …ve a complete timestamp range
    @quux00
    quux00 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    f2b3631 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    939fb0e View commit details
    Browse the repository at this point in the history

  4. Added logging around assert in ShardStateAction that causes bwc error… 

    …s to help debug cause of test failures
    @quux00
    quux00 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    9da8f8d View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    e7aeb7d View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Changed assert to include IndexLongFieldRange.UNKNOWN to see if that … 

    …allows bwc tests to pass
    @quux00
    quux00 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    5fc0867 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    108a903 View commit details
    Browse the repository at this point in the history

  3. Fixed compile error in SearchableSnapshotsCanMatchOnCoordinatorIntegT… 

    …ests and corrected log message in ShardStateAction for bwc testing
    @quux00
    quux00 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    163326a View commit details
    Browse the repository at this point in the history

  4. Added logging to help debug bwc tests

    @quux00
    quux00 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    1dd1aa4 View commit details
    Browse the repository at this point in the history

  5. Modified temp logging in ShardStateAction to debug failing bwc tests

    @quux00
    quux00 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    13da015 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    928a798 View commit details
    Browse the repository at this point in the history

  7. Additional temp logging to determine where NO_SHARDS is coming from f… 

    …or event.ingested in bwc tests
    @quux00
    quux00 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    9c9ecdf View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    3ac9638 View commit details
    Browse the repository at this point in the history

  2. Additional logging added for debugging bwc tests

    @quux00
    quux00 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    1048a1c View commit details
    Browse the repository at this point in the history

  3. eventIngestedRange = IndexLongFieldRange.UNKNOWN is default in IndexM… 

    …etadata to see if that allows bwc tests to pass
    @quux00
    quux00 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    3bd5830 View commit details
    Browse the repository at this point in the history

  4. Setting IndexLongFieldRange.UNKNOWN in IndexMetadata readFrom and ass… 

    …erts for UNKNOWN in writeTo methods
    @quux00
    quux00 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    caf9ba2 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Removed 'assert eventIngestedRange == IndexLongFieldRange.UNKNOWN' fr… 

    …om IndexMetadata to see if bwc tests pass
    @quux00
    quux00 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    96a464f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    626332a View commit details
    Browse the repository at this point in the history

  3. Setting IndexLongFieldRange.UNKNOWN in IndexMetadata.fromXContent as … 

    …default; removed debugging logging
    @quux00
    quux00 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    701f7cf View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Additional logging to debug failing mixed-cluster tests; Uncommented … 

    …assert for event.ingested==UNKNOWN
    @quux00
    quux00 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    0cd7a3d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    f2eee89 View commit details
    Browse the repository at this point in the history

  3. Updated TransportVersions

    @quux00
    quux00 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    cba746d View commit details
    Browse the repository at this point in the history

  4. Stable point for new test testEventIngestedRangeInSearchAgainstSearch… 

    …ableSnapshotShards; needs cleanup
    @quux00
    quux00 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    a3b7518 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Trying to set UNKNOWN for event.ingested in apply of IndexMetadataDif… 

    …f to see if that works for mixed-cluster tests
    @quux00
    quux00 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    31eab55 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    0487748 View commit details
    Browse the repository at this point in the history

  3. Finalized new test in SearchableSnapshotsCanMatchOnCoordinatorIntegTe… 

    …sts for event.ingested; passing
    @quux00
    quux00 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    c2755f4 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Set eventIngestedRange=UNKNOWN in MetadataCreateIndexService if min t… 

    …ransport version before EVENT_INGESTED_RANGE_IN_CLUSTER_STATE

Hoping this fixes the index creation test failures in mixed-cluster tests.

Also added new tests for testing the new logic in CoordinatorRewriteContextProvider.getCoordinatorRewriteContext
which was changed in previous commit
    @quux00
    quux00 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    18da177 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    43d0a9d View commit details
    Browse the repository at this point in the history

  3. Fix checkstyle issue

    @quux00
    quux00 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    a5b5cf8 View commit details
    Browse the repository at this point in the history

  4. Added min transport version check to MetadataIndexStateService

    @quux00
    quux00 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    3c3256d View commit details
    Browse the repository at this point in the history

  5. Added min transport version check to RestoreService

    @quux00
    quux00 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    9d4c75f View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Added min transport version check for setting UNKNOWN in MetadataInde… 

    …xStateService
    @quux00
    quux00 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    e970e94 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    1071eda View commit details
    Browse the repository at this point in the history

  3. Finished new tests in CanMatchPreFilterSearchPhaseTests

    @quux00
    quux00 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    660be67 View commit details
    Browse the repository at this point in the history

  4. Cleanup and some minor test tweaks to ready this for review

    @quux00
    quux00 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    faf8a7d View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    7b2b9b1 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    ae97028 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    5c888ac View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    25efcaf View commit details
    Browse the repository at this point in the history

  2. Reverted 10 files back to main in order to focus this PR on just chan… 

    …ges to cluster state (adding event.ingested range).

Changes reverted were around the search can-match Coordinator rewrite logic using the new event.ingested range
and associated tests. Those will be added in a follow-on PR.
    @quux00
    quux00 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    7bfe3f9 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 17, 2024
    Configuration menu
    Copy the full SHA
    4dcfea5 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    b9dbb97 View commit details
    Browse the repository at this point in the history

  2. Init PR feedback changes

    @quux00
    quux00 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    4babaf4 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    cf0ff77 View commit details
    Browse the repository at this point in the history

  2. First batch of changes based on PR feedback 

    Added assert for eventIngestedRange != null in IndexMetadata
Simplified/collated logic for setting eventIngestedRange in MetadataIndexStateService
New test added ShardStateActionTests to test serialization against older versions
    @quux00
    quux00 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    ccd11d9 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    0846cb5 View commit details
    Browse the repository at this point in the history

  2. PR feedback: added test to MetadataCreateIndexServiceTests, building … 

    …IndexMetadata with older TransportVersions
    @quux00
    quux00 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    282170d View commit details
    Browse the repository at this point in the history

  3. Init versions of two new tests to ClusterSerializationTests

    @quux00
    quux00 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    5fb26b8 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    4737c23 View commit details
    Browse the repository at this point in the history

  5. Added eventIngested to IndexMetadataTests.testIndexMetadataSerialization

    @quux00
    quux00 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    5b1e47b View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    0b3f6d5 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Improved several tests based on PR feedback

    @quux00
    quux00 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    56e4d1a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    9121b0f View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    48d165a View commit details
    Browse the repository at this point in the history

  2. Added minTransportVersion to IndexMetadata.withTimestampRanges in ord… 

    …er to keep mixed-clusters with UNKNOWN for event.ingested range
    @quux00
    quux00 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    0e69ac3 View commit details
    Browse the repository at this point in the history

  3. Fix ReactiveStorageDeciderServiceTests to compile with new signature … 

    …for updateMetadataWithRoutingChanges method
    @quux00
    quux00 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    861d6c8 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Changed IndexMetadata.Builder.eventIngestedRange to take in minCluste… 

    …rTransportVersion. Unfortunately not all callers know it.
    @quux00
    quux00 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    11dca2a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    ad69ea2 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    1b8fa73 View commit details
    Browse the repository at this point in the history

  2. PR changes: Get minTransportVersion from instance var in AllocationSe… 

    …rvice
    @quux00
    quux00 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    66528b3 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    93d368a View commit details
    Browse the repository at this point in the history

  2. PR feedback; ShardStateActionTests asserts for eventIngestedRange; re… 

    …moved unneeded code comments
    @quux00
    quux00 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    10de812 View commit details
    Browse the repository at this point in the history

  3. Added minClusterTransportVersion to XContentParserConfiguration and (… 

    …some versions of) XContentParser.

This allows several more tests to pass with the new assert in IndexMetadata.Builder.eventIngestedRange
but several dozen still fail due to other classes needing to have access to minClusterTransportState that do not have it.
    @quux00
    quux00 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    0efb4ca View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Revert "Added minClusterTransportVersion to XContentParserConfigurati… 

    …on and (some versions of) XContentParser."

This reverts commit 0efb4ca.
    @quux00
    quux00 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    f20af53 View commit details
    Browse the repository at this point in the history

  2. Added eventIngestedRange Builder method that does not take TransportV… 

    …ersion

for use internal to IndexMetadata file
    @quux00
    quux00 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    09b76e2 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    c6a66e7 View commit details
    Browse the repository at this point in the history

  4. Additional asserts around eventIngestedRange in SearchableSnapshotsIn… 

    …tegTests
    @quux00
    quux00 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    1df7044 View commit details
    Browse the repository at this point in the history

  5. Added additional tests or asserts around eventIngestedRange to Frozen… 

    …IndexIT and FrozenIndexTests
    @quux00
    quux00 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    d8b054d View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    9552ad1 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    e3b1a4b View commit details
    Browse the repository at this point in the history

  2. First round of next PR change requests 

    Added back the assert in public Builder.eventIngestedRange method -
 assert minClusterTransportVersion != null || eventIngestedRange == IndexLongFieldRange.UNKNOWN
now passes tests.

Changed IndexMetadataTests to use package private version of eventIngestedRange builder method that takes no TransportVersion
    @quux00
    quux00 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    d0f7ae2 View commit details
    Browse the repository at this point in the history

  3. Added asserts around UNKNOWN for eventIngestedRange to ClusterState c… 

    …onstructor and adjusted a few related tests
    @quux00
    quux00 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    ed9d828 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    3c2c8b8 View commit details
    Browse the repository at this point in the history

  5. Null check in the new assert in ClusterState to avoid some xpack test… 

    … failures
    @quux00
    quux00 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    910cf3f View commit details
    Browse the repository at this point in the history

  6. Fixes to various tests or prod code to allow new ClusterState ctor as… 

    …sert around eventIngestedRange

Changes to:
ClusterStateDiffIT
and MetadataIndexTemplateService, which was causing several bwc tests to fail.
    @quux00
    quux00 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    694d9c1 View commit details
    Browse the repository at this point in the history

  7. Additional null check in assert in ClusterState constructor to avoid … 

    …test failures in TransportVersionUtilsTests
    @quux00
    quux00 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    91f1293 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. Final adjustments requested in the PR

    @quux00
    quux00 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    2e4815c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    86a2939 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    434dec8 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'elastic/main' into search/coordinator-r… 

    …ewrite-uses-event.ingested
    @quux00
    quux00 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    6477f3d View commit details
    Browse the repository at this point in the history

  5. Adjusted to ML_INFERENCE_GOOGLE_VERTEX_AI_EMBEDDINGS_ADDED in Cluster… 

    …SerializationTests
    @quux00
    quux00 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    f1e0434 View commit details
    Browse the repository at this point in the history