fix for max & min aggregations when no metric property exist #870

sbcd90 · 2023-07-22T00:39:41Z

Issue #, if available:

Description of changes:
fix for max & min aggregations when no metric property exist

CheckList:

Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

codecov · 2023-07-22T01:15:22Z

Codecov Report

Merging #870 (426b817) into main (d4cafd6) will increase coverage by 0.05%.
The diff coverage is 100.00%.

❗ Current head 426b817 differs from pull request most recent head 2b36a79. Consider uploading reports for the commit 2b36a79 to get more accurate results

@@             Coverage Diff              @@
##               main     #870      +/-   ##
============================================
+ Coverage     75.63%   75.69%   +0.05%     
- Complexity     2848     2850       +2     
============================================
  Files           364      364              
  Lines         16184    16184              
  Branches       2329     2329              
============================================
+ Hits          12241    12250       +9     
+ Misses         2600     2590      -10     
- Partials       1343     1344       +1

Files Changed	Coverage Δ
...opensearch/indexmanagement/rollup/RollupIndexer.kt	`57.57% <100.00%> (ø)`

... and 13 files with indirect coverage changes

bowenlan-amzn · 2023-07-22T02:14:19Z

src/test/kotlin/org/opensearch/indexmanagement/IndexManagementRestTestCase.kt

@@ -152,6 +152,11 @@ abstract class IndexManagementRestTestCase : ODFERestTestCase() {
        insertSampleBulkData(index, javaClass.classLoader.getResource("data/nyc_5000.ndjson").readText())
    }

+    protected fun generateMessageLogsData(index: String = "message-logs") {
+        createIndex(index, Settings.EMPTY, """"properties": {"USM_Storage":{"properties":{"occured_to_received":{"type":"long"},"received_to_storage":{"type":"long"},"storage_to_os":{"type":"long"}}},"message":{"properties":{"access_control_outcome":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"access_key_id":{"ignore_above":10000,"type":"keyword"},"account_id":{"ignore_above":10000,"type":"keyword"},"account_name":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"account_vendor":{"ignore_above":10000,"type":"keyword"},"adhoc_query_id":{"ignore_above":10000,"type":"keyword"},"affected_family":{"ignore_above":10000,"type":"keyword"},"affected_platform":{"ignore_above":10000,"type":"keyword"},"affected_platforms":{"ignore_above":10000,"type":"keyword"},"affected_products":{"ignore_above":10000,"type":"keyword"},"alarm_events_count":{"type":"long"},"app_id":{"ignore_above":10000,"type":"keyword"},"app_name":{"ignore_above":10000,"type":"keyword"},"app_type":{"ignore_above":10000,"type":"keyword"},"application":{"ignore_above":10000,"type":"keyword"},"application_protocol":{"ignore_above":10000,"type":"keyword"},"application_type":{"ignore_above":10000,"type":"keyword"},"asset_status":{"ignore_above":10000,"type":"keyword"},"assumed_role":{"ignore_above":10000,"type":"keyword"},"audit_reason":{"ignore_above":10000,"type":"keyword"},"authentication_mode":{"ignore_above":10000,"type":"keyword"},"authentication_package_name":{"ignore_above":10000,"type":"keyword"},"authentication_type":{"ignore_above":10000,"type":"keyword"},"base_event_count":{"type":"long"},"blacklist_reference_url":{"ignore_above":10000,"type":"keyword"},"bytes_in":{"type":"long"},"bytes_out":{"type":"long"},"certificate_issuer_name":{"ignore_above":10000,"type":"keyword"},"certificate_serial_number":{"ignore_above":10000,"type":"keyword"},"certificate_subject_name":{"ignore_above":10000,"type":"keyword"},"confidence":{"type":"long"},"connection_count":{"type":"long"},"connector_id":{"ignore_above":10000,"type":"keyword"},"connector_source":{"ignore_above":10000,"type":"keyword"},"connector_source_file":{"ignore_above":10000,"type":"keyword"},"container_cmd":{"ignore_above":10000,"type":"keyword"},"container_cpu":{"ignore_above":10000,"type":"keyword"},"container_id":{"ignore_above":10000,"type":"keyword"},"container_image":{"ignore_above":10000,"type":"keyword"},"container_image_id":{"ignore_above":10000,"type":"keyword"},"container_memory":{"ignore_above":10000,"type":"keyword"},"container_name":{"ignore_above":10000,"type":"keyword"},"container_state":{"ignore_above":10000,"type":"keyword"},"container_volume":{"ignore_above":10000,"type":"keyword"},"contains_credit_card_number":{"type":"boolean"},"content_category":{"ignore_above":10000,"type":"keyword"},"control_id":{"ignore_above":10000,"type":"keyword"},"current_pps":{"type":"long"},"current_working_directory":{"ignore_above":10000,"type":"keyword"},"customfield_0":{"ignore_above":10000,"type":"keyword"},"customfield_1":{"ignore_above":10000,"type":"keyword"},"customfield_10":{"ignore_above":10000,"type":"keyword"},"customfield_11":{"ignore_above":10000,"type":"keyword"},"customfield_12":{"ignore_above":10000,"type":"keyword"},"customfield_13":{"ignore_above":10000,"type":"keyword"},"customfield_14":{"ignore_above":10000,"type":"keyword"},"customfield_15":{"ignore_above":10000,"type":"keyword"},"customfield_16":{"ignore_above":10000,"type":"keyword"},"customfield_17":{"ignore_above":10000,"type":"keyword"},"customfield_18":{"ignore_above":10000,"type":"keyword"},"customfield_19":{"ignore_above":10000,"type":"keyword"},"customfield_2":{"ignore_above":10000,"type":"keyword"},"customfield_20":{"ignore_above":10000,"type":"keyword"},"customfield_21":{"ignore_above":10000,"type":"keyword"},"customfield_22":{"ignore_above":10000,"type":"keyword"},"customfield_23":{"ignore_above":10000,"type":"keyword"},"customfield_24":{"ignore_above":10000,"type":"keyword"},"customfield_25":{"ignore_above":10000,"type":"keyword"},"customfield_26":{"ignore_above":10000,"type":"keyword"},"customfield_27":{"ignore_above":10000,"type":"keyword"},"customfield_28":{"ignore_above":10000,"type":"keyword"},"customfield_29":{"ignore_above":10000,"type":"keyword"},"customfield_3":{"ignore_above":10000,"type":"keyword"},"customfield_30":{"ignore_above":10000,"type":"keyword"},"customfield_4":{"ignore_above":10000,"type":"keyword"},"customfield_5":{"ignore_above":10000,"type":"keyword"},"customfield_6":{"ignore_above":10000,"type":"keyword"},"customfield_7":{"ignore_above":10000,"type":"keyword"},"customfield_8":{"ignore_above":10000,"type":"keyword"},"customfield_9":{"ignore_above":10000,"type":"keyword"},"customheader_0":{"ignore_above":10000,"type":"keyword"},"customheader_1":{"ignore_above":10000,"type":"keyword"},"customheader_10":{"ignore_above":10000,"type":"keyword"},"customheader_11":{"ignore_above":10000,"type":"keyword"},"customheader_12":{"ignore_above":10000,"type":"keyword"},"customheader_13":{"ignore_above":10000,"type":"keyword"},"customheader_14":{"ignore_above":10000,"type":"keyword"},"customheader_15":{"ignore_above":10000,"type":"keyword"},"customheader_16":{"ignore_above":10000,"type":"keyword"},"customheader_17":{"ignore_above":10000,"type":"keyword"},"customheader_18":{"ignore_above":10000,"type":"keyword"},"customheader_19":{"ignore_above":10000,"type":"keyword"},"customheader_2":{"ignore_above":10000,"type":"keyword"},"customheader_20":{"ignore_above":10000,"type":"keyword"},"customheader_21":{"ignore_above":10000,"type":"keyword"},"customheader_22":{"ignore_above":10000,"type":"keyword"},"customheader_23":{"ignore_above":10000,"type":"keyword"},"customheader_24":{"ignore_above":10000,"type":"keyword"},"customheader_25":{"ignore_above":10000,"type":"keyword"},"customheader_26":{"ignore_above":10000,"type":"keyword"},"customheader_27":{"ignore_above":10000,"type":"keyword"},"customheader_28":{"ignore_above":10000,"type":"keyword"},"customheader_29":{"ignore_above":10000,"type":"keyword"},"customheader_3":{"ignore_above":10000,"type":"keyword"},"customheader_30":{"ignore_above":10000,"type":"keyword"},"customheader_4":{"ignore_above":10000,"type":"keyword"},"customheader_5":{"ignore_above":10000,"type":"keyword"},"customheader_6":{"ignore_above":10000,"type":"keyword"},"customheader_7":{"ignore_above":10000,"type":"keyword"},"customheader_8":{"ignore_above":10000,"type":"keyword"},"customheader_9":{"ignore_above":10000,"type":"keyword"},"datascience_alarm_threshold":{"type":"float"},"datascience_alarm_threshold_99":{"type":"float"},"datascience_alarm_threshold_low_confidence":{"type":"float"},"datascience_alarm_threshold_medium_confidence":{"type":"float"},"datascience_anomaly_score":{"type":"float"},"datascience_inference_explanation":{"ignore_above":10000,"type":"keyword"},"datascience_inference_type":{"ignore_above":10000,"type":"keyword"},"datascience_tenant_event_threshold":{"type":"float"},"destination_account_id":{"ignore_above":10000,"type":"keyword"},"destination_additional_hostnames":{"ignore_above":10000,"type":"keyword"},"destination_address":{"ignore_above":10000,"type":"keyword"},"destination_address_6":{"ignore_above":10000,"type":"keyword"},"destination_asn":{"ignore_above":10000,"type":"keyword"},"destination_asset_id":{"ignore_above":10000,"type":"keyword"},"destination_blacklist_activity":{"ignore_above":10000,"type":"keyword"},"destination_blacklist_priority":{"ignore_above":10000,"type":"keyword"},"destination_blacklist_reliability":{"ignore_above":10000,"type":"keyword"},"destination_canonical":{"ignore_above":10000,"type":"keyword"},"destination_city":{"ignore_above":10000,"type":"keyword"},"destination_country":{"ignore_above":10000,"type":"keyword"},"destination_datastore":{"ignore_above":10000,"type":"keyword"},"destination_dns_domain":{"ignore_above":10000,"type":"keyword"},"destination_fqdn":{"ignore_above":10000,"type":"keyword"},"destination_hostname":{"ignore_above":10000,"type":"keyword"},"destination_infrastructure_name":{"ignore_above":10000,"type":"keyword"},"destination_infrastructure_type":{"ignore_above":10000,"type":"keyword"},"destination_instance_id":{"ignore_above":10000,"type":"keyword"},"destination_latitude":{"ignore_above":10000,"type":"keyword"},"destination_longitude":{"ignore_above":10000,"type":"keyword"},"destination_mac":{"ignore_above":10000,"type":"keyword"},"destination_mac_vendor":{"ignore_above":10000,"type":"keyword"},"destination_name":{"ignore_above":10000,"type":"keyword"},"destination_nat_address":{"ignore_above":10000,"type":"keyword"},"destination_nat_port":{"type":"long"},"destination_netmask":{"ignore_above":10000,"type":"keyword"},"destination_network":{"ignore_above":10000,"type":"keyword"},"destination_ntdomain":{"ignore_above":10000,"type":"keyword"},"destination_organisation":{"ignore_above":10000,"type":"keyword"},"destination_port":{"type":"long"},"destination_port_label":{"ignore_above":10000,"type":"keyword"},"destination_post_nat_port":{"type":"long"},"destination_pre_nat_port":{"type":"long"},"destination_process":{"ignore_above":10000,"type":"keyword"},"destination_process_id":{"ignore_above":10000,"type":"keyword"},"destination_region":{"ignore_above":10000,"type":"keyword"},"destination_registered_country":{"ignore_above":10000,"type":"keyword"},"destination_service_name":{"ignore_above":10000,"type":"keyword"},"destination_translated_address":{"ignore_above":10000,"type":"keyword"},"destination_translated_port":{"type":"long"},"destination_user_email":{"ignore_above":10000,"type":"keyword"},"destination_user_group":{"ignore_above":10000,"type":"keyword"},"destination_user_id":{"ignore_above":10000,"type":"keyword"},"destination_user_privileges":{"ignore_above":10000,"type":"keyword"},"destination_userid":{"ignore_above":10000,"type":"keyword"},"destination_username":{"ignore_above":10000,"type":"keyword"},"destination_vguest":{"ignore_above":10000,"type":"keyword"},"destination_vhost":{"ignore_above":10000,"type":"keyword"},"destination_vpc":{"ignore_above":10000,"type":"keyword"},"destination_vpn":{"ignore_above":10000,"type":"keyword"},"destination_zone":{"ignore_above":10000,"type":"keyword"},"device_class":{"ignore_above":10000,"type":"keyword"},"device_configuration":{"ignore_above":10000,"type":"keyword"},"device_custom_date_1":{"ignore_above":10000,"type":"keyword"},"device_custom_date_1_label":{"ignore_above":10000,"type":"keyword"},"device_custom_date_2":{"ignore_above":10000,"type":"keyword"},"device_custom_date_2_label":{"ignore_above":10000,"type":"keyword"},"device_custom_number_1":{"type":"long"},"device_custom_number_1_label":{"ignore_above":10000,"type":"keyword"},"device_custom_number_2":{"type":"long"},"device_custom_number_2_label":{"ignore_above":10000,"type":"keyword"},"device_custom_number_3":{"type":"long"},"device_custom_number_3_label":{"ignore_above":10000,"type":"keyword"},"device_direction":{"ignore_above":10000,"type":"keyword"},"device_dns_domain":{"ignore_above":10000,"type":"keyword"},"device_event_category":{"ignore_above":10000,"type":"keyword"},"device_external_id":{"ignore_above":10000,"type":"keyword"},"device_facility":{"ignore_above":10000,"type":"keyword"},"device_inbound_interface":{"ignore_above":10000,"type":"keyword"},"device_name":{"ignore_above":10000,"type":"keyword"},"device_nt_domain":{"ignore_above":10000,"type":"keyword"},"device_outbound_interface":{"ignore_above":10000,"type":"keyword"},"device_process_name":{"ignore_above":10000,"type":"keyword"},"device_sender_address":{"ignore_above":10000,"type":"keyword"},"device_sender_asset_id":{"ignore_above":10000,"type":"keyword"},"device_vendor":{"ignore_above":10000,"type":"keyword"},"dns_message":{"ignore_above":10000,"type":"keyword"},"dns_rcode":{"type":"long"},"dns_rrname":{"ignore_above":10000,"type":"keyword"},"dns_rrtype":{"ignore_above":10000,"type":"keyword"},"dns_server_address":{"ignore_above":10000,"type":"keyword"},"dns_ttl":{"ignore_above":10000,"type":"keyword"},"dns_type":{"ignore_above":10000,"type":"keyword"},"duration":{"ignore_above":10000,"type":"keyword"},"email_recipient":{"ignore_above":10000,"type":"keyword"},"email_relay":{"ignore_above":10000,"type":"keyword"},"email_sender":{"ignore_above":10000,"type":"keyword"},"email_subject":{"ignore_above":10000,"type":"keyword"},"environment_variable_key":{"ignore_above":10000,"type":"keyword"},"environment_variable_value":{"ignore_above":10000,"type":"keyword"},"error_code":{"ignore_above":10000,"type":"keyword"},"error_message":{"ignore_above":10000,"type":"keyword"},"event_action":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"event_activity":{"ignore_above":10000,"type":"keyword"},"event_attack_id":{"ignore_above":10000,"type":"keyword"},"event_attack_tactic":{"ignore_above":10000,"type":"keyword"},"event_attack_technique":{"ignore_above":10000,"type":"keyword"},"event_auth_action":{"ignore_above":10000,"type":"keyword"},"event_auth_role":{"ignore_above":10000,"type":"keyword"},"event_category":{"ignore_above":10000,"type":"keyword"},"event_cve":{"ignore_above":10000,"type":"keyword"},"event_description":{"ignore_above":10000,"type":"keyword"},"event_description_url":{"ignore_above":10000,"type":"keyword"},"event_group":{"ignore_above":10000,"type":"keyword"},"event_name":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"event_outcome":{"ignore_above":10000,"type":"keyword"},"event_priority":{"type":"long"},"event_receipt_time":{"type":"date"},"event_ref_date":{"ignore_above":10000,"type":"keyword"},"event_ref_score":{"ignore_above":10000,"type":"keyword"},"event_ref_source":{"ignore_above":10000,"type":"keyword"},"event_severity":{"ignore_above":10000,"type":"keyword"},"event_subcategory":{"ignore_above":10000,"type":"keyword"},"event_type":{"ignore_above":10000,"type":"keyword"},"event_violation":{"ignore_above":10000,"type":"keyword"},"expires":{"type":"boolean"},"external_id":{"ignore_above":10000,"type":"keyword"},"file_hash":{"ignore_above":10000,"type":"keyword"},"file_hash_algorithm":{"ignore_above":10000,"type":"keyword"},"file_hash_md5":{"ignore_above":10000,"type":"keyword"},"file_hash_sha1":{"ignore_above":10000,"type":"keyword"},"file_hash_sha256":{"ignore_above":10000,"type":"keyword"},"file_id":{"ignore_above":10000,"type":"keyword"},"file_kb_size":{"ignore_above":10000,"type":"keyword"},"file_modification_time":{"ignore_above":10000,"type":"keyword"},"file_name":{"ignore_above":10000,"type":"keyword"},"file_old_hash":{"ignore_above":10000,"type":"keyword"},"file_old_id":{"ignore_above":10000,"type":"keyword"},"file_old_modification_time":{"ignore_above":10000,"type":"keyword"},"file_old_name":{"ignore_above":10000,"type":"keyword"},"file_old_path":{"ignore_above":10000,"type":"keyword"},"file_old_permission":{"ignore_above":10000,"type":"keyword"},"file_old_size":{"ignore_above":10000,"type":"keyword"},"file_owner":{"ignore_above":10000,"type":"keyword"},"file_path":{"ignore_above":10000,"type":"keyword"},"file_permission":{"ignore_above":10000,"type":"keyword"},"file_type":{"ignore_above":10000,"type":"keyword"},"full_message":{"ignore_above":10000,"type":"keyword"},"gateway":{"ignore_above":10000,"type":"keyword"},"global_list_name":{"ignore_above":10000,"type":"keyword"},"global_list_value":{"ignore_above":10000,"type":"keyword"},"group_policy":{"ignore_above":10000,"type":"keyword"},"has_alarm":{"type":"boolean"},"highlight_fields":{"ignore_above":10000,"type":"keyword"},"http_hostname":{"ignore_above":10000,"type":"keyword"},"http_referer":{"ignore_above":10000,"type":"keyword"},"identity_group_name":{"ignore_above":10000,"type":"keyword"},"identity_host_name":{"ignore_above":10000,"type":"keyword"},"incident_id":{"ignore_above":10000,"type":"keyword"},"instance_ids":{"ignore_above":10000,"type":"keyword"},"instance_types":{"ignore_above":10000,"type":"keyword"},"iocs":{"ignore_above":10000,"type":"keyword"},"ip_addresses":{"ignore_above":10000,"type":"keyword"},"k8s_dns_policy":{"ignore_above":10000,"type":"keyword"},"k8s_node_name":{"ignore_above":10000,"type":"keyword"},"k8s_priority":{"ignore_above":10000,"type":"keyword"},"level":{"type":"long"},"log":{"index_options":"docs","norms":false,"type":"text"},"malware_family":{"ignore_above":10000,"type":"keyword"},"malware_variant":{"ignore_above":10000,"type":"keyword"},"matched_value":{"ignore_above":10000,"type":"keyword"},"needs_enrichment":{"type":"boolean"},"needs_internal_enrichment":{"type":"boolean"},"num_containers":{"ignore_above":10000,"type":"keyword"},"old_ip":{"ignore_above":10000,"type":"keyword"},"operating_system":{"ignore_above":10000,"type":"keyword"},"package_architecture":{"ignore_above":10000,"type":"keyword"},"package_name":{"ignore_above":10000,"type":"keyword"},"package_revision":{"ignore_above":10000,"type":"keyword"},"package_source":{"ignore_above":10000,"type":"keyword"},"package_version":{"ignore_above":10000,"type":"keyword"},"packet_data":{"ignore_above":10000,"type":"keyword"},"packet_payload":{"ignore_above":10000,"type":"keyword"},"packet_type":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"packets_received":{"type":"long"},"packets_sent":{"type":"long"},"peak_pps":{"type":"long"},"pefile_company":{"ignore_above":10000,"type":"keyword"},"pefile_description":{"ignore_above":10000,"type":"keyword"},"pefile_fileversion":{"ignore_above":10000,"type":"keyword"},"pefile_product":{"ignore_above":10000,"type":"keyword"},"plugin":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"plugin_device":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"plugin_device_type":{"ignore_above":10000,"type":"keyword"},"plugin_device_version":{"ignore_above":10000,"type":"keyword"},"plugin_enrichment_script":{"ignore_above":10000,"type":"keyword"},"plugin_family":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"plugin_parent":{"ignore_above":10000,"type":"keyword"},"plugin_rule":{"ignore_above":10000,"type":"keyword"},"plugin_version":{"ignore_above":10000,"type":"keyword"},"policy":{"ignore_above":10000,"type":"keyword"},"policy_address":{"ignore_above":10000,"type":"keyword"},"pre_authentication_type":{"ignore_above":10000,"type":"keyword"},"project_id":{"ignore_above":10000,"type":"keyword"},"protocol_version":{"ignore_above":10000,"type":"keyword"},"received_from":{"ignore_above":10000,"type":"keyword"},"registry_path":{"ignore_above":10000,"type":"keyword"},"registry_value":{"ignore_above":10000,"type":"keyword"},"relative_distinguished_name":{"ignore_above":10000,"type":"keyword"},"rep_dev_canonical":{"ignore_above":10000,"type":"keyword"},"rep_device_address":{"ignore_above":10000,"type":"keyword"},"rep_device_address_6":{"ignore_above":10000,"type":"keyword"},"rep_device_asset_id":{"ignore_above":10000,"type":"keyword"},"rep_device_fqdn":{"ignore_above":10000,"type":"keyword"},"rep_device_hostname":{"ignore_above":10000,"type":"keyword"},"rep_device_inbound_interface":{"ignore_above":10000,"type":"keyword"},"rep_device_instance_id":{"ignore_above":10000,"type":"keyword"},"rep_device_mac":{"ignore_above":10000,"type":"keyword"},"rep_device_model":{"ignore_above":10000,"type":"keyword"},"rep_device_outbound_interface":{"ignore_above":10000,"type":"keyword"},"rep_device_rule_id":{"ignore_above":10000,"type":"keyword"},"rep_device_type":{"ignore_above":10000,"type":"keyword"},"rep_device_vendor":{"ignore_above":10000,"type":"keyword"},"rep_device_version":{"ignore_above":10000,"type":"keyword"},"report_executed_date":{"type":"date"},"reputation_score":{"ignore_above":10000,"type":"keyword"},"request_content_type":{"ignore_above":10000,"type":"keyword"},"request_cookies":{"ignore_above":10000,"type":"keyword"},"request_http_version":{"ignore_above":10000,"type":"keyword"},"request_method":{"ignore_above":10000,"type":"keyword"},"request_referrer":{"ignore_above":10000,"type":"keyword"},"request_url":{"ignore_above":10000,"type":"keyword"},"request_user_agent":{"ignore_above":10000,"type":"keyword"},"resource_provider":{"ignore_above":10000,"type":"keyword"},"resource_uri":{"ignore_above":10000,"type":"keyword"},"response_code":{"type":"long"},"response_content_type":{"ignore_above":10000,"type":"keyword"},"return_value":{"ignore_above":10000,"type":"keyword"},"rule_id":{"ignore_above":10000,"type":"keyword"},"rule_uuid":{"ignore_above":10000,"type":"keyword"},"security_group_id":{"ignore_above":10000,"type":"keyword"},"security_group_name":{"ignore_above":10000,"type":"keyword"},"sensor_event_rate":{"type":"double"},"sensor_name":{"ignore_above":10000,"type":"keyword"},"sensor_uuid":{"ignore_above":10000,"type":"keyword"},"session":{"ignore_above":10000,"type":"keyword"},"shared_resource_name":{"ignore_above":10000,"type":"keyword"},"short_message":{"ignore_above":10000,"type":"keyword"},"silent":{"type":"boolean"},"source_account":{"ignore_above":10000,"type":"keyword"},"source_account_id":{"ignore_above":10000,"type":"keyword"},"source_account_name":{"ignore_above":10000,"type":"keyword"},"source_additional_hostnames":{"ignore_above":10000,"type":"keyword"},"source_address":{"ignore_above":10000,"type":"keyword"},"source_address_6":{"ignore_above":10000,"type":"keyword"},"source_asn":{"ignore_above":10000,"type":"keyword"},"source_asset_id":{"ignore_above":10000,"type":"keyword"},"source_blacklist_activity":{"ignore_above":10000,"type":"keyword"},"source_blacklist_priority":{"ignore_above":10000,"type":"keyword"},"source_blacklist_reliability":{"ignore_above":10000,"type":"keyword"},"source_canonical":{"ignore_above":10000,"type":"keyword"},"source_city":{"ignore_above":10000,"type":"keyword"},"source_country":{"ignore_above":10000,"type":"keyword"},"source_cpe":{"ignore_above":10000,"type":"keyword"},"source_datacenter":{"ignore_above":10000,"type":"keyword"},"source_datastore":{"ignore_above":10000,"type":"keyword"},"source_dns_domain":{"ignore_above":10000,"type":"keyword"},"source_fqdn":{"ignore_above":10000,"type":"keyword"},"source_hostname":{"ignore_above":10000,"type":"keyword"},"source_infrastructure_name":{"ignore_above":10000,"type":"keyword"},"source_infrastructure_type":{"ignore_above":10000,"type":"keyword"},"source_instance_id":{"ignore_above":10000,"type":"keyword"},"source_latitude":{"ignore_above":10000,"type":"keyword"},"source_location_id":{"ignore_above":10000,"type":"keyword"},"source_location_name":{"ignore_above":10000,"type":"keyword"},"source_longitude":{"ignore_above":10000,"type":"keyword"},"source_mac":{"ignore_above":10000,"type":"keyword"},"source_mac_vendor":{"ignore_above":10000,"type":"keyword"},"source_name":{"ignore_above":10000,"type":"keyword"},"source_nat_address":{"ignore_above":10000,"type":"keyword"},"source_nat_port":{"type":"long"},"source_netmask":{"ignore_above":10000,"type":"keyword"},"source_network":{"ignore_above":10000,"type":"keyword"},"source_ntdomain":{"ignore_above":10000,"type":"keyword"},"source_organisation":{"ignore_above":10000,"type":"keyword"},"source_port":{"type":"long"},"source_port_label":{"ignore_above":10000,"type":"keyword"},"source_post_nat_port":{"type":"long"},"source_pre_nat_port":{"type":"long"},"source_process":{"ignore_above":10000,"type":"keyword"},"source_process_commandline":{"ignore_above":10000,"type":"keyword"},"source_process_id":{"ignore_above":10000,"type":"keyword"},"source_process_parent":{"ignore_above":10000,"type":"keyword"},"source_process_parent_commandline":{"ignore_above":10000,"type":"keyword"},"source_process_parent_process_id":{"ignore_above":10000,"type":"keyword"},"source_region":{"ignore_above":10000,"type":"keyword"},"source_registered_country":{"ignore_above":10000,"type":"keyword"},"source_service_name":{"ignore_above":10000,"type":"keyword"},"source_translated_address":{"ignore_above":10000,"type":"keyword"},"source_translated_port":{"type":"long"},"source_user_email":{"ignore_above":10000,"type":"keyword"},"source_user_email_domain":{"ignore_above":10000,"type":"keyword"},"source_user_group":{"ignore_above":10000,"type":"keyword"},"source_user_id":{"ignore_above":10000,"type":"keyword"},"source_user_privileges":{"ignore_above":10000,"type":"keyword"},"source_userid":{"ignore_above":10000,"type":"keyword"},"source_username":{"ignore_above":10000,"type":"keyword"},"source_vhost":{"ignore_above":10000,"type":"keyword"},"source_vpc":{"ignore_above":10000,"type":"keyword"},"source_vpn":{"ignore_above":10000,"type":"keyword"},"source_workstation":{"ignore_above":10000,"type":"keyword"},"source_zone":{"ignore_above":10000,"type":"keyword"},"ssh_authorized_key":{"ignore_above":10000,"type":"keyword"},"ssh_client_proto":{"ignore_above":10000,"type":"keyword"},"ssh_client_software":{"ignore_above":10000,"type":"keyword"},"ssh_server_proto":{"ignore_above":10000,"type":"keyword"},"ssh_server_software":{"ignore_above":10000,"type":"keyword"},"stat_value":{"type":"long"},"status":{"ignore_above":10000,"type":"keyword"},"suppress_rule_id":{"ignore_above":10000,"type":"keyword"},"suppress_rule_name":{"ignore_above":10000,"type":"keyword"},"suppressed":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"syslog_source":{"ignore_above":10000,"type":"keyword"},"tag":{"ignore_above":10000,"type":"keyword"},"threat_intelligence_feed_name":{"ignore_above":10000,"type":"keyword"},"threat_intelligence_matched_metadata":{"ignore_above":10000,"type":"keyword"},"ticket_encryption_type":{"ignore_above":10000,"type":"keyword"},"timeStamp":{"ignore_above":10000,"type":"keyword"},"time_end":{"type":"date"},"time_offset":{"ignore_above":10000,"type":"keyword"},"time_start":{"type":"date"},"time_zone":{"ignore_above":10000,"type":"keyword"},"timestamp_arrived":{"type":"date"},"timestamp_end":{"type":"date"},"timestamp_occured":{"type":"date"},"timestamp_occured_iso8601":{"type":"date"},"timestamp_os":{"type":"date"},"timestamp_received":{"type":"date"},"timestamp_received_iso8601":{"type":"date"},"timestamp_start":{"type":"date"},"timestamp_to_storage":{"type":"date"},"tls_cipher":{"ignore_above":10000,"type":"keyword"},"tls_fingerprint":{"ignore_above":10000,"type":"keyword"},"tls_issuerdn":{"ignore_above":10000,"type":"keyword"},"tls_sni":{"ignore_above":10000,"type":"keyword"},"tls_subject":{"ignore_above":10000,"type":"keyword"},"tls_version":{"ignore_above":10000,"type":"keyword"},"total_disconnection_time":{"ignore_above":10000,"type":"keyword"},"total_packets":{"type":"long"},"transaction_status":{"ignore_above":10000,"type":"keyword"},"transient":{"type":"boolean"},"transport_protocol":{"ignore_above":10000,"type":"keyword"},"tty_terminal":{"ignore_above":10000,"type":"keyword"},"used_hint":{"type":"boolean"},"user_group_id":{"ignore_above":10000,"type":"keyword"},"user_policy":{"ignore_above":10000,"type":"keyword"},"user_realm":{"ignore_above":10000,"type":"keyword"},"user_resource":{"ignore_above":10000,"type":"keyword"},"user_resource_type":{"ignore_above":10000,"type":"keyword"},"user_role":{"ignore_above":10000,"type":"keyword"},"user_type":{"ignore_above":10000,"type":"keyword"},"uuid":{"ignore_above":10000,"type":"keyword"},"virtual_source_address":{"ignore_above":10000,"type":"keyword"},"virtual_source_name":{"ignore_above":10000,"type":"keyword"},"was_fuzzied":{"type":"boolean"},"was_guessed":{"type":"boolean"},"watchlist":{"ignore_above":10000,"type":"keyword"},"wireless_ap":{"ignore_above":10000,"type":"keyword"},"wireless_bssid":{"ignore_above":10000,"type":"keyword"},"wireless_channel":{"ignore_above":10000,"type":"keyword"},"wireless_encryption":{"ignore_above":10000,"type":"keyword"},"wireless_ssid":{"ignore_above":10000,"type":"keyword"},"x_att_tenantid":{"ignore_above":10000,"type":"keyword"}}},"timeStamp":{"ignore_above":10000,"type":"keyword"}}""")


Wondering why putting so many fields here? same for the sample data

hi @bowenlan-amzn , updated the mappings to only have necessary fields & updated sample data too.

bowenlan-amzn · 2023-07-26T07:53:27Z

src/main/kotlin/org/opensearch/indexmanagement/rollup/RollupIndexer.kt

@@ -116,8 +116,8 @@ class RollupIndexer(
            it.aggregations.forEach {
                when (it) {
                    is InternalSum -> aggResults[it.name] = it.value
-                    is InternalMax -> aggResults[it.name] = it.value
-                    is InternalMin -> aggResults[it.name] = it.value
+                    is InternalMax -> if (it.value.isInfinite()) aggResults[it.name] = null else aggResults[it.name] = it.value


The reason this was missed before is because the value of max/min in InternalMax/InternalMin is initialized in method reduce, and processed in doXContentBody before responding. However, the it.value we got here has not been processed by doXContentBody. This is easy to miss, can we add a comment here in case in the future we are adding more metrics and may miss again. like Need to redo the logic in corresponding doXContentBody https://github.com/opensearch-project/OpenSearch/blob/main/server/src/main/java/org/opensearch/search/aggregations/metrics/InternalMax.java#L101

hi @bowenlan-amzn , i added a comment.

Signed-off-by: Subhobrata Dey <[email protected]>

Signed-off-by: Subhobrata Dey <[email protected]> (cherry picked from commit 6cbe2f4) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…878) (cherry picked from commit 6cbe2f4) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…rch-project#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]>

* Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]>

* Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (opensearch-project#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (opensearch-project#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (opensearch-project#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (opensearch-project#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (opensearch-project#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (opensearch-project#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (opensearch-project#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (opensearch-project#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (opensearch-project#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (opensearch-project#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (opensearch-project#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (opensearch-project#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (opensearch-project#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (opensearch-project#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (opensearch-project#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (opensearch-project#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (opensearch-project#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]>

* [Feature] Support Transform as an ISM action (#760) * Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> * [Test] increase the wait time after transform job triggered (#999) Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: Tanqiu Liu <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]>

* Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (opensearch-project#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (opensearch-project#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (opensearch-project#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (opensearch-project#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (opensearch-project#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (opensearch-project#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (opensearch-project#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (opensearch-project#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (opensearch-project#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (opensearch-project#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (opensearch-project#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (opensearch-project#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (opensearch-project#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (opensearch-project#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (opensearch-project#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (opensearch-project#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (opensearch-project#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Signed-off-by: Joshua Au <[email protected]>

* Added minimum timeout for transforms search of 10 minutes Signed-off-by: Joshua Au <[email protected]> * Extracted cancel minimum code to function Signed-off-by: Joshua Au <[email protected]> * Fixed transform code to use cluster setting Signed-off-by: Joshua Au <[email protected]> * Removed log statements Signed-off-by: Joshua Au <[email protected]> * Changed timeout logic Signed-off-by: Joshua Au <[email protected]> * Switched to basing off seconds Signed-off-by: Joshua Au <[email protected]> * [Feature] Support Transform as an ISM action (#760) * Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Signed-off-by: Joshua Au <[email protected]> * [Test] increase the wait time after transform job triggered (#999) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Drafted 2.11 release notes. (#1004) * Drafted 2.11 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Drafted 2.11 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Refactor change policy API and the policy in managed index to be non-null (#967) * Refactor the policy to be non null in managed index config Signed-off-by: bowenlan-amzn <[email protected]> * Update Signed-off-by: bowenlan-amzn <[email protected]> * fix bug Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Add more error notification at fail points (#1000) * Add more error notification at fail points Signed-off-by: bowenlan-amzn <[email protected]> * Handle exception gracefully Signed-off-by: bowenlan-amzn <[email protected]> * small fix Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * fix the race condition in test reset action start time (#1007) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Bump bwc version after 2.11 release (#1015) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * added type check for pipeline aggregator types in Transform initialization (#1014) Signed-off-by: n-dohrmann <[email protected]> Co-authored-by: Joanne Wang <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Improve security plugin enabling check (#1017) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Onboard jenkins prod docker images to github actions (#1025) * Onboard jenkins prod docker images to github actions Signed-off-by: Peter Zhu <[email protected]> * Add more Signed-off-by: Peter Zhu <[email protected]> * Add more Signed-off-by: Peter Zhu <[email protected]> --------- Signed-off-by: Peter Zhu <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Support switch aliases in shrink action. (#987) Signed-off-by: Oleg Kravchuk <[email protected]> Co-authored-by: ikibo <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Transform pipeline aggr test (#1027) * tester code: pipeline aggr. transform job Signed-off-by: n-dohrmann <[email protected]> * made test case for pipeline aggregator in transform job Signed-off-by: n-dohrmann <[email protected]> * removed unnec. test lines Signed-off-by: n-dohrmann <[email protected]> * re-added method call on Transform obj Signed-off-by: n-dohrmann <[email protected]> --------- Signed-off-by: n-dohrmann <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Added unit test for switchAliases method. (#1035) * Added unit test for switchAliases method. Signed-off-by: Oleg Kravchuk <[email protected]> * Added unit test for switchAliases method checking the flow when switchAliases is disabled. Signed-off-by: Oleg Kravchuk <[email protected]> --------- Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036) Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Added minimum for search.cancel_after_time_interval setting for rollups (#1026) * Added minimum for search.cancel_after_time_interval setting for rollups Signed-off-by: Joshua Au <[email protected]> * Added constant for cancel_after_time_interval for rollup search Signed-off-by: Joshua Au <[email protected]> * Handled case of default value for cancel interval Signed-off-by: Joshua Au <[email protected]> * Added comment explanation for default rollup cancel after time interval Signed-off-by: Joshua Au <[email protected]> * Fixed github workflow checks Signed-off-by: Joshua Au <[email protected]> --------- Signed-off-by: Joshua Au <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Update 2.11.1 release note (#1042) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Interval schedule should take start time from the request, should not… (#1040) * Interval schedule should take start time from the request, should not set it to the current time of request execution. Signed-off-by: Oleg Kravchuk <[email protected]> * Changed the "delayed continuous execution test" to be more expressive about what it should test. Signed-off-by: Oleg Kravchuk <[email protected]> * fixed the NPE if schedule.startTime is NULL Signed-off-by: Oleg Kravchuk <[email protected]> * fixed the NPE if schedule.startTime is NULL Signed-off-by: Oleg Kravchuk <[email protected]> * fixed styling Signed-off-by: Oleg Kravchuk <[email protected]> * - removed null checks from RollUp and Transforms - fixed comments in the "delayed execution" test Signed-off-by: Oleg Kravchuk <[email protected]> --------- Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Removed unused imports Signed-off-by: Joshua Au <[email protected]> --------- Signed-off-by: Joshua Au <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: n-dohrmann <[email protected]> Signed-off-by: Peter Zhu <[email protected]> Signed-off-by: Oleg Kravchuk <[email protected]> Co-authored-by: Tanqiu Liu <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Co-authored-by: n-dohrmann <[email protected]> Co-authored-by: Joanne Wang <[email protected]> Co-authored-by: Peter Zhu <[email protected]> Co-authored-by: Oleg Kravchuk <[email protected]> Co-authored-by: ikibo <[email protected]>

* Added minimum timeout for transforms search of 10 minutes Signed-off-by: Joshua Au <[email protected]> * Extracted cancel minimum code to function Signed-off-by: Joshua Au <[email protected]> * Fixed transform code to use cluster setting Signed-off-by: Joshua Au <[email protected]> * Removed log statements Signed-off-by: Joshua Au <[email protected]> * Changed timeout logic Signed-off-by: Joshua Au <[email protected]> * Switched to basing off seconds Signed-off-by: Joshua Au <[email protected]> * [Feature] Support Transform as an ISM action (#760) * Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Signed-off-by: Joshua Au <[email protected]> * [Test] increase the wait time after transform job triggered (#999) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Drafted 2.11 release notes. (#1004) * Drafted 2.11 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Drafted 2.11 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Refactor change policy API and the policy in managed index to be non-null (#967) * Refactor the policy to be non null in managed index config Signed-off-by: bowenlan-amzn <[email protected]> * Update Signed-off-by: bowenlan-amzn <[email protected]> * fix bug Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Add more error notification at fail points (#1000) * Add more error notification at fail points Signed-off-by: bowenlan-amzn <[email protected]> * Handle exception gracefully Signed-off-by: bowenlan-amzn <[email protected]> * small fix Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * fix the race condition in test reset action start time (#1007) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Bump bwc version after 2.11 release (#1015) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * added type check for pipeline aggregator types in Transform initialization (#1014) Signed-off-by: n-dohrmann <[email protected]> Co-authored-by: Joanne Wang <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Improve security plugin enabling check (#1017) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Onboard jenkins prod docker images to github actions (#1025) * Onboard jenkins prod docker images to github actions Signed-off-by: Peter Zhu <[email protected]> * Add more Signed-off-by: Peter Zhu <[email protected]> * Add more Signed-off-by: Peter Zhu <[email protected]> --------- Signed-off-by: Peter Zhu <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Support switch aliases in shrink action. (#987) Signed-off-by: Oleg Kravchuk <[email protected]> Co-authored-by: ikibo <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Transform pipeline aggr test (#1027) * tester code: pipeline aggr. transform job Signed-off-by: n-dohrmann <[email protected]> * made test case for pipeline aggregator in transform job Signed-off-by: n-dohrmann <[email protected]> * removed unnec. test lines Signed-off-by: n-dohrmann <[email protected]> * re-added method call on Transform obj Signed-off-by: n-dohrmann <[email protected]> --------- Signed-off-by: n-dohrmann <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Added unit test for switchAliases method. (#1035) * Added unit test for switchAliases method. Signed-off-by: Oleg Kravchuk <[email protected]> * Added unit test for switchAliases method checking the flow when switchAliases is disabled. Signed-off-by: Oleg Kravchuk <[email protected]> --------- Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036) Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Added minimum for search.cancel_after_time_interval setting for rollups (#1026) * Added minimum for search.cancel_after_time_interval setting for rollups Signed-off-by: Joshua Au <[email protected]> * Added constant for cancel_after_time_interval for rollup search Signed-off-by: Joshua Au <[email protected]> * Handled case of default value for cancel interval Signed-off-by: Joshua Au <[email protected]> * Added comment explanation for default rollup cancel after time interval Signed-off-by: Joshua Au <[email protected]> * Fixed github workflow checks Signed-off-by: Joshua Au <[email protected]> --------- Signed-off-by: Joshua Au <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Update 2.11.1 release note (#1042) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Interval schedule should take start time from the request, should not… (#1040) * Interval schedule should take start time from the request, should not set it to the current time of request execution. Signed-off-by: Oleg Kravchuk <[email protected]> * Changed the "delayed continuous execution test" to be more expressive about what it should test. Signed-off-by: Oleg Kravchuk <[email protected]> * fixed the NPE if schedule.startTime is NULL Signed-off-by: Oleg Kravchuk <[email protected]> * fixed the NPE if schedule.startTime is NULL Signed-off-by: Oleg Kravchuk <[email protected]> * fixed styling Signed-off-by: Oleg Kravchuk <[email protected]> * - removed null checks from RollUp and Transforms - fixed comments in the "delayed execution" test Signed-off-by: Oleg Kravchuk <[email protected]> --------- Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Removed unused imports Signed-off-by: Joshua Au <[email protected]> --------- Signed-off-by: Joshua Au <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: n-dohrmann <[email protected]> Signed-off-by: Peter Zhu <[email protected]> Signed-off-by: Oleg Kravchuk <[email protected]> Co-authored-by: Tanqiu Liu <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Co-authored-by: n-dohrmann <[email protected]> Co-authored-by: Joanne Wang <[email protected]> Co-authored-by: Peter Zhu <[email protected]> Co-authored-by: Oleg Kravchuk <[email protected]> Co-authored-by: ikibo <[email protected]> (cherry picked from commit 60a8513) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

) * Added minimum timeout for transforms search of 10 minutes * Extracted cancel minimum code to function * Fixed transform code to use cluster setting * Removed log statements * Changed timeout logic * Switched to basing off seconds * [Feature] Support Transform as an ISM action (#760) * Initial impl * fix style * end to end functional * ISM transform unit tests & integ tests * Fix after core #8157 (#857) * Upgrade the backport workflow (#862) * Added 2.9 release notes. (#851) * Added 2.9 release notes. * Added 2.9 release notes. * Added 2.9 release notes. --------- * Handle NPE in isRollupIndex (#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. * unit test --------- * Fix core XcontentType refactor (#873) * fix for max & min aggregations when no metric property exist (#870) * core refactor change (#884) * update backport branch name (#885) * core refactor change (#887) * Fix breaking change by core refactor (#888) * fix core breaking (#906) * Support copy alias in rollover (#907) * Support copy alias in rollover * 2.10 --------- * Set preference to _primary when searching control-center index (#911) * Set preference to _primary when searching control-center index * Use _primary_first instead --------- * Add primary first preference to all search requests (#912) * fix intelliJ IDEA gradle sync error (#916) * make control center index as system index (#919) * Updates demo certs used in integ tests (#921) * Added 2.10 release notes (#925) * Bump bwc version (#930) * fix integ tests; upgrade mappings versions * Fix DCO * Addressed pr comments; Add integ test case for re-execute the same transform action * Addressed detekt error * Added ISMTransform writeable test * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase --------- * [Test] increase the wait time after transform job triggered (#999) * Drafted 2.11 release notes. (#1004) * Drafted 2.11 release notes. * Drafted 2.11 release notes. --------- * Refactor change policy API and the policy in managed index to be non-null (#967) * Refactor the policy to be non null in managed index config * Update * fix bug --------- * Add more error notification at fail points (#1000) * Add more error notification at fail points * Handle exception gracefully * small fix --------- * fix the race condition in test reset action start time (#1007) * Bump bwc version after 2.11 release (#1015) * added type check for pipeline aggregator types in Transform initialization (#1014) * Improve security plugin enabling check (#1017) * Onboard jenkins prod docker images to github actions (#1025) * Onboard jenkins prod docker images to github actions * Add more * Add more --------- * Support switch aliases in shrink action. (#987) * Transform pipeline aggr test (#1027) * tester code: pipeline aggr. transform job * made test case for pipeline aggregator in transform job * removed unnec. test lines * re-added method call on Transform obj --------- * Added unit test for switchAliases method. (#1035) * Added unit test for switchAliases method. * Added unit test for switchAliases method checking the flow when switchAliases is disabled. --------- * Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036) * Added minimum for search.cancel_after_time_interval setting for rollups (#1026) * Added minimum for search.cancel_after_time_interval setting for rollups * Added constant for cancel_after_time_interval for rollup search * Handled case of default value for cancel interval * Added comment explanation for default rollup cancel after time interval * Fixed github workflow checks --------- * Update 2.11.1 release note (#1042) * Interval schedule should take start time from the request, should not… (#1040) * Interval schedule should take start time from the request, should not set it to the current time of request execution. * Changed the "delayed continuous execution test" to be more expressive about what it should test. * fixed the NPE if schedule.startTime is NULL * fixed the NPE if schedule.startTime is NULL * fixed styling * - removed null checks from RollUp and Transforms - fixed comments in the "delayed execution" test --------- * Removed unused imports --------- (cherry picked from commit 60a8513) Signed-off-by: Joshua Au <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: n-dohrmann <[email protected]> Signed-off-by: Peter Zhu <[email protected]> Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Tanqiu Liu <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Co-authored-by: n-dohrmann <[email protected]> Co-authored-by: Joanne Wang <[email protected]> Co-authored-by: Peter Zhu <[email protected]> Co-authored-by: Oleg Kravchuk <[email protected]> Co-authored-by: ikibo <[email protected]>

* Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (opensearch-project#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (opensearch-project#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (opensearch-project#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (opensearch-project#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (opensearch-project#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (opensearch-project#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (opensearch-project#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (opensearch-project#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (opensearch-project#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (opensearch-project#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (opensearch-project#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (opensearch-project#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (opensearch-project#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (opensearch-project#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (opensearch-project#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (opensearch-project#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (opensearch-project#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]>

…-project#1033) * Added minimum timeout for transforms search of 10 minutes Signed-off-by: Joshua Au <[email protected]> * Extracted cancel minimum code to function Signed-off-by: Joshua Au <[email protected]> * Fixed transform code to use cluster setting Signed-off-by: Joshua Au <[email protected]> * Removed log statements Signed-off-by: Joshua Au <[email protected]> * Changed timeout logic Signed-off-by: Joshua Au <[email protected]> * Switched to basing off seconds Signed-off-by: Joshua Au <[email protected]> * [Feature] Support Transform as an ISM action (opensearch-project#760) * Initial impl Signed-off-by: Tanqiu Liu <[email protected]> * fix style Signed-off-by: Tanqiu Liu <[email protected]> * end to end functional Signed-off-by: Tanqiu Liu <[email protected]> * ISM transform unit tests & integ tests Signed-off-by: Tanqiu Liu <[email protected]> * Fix after core #8157 (opensearch-project#857) Signed-off-by: bowenlan-amzn <[email protected]> * Upgrade the backport workflow (opensearch-project#862) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.9 release notes. (opensearch-project#851) * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Added 2.9 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Handle NPE in isRollupIndex (opensearch-project#855) * Handle NPE in isRollupIndex `metadata.index()` can return `null`, so handle that case by returning `false`. Signed-off-by: Bryce Lampe <[email protected]> * unit test Signed-off-by: Bryce Lampe <[email protected]> --------- Signed-off-by: Bryce Lampe <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix core XcontentType refactor (opensearch-project#873) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix for max & min aggregations when no metric property exist (opensearch-project#870) Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#884) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * update backport branch name (opensearch-project#885) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * core refactor change (opensearch-project#887) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Fix breaking change by core refactor (opensearch-project#888) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix core breaking (opensearch-project#906) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Support copy alias in rollover (opensearch-project#907) * Support copy alias in rollover Signed-off-by: bowenlan-amzn <[email protected]> * 2.10 Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Set preference to _primary when searching control-center index (opensearch-project#911) * Set preference to _primary when searching control-center index Signed-off-by: gaobinlong <[email protected]> * Use _primary_first instead Signed-off-by: gaobinlong <[email protected]> --------- Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Add primary first preference to all search requests (opensearch-project#912) Signed-off-by: Tanqiu Liu <[email protected]> * fix intelliJ IDEA gradle sync error (opensearch-project#916) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * make control center index as system index (opensearch-project#919) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Updates demo certs used in integ tests (opensearch-project#921) Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Added 2.10 release notes (opensearch-project#925) Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * Bump bwc version (opensearch-project#930) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> * fix integ tests; upgrade mappings versions Signed-off-by: Tanqiu Liu <[email protected]> * Fix DCO Signed-off-by: Tanqiu Liu <[email protected]> * Addressed pr comments; Add integ test case for re-execute the same transform action Signed-off-by: Tanqiu Liu <[email protected]> * Addressed detekt error Signed-off-by: Tanqiu Liu <[email protected]> * Added ISMTransform writeable test Signed-off-by: Tanqiu Liu <[email protected]> * Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase Signed-off-by: Tanqiu Liu <[email protected]> --------- Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Signed-off-by: Joshua Au <[email protected]> * [Test] increase the wait time after transform job triggered (opensearch-project#999) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Drafted 2.11 release notes. (opensearch-project#1004) * Drafted 2.11 release notes. Signed-off-by: AWSHurneyt <[email protected]> * Drafted 2.11 release notes. Signed-off-by: AWSHurneyt <[email protected]> --------- Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Refactor change policy API and the policy in managed index to be non-null (opensearch-project#967) * Refactor the policy to be non null in managed index config Signed-off-by: bowenlan-amzn <[email protected]> * Update Signed-off-by: bowenlan-amzn <[email protected]> * fix bug Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Add more error notification at fail points (opensearch-project#1000) * Add more error notification at fail points Signed-off-by: bowenlan-amzn <[email protected]> * Handle exception gracefully Signed-off-by: bowenlan-amzn <[email protected]> * small fix Signed-off-by: bowenlan-amzn <[email protected]> --------- Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * fix the race condition in test reset action start time (opensearch-project#1007) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Bump bwc version after 2.11 release (opensearch-project#1015) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * added type check for pipeline aggregator types in Transform initialization (opensearch-project#1014) Signed-off-by: n-dohrmann <[email protected]> Co-authored-by: Joanne Wang <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Improve security plugin enabling check (opensearch-project#1017) Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Onboard jenkins prod docker images to github actions (opensearch-project#1025) * Onboard jenkins prod docker images to github actions Signed-off-by: Peter Zhu <[email protected]> * Add more Signed-off-by: Peter Zhu <[email protected]> * Add more Signed-off-by: Peter Zhu <[email protected]> --------- Signed-off-by: Peter Zhu <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Support switch aliases in shrink action. (opensearch-project#987) Signed-off-by: Oleg Kravchuk <[email protected]> Co-authored-by: ikibo <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Transform pipeline aggr test (opensearch-project#1027) * tester code: pipeline aggr. transform job Signed-off-by: n-dohrmann <[email protected]> * made test case for pipeline aggregator in transform job Signed-off-by: n-dohrmann <[email protected]> * removed unnec. test lines Signed-off-by: n-dohrmann <[email protected]> * re-added method call on Transform obj Signed-off-by: n-dohrmann <[email protected]> --------- Signed-off-by: n-dohrmann <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Added unit test for switchAliases method. (opensearch-project#1035) * Added unit test for switchAliases method. Signed-off-by: Oleg Kravchuk <[email protected]> * Added unit test for switchAliases method checking the flow when switchAliases is disabled. Signed-off-by: Oleg Kravchuk <[email protected]> --------- Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Interval schedule should take start time from the request, should not set it to the current time of request execution. (opensearch-project#1036) Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Added minimum for search.cancel_after_time_interval setting for rollups (opensearch-project#1026) * Added minimum for search.cancel_after_time_interval setting for rollups Signed-off-by: Joshua Au <[email protected]> * Added constant for cancel_after_time_interval for rollup search Signed-off-by: Joshua Au <[email protected]> * Handled case of default value for cancel interval Signed-off-by: Joshua Au <[email protected]> * Added comment explanation for default rollup cancel after time interval Signed-off-by: Joshua Au <[email protected]> * Fixed github workflow checks Signed-off-by: Joshua Au <[email protected]> --------- Signed-off-by: Joshua Au <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Update 2.11.1 release note (opensearch-project#1042) Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Interval schedule should take start time from the request, should not… (opensearch-project#1040) * Interval schedule should take start time from the request, should not set it to the current time of request execution. Signed-off-by: Oleg Kravchuk <[email protected]> * Changed the "delayed continuous execution test" to be more expressive about what it should test. Signed-off-by: Oleg Kravchuk <[email protected]> * fixed the NPE if schedule.startTime is NULL Signed-off-by: Oleg Kravchuk <[email protected]> * fixed the NPE if schedule.startTime is NULL Signed-off-by: Oleg Kravchuk <[email protected]> * fixed styling Signed-off-by: Oleg Kravchuk <[email protected]> * - removed null checks from RollUp and Transforms - fixed comments in the "delayed execution" test Signed-off-by: Oleg Kravchuk <[email protected]> --------- Signed-off-by: Oleg Kravchuk <[email protected]> Signed-off-by: Joshua Au <[email protected]> * Removed unused imports Signed-off-by: Joshua Au <[email protected]> --------- Signed-off-by: Joshua Au <[email protected]> Signed-off-by: Tanqiu Liu <[email protected]> Signed-off-by: bowenlan-amzn <[email protected]> Signed-off-by: Ashish Agrawal <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Signed-off-by: Bryce Lampe <[email protected]> Signed-off-by: Hailong Cui <[email protected]> Signed-off-by: Subhobrata Dey <[email protected]> Signed-off-by: gaobinlong <[email protected]> Signed-off-by: Darshit Chanpura <[email protected]> Signed-off-by: n-dohrmann <[email protected]> Signed-off-by: Peter Zhu <[email protected]> Signed-off-by: Oleg Kravchuk <[email protected]> Co-authored-by: Tanqiu Liu <[email protected]> Co-authored-by: bowenlan-amzn <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> Co-authored-by: Bryce Lampe <[email protected]> Co-authored-by: Hailong Cui <[email protected]> Co-authored-by: Subhobrata Dey <[email protected]> Co-authored-by: gaobinlong <[email protected]> Co-authored-by: Darshit Chanpura <[email protected]> Co-authored-by: n-dohrmann <[email protected]> Co-authored-by: Joanne Wang <[email protected]> Co-authored-by: Peter Zhu <[email protected]> Co-authored-by: Oleg Kravchuk <[email protected]> Co-authored-by: ikibo <[email protected]>

sbcd90 requested review from bowenlan-amzn, getsaurabh02, lezzago, praveensameneni, xluo-aws, gaobinlong, Hailong-am, amsiglan, eirsep and AWSHurneyt as code owners July 22, 2023 00:39

bowenlan-amzn reviewed Jul 22, 2023

View reviewed changes

bowenlan-amzn reviewed Jul 26, 2023

View reviewed changes

bowenlan-amzn added the backport 2.x label Jul 28, 2023

sbcd90 force-pushed the test1 branch from 426b817 to 4c7642e Compare July 28, 2023 17:54

fix for max & min aggregations when no metric property exist

2b36a79

Signed-off-by: Subhobrata Dey <[email protected]>

sbcd90 force-pushed the test1 branch from 4c7642e to 2b36a79 Compare July 28, 2023 17:59

bowenlan-amzn approved these changes Jul 28, 2023

View reviewed changes

AWSHurneyt approved these changes Jul 28, 2023

View reviewed changes

bowenlan-amzn merged commit 6cbe2f4 into opensearch-project:main Jul 28, 2023

opensearch-trigger-bot bot mentioned this pull request Jul 28, 2023

[Backport 2.x] fix for max & min aggregations when no metric property exist #878

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix for max & min aggregations when no metric property exist #870

fix for max & min aggregations when no metric property exist #870

sbcd90 commented Jul 22, 2023

codecov bot commented Jul 22, 2023 •

edited

Loading

bowenlan-amzn Jul 22, 2023

sbcd90 Jul 24, 2023

bowenlan-amzn Jul 26, 2023

sbcd90 Jul 28, 2023

fix for max & min aggregations when no metric property exist #870

fix for max & min aggregations when no metric property exist #870

Conversation

sbcd90 commented Jul 22, 2023

codecov bot commented Jul 22, 2023 • edited Loading

Codecov Report

bowenlan-amzn Jul 22, 2023

Choose a reason for hiding this comment

sbcd90 Jul 24, 2023

Choose a reason for hiding this comment

bowenlan-amzn Jul 26, 2023

Choose a reason for hiding this comment

sbcd90 Jul 28, 2023

Choose a reason for hiding this comment

codecov bot commented Jul 22, 2023 •

edited

Loading