Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

disagg: Bump aws sdk #8247

Merged
merged 7 commits into from
Oct 31, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -94,13 +94,13 @@
url = https://github.com/guanzhi/GmSSL.git
[submodule "contrib/aws"]
path = contrib/aws
url = https://github.com/JaySon-Huang/aws-sdk-cpp.git
url = https://github.com/aws/aws-sdk-cpp.git
[submodule "contrib/aws-c-auth"]
path = contrib/aws-c-auth
url = https://github.com/awslabs/aws-c-auth.git
[submodule "contrib/aws-c-cal"]
path = contrib/aws-c-cal
url = https://github.com/ClickHouse/aws-c-cal.git
url = https://github.com/awslabs/aws-c-cal.git
[submodule "contrib/aws-c-common"]
path = contrib/aws-c-common
url = https://github.com/awslabs/aws-c-common.git
Expand Down
2 changes: 1 addition & 1 deletion contrib/aws
Submodule aws updated 26380 files
2 changes: 1 addition & 1 deletion contrib/aws-c-auth
Submodule aws-c-auth updated 49 files
+82 −0 .github/ISSUE_TEMPLATE/bug-report.yml
+5 −0 .github/ISSUE_TEMPLATE/config.yml
+23 −0 .github/ISSUE_TEMPLATE/documentation.yml
+47 −0 .github/ISSUE_TEMPLATE/feature-request.yml
+4 −5 .github/workflows/ci.yml
+17 −0 .github/workflows/closed-issue-message.yml
+18 −0 .github/workflows/handle-stale-discussions.yml
+49 −0 .github/workflows/stale_issue.yml
+2 −9 CMakeLists.txt
+7 −0 include/aws/auth/auth.h
+3 −0 include/aws/auth/aws_imds_client.h
+131 −6 include/aws/auth/credentials.h
+3 −0 include/aws/auth/private/aws_signing.h
+11 −1 include/aws/auth/private/credentials_utils.h
+112 −0 include/aws/auth/private/sso_token_providers.h
+58 −0 include/aws/auth/private/sso_token_utils.h
+4 −0 include/aws/auth/signable.h
+3 −0 include/aws/auth/signing.h
+9 −7 include/aws/auth/signing_config.h
+3 −0 include/aws/auth/signing_result.h
+12 −0 source/auth.c
+13 −2 source/aws_imds_client.c
+120 −1 source/aws_signing.c
+140 −44 source/credentials.c
+3 −1 source/credentials_provider_anonymous.c
+26 −1 source/credentials_provider_default_chain.c
+1 −1 source/credentials_provider_ecs.c
+1 −1 source/credentials_provider_environment.c
+14 −15 source/credentials_provider_process.c
+103 −86 source/credentials_provider_profile.c
+851 −0 source/credentials_provider_sso.c
+58 −59 source/credentials_provider_sts.c
+135 −102 source/credentials_provider_sts_web_identity.c
+67 −4 source/credentials_utils.c
+4 −4 source/signing_config.c
+160 −0 source/sso_token_utils.c
+186 −0 source/token_provider_sso_profile.c
+251 −0 source/token_provider_sso_session.c
+46 −5 tests/CMakeLists.txt
+0 −3 tests/aws_profile_tests.c
+73 −2 tests/credentials_provider_process_tests.c
+937 −0 tests/credentials_provider_sso_tests.c
+126 −0 tests/credentials_provider_sts_web_identity_tests.c
+326 −0 tests/credentials_provider_utils.c
+81 −0 tests/credentials_provider_utils.h
+140 −0 tests/credentials_tests.c
+134 −0 tests/sso_token_util_tests.c
+343 −0 tests/test_event_signing.c
+605 −0 tests/token_provider_sso_tests.c
2 changes: 1 addition & 1 deletion contrib/aws-c-cal
Submodule aws-c-cal updated 51 files
+82 −0 .github/ISSUE_TEMPLATE/bug-report.yml
+5 −0 .github/ISSUE_TEMPLATE/config.yml
+23 −0 .github/ISSUE_TEMPLATE/documentation.yml
+47 −0 .github/ISSUE_TEMPLATE/feature-request.yml
+60 −5 .github/workflows/ci.yml
+17 −0 .github/workflows/closed-issue-message.yml
+18 −0 .github/workflows/handle-stale-discussions.yml
+46 −0 .github/workflows/stale_issue.yml
+5 −4 CMakeLists.txt
+7 −1 README.md
+1 −1 bin/produce_x_platform_fuzz_corpus/CMakeLists.txt
+1 −1 bin/run_x_platform_fuzz_corpus/CMakeLists.txt
+2 −1 bin/run_x_platform_fuzz_corpus/main.c
+1 −1 bin/sha256_profile/CMakeLists.txt
+42 −5 builder.json
+12 −15 cmake/aws-c-cal-config.cmake
+1 −0 format-check.sh
+14 −1 include/aws/cal/cal.h
+12 −4 include/aws/cal/ecc.h
+3 −0 include/aws/cal/hash.h
+3 −0 include/aws/cal/hmac.h
+19 −2 include/aws/cal/private/der.h
+20 −8 include/aws/cal/private/opensslcrypto_common.h
+118 −0 include/aws/cal/private/rsa.h
+59 −0 include/aws/cal/private/symmetric_cipher_priv.h
+165 −0 include/aws/cal/rsa.h
+242 −0 include/aws/cal/symmetric_cipher.h
+0 −0 sanitizer-blacklist.txt
+25 −4 source/cal.c
+458 −0 source/darwin/common_cryptor_spi.h
+694 −0 source/darwin/commoncrypto_aes.c
+2 −0 source/darwin/commoncrypto_platform_init.c
+63 −13 source/darwin/securityframework_ecc.c
+491 −0 source/darwin/securityframework_rsa.c
+28 −7 source/der.c
+282 −0 source/rsa.c
+256 −0 source/symmetric_cipher.c
+709 −0 source/unix/openssl_aes.c
+123 −50 source/unix/openssl_platform_init.c
+393 −0 source/unix/openssl_rsa.c
+1 −1 source/unix/opensslcrypto_hmac.c
+1,121 −0 source/windows/bcrypt_aes.c
+5 −6 source/windows/bcrypt_ecc.c
+7 −6 source/windows/bcrypt_hash.c
+2 −0 source/windows/bcrypt_platform_init.c
+422 −0 source/windows/bcrypt_rsa.c
+53 −0 tests/CMakeLists.txt
+1,455 −0 tests/aes256_test.c
+139 −3 tests/der_test.c
+82 −0 tests/ecc_test.c
+747 −0 tests/rsa_test.c
2 changes: 1 addition & 1 deletion contrib/aws-c-common
Submodule aws-c-common updated 135 files
2 changes: 1 addition & 1 deletion contrib/aws-c-http
Submodule aws-c-http updated 56 files
+4 −0 .builder/action/local-server-setup.py
+82 −0 .github/ISSUE_TEMPLATE/bug-report.yml
+5 −0 .github/ISSUE_TEMPLATE/config.yml
+23 −0 .github/ISSUE_TEMPLATE/documentation.yml
+47 −0 .github/ISSUE_TEMPLATE/feature-request.yml
+4 −4 .github/workflows/ci.yml
+17 −0 .github/workflows/closed-issue-message.yml
+18 −0 .github/workflows/handle-stale-discussions.yml
+46 −0 .github/workflows/stale_issue.yml
+1 −1 CMakeLists.txt
+1 −1 bin/elasticurl/CMakeLists.txt
+0 −9 bin/elasticurl/main.c
+3 −2 codebuild/linux-integration-tests.yml
+16 −0 include/aws/http/connection.h
+3 −0 include/aws/http/connection_manager.h
+5 −0 include/aws/http/http.h
+4 −0 include/aws/http/http2_stream_manager.h
+1 −0 include/aws/http/private/h2_connection.h
+2 −0 include/aws/http/private/proxy_impl.h
+2 −0 include/aws/http/private/request_response_impl.h
+3 −0 include/aws/http/proxy.h
+63 −0 include/aws/http/request_response.h
+3 −0 include/aws/http/server.h
+3 −0 include/aws/http/statistics.h
+9 −0 include/aws/http/websocket.h
+4 −4 integration-testing/http_client_test.py
+0 −2 sanitizer-blacklist.txt
+13 −1 source/connection.c
+1 −1 source/connection_manager.c
+91 −1 source/h1_connection.c
+7 −0 source/h1_stream.c
+2 −1 source/h2_connection.c
+1 −1 source/h2_frames.c
+48 −13 source/h2_stream.c
+1 −1 source/hpack.c
+7 −1 source/http.c
+1 −1 source/http2_stream_manager.c
+32 −17 source/proxy_connection.c
+19 −4 source/request_response.c
+1 −1 source/websocket.c
+2 −1 source/websocket_bootstrap.c
+24 −14 tests/CMakeLists.txt
+8 −8 tests/resources/unittests.crt
+ tests/resources/unittests.p12
+26 −0 tests/stream_test_helper.c
+1 −0 tests/stream_test_helper.h
+1 −1 tests/test_connection.c
+53 −8 tests/test_connection_manager.c
+159 −18 tests/test_h1_client.c
+1 −1 tests/test_h1_server.c
+67 −0 tests/test_h2_client.c
+5 −0 tests/test_localhost_integ.c
+4 −2 tests/test_stream_manager.c
+1 −1 tests/test_websocket_bootstrap.c
+1 −1 tests/test_websocket_decoder.c
+1 −1 tests/test_websocket_handler.c
2 changes: 1 addition & 1 deletion contrib/aws-c-io
Submodule aws-c-io updated 78 files
+11 −6 .builder/actions/pkcs11_test_setup.py
+5 −0 .gitattributes
+82 −0 .github/ISSUE_TEMPLATE/bug-report.yml
+5 −0 .github/ISSUE_TEMPLATE/config.yml
+23 −0 .github/ISSUE_TEMPLATE/documentation.yml
+47 −0 .github/ISSUE_TEMPLATE/feature-request.yml
+8 −8 .github/workflows/ci.yml
+17 −0 .github/workflows/closed-issue-message.yml
+18 −0 .github/workflows/handle-stale-discussions.yml
+3 −2 .github/workflows/proof-alarm.yml
+49 −0 .github/workflows/stale_issue.yml
+1 −0 .gitignore
+1 −1 CMakeLists.txt
+2 −2 README.md
+0 −1 builder.json
+3 −2 codebuild/linux-integration-tests.yml
+117 −0 include/aws/io/async_stream.h
+3 −0 include/aws/io/channel.h
+4 −0 include/aws/io/channel_bootstrap.h
+3 −0 include/aws/io/event_loop.h
+627 −0 include/aws/io/future.h
+56 −76 include/aws/io/host_resolver.h
+7 −0 include/aws/io/io.h
+4 −0 include/aws/io/logging.h
+3 −0 include/aws/io/message_pool.h
+99 −0 include/aws/io/pem.h
+3 −0 include/aws/io/pipe.h
+3 −0 include/aws/io/pkcs11.h
+4 −27 include/aws/io/private/pki_utils.h
+22 −0 include/aws/io/private/tracing.h
+5 −0 include/aws/io/retry_strategy.h
+3 −0 include/aws/io/shared_library.h
+9 −0 include/aws/io/socket.h
+6 −0 include/aws/io/socket_channel_handler.h
+3 −0 include/aws/io/statistics.h
+3 −0 include/aws/io/stream.h
+5 −2 include/aws/io/tls_channel_handler.h
+264 −0 include/aws/testing/async_stream_tester.h
+227 −0 include/aws/testing/stream_tester.h
+153 −0 source/async_stream.c
+9 −0 source/bsd/kqueue_event_loop.c
+1 −1 source/channel.c
+23 −20 source/channel_bootstrap.c
+28 −32 source/darwin/darwin_pki_utils.c
+2 −3 source/darwin/secure_transport_tls_channel_handler.c
+11 −3 source/exponential_backoff_retry_strategy.c
+543 −0 source/future.c
+275 −646 source/host_resolver.c
+8 −1 source/io.c
+17 −0 source/linux/epoll_event_loop.c
+436 −0 source/pem.c
+0 −98 source/pem_utils.c
+0 −224 source/pki_utils.c
+15 −5 source/posix/socket.c
+58 −22 source/s2n/s2n_tls_channel_handler.c
+7 −1 source/socket_channel_handler.c
+4 −1 source/stream.c
+2 −0 source/tls_channel_handler.c
+20 −0 source/tracing.c
+19 −9 source/windows/iocp/socket.c
+4 −4 source/windows/secure_channel_tls_handler.c
+21 −35 source/windows/windows_pki_utils.c
+64 −34 tests/CMakeLists.txt
+168 −0 tests/async_stream_test.c
+2 −14 tests/byo_crypto_test.c
+312 −1,402 tests/default_host_resolver_test.c
+57 −0 tests/exponential_backoff_retry_test.c
+739 −0 tests/future_test.c
+22 −0 tests/future_test.h
+432 −220 tests/pem_test.c
+0 −145 tests/pem_utils_test.c
+1 −1 tests/pkcs11_test.c
+1 −1 tests/read_write_test_handler.c
+23 −0 tests/resources/testparse_crlf.crt
+2 −13 tests/socket_handler_test.c
+34 −26 tests/socket_test.c
+69 −25 tests/stream_test.c
+24 −19 tests/tls_handler_test.c
2 changes: 1 addition & 1 deletion contrib/aws-c-mqtt
Submodule aws-c-mqtt updated 73 files
+82 −0 .github/ISSUE_TEMPLATE/bug-report.yml
+5 −0 .github/ISSUE_TEMPLATE/config.yml
+23 −0 .github/ISSUE_TEMPLATE/documentation.yml
+47 −0 .github/ISSUE_TEMPLATE/feature-request.yml
+10 −1 .github/workflows/ci.yml
+17 −0 .github/workflows/closed-issue-message.yml
+18 −0 .github/workflows/handle-stale-discussions.yml
+46 −0 .github/workflows/stale_issue.yml
+2 −9 CMakeLists.txt
+1 −1 bin/elastipubsub/CMakeLists.txt
+1 −1 bin/elastipubsub5/CMakeLists.txt
+1 −1 bin/mqtt5canary/CMakeLists.txt
+92 −10 bin/mqtt5canary/main.c
+4 −8 cmake/aws-c-mqtt-config.cmake
+1 −1 codebuild/CanaryWrapper.py
+1 −1 codebuild/CanaryWrapper_24_7.py
+52 −30 codebuild/CanaryWrapper_Classes.py
+3 −3 codebuild/CanaryWrapper_MetricFunctions.py
+14 −8 codebuild/mqtt-canary-test.yml
+149 −26 include/aws/mqtt/client.h
+16 −0 include/aws/mqtt/mqtt.h
+148 −25 include/aws/mqtt/private/client_impl.h
+123 −0 include/aws/mqtt/private/client_impl_shared.h
+2 −0 include/aws/mqtt/private/fixed_header.h
+135 −0 include/aws/mqtt/private/mqtt311_decoder.h
+1 −1 include/aws/mqtt/private/mqtt_client_test_helper.h
+227 −0 include/aws/mqtt/private/mqtt_subscription_set.h
+3 −0 include/aws/mqtt/private/packets.h
+90 −0 include/aws/mqtt/private/v5/mqtt5_callbacks.h
+67 −4 include/aws/mqtt/private/v5/mqtt5_client_impl.h
+0 −7 include/aws/mqtt/private/v5/mqtt5_decoder.h
+8 −10 include/aws/mqtt/private/v5/mqtt5_options_storage.h
+361 −0 include/aws/mqtt/private/v5/mqtt5_to_mqtt3_adapter_impl.h
+2 −3 include/aws/mqtt/private/v5/mqtt5_utils.h
+23 −11 include/aws/mqtt/v5/mqtt5_client.h
+88 −0 include/aws/mqtt/v5/mqtt5_listener.h
+3 −0 include/aws/mqtt/v5/mqtt5_packet_storage.h
+3 −0 include/aws/mqtt/v5/mqtt5_types.h
+864 −501 source/client.c
+291 −207 source/client_channel_handler.c
+220 −0 source/client_impl_shared.c
+3 −2 source/fixed_header.c
+55 −8 source/mqtt.c
+211 −0 source/mqtt311_decoder.c
+431 −0 source/mqtt_subscription_set.c
+4 −0 source/packets.c
+8 −4 source/topic_tree.c
+159 −0 source/v5/mqtt5_callbacks.c
+113 −116 source/v5/mqtt5_client.c
+2 −99 source/v5/mqtt5_decoder.c
+121 −0 source/v5/mqtt5_listener.c
+134 −122 source/v5/mqtt5_options_storage.c
+3,140 −0 source/v5/mqtt5_to_mqtt3_adapter.c
+2 −8 source/v5/mqtt5_topic_alias.c
+51 −36 source/v5/mqtt5_utils.c
+139 −7 tests/CMakeLists.txt
+158 −0 tests/shared_utils_tests.c
+1,458 −63 tests/v3/connection_state_test.c
+33 −7 tests/v3/mqtt_mock_server_handler.c
+19 −0 tests/v3/mqtt_mock_server_handler.h
+1,320 −0 tests/v3/operation_statistics_test.c
+136 −0 tests/v3/packet_encoding_test.c
+693 −0 tests/v3/packet_framing_tests.c
+50 −7 tests/v3/topic_tree_test.c
+460 −237 tests/v5/mqtt5_client_tests.c
+33 −9 tests/v5/mqtt5_encoding_tests.c
+4 −4 tests/v5/mqtt5_operation_and_storage_tests.c
+237 −111 tests/v5/mqtt5_operation_validation_failure_tests.c
+39 −44 tests/v5/mqtt5_testing_utils.c
+79 −0 tests/v5/mqtt5_testing_utils.h
+4,223 −0 tests/v5/mqtt5_to_mqtt3_adapter_tests.c
+37 −13 tests/v5/mqtt5_utils_tests.c
+832 −0 tests/v5/mqtt_subscription_set_tests.c
2 changes: 1 addition & 1 deletion contrib/aws-c-s3
Submodule aws-c-s3 updated 78 files
+6 −2 .builder/actions/mock_server_setup.py
+82 −0 .github/ISSUE_TEMPLATE/bug-report.yml
+5 −0 .github/ISSUE_TEMPLATE/config.yml
+23 −0 .github/ISSUE_TEMPLATE/documentation.yml
+47 −0 .github/ISSUE_TEMPLATE/feature-request.yml
+17 −8 .github/workflows/ci.yml
+17 −0 .github/workflows/closed-issue-message.yml
+18 −0 .github/workflows/handle-stale-discussions.yml
+46 −0 .github/workflows/stale_issue.yml
+11 −11 CMakeLists.txt
+17 −0 README.md
+9 −7 benchmarks/benchmarks-stack/benchmarks-stack/lib/benchmarks-stack.ts
+1 −1 benchmarks/benchmarks-stack/benchmarks-stack/package.json
+1 −1 benchmarks/dashboard-stack/package.json
+10 −2 include/aws/s3/private/s3_auto_ranged_get.h
+38 −17 include/aws/s3/private/s3_auto_ranged_put.h
+11 −6 include/aws/s3/private/s3_client_impl.h
+5 −2 include/aws/s3/private/s3_copy_object.h
+12 −0 include/aws/s3/private/s3_endpoint_resolver.h
+1 −5 include/aws/s3/private/s3_list_objects.h
+6 −24 include/aws/s3/private/s3_list_parts.h
+97 −17 include/aws/s3/private/s3_meta_request_impl.h
+5 −6 include/aws/s3/private/s3_paginator.h
+90 −3 include/aws/s3/private/s3_request.h
+9 −3 include/aws/s3/private/s3_request_messages.h
+46 −21 include/aws/s3/private/s3_util.h
+15 −0 include/aws/s3/s3.h
+349 −16 include/aws/s3/s3_client.h
+26 −0 include/aws/s3/s3_endpoint_resolver.h
+1 −1 samples/s3/CMakeLists.txt
+15 −10 samples/s3/s3-cp.c
+9 −2 samples/s3/s3-ls.c
+115 −0 scripts/update_s3_endpoint_resolver_artifacts.py
+4 −2 source/s3.c
+67 −34 source/s3_auto_ranged_get.c
+970 −313 source/s3_auto_ranged_put.c
+0 −1 source/s3_checksums.c
+129 −107 source/s3_client.c
+112 −80 source/s3_copy_object.c
+117 −15 source/s3_default_meta_request.c
+0 −11 source/s3_endpoint.c
+201 −0 source/s3_endpoint_resolver/aws_s3_endpoint_resolver_partition.c
+3,227 −0 source/s3_endpoint_resolver/aws_s3_endpoint_rule_set.c
+32 −0 source/s3_endpoint_resolver/s3_endpoint_resolver.c
+43 −85 source/s3_list_objects.c
+55 −115 source/s3_list_parts.c
+351 −150 source/s3_meta_request.c
+37 −36 source/s3_paginator.c
+311 −9 source/s3_request.c
+158 −95 source/s3_request_messages.c
+156 −124 source/s3_util.c
+54 −13 tests/CMakeLists.txt
+1 −1 tests/mock_s3_server/CreateMultipartUpload/default.json
+12 −0 tests/mock_s3_server/GetObject/get_object_checksum_retry.json
+15 −0 tests/mock_s3_server/GetObject/get_object_delay_60s.json
+0 −1 tests/mock_s3_server/GetObject/get_object_unmatch_checksum_crc32.json
+2 −1 tests/mock_s3_server/ListParts/multiple_list_parts_1.json
+2 −1 tests/mock_s3_server/ListParts/multiple_list_parts_2.json
+2 −2 tests/mock_s3_server/ListParts/resume_first_part_not_completed.json
+3 −1 tests/mock_s3_server/README.md
+13 −0 tests/mock_s3_server/UploadPart/throttle.json
+176 −106 tests/mock_s3_server/mock_s3_server.py
+0 −70 tests/s3_bad_input_stream.c
+71 −12 tests/s3_cancel_tests.c
+4 −2 tests/s3_checksums_test_case_helper.h
+1,460 −221 tests/s3_data_plane_tests.c
+112 −0 tests/s3_endpoint_resolver_tests.c
+2 −2 tests/s3_list_objects_tests.c
+8 −8 tests/s3_meta_request_test.c
+263 −45 tests/s3_mock_server_tests.c
+39 −51 tests/s3_request_messages_tests.c
+46 −14 tests/s3_retry_tests.c
+6 −7 tests/s3_test_input_stream.c
+351 −67 tests/s3_tester.c
+56 −8 tests/s3_tester.h
+218 −72 tests/s3_util_tests.c
+29 −19 tests/test_helper/README.md
+71 −21 tests/test_helper/test_helper.py
38 changes: 18 additions & 20 deletions contrib/aws-cmake/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,13 @@ set(AWS_PUBLIC_COMPILE_DEFS)
set(AWS_PRIVATE_COMPILE_DEFS)
set(AWS_PRIVATE_LIBS)

list(APPEND AWS_PRIVATE_COMPILE_DEFS "-DENABLE_CURL_CLIENT")
# Versions
list(APPEND AWS_PUBLIC_COMPILE_DEFS "-DAWS_SDK_VERSION_MAJOR=1")
list(APPEND AWS_PUBLIC_COMPILE_DEFS "-DAWS_SDK_VERSION_MINOR=11")
list(APPEND AWS_PUBLIC_COMPILE_DEFS "-DAWS_SDK_VERSION_PATCH=186")

# ignore the symbols defined in `aws/common/external/ittnotify.h`
list(APPEND AWS_PRIVATE_COMPILE_DEFS "-DENABLE_CURL_CLIENT -DINTEL_NO_ITTNOTIFY_API")

if (CMAKE_BUILD_TYPE_UC STREQUAL "DEBUG")
list(APPEND AWS_PRIVATE_COMPILE_DEFS "-DDEBUG_BUILD")
Expand Down Expand Up @@ -48,7 +54,6 @@ SET(AWS_S2N_TLS_DIR "${TiFlash_SOURCE_DIR}/contrib/aws-s2n-tls")
SET(AWS_S3_DIR "${TiFlash_SOURCE_DIR}/contrib/aws-c-s3")
SET(AWS_SDKUTILS_DIR "${TiFlash_SOURCE_DIR}/contrib/aws-c-sdkutils")


# aws-cpp-sdk-core
file(GLOB AWS_SDK_CORE_SRC
"${AWS_SDK_CORE_DIR}/source/*.cpp"
Expand All @@ -64,15 +69,18 @@ file(GLOB AWS_SDK_CORE_SRC
"${AWS_SDK_CORE_DIR}/source/external/cjson/*.cpp"
"${AWS_SDK_CORE_DIR}/source/external/tinyxml2/*.cpp"
"${AWS_SDK_CORE_DIR}/source/http/*.cpp"
"${AWS_SDK_CORE_DIR}/source/http/standard/*.cpp"
"${AWS_SDK_CORE_DIR}/source/http/curl/*.cpp"
"${AWS_SDK_CORE_DIR}/source/http/standard/*.cpp"
"${AWS_SDK_CORE_DIR}/source/internal/*.cpp"
"${AWS_SDK_CORE_DIR}/source/monitoring/*.cpp"
"${AWS_SDK_CORE_DIR}/source/smithy/*.cpp"
"${AWS_SDK_CORE_DIR}/source/smithy/tracing/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/base64/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/component-registry/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/crypto/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/crypto/openssl/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/crypto/factory/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/crypto/openssl/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/event/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/json/*.cpp"
"${AWS_SDK_CORE_DIR}/source/utils/logging/*.cpp"
Expand All @@ -95,10 +103,6 @@ OPTION(USE_AWS_MEMORY_MANAGEMENT "Aws memory management" OFF)
configure_file("${AWS_SDK_CORE_DIR}/include/aws/core/SDKConfig.h.in"
"${CMAKE_CURRENT_BINARY_DIR}/include/aws/core/SDKConfig.h" @ONLY)

list(APPEND AWS_PUBLIC_COMPILE_DEFS "-DAWS_SDK_VERSION_MAJOR=1")
list(APPEND AWS_PUBLIC_COMPILE_DEFS "-DAWS_SDK_VERSION_MINOR=10")
list(APPEND AWS_PUBLIC_COMPILE_DEFS "-DAWS_SDK_VERSION_PATCH=36")

list(APPEND AWS_SOURCES ${AWS_SDK_CORE_SRC} ${AWS_SDK_CORE_NET_SRC} ${AWS_SDK_CORE_PLATFORM_SRC})

list(APPEND AWS_PUBLIC_INCLUDES
Expand Down Expand Up @@ -140,6 +144,8 @@ file(GLOB AWS_CAL_SRC
)

if (ENABLE_OPENSSL_ENCRYPTION)
# Note: We use `unix/*.c` for both OS_LINUX and OS_DARWIN
# `darwin/*.c` lead to compile errors
file(GLOB AWS_CAL_OS_SRC
"${AWS_CAL_DIR}/source/unix/*.c"
)
Expand Down Expand Up @@ -204,9 +210,6 @@ list(APPEND AWS_PUBLIC_INCLUDES
# aws-checksums
file(GLOB AWS_CHECKSUMS_SRC
"${AWS_CHECKSUMS_DIR}/source/*.c"
"${AWS_CHECKSUMS_DIR}/source/intel/*.c"
"${AWS_CHECKSUMS_DIR}/source/intel/asm/*.c"
"${AWS_CHECKSUMS_DIR}/source/arm/*.c"
)

if(AWS_ARCH_INTEL AND AWS_HAVE_GCC_INLINE_ASM)
Expand All @@ -220,14 +223,6 @@ if (AWS_ARCH_ARM64)
"${AWS_CHECKSUMS_DIR}/source/arm/*.c"
)
set_source_files_properties("${AWS_CHECKSUMS_DIR}/source/arm/crc32c_arm.c" PROPERTIES COMPILE_FLAGS -march=armv8-a+crc)
elseif (AWS_ARCH_ARM32)
if (AWS_ARM32_CRC)
file(GLOB AWS_CHECKSUMS_ARCH_SRC
"${AWS_CHECKSUMS_DIR}/source/arm/*.c"
"${AWS_CHECKSUMS_DIR}/source/arm/asm/*.c"
)
set_source_files_properties(source/arm/crc32c_arm.c PROPERTIES COMPILE_FLAGS -march=armv8-a+crc)
endif()
endif()

list(APPEND AWS_SOURCES ${AWS_CHECKSUMS_SRC} ${AWS_CHECKSUMS_ARCH_SRC})
Expand All @@ -248,6 +243,8 @@ elseif (OS_DARWIN)
file(GLOB AWS_IO_OS_SRC
"${AWS_IO_DIR}/source/bsd/*.c"
"${AWS_IO_DIR}/source/posix/*.c"
# Note darwin source files leads to compile errors, ignore them
# "${AWS_IO_DIR}/source/darwin/*.c"
)
endif()

Expand Down Expand Up @@ -290,13 +287,14 @@ file(GLOB AWS_CRT_SRC
"${AWS_CRT_DIR}/source/auth/*.cpp"
"${AWS_CRT_DIR}/source/crypto/*.cpp"
"${AWS_CRT_DIR}/source/endpoints/*.cpp"
"${AWS_CRT_DIR}/source/external/*.cpp"
"${AWS_CRT_DIR}/source/http/*.cpp"
"${AWS_CRT_DIR}/source/io/*.cpp"
)

list(APPEND AWS_SOURCES ${AWS_CRT_SRC})
list(APPEND AWS_PUBLIC_INCLUDES "${AWS_CRT_DIR}/include/")
configure_file("${AWS_CRT_DIR}/include/aws/crt/Config.h.in"
${CMAKE_CURRENT_BINARY_DIR}/include/aws/crt/Config.h @ONLY)


# aws-c-mqtt
Expand Down
2 changes: 1 addition & 1 deletion contrib/aws-crt-cpp
Submodule aws-crt-cpp updated 84 files
+28 −3 .builder/actions/build_crt.py
+3 −11 .builder/actions/crt-ci-prep.py
+82 −0 .github/ISSUE_TEMPLATE/bug-report.yml
+5 −0 .github/ISSUE_TEMPLATE/config.yml
+23 −0 .github/ISSUE_TEMPLATE/documentation.yml
+47 −0 .github/ISSUE_TEMPLATE/feature-request.yml
+66 −29 .github/workflows/ci.yml
+17 −0 .github/workflows/closed-issue-message.yml
+1 −1 .github/workflows/docs.yml
+19 −0 .github/workflows/handle-stale-discussions.yml
+1 −1 .github/workflows/lint.yml
+2 −2 .github/workflows/release.yml
+49 −0 .github/workflows/stale_issue.yml
+16 −56 CMakeLists.txt
+1 −1 README.md
+1 −1 VERSION
+7 −7 bin/elasticurl_cpp/CMakeLists.txt
+7 −7 bin/mqtt5_app/CMakeLists.txt
+37 −37 bin/mqtt5_app/main.cpp
+7 −8 bin/mqtt5_canary/CMakeLists.txt
+201 −132 bin/mqtt5_canary/main.cpp
+4 −1 builder.json
+0 −71 cmake/AwsCheckHeadersCxx.cmake
+330 −0 codebuild/CanaryWrapper.py
+1,288 −0 codebuild/CanaryWrapper_Classes.py
+48 −0 codebuild/CanaryWrapper_MetricFunctions.py
+12 −13 codebuild/linux-integration-tests.yml
+51 −0 codebuild/mqtt5-cpp-canary-test.yml
+1 −1 crt/aws-c-auth
+1 −1 crt/aws-c-cal
+1 −1 crt/aws-c-common
+1 −1 crt/aws-c-compression
+1 −1 crt/aws-c-event-stream
+1 −1 crt/aws-c-http
+1 −1 crt/aws-c-io
+1 −1 crt/aws-c-mqtt
+1 −1 crt/aws-c-s3
+1 −1 crt/aws-c-sdkutils
+1 −1 crt/aws-checksums
+1 −1 crt/aws-lc
+1 −1 crt/s2n
+173 −87 docsrc/Doxyfile
+79 −32 include/aws/crt/JsonObject.h
+17 −17 include/aws/crt/Optional.h
+1 −1 include/aws/crt/auth/Signing.h
+0 −309 include/aws/crt/external/cJSON.h
+5 −4 include/aws/crt/http/HttpRequestResponse.h
+6 −3 include/aws/crt/io/Stream.h
+41 −107 include/aws/crt/mqtt/Mqtt5Client.h
+61 −61 include/aws/crt/mqtt/Mqtt5Packets.h
+7 −418 include/aws/crt/mqtt/MqttClient.h
+462 −0 include/aws/crt/mqtt/MqttConnection.h
+130 −0 include/aws/crt/mqtt/MqttTypes.h
+260 −0 include/aws/crt/mqtt/private/Mqtt5ClientCore.h
+395 −0 include/aws/crt/mqtt/private/MqttConnectionCore.h
+45 −24 include/aws/iot/Mqtt5Client.h
+51 −3 include/aws/iot/MqttClient.h
+10 −0 include/aws/iot/MqttCommon.h
+7 −20 source/Api.cpp
+294 −271 source/JsonObject.cpp
+0 −3,120 source/external/cJSON.cpp
+20 −0 source/io/Stream.cpp
+141 −55 source/iot/Mqtt5Client.cpp
+70 −0 source/iot/MqttClient.cpp
+80 −444 source/mqtt/Mqtt5Client.cpp
+658 −0 source/mqtt/Mqtt5ClientCore.cpp
+70 −70 source/mqtt/Mqtt5Packets.cpp
+19 −724 source/mqtt/MqttClient.cpp
+303 −0 source/mqtt/MqttConnection.cpp
+924 −0 source/mqtt/MqttConnectionCore.cpp
+79 −8 tests/CMakeLists.txt
+13 −9 tests/CredentialsTest.cpp
+2 −1 tests/HostResolverTest.cpp
+3 −5 tests/ImdsClientTest.cpp
+1,109 −145 tests/IotServiceTest.cpp
+60 −0 tests/JsonParserTest.cpp
+1,028 −0 tests/Mqtt5ClientCredentialsTest.cpp
+1,331 −873 tests/Mqtt5ClientTest.cpp
+1,016 −0 tests/MqttClientCredentialsTest.cpp
+475 −3 tests/MqttClientTest.cpp
+27 −27 tests/ProxyTest.cpp
+169 −6 tests/Sigv4SigningTest.cpp
+3 −3 tests/StreamTest.cpp
+1 −0 tests/resources/suppressions-lsan.txt
2 changes: 1 addition & 1 deletion contrib/aws-s2n-tls
Submodule aws-s2n-tls updated 708 files
22 changes: 11 additions & 11 deletions dbms/src/Server/Server.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -705,28 +705,25 @@ class Server::TcpHttpServersHolder
server->start();
}

// terminate all TCP servers when receive exit signal
void onExit()
{
auto & config = server.config();

LOG_DEBUG(log, "Received termination signal.");
LOG_DEBUG(log, "Waiting for current connections to close.");
LOG_INFO(log, "Received termination signal, stopping server...");
LOG_INFO(log, "Waiting for current connections to close.");

int current_connections = 0;
for (auto & server : servers)
{
server->stop();
current_connections += server->currentConnections();
}
String debug_msg = "Closed all listening sockets.";

if (current_connections)
LOG_DEBUG(log, "{} Waiting for {} outstanding connections.", debug_msg, current_connections);
else
LOG_DEBUG(log, debug_msg);

String debug_msg = "Closed all listening sockets.";
if (current_connections)
{
LOG_INFO(log, "{} Waiting for {} outstanding connections.", debug_msg, current_connections);
const int sleep_max_ms = 1000 * config.getInt("shutdown_wait_unfinished", 5);
const int sleep_one_ms = 100;
int sleep_current_ms = 0;
Expand All @@ -741,18 +738,21 @@ class Server::TcpHttpServersHolder
std::this_thread::sleep_for(std::chrono::milliseconds(sleep_one_ms));
}
}
else
{
LOG_INFO(log, debug_msg);
}

debug_msg = "Closed connections.";

if (current_connections)
LOG_DEBUG(
LOG_INFO(
log,
"{} But {} remains."
" Tip: To increase wait time add to config: <shutdown_wait_unfinished>60</shutdown_wait_unfinished>",
debug_msg,
current_connections);
else
LOG_DEBUG(log, debug_msg);
LOG_INFO(log, debug_msg);
}

private:
Expand Down