Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge 'origin/master' into transfer manager branch #2647

Merged
merged 204 commits into from
Aug 9, 2021

Conversation

zoewangg
Copy link
Contributor

@zoewangg zoewangg commented Aug 9, 2021

Merge 'origin/master' into transfer manager branch

Carey-AWS and others added 30 commits July 13, 2021 10:58
…ots built with Lex V1 APIs to V2 APIs. This release adds APIs to initiate and manage the migration of a bot.
…icalDeviceId that it displays the AWS Direct Connect endpoint which terminates a physical connection's BGP Sessions.
… to support a new feature, operational insights.
…4f9d7ef85

Pull request: release <- staging/2cc4fa30-85dd-4377-ab91-f2e4f9d7ef85
…2589)

Pull requests read more intuitively when they begin with the motivation
before diving into a detailed description.
… StartFHIRImportJob and StartFHIRExportJob APIs now require AWS KMS parameter. For more information, see the Amazon HealthLake Documentation https://docs.aws.amazon.com/healthlake/index.html.
…ll-Architected API users to mark answer choices as not applicable.
…htsail object storage service, which allows you to create buckets and store objects.
…ECA-Endpoint settings. This allows customer to delete a field in endpoint settings by using --exact-settings flag in modify-endpoint api. This also displays default values for certain required fields of endpoint settings in describe-endpoint-settings api.
…788554657

Pull request: release <- staging/711e8f67-93b9-4491-bbf4-c4a788554657
* Add support for marshalling lists of strings in HTTP headers...

...for JSON/XML protocols.

## Motivation and Context

We currently lack support for marshalling lists of strings (and enums)
in HTTP headers. Other IDLs and modeling languages, e.g., Smithy, do
support such bindings and services may come to expect such support:

https://awslabs.github.io/smithy/1.0/spec/core/http-traits.html#httpheader-trait

## Description

* Add support for marshalling a list of strings to relevant JSON and XML
marshalling classes
* Consistent with the existing XML HeaderUnmarshaller map
implementation, unmarshalling only supports string value types (this can
be extended in the future if needed)
* Marshalling implementations are changed to use appendHeader rather
than putHeader
* Add convenience method SdkField#getRequiredTrait(..) to support the
common use case of ensuring a trait is present; update other existing
use cases to utilize this method
* Update relevant test classes to correctly recognize headers as a
Map<String, List<String>>
* Only wrap marshalling assertion exceptions as runtime when needed,
minimizing stack trace noise

## Testing

New tests added to:
* rest-json-input.json
* rest-json-output.json
* rest-xml-input.json
* rest-xml-output.json
…o specify weekly recurring time window(s) for scheduled events that reboot, stop or terminate EC2 instances.
AWS and others added 20 commits August 5, 2021 18:56
…bytes of the 16 byte checksum, creating the potential for corrupted downloads to go undetected. (#2646)
…atus and hours of operation. For details, see the Release Notes in the Amazon Connect Administrator Guide.
…allow software developers to create and manage unique instances of their messaging applications.
…s allow software developers to send and receive messages in custom messaging applications.
…fe3201dde

Pull request: release <- staging/20132ea1-1807-41b0-aada-c78fe3201dde
…es of segments (opening credits, content segments, slates, and studio logos), improved accuracy for credits and shot detection and new filters to control black frame detection.
…c8b8c8d9d

Pull request: release <- staging/2a71d721-9cc1-4cb0-a733-a6ec8b8c8d9d
@sonarqubecloud
Copy link

sonarqubecloud bot commented Aug 9, 2021

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

80.6% 80.6% Coverage
0.0% 0.0% Duplication

@zoewangg zoewangg merged commit 150a4b1 into feature/master/transfermanager Aug 9, 2021
@zoewangg zoewangg deleted the zoewang/mergeTM2 branch August 9, 2021 22:42
@zoewangg zoewangg restored the zoewang/mergeTM2 branch August 9, 2021 22:52
zoewangg added a commit that referenced this pull request Aug 9, 2021
zoewangg added a commit that referenced this pull request Aug 10, 2021
* Add download implementation for API requests

* Add S3CrtAsyncClient skeleton

* Add support for adapting the sdk configurations to crt configurations.

* Implement getObject in S3CrtAsyncClient

* Implement S3 CRT upload

* Fix checkstyle errors, add stability tests

* Upgrade crt to 0.11.5

* Update APIs

* Fix CRT S3 Client builder

 - Return the correct type from builder methods
 - Make max throughput and part size nullable

* Implement S3TransferManager#upload

* Implement TransferManager download and add s3-benchmarks module

* Move s3 crt related classes to s3-transfermanager

* Add requestLogger and requestIdLogger

* Various fixes and refactoring

* Add user-agent header in transfer manager

* Refactor UserAgentUtils and make it a protected API

* Fix sdk-benchmarks version

* Rename module and package for transfermanager

* Fix stability tests to not create a new client per request

* Various renaming

* Remove the option to pass bucket and key to DownloadRequest and UploadRequest and remove unused files

* Add README for S3TransferManager

* Add validation in S3ClientConfiguration

* Fix CRT/SDK POJO conversion and add more tests

* Update to use CRT DelegateCredentialsProvider

* Provide HTTP request-level data to PutObjectResponse

* Update Javadocs

* Fix the race condition in the FileAsyncRequestBody which causes the request to hang

* Add request cancellation logic and tests

* Fixed an issue where the future gets stuck when upload fails

* Offload completion of execution future to a separate thread

* Wrap CrtS3RuntimeException to SdkServiceException

* Revert "Wrap CrtS3RuntimeException to SdkServiceException"

* Update s3 crt client tests to verify resources are closed properly

* Wrap CrtS3RuntimeException to S3ServiceException

* Update version

* Bump up CRT version, clean up resources in tests, fix credential adapter TODO (#2594)

* Remove buffer copy since it's no longer needed (#2611)

* Fix fd remaining open longer than necessary (#2616)

In FileAsyncRequestBody, the file was not being closed until a request()
read past the end of the file without ready any bytes; i.e. if a read()
call reads up to the end of the file, it would not complete the
subscription on the subsequent request() signal. This fixes this issue
by signaling complete if we know we've reached the end.

* Cancel sub on finish and exception (#2619)

* Bump up crt version (#2640)

Bump up crt version

* Fix merge conflict

* Merge 'origin/master' into transfer manager branch (#2647)

Co-authored-by: Quanzzzz <[email protected]>
Co-authored-by: John Viegas <[email protected]>
Co-authored-by: Dongie Agnir <[email protected]>
@zoewangg zoewangg deleted the zoewang/mergeTM2 branch October 1, 2021 23:50
aws-sdk-java-automation added a commit that referenced this pull request Aug 8, 2023
…c6d43d5c2

Pull request: release <- staging/ffc15475-3fe0-48b4-a3ef-752c6d43d5c2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants