Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[draft] multipart download #5164

Draft
wants to merge 20 commits into
base: master
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 14 commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
7100df4
Merge from master (#4901)
L-Applin Feb 8, 2024
8c18e39
Splitting transformer (#4826)
L-Applin Feb 12, 2024
b247de9
Enable setting multipart to true/false by defining it as a custom cli…
anirudh9391 Feb 12, 2024
511205c
Add config class for SplittingTransformer (#4939)
davidh44 Feb 17, 2024
730750e
Merge mainline into multipart feature branch (#4965)
L-Applin Feb 26, 2024
a98af91
Surface area review (#4971)
L-Applin Feb 29, 2024
dd3eb20
MultipartS3AsyncClient download benchmarks (#4948)
davidh44 Mar 1, 2024
336fd35
Implementation of MultipartDownloaderSubscriber (#4931)
L-Applin Mar 7, 2024
7d82774
Update s3-benchmarks to support java-based multipart download. (#5003)
L-Applin Mar 11, 2024
9f4563b
Use Content-Range in multipart download for totalBytes (#5101)
L-Applin Apr 12, 2024
330ab9f
change NoopTransformer type-param to Object, preventing an NPE which …
L-Applin Apr 17, 2024
e041ca2
Fix for threads hanging with forwardTransformedResultTo (#5117)
L-Applin Apr 22, 2024
4187e62
Merge branch 'master' into feature/master/s3mpu
L-Applin Apr 25, 2024
d5dff64
Merge branch 'master' into feature/master/s3mpu
L-Applin Apr 29, 2024
97f0a5f
[draft] java-based integ test (#5129)
L-Applin May 1, 2024
768526e
Fix merge issue and bump peak thread count in stability tests (#5174)
zoewangg May 2, 2024
405cc74
Fix stability tests (#5178)
zoewangg May 3, 2024
1660397
Fix for multipart integ test failure (#5176)
L-Applin May 21, 2024
85a8f89
FileAsyncResponseTransformer - write to position (#5241)
L-Applin May 23, 2024
ee6ebff
add completed to ResumableFileDownload ser/des (#5254)
L-Applin May 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
60 changes: 60 additions & 0 deletions .changes/2.23.1.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
{
"version": "2.23.1",
"date": "2024-01-11",
"entries": [
{
"type": "bugfix",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Fix IllegalArgumentException in FullJitterBackoffStrategy when base delay and max backoff time are zero."
},
{
"type": "feature",
"category": "AWS IoT",
"contributor": "",
"description": "Add ConflictException to Update APIs of AWS IoT Software Package Catalog"
},
{
"type": "feature",
"category": "AWS IoT FleetWise",
"contributor": "",
"description": "The following dataTypes have been removed: CUSTOMER_DECODED_INTERFACE in NetworkInterfaceType; CUSTOMER_DECODED_SIGNAL_INFO_IS_NULL in SignalDecoderFailureReason; CUSTOMER_DECODED_SIGNAL_NETWORK_INTERFACE_INFO_IS_NULL in NetworkInterfaceFailureReason; CUSTOMER_DECODED_SIGNAL in SignalDecoderType"
},
{
"type": "feature",
"category": "AWS Secrets Manager",
"contributor": "",
"description": "Doc only update for Secrets Manager"
},
{
"type": "feature",
"category": "Amazon EC2 Container Service",
"contributor": "",
"description": "This release adds support for adding an ElasticBlockStorage volume configurations in ECS RunTask/StartTask/CreateService/UpdateService APIs. The configuration allows for attaching EBS volumes to ECS Tasks."
},
{
"type": "feature",
"category": "Amazon Elastic Compute Cloud",
"contributor": "",
"description": "This release adds support for adding an ElasticBlockStorage volume configurations in ECS RunTask/StartTask/CreateService/UpdateService APIs. The configuration allows for attaching EBS volumes to ECS Tasks."
},
{
"type": "feature",
"category": "Amazon EventBridge",
"contributor": "",
"description": "Adding AppSync as an EventBridge Target"
},
{
"type": "feature",
"category": "Amazon WorkSpaces",
"contributor": "",
"description": "Added AWS Workspaces RebootWorkspaces API - Extended Reboot documentation update"
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Updated endpoint and partition metadata."
}
]
}
36 changes: 36 additions & 0 deletions .changes/2.23.10.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
{
"version": "2.23.10",
"date": "2024-01-24",
"entries": [
{
"type": "feature",
"category": "AWS Outposts",
"contributor": "",
"description": "DeviceSerialNumber parameter is now optional in StartConnection API"
},
{
"type": "feature",
"category": "AWS Storage Gateway",
"contributor": "",
"description": "Add DeprecationDate and SoftwareVersion to response of ListGateways."
},
{
"type": "feature",
"category": "Amazon EC2 Container Service",
"contributor": "",
"description": "Documentation updates for Amazon ECS."
},
{
"type": "feature",
"category": "Amazon Elastic Compute Cloud",
"contributor": "",
"description": "Introduced a new clientToken request parameter on CreateNetworkAcl and CreateRouteTable APIs. The clientToken parameter allows idempotent operations on the APIs."
},
{
"type": "feature",
"category": "Amazon Relational Database Service",
"contributor": "",
"description": "This release adds support for Aurora Limitless Database."
}
]
}
18 changes: 18 additions & 0 deletions .changes/2.23.11.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
{
"version": "2.23.11",
"date": "2024-01-25",
"entries": [
{
"type": "feature",
"category": "AWS Certificate Manager Private Certificate Authority",
"contributor": "",
"description": "AWS Private CA now supports an option to omit the CDP extension from issued certificates, when CRL revocation is enabled."
},
{
"type": "feature",
"category": "Amazon Lightsail",
"contributor": "",
"description": "This release adds support for IPv6-only instance plans."
}
]
}
36 changes: 36 additions & 0 deletions .changes/2.23.12.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
{
"version": "2.23.12",
"date": "2024-01-26",
"entries": [
{
"type": "bugfix",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Fixed bug where the ProfileCredentialsProvider would re-read the credentials file with each request by default."
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Improved performance of chunk-encoded streaming uploads, like S3's PutObject."
},
{
"type": "feature",
"category": "Amazon Connect Service",
"contributor": "",
"description": "Update list and string length limits for predefined attributes."
},
{
"type": "feature",
"category": "Amazon SageMaker Service",
"contributor": "",
"description": "Amazon SageMaker Automatic Model Tuning now provides an API to programmatically delete tuning jobs."
},
{
"type": "feature",
"category": "Inspector2",
"contributor": "",
"description": "This release adds ECR container image scanning based on their lastRecordedPullTime."
}
]
}
54 changes: 54 additions & 0 deletions .changes/2.23.13.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
{
"version": "2.23.13",
"date": "2024-01-29",
"entries": [
{
"type": "bugfix",
"category": "Amazon Simple Storage Service",
"contributor": "",
"description": "S3 client configured with crossRegionEnabled(true) will now use us-east-1 regional endpoint instead of the global endpoint. See [#4720](https://github.com/aws/aws-sdk-java-v2/issues/4720)."
},
{
"type": "feature",
"category": "Amazon Comprehend",
"contributor": "",
"description": "Comprehend PII analysis now supports Spanish input documents."
},
{
"type": "feature",
"category": "Amazon Elastic Compute Cloud",
"contributor": "",
"description": "EC2 Fleet customers who use attribute based instance-type selection can now intuitively define their Spot instances price protection limit as a percentage of the lowest priced On-Demand instance type."
},
{
"type": "feature",
"category": "Amazon Import/Export Snowball",
"contributor": "",
"description": "Modified description of createaddress to include direction to add path when providing a JSON file."
},
{
"type": "feature",
"category": "AmazonMWAA",
"contributor": "",
"description": "This release adds MAINTENANCE environment status for Amazon MWAA environments."
},
{
"type": "feature",
"category": "Amazon Relational Database Service",
"contributor": "",
"description": "Introduced support for the InsufficientDBInstanceCapacityFault error in the RDS RestoreDBClusterFromSnapshot and RestoreDBClusterToPointInTime API methods. This provides enhanced error handling, ensuring a more robust experience."
},
{
"type": "feature",
"category": "Auto Scaling",
"contributor": "",
"description": "EC2 Auto Scaling customers who use attribute based instance-type selection can now intuitively define their Spot instances price protection limit as a percentage of the lowest priced On-Demand instance type."
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Updated endpoint and partition metadata."
}
]
}
24 changes: 24 additions & 0 deletions .changes/2.23.14.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
{
"version": "2.23.14",
"date": "2024-01-30",
"entries": [
{
"type": "feature",
"category": "Amazon DataZone",
"contributor": "",
"description": "Add new skipDeletionCheck to DeleteDomain. Add new skipDeletionCheck to DeleteProject which also automatically deletes dependent objects"
},
{
"type": "feature",
"category": "Amazon Route 53",
"contributor": "",
"description": "Update the SDKs for text changes in the APIs."
},
{
"type": "feature",
"category": "Amazon S3",
"contributor": "",
"description": "Reduce memory usage when request-level plugins aren't used."
}
]
}
42 changes: 42 additions & 0 deletions .changes/2.23.15.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
{
"version": "2.23.15",
"date": "2024-01-31",
"entries": [
{
"type": "feature",
"category": "AWS CloudFormation",
"contributor": "",
"description": "CloudFormation IaC generator allows you to scan existing resources in your account and select resources to generate a template for a new or existing CloudFormation stack."
},
{
"type": "feature",
"category": "AWS Glue",
"contributor": "",
"description": "Update page size limits for GetJobRuns and GetTriggers APIs."
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Reduce how many times input data is copied when writing to chunked encoded operations, like S3's PutObject."
},
{
"type": "feature",
"category": "Amazon Simple Systems Manager (SSM)",
"contributor": "",
"description": "This release adds an optional Duration parameter to StateManager Associations. This allows customers to specify how long an apply-only-on-cron association execution should run. Once the specified Duration is out all the ongoing cancellable commands or automations are cancelled."
},
{
"type": "feature",
"category": "Elastic Load Balancing",
"contributor": "",
"description": "This release enables unhealthy target draining intervals for Network Load Balancers."
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Updated endpoint and partition metadata."
}
]
}
48 changes: 48 additions & 0 deletions .changes/2.23.16.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
{
"version": "2.23.16",
"date": "2024-02-01",
"entries": [
{
"type": "feature",
"category": "AWS Elemental MediaConvert",
"contributor": "",
"description": "This release includes support for broadcast-mixed audio description tracks."
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Switching a set of services onto the new SRA (Smithy Reference Architecture) identity and auth logic that was released in v2.21.0. For a list of individual services affected, please check the committed files."
},
{
"type": "feature",
"category": "Amazon Cognito Identity Provider",
"contributor": "",
"description": "Added CreateIdentityProvider and UpdateIdentityProvider details for new SAML IdP features"
},
{
"type": "feature",
"category": "Amazon Interactive Video Service",
"contributor": "",
"description": "This release introduces a new resource Playback Restriction Policy which can be used to geo-restrict or domain-restrict channel stream playback when associated with a channel. New APIs to support this resource were introduced in the form of Create/Delete/Get/Update/List."
},
{
"type": "feature",
"category": "Amazon Managed Blockchain Query",
"contributor": "",
"description": "This release adds support for transactions that have not reached finality. It also removes support for the status property from the response of the GetTransaction operation. You can use the confirmationStatus and executionStatus properties to determine the status of the transaction."
},
{
"type": "feature",
"category": "Amazon Neptune Graph",
"contributor": "",
"description": "Adding new APIs in SDK for Amazon Neptune Analytics. These APIs include operations to execute, cancel, list queries and get the graph summary."
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Updated endpoint and partition metadata."
}
]
}
36 changes: 36 additions & 0 deletions .changes/2.23.17.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
{
"version": "2.23.17",
"date": "2024-02-02",
"entries": [
{
"type": "feature",
"category": "AWS CRT-based S3 Client",
"contributor": "",
"description": "Allow users to configure future completion executor on the AWS CRT-based S3 client via `S3CrtAsyncClientBuilder#futureCompletionExecutor`. See [#4879](https://github.com/aws/aws-sdk-java-v2/issues/4879)"
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Adds setting to disable making EC2 Instance Metadata Service (IMDS) calls without a token header when prefetching a token does not work. This feature can be configured through environment variables (AWS_EC2_METADATA_V1_DISABLED), system property (aws.disableEc2MetadataV1) or AWS config file (ec2_metadata_v1_disabled). When you configure this setting to true, no calls without token headers will be made to IMDS."
},
{
"type": "feature",
"category": "Amazon DynamoDB",
"contributor": "",
"description": "Any number of users can execute up to 50 concurrent restores (any type of restore) in a given account."
},
{
"type": "feature",
"category": "Amazon SageMaker Service",
"contributor": "",
"description": "Amazon SageMaker Canvas adds GenerativeAiSettings support for CanvasAppSettings."
},
{
"type": "feature",
"category": "AWS SDK for Java v2",
"contributor": "",
"description": "Updated endpoint and partition metadata."
}
]
}
18 changes: 18 additions & 0 deletions .changes/2.23.18.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
{
"version": "2.23.18",
"date": "2024-02-05",
"entries": [
{
"type": "feature",
"category": "AWS Glue",
"contributor": "",
"description": "Introduce Catalog Encryption Role within Glue Data Catalog Settings. Introduce SASL/PLAIN as an authentication method for Glue Kafka connections"
},
{
"type": "feature",
"category": "Amazon WorkSpaces",
"contributor": "",
"description": "Added definitions of various WorkSpace states"
}
]
}