Soto Core

Minor Changes

• Add support for role_arn, credential_source and source_profile tags in ~/.aws/credentials and ~/.aws/config files. PR #408, #415 from @eneko
• Added AWSService.signHeaders to provide signed headers for a request. Required when signing Elasticsearch queries. PR #414
• Added public NullCredentialProvider.init.
• Add support for CustomCoding property wrappers of header and query values.
• Add s3UseDualStackEndpoint and s3UseTransferAcceleratedEndpoint flags to AWSServiceConfig.Options.

Patch Changes

• Retry requests on HTTPClient.remoteConnectionClosed error.
• Percent encode non S3 URLs twice while signing. PR #414
• Percent encode "+" character in S3 URLs before signing. PR #414
• Fix sorting of query parameters in V4 Signer. Sort query params by key and if key is equal then by value. PR #414

Major changes

• Soto: The rename to Soto is complete. The package name is "soto-core" and core library is now "SotoCore".
• AWSClient has now been split from the service objects. So you can have one AWSClient that is used by many services.
• HTTP Client: We are now using the swift server async-http-client instead of own custom http client. We also provide the ability for the user to replace this client with their own.
• Credential providers: Abstracted credential acquisition to make it easier to write credential providers and control which credential providers you want to use.
• Swift server eco-system: On top of using async-http-client we have added support for swift-log and swift-metrics.
• Crypto: There is no dependency on openssl libraries anymore. Instead we use swift-crypto on Linux and CommonCrypto on macOS and iOS.
• Request/Response encoding/decoding:
  • We have added a Codable based QueryEncoder so all protocols now use Codable for serialisation.
  • Added property wrappers for Collection types Array and Dictionary to define how they are serialised. We have also included property wrappers for Date which has allowed us to remove Timestamp and replace it with Date.
  • Fixed many serialisation bugs.
• Request Signing: The V4 signer has been completely re-written and is available as a separate library. This also added support for signing streamed S3 requests.
• Streaming: We have added support for both streaming of request data and streaming of response data thus allowing the uploading and downloading of large files without requiring a large memory footprint. Added AWSPayload for raw payloads. Allows the user to supply a payload as a String, Data, ByteBuffer or closure supplying a stream of ByteBuffers.
• Retrying Requests: AWSClient now retries requests that have failed. You can define how the client does this using a RetryPolicy object.
• Errors: Errors thrown by SotoCore are now structs and not enums. They also hold additional data like the response code and http headers returned.
• Added AWSService protocol with support for signing URLs and creating edited versions of services.
• Added new Array.reduce style paginator functions.

Major version changes

• RetryPolicy is now provided with processed errors instead of a raw http response. PR #394
• Logger and EventLoop parameter order in public functions AWSClient.execute and AWSClient.paginate has been swapped around. PR #399

Minor version changes

• Added errors invalidSignature, signatureDoesNotMatch and unrecognizedClient that are common across many service to AWSClientError.
• Added RotatingCredential struct so we don't need to keep re-implementing it.
• Added additionalFields to AWSErrorContext. Any additional fields on top of the errorCode and message are stored here. PR #392
• Added createNewWithEventLoopGroup to AWSClient.HttpClientProvider. PR #395
• Added AWSClient.ClientError.notEnoughData error, which is thrown when a streaming function indicates it has finished passing on data but it has not provided enough data.
• Added Region(awsRegionName:) which verifies it has been passed an AWS region name. PR #397 by @sebsto
• SotoSignerV4 is now available as a library separate from SotoCore

Patch version changes

• When calculating the delay before retrying a failed request, check the Retry-After header in the response. PR #394
• Retry when response is a throttling error. PR #394
• Pass EventLoop to AWSClient.invoke. PR #398
• HTTPClient created by AWSClient has a default connection timeout of 10 seconds
• Fixed issues with S3 streaming code where data was not passed onto the HTTP streaming code and where already streamed data was not de-allocated. PR #400
• Request signer should sort header values by key not key=value. PR #401

• Fixed crash in XML parser when given invalid content

Major version changes

• Extended AWSErrorType protocol to include context structure which includes message, http status code and headers. PR #389

Minor version changes

• Add Array.reduce style paginator functions. PR #385
• Make SotoTestUtils a library so it is available to other Packages. PR #386

Patch version changes

• Fixed percent encoding of URL paths, which was being removed. Also fixed encoding of "+" character. PR #390

Major version changes

• AWSService.signURL no longer has a default for the expiration time expires. It has also been changed to a NIO.TimeAmount from a integer. PR #373
• Removed Date wrapping struct Timestamp. Dates are now decoded based on service protocol. This can be overidden with a DateFormatCoder property wrapper. PR #383
• Renamed Coding to CustomCoding, OptionalCoding to OptionalCustomCoding. PR #376
• Renamed DefaultArrayCoder to StandardArrayCoder, DefaultDictionaryCoder to StandardDictionaryCoder. PR #376

Minor version changes

• Add ability to include headers when generating a signed URL. When you use the URL you will need to supply the exact same headers. PR #367
• Added AWSService.with which creates a new copy of a service with edited values. Values you can edit include middlewares, timeout, byteBufferAllocator and options. PR #377
• Region now conforms to Codable. PR #375

Patch version changes

• Allow for JSON error messages with message key capitalized. This fixes issue with Lambda service errors being unhandled. PR #370
• Improve performance of QueryEncoder. PR #380
• Run benchmarks on all PRs. PR #381

Patch version changes

• Removes duplicate "/" in InstanceMetaDataServiceProvider request to avoid redirect. PR #371 from @t089

AWS SDK Swift has been renamed to Soto

Major version changes

• AWS SDK Swift Core has changed name and is now called SotoCore. The package name is "soto-core".
• Body.json now holds a ByteBuffer instead of Data. PR #350
• Add offset function parameter to AWSPayload.fileHandle. PR #352
• Add 'context' parameter to AWSServiceMiddleware.chain() functions
• AWSClient.signURL use HTTPMethod instead of a String for the http method.
• Renamed TimeStampFormatterCoder to TimeStampFormatCoder and made it internal. PR #364

Minor version changes

• AWSClient.HTTPResponseError is now public. This eases the writing of custom RetryPolicy objects.
• Added AWSService a protocol for AWS services which provides helper vars to access the service region, endpoint and eventLoopGroup and a function for signing a URL for use by the service. PR #347
• Added ByteBufferAllocator to AWSServiceConfig to be used throughout AWSClient. PR #351
• Add pagination functions that include a test for a moreResults flag.
• Add support to TimeStampFormatCoder for multiple time formats and add both with millisecond and without millisecond formats to the ISO8601TimeStampCoder. PR #364
• Make AWSPayload.size public

Patch version changes

• Provide common internal execute function used by all the public execute functions. PR #349
• Fix bug in DeferredCredentialProvider where credential can be accessed and written at same time. PR #357
• Add Glibc import at top of Expat.swift to aid cross compiler compilation
• Tilda expansion for config file loading on macOS sandboxed apps expands to the home folder, instead of folder inside container. PR #361 from @sebsto
• Fix v4 signer issue when the URL ends in a slash. This fixes signing issue for Lambda.ListFunctions. PR #363

Major version changes

• Use AsyncHTTPClient for macOS and iOS builds. This requires v1.2.0 of AsyncHTTPClient. NIOTSHTTPClient has been removed from the project. PR #339
• Use Expat for XML parsing. This allows us to remove our dependency on FoundationXML. PR #342
• Add RetryPolicyFactory setup in similar manner to the CredentialProviderFactory. Allows you to choose RetryPolicy using dot notation eg AWSClient(retryPolicy: .jitter(), ...). Also allows us to remove a number of public symbols. PR #323
• AWSClient.ClientError is now a struct. PR #338
• Add progress callback to AWSPayload.fileHandle. PR #334
• Replace HTTP method string with enum NIOHTTP1.HTTPMethod. PR #329
• Add logging to AWSClient. Pass in a swift-log Logger to output log information. PR #330, #331, #332
• Partition renamed to AWSPartition
• PayloadOptions renamed to AWSShapePayloadOptions. PR #322

Minor version changes

• Add AWSClient.credentialProvider.shutdown() to shutdown AWSClient asynchronously. PR #327, #333
• Add HTTP client timeout value to AWSServiceConfig. PR #328
• Added ap-northeast-3 (Osaka Local) region.
• AWSClient.credentialProvider is now public.

Internal changes

• Use SwiftFormat for code formatting.

Add Region ap-northeast-3 (Asia Pacific (Osaka-Local))

• Use full .package() enum in Package.swift for swift-crypto package. This appears to resolve issues with latest version of swift 5.3

Major version changes:

• AWS Service configuration data is now stored in a AWSServiceConfig class.
• Renamed AWSClient.send methods to execute. PR #309 from @Ro-M
• AWSClient no longer owns the service configuration data. This is passed to the AWSClient in the execute methods. This allows us to separate the client from the services and have one client serving multiple services. PR #309 from @Ro-M
• AWS Credentials are supplied via a CredentialProvider. Possible credential provider parameters are static: provide credentials directly, environment: from environment variables, ec2: from EC2 metadata, ecs: from ECS metadata, configFile: from ~/.aws/credentials file, empty: no credentials or selector: choose from a list of credential providers. If you don't provide a CredentialProvider the default is .selector(.environment, .ecs, .ec2, .configFile()). PR #258, #303, #314, #318, #306
• Added support for streaming response payloads. This is only available if you are using AsyncHTTPClient though. PR #236
• Added AWSClient.syncShutdown() to shutdown HTTPClient and any active CredentialProviders. It is required to call this before deleting the AWSClient. PR #293
• Move XML code to separate target AWSXML. PR #271
• Removed AWSMemberEncoding.encoding. Raw payload flag is now OptionSet entry PayloadOptions.raw. PR #294
• AWSRequest uses NIO HTTPHeaders instead of a dictionary for headers. PR #301
• AWSPayload.stream returns a StreamReaderResult instead of a ByteBuffer. Instead of returning an empty ByteBuffer to indicate the stream is done you now return .end. PR #316

Minor version changes:

• S3 streamed requests are now signed. PR #277
• Moved AWSClient.validate and AWSClient.createError to AWSResponse. PR #295
• Moved AWSClient.createAWSRequest into AWSRequest.init. PR #296 from @Ro-M
• AWSTestServer and TestUtils have been moved to separate target AWSTestUtils. PR #271
• Requests are always signed using Authorization header. PR #272 by @Ro-M
• Retry time calculation is more in line with aws-sdk-go sdk. PR #282
• Set User-Agent header to "AWSSDKSwift/5.0". PR #288
• Add port to host header. PR #291
• Run middleware on AWSResponse in AWSClient.createError

Patch version changes:

• The list of characters allowed in queries has been edited to be inline with AWS docs. PR #281
• Replace all usages of String.components with String.split. PR #286
• Provide better error messaging when we get an unparseable error. PR #287
• Fixed crash when XML parser returned no XML.
• Fixed head uri for NIOTSHTTPClient. It is no longer the full path. PR #298

Encode Foundation Data as base64 when encoding queries. This fixes an issue with SES.SendRawEmail()

• Upped swift-nio version package requirements to ensure we get swift 5.3 versions
• Ensure EC2 labels all have their first letter uppercased

Major version changes:

• AWSPayload is used for payloads in responses. PR #243
• Use property wrappers to define how collections are encoded/decoded. PR #215
• Added ability to stream request payloads. Added AWSPayload.stream which has a function that provides ByteBuffers to a request. Added AWSPayload.fileHandle which streams a file for a request.
• Added support for all AWS partitions. This gives access to china and government regions. PR #242
• Region is now a struct so we can add new regions without requiring a major version change. PR #246
• Change AWSClientError and AWSServerError to structs so they can be extended without a major version change. Removed some service specific errors from them. PR #247
• Renamed RetryController to RetryPolicy and defaulted it to JitterRetry which retries failed requests with a random wait time taken from an exponential increasing range.

Minor version changes:

• AWSClient.httpClient is now public
• Added TimeStampCoder property wrappers that enforces how a TimeStamp would be encoded/decoded. PR #249
• Added RED (Request, Error, Durarion) metrics using swift-metrics. PR #245

Patch version changes:

• Check for os Linux instead of availability of swift-crypto when chosing between which crypto to run.
• Don't set Content-Type header if it is already set
• Fixed issue with decoding empty XML arrays
• Add query encoding specialisation for EC2. EC2 requires all query variables to have their first character capitalised. PR #253
• Added iOS CI
• Replace using ProcessInfo to get environment variables with the C function getenv. PR #257

• Check to see if "Content-Type" header is set before setting default content type.

• Fixed compilation issue when compiling with another library that has swift-crypto as a dependency.

Minor version changes:

• Added regions af-south-1 and eu-south-1

Patch version changes:

• Fixed issue where "x-amz-target" header wasn't getting set

• Added region eu-south-1

• Added region af-south-1

Major version changes:

• Allow user to set the HTTP client for AWSClient. This has replaced setting the EventLoopGroup. This means you provide a HTTP client with your own setup. If you are using AsyncHTTPClient this includes proxy settings, response decompression and timeouts. The EventLoopGroup AWSClient uses will be the same one the HTTP client uses. PR #203
• Add on: EventLoop parameter to all the commands to force the EventLoop AWSClient will use. This has one restriction in that the EventLoop has to come from the EventLoopGroup being used by the client. PR #240
• Simplified the service protocol, reducing it to an enum. #241

Minor version changes:

• Group all service configuration data into one ServiceConfig object. #239

Major version changes

• Split AWSShape into AWSEncodableShape and AWSDecodableShape. PR #214
• Added AWSShapeWithPayload for shapes with a payload. PR #214
• Added AWSPayload for raw data payload objects. Internally this is a ByteBuffer, but it can be initialised with Data, String or ByteBuffer. PR #218
• Reduced pagination token protocols down to a single protocol AWSPaginationToken with associated type. PR #231
• XMLEncoder, XMLDecoder, DictionaryDecoder and QueryEncoder are no longer public.
• Removed URL.hostWithPort extension.
• AWSLoggingMiddleware is now a struct

Minor version changes

• Added ability to extract the response status code and serialize into AWSShape. #234
• The user can provide an arbitrarily named region now using .other(myregion). PR #228
• Added query serialization of Dictionaries. #235
• Added support for retrying requests if they return an error. This is currently default to off.

Patch version changes

• Fixed an issue where in a rare case the query parameters were not being sorted correctly

• Upped swift-nio-ssl version requirement to 2.6.0 and above

This is the first alpha release of v5.0.0. There will be a number of future alpha releases each which could include more breaking changes.

Major version changes:

• On Linux we are using the AsyncHTTPClient to serve our HTTP requests. On macOS, iOS we are using a NIOTSHTTPClient internal to aws-sdk-swift-core. This is a reduced version of the old HTTPClient with only NIOTransportServices support. You can get macOS to use the AsyncHTTPClient by providing a MultithreadedEventLoopGroup to AWSClient. PR #141
• The URL/Header signing code has been completely rewritten and can be found here in a separate module AWSSignerV4.
• Added AWSCrypto module which wraps crypto functions. The Linux build uses swift-crypto while AWSCrypto provides macOS and iOS with drop in replacements, using CommonCrypto, for the functions we use. This is to avoid forcing all our users onto macOS 10.15 and iOS 13.0. PR #197
• Removed the typealias Future = EventLoopFuture. PR #229
• CredentialProvider has been renamed to Credential.
• Removed dependency on HypertextApplicationLanguage package. We don't need the majority of this code. The small bit we require has been implemented in aws-sdk-swift-core. PR #189
• Remove dependency on INIParser package. Instead we vendor the code from within aws-sdk-swift-core. PR #206
• Cleaned up AWSShapeMember. Removed unnecessary members 'required' and 'type', renamed AWSShapeMember to AWSMemberEncoding, renamed _members to _encoding.removed all String extensions used by AWSShapeMember code, getEncoding(forLocation: String) is now getEncoding(forKey: CodingKey). Don't assume every AWSShape member has an equivalent AWSShapeMember. PR #205
• Body.buffer() now holds a ByteBuffer instead of Data PR #200
• Package name has changed from AWSSDKSwiftCore to aws-sdk-swift-core to ease adding it as a dependency in swift 5.2 package files.

Minor version changes:

• Added Support for EC2 Instance Meta v2. PR #184
• HTTP Client is created at AWSClient initialization, so the same http client can be used throughout.
• Queries are encoded using the Codable system. Now all request body encoding and response body decoding uses Codable. PR #187
• Added encoding functions to AWSShape. This allows us to encode Payload objects directly and removes any requirement for a DictionaryEncoder. So this has been removed from the project. PR #212

Patch version changes:

• Fixed XML container encoding not being reset while encoding/decoding arrays of non-trivial objects.
• Fixed errors from requests expecting a raw data result not being parsed correctly.
• Fixed various error parsing issues, where errors were inside additional XML nodes.
• Return EC2 Error codes.
• Allow for query values that are arrays. Serialize them as entry=value1&entry=value2.

Fixes for swift 5.2

• Added AWSClient.region to access region client is working in.
• Fixed up XML error parsing. Add tests for situation where error is enclosed in an additional XML Node.
• Removed automatically setting "Accept" header to "/" as this was breaking some services

• Fixed Query encoding of Foundation.Data (PR from @vkill)
• Fixed ordering of headers in canonicalRequest while signing requests. Make sure we order them after lowercasing them, and not before. Fixes issue with signing of requests from Lambda.invoke()
• Improved error handling for restjson services where the error code is in the response body.
• Improved error handling for EC2, by returning a AWSResponseError with the error code in it, instead of an unrecognised error.

• Mojave will not use the NIOTS version of the HTTPClient anymore as it crashes.
• Fix issue with parsing errors from raw payload responses
• Include response status code in AWSError

• Update SwiftNIO version to bring in security update https://github.com/apple/swift-nio/releases/tag/2.13.1
• Update SwiftNIOSSL version to bring in security update https://github.com/apple/swift-nio-ssl/security/advisories/GHSA-9556-94c5-c3j8

Update SwiftNIO version to pull in security update https://github.com/apple/swift-nio/releases/tag/1.14.2