v0.37.0

v0.37.0 (2024-04-29)

Highlights

• You can reference your streams with glob patters in stream map configuration:

  stream_maps:
    # This will affect all streams with names starting with 'my_prefix_'
    "my_prefix_*":
      id: id
      first_name: first_name
      email:     # drop the PII field from RECORD and SCHEMA messages
      email_domain: email.split('@')[-1]
      email_hash: md5(config['hash_seed'] + email)
      __else__: null

✨ New

• #2389 JSON schema keyword allOf is now supported
• #1888 Added support for glob patterns in source stream names -- Thanks @DouweM!
• #2345 PropertiesList can now behave as an iterable -- Thanks @ReubenFrankel!

🐛 Fixes

• #2352 Removed unnecessary and problematic column caching -- Thanks @raulbonet!
• #2375 Added sensitive: true to password settings in templates
• #2301 Unmapped sub-fields in object-type fields are now no longer dropped when the field declares additionalProperties
• #2348 Added a condition to the No schema for record field warning -- Thanks @tobiascadee!
• #2342 Avoid failing if VSCode IDE config is not requested for target and mapper cookiecutter templates -- Thanks @ReubenFrankel!
• #2331 Allow importlib-resources >=6.3.2

⚙️ Under the Hood

• #2205 Added a jwt package extra, but the cryptography and jwt dependencies are still installed by default for now

📚 Documentation Improvements

• #2326 Documented BATCH as a default plugin capability -- Thanks @ReubenFrankel!

v0.37.0a4

chore: Bump `poetry-core` build backend to 1.9 (#2391)

v0.37.0a3

chore(deps): bump myst-parser from 2.0.0 to 3.0.0 (#2385)

Bumps [myst-parser](https://github.com/executablebooks/MyST-Parser) from 2.0.0 to 3.0.0.
- [Release notes](https://github.com/executablebooks/MyST-Parser/releases)
- [Changelog](https://github.com/executablebooks/MyST-Parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/MyST-Parser/compare/v2.0.0...v3.0.0)

---
updated-dependencies:
- dependency-name: myst-parser
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

v0.37.0a2

chore: Ensure `PyJWT` and `cryptography` are always installed for now…

… (#2368)

v0.37.0a1

refactor: Added a `jwt` package extra, but the `cryptography` and `jw…

…t` dependencies are still installed by default for now (#2205)

refactor: Added a `jwt` package extra. The `cryptography` and `PyJWT` dependencies are not yet removed from the default dependencies

v0.36.1

v0.36.1 (2024-03-13)

🐛 Fixes

• #2310 Limited importlib-resources to < 6.2 due to breaking changes
• #2288 Bumped min joblib dependency to >=1.3.0 and replaced deprecated parallel_backend with parallel_config -- Thanks @BuzzCutNorman!
• #2281 The state_partition_context dictionary is now correctly interpolated in the error message when duplicate partitions/contexts are detected in the input state
• #2274 Test workflow now fails for any Python matrix job failure in cookiecutter template -- Thanks @ReubenFrankel!

v0.36.0

v0.36.0 (2024-02-26)

✨ New

• #2241 JSON schema keywords such as maxLength are now supported in StringType, IntegerType and NumberType JSON schema helpers
• #2263 Nested settings are now documented in the output of --about --format=markdown
• #2248 Targets now accept a batch_size_rows setting to configure how many rows are loaded in each record batch -- Thanks @BuzzCutNorman!

🐛 Fixes

• #2258 Database disconnects are now handled via SQLAlchemy pool_pre_ping parameter

⚙️ Under the Hood

• #2220 Deprecated singer_sdk.authenticators.BasicAuthenticator in favor of requests.auth.HTTPBasicAuth

v0.36.0rc1

First v0.36.0 RC!

v0.35.2

v0.35.2 (2024-02-19)

🐛 Fixes

• #2252 Null type is now correctly appended as {"type": "null"} to oneOf types

v0.35.1

v0.35.1 (2024-02-15)

🐛 Fixes

• #2243 Flattening level of record is now forced to match the provided flattened schema -- Thanks @joaopamaral!
• #2245 Instances of oneOf are now handled by null-appending logic
• #2242 Hard and soft deletes for handling ACTIVATE_VERSION messages now use the same WHERE clause -- Thanks @vitoravancini!
• #2232 Test workflow job now fails for unsupported Python versions in cookiecutter templates -- Thanks @ReubenFrankel!
• #2225 SQL columns that are non-nullable but not required (i.e. not part of a primary key) are now not included in the "required": [...] array of the discovered JSON schema

📚 Documentation Improvements

• #2239 Linked reference docs to source code
• #2231 Added an example implemetation of JSON schema validation that uses fastjsonschema
• #2219 Added reference docs for tap & target testing helpers