Skip to content

Releases: meltano/sdk

v0.31.1

17 Aug 15:08
efca24f
Compare
Choose a tag to compare

v0.31.1 (2023-08-17)

✨ New

  • #1905 Add email field and use human-readable questions in templates

🐛 Fixes

  • #1913 Fix tap tests for multiple test classes with different input catalogs

v0.31.0

07 Aug 21:56
f4af551
Compare
Choose a tag to compare

v0.31.0 (2023-08-07)

Highlights

  • Improved connection handling in SQL targets by sharing a connector instance among stream sinks
  • Expose builtin add_record_metadata and batch_config target settings

✨ New

  • #1892 Add a mapper cookiecutter template
  • #1864 SQLTarget connector instance shared with sinks -- Thanks @BuzzCutNorman!
  • #1878 Add _sdc_sync_started_at metadata column to indicate the start of the target process
  • #1484 Bump latest supported sqlalchemy from 1.* to 2.*

🐛 Fixes

  • #1898 Correctly serialize decimal.Decimal in JSON fields of SQL targets
  • #1881 Expose add_record_metadata as a builtin target setting
  • #1880 Append batch config if target supports the batch capability
  • #1865 Handle missing record properties in SQL sinks
  • #1838 Add deprecation warning when importing legacy testing helpers
  • #1842 Ensure all expected tap parameters are passed to SQLTap initializer
  • #1853 Check against the unconformed key properties when validating record keys
  • #1843 Target template should not reference tap_id
  • #1708 Finalize and write last state message with dedupe
  • #1835 Avoid setting up mapper in discovery mode

⚙️ Under the Hood

  • #1877 Use importlib.resources instead of __file__ to retrieve sample Singer output files

📚 Documentation Improvements

  • #1852 Fix stale pip_url example that uses shell script workaround for editable installation

v0.30.0

10 Jul 23:02
bdbf334
Compare
Choose a tag to compare

v0.30.0 (2023-07-10)

✨ New

  • #1815 Support optional headers for OAuth request -- Thanks @s7clarke10!
  • #1800 Publish supported python versions in --about

🐛 Fixes

  • #1829 Update cookiecutter copyright assignment to cookiecutter user -- Thanks @riordan!
  • #1826 Serialization of decimal.Decimal
  • #1827 Add explicit dependency on packaging library
  • #1820 Include SCHEMA message count in target logs

📚 Documentation Improvements

  • #1824 Document RESTStream.rest_method
  • #1818 Update testing.md

v0.29.0

06 Jul 20:27
6a90e60
Compare
Choose a tag to compare

v0.29.0 (2023-07-06)

Highlights

  • A bunch of target improvements, including better batch message handling and more extensive tests.
  • Union schemas are now supported. These are specially useful for tap or target configurations that accept mutually exclusive settings (e.g. both OAuth and API key auth methods). Read the documentation for more details.

✨ New

  • #1769 Validate parsed/transformed record against schema message
  • #1525 Support union schemas

🐛 Fixes

  • #1809 Deserialize floats as decimal.Decimal
  • #1770 Check schema has arrived before record
  • #1796 Create batch directory if missing
  • #1688 Incremental where clause generation from triggering TypeError -- Thanks @BuzzCutNorman!
  • #1778 Sink schema comparison before adding metadata columns
  • #1698 Force stream selection in tests
  • #1775 Add tests for SQL type conversion from JSON schemas
  • #1771 Add descriptions for batch_config properties
  • #1752 Change runner scope to function for target tests
  • #1753 Always emit a STATE message at the start of the sync process

⚙️ Under the Hood

  • #1745 Change SQLStream.schema into a cached property -- Thanks @mjsqu!

📚 Documentation Improvements

  • #1756 Fix invalid JSON in Stream Maps page and add meltano.yml tabs -- Thanks @mjsqu!
  • #1763 Add Cloud banner

v0.28.0

05 Jun 10:51
cbb858a
Compare
Choose a tag to compare

v0.28.0 (2023-06-05)

✨ New

  • #1728 Add an optional Dependabot file to projects generated from templates
  • #1572 Add batch_config handling in append_builtin_config() -- Thanks @aaronsteers!
  • #1686 Log stream errors
  • #1711 Validate records against stream schema in standard tap tests
  • #1709 Add a default Apache 2.0 license to tap and target templates

🐛 Fixes

  • #1742 Recommend meltano run in target cookiecutter README

⚙️ Under the Hood

  • #936 Use inheritance to construct plugin CLI

📚 Documentation Improvements

  • #1721 Remove unsupported previous_token from HATEOAS example
  • #1703 Fix broken docs link for record_metadata page -- Thanks @menzenski!

v0.27.0

11 May 19:40
f31ae02
Compare
Choose a tag to compare

v0.27.0 (2023-05-11)

✨ New

  • #1681 Allow SQL tap developers to leverage post_process -- Thanks @BuzzCutNorman!
  • #1672 Support deselecting streams by default
  • #1648 Use Ruff to lint projects generated with Cookiecutter templates

🐛 Fixes

  • #1680 Pin urllib3 to <2 to avoid incompatibility issues with botocore
  • #1646 Use get_new_paginator in REST tap cookiecutter template

⚙️ Under the Hood

  • #1668 Break out default batch file writer into a separate class

📚 Documentation Improvements

  • #1685 Add PyCharm debugging tips to docs
  • #1673 Fix docs build by specifying OS in RTD config file

v0.26.0

02 May 16:28
a249567
Compare
Choose a tag to compare

v0.26.0 (2023-05-02)

✨ New

  • #1623 Explicitly support URL params in string form

v0.25.0

25 Apr 09:36
4371122
Compare
Choose a tag to compare

v0.25.0 (2023-04-25)

✨ New

  • #1603 Allow allowed_values and examples in any JSON schema type constructor

⚙️ Under the Hood

  • #1610 Consolidate config parsing for all plugin base classes

v0.24.0

12 Apr 20:49
c532c43
Compare
Choose a tag to compare

v0.24.0 (2023-04-12)

✨ New

  • #1601 Allow skipping child streams by returning an empty child context from parent stream
  • #1581 Add pattern, contentMediaType, and contentEncoding to Schema data class -- Thanks @BuzzCutNorman!

🐛 Fixes

  • #1587 Update cookiecutter tests path

⚙️ Under the Hood

  • #1570 Move "about" formatting logic into dedicated classes

v0.23.0

04 Apr 11:56
ad53dfa
Compare
Choose a tag to compare

v0.23.0 (2023-04-04)

✨ New

  • #1563 Migrate shell scripts for cookiecutter e2e tests to Nox -- Thanks @mkranna!

🐛 Fixes

  • #1574 Conform metric field type to Singer spec
  • #1436 Handle sync abort, reduce duplicate STATE messages, rename _MAX_RECORD_LIMIT as ABORT_AT_RECORD_COUNT