Skip to content

Releases: airbytehq/airbyte

v0.52.0

08 Mar 18:32
Compare
Choose a tag to compare

2547af2 delete unused airbyte-base-java-image top-level folder (#35918)
21d1330 .github: remove unused connector_dependency_template.md (#35917)
d7f1a24 Source Facebook Marketing: Fix lookback window (#35913)
9175956 Source GitHub: update CDK (#35915)
4dc8c43 🐛 Source Orb: update enrich ledger entry with event stream to pass timeframe bounds (#35897)
e77901d Attempt to fix transient nightly build errors: Remove poetry cache (#35894)
63091e5 🚨🚨 Source Hubspot: Update Deals Property History and Companies Property History to API v3 (#35662)
f09c97c connectors-qa: check cdk and language tags (#35685)
eabf39c GA release 4.0.0 (#35873)
0a9e0fe updated instructions for external logging (#35903)
55e6fbd Destination Snowflake: Handle NPE for state value. (#35899)
6b8cc39 Docs: Fix link in Core Concepts page (#35900)
1bb7a1c [source-postgres] State counter on postgres (#34724)
be6849f Source Ringcentral: add logo (#34242)
6f16ac5 📝 Updated Qdrant destination icon (#35104)
7d3a5f8 🤖 Bump patch version of Python CDK
4a808ee 🐛 follow up to #35471: update the cartesian stream slicer (#35865)
106102c 🤖 Bump patch version of Python CDK
858e61d Declarative CDK: Fix None error on stream_slice (#35879)
88314dd Source Metabase: Updates dashboards stream, migrates to poetry (#35680)
6b26b27 speed up source-mssql tests (#35799)
666a3a3 source-mssql: reduce the number of containers used in tests (#35855)
0965ebd live-tests: add regression tests suite (#35837)
72eb8a6 ✨ Source Bing Ads: new streams: Audience Performance Report, Goals And Funnels Report, Product Dimension Performance Report (#35812)
8c862a8 Fix tags in metadata.yaml files: declare cdk tags (#35670)
fc03071 🐛 Source S3: Return iam docs (#35850)
df1cff1 Source Instagram: remove "total_interactions" from MediaInsights queries (#35875)
e4ccffb Docs: Tutorials formatting + from scratch connector tutorial cleanup (#33839)
4fcff41 [Source-postgres]: Add logging in case of multiple records with same LSN (#35842)
8ab77d4 Pass docker hub credentials to airbyte-ci's bump_version command (#35802)
d5e91ae [source-mongodb] record count in state & initial iterator refactor (#35669)
8ee36d6 add background threads to MssqlTestDatabase (#35727)
aca8679 🐛 Destination Vectara: Improve title extraction logic (#35206)
da79f6e Destination Snowflake: Write extracted_at in UTC (#35308)
9ce9217 make query safer for servers that are case sensitive (#35816)
83cfcbf Source Microsoft Onedrive: Bump poetry.lock to upgrade transitive dependency (#35858)
cdf80f3 get source-mssql CI to green (#35721)
5f0d9c3 Source S3: upgrade dependencies to avoid transformers transitive dependency (#35857)
671ed4c Source File: Add Python 3.11 support (#35800)
4a2350d Attempt to fix Connector Builder release (#35851)
bba545e Source s3 cache connection (#35808)
1571dbd live-tests: debug mode and initial regression tests framework (#35624)
04943c9 📝Source Amazon Seller Partner: update supportLevel to certified (#35848)
84adf58 Fix tags in metadata files for migrated community connectors (#35725)
0c67a1e 🏥Source Zendesk Support: fix expected records (#35847)
dee240a ✨Source Amazon Ads: migrate source to YamlDeclarativeSource with custom check_connection (#35481)
e10826c 🚨🚨 Source Facebook Marketing: update API to v19.0 (#35746)
1d9e546 🤖 Bump patch version of Python CDK
f55abc1 🐛 low-code: Fix incremental substreams (#35471)
95afe28 Un-Archive python destinstions (#35838)
b67d16d java-CDK fixes to the Junit interceptor (#35827)

v0.51.0

06 Mar 00:54
Compare
Choose a tag to compare

⚠️ 🚨 Deployment Configuration Breaking Change Alert 🚨 ⚠️

This update has a breaking change to Docker and Helm deployments.
We've revamped how external logs are configured, making it much simpler.
Be sure to watch out for upcoming migration documentation if you're considering upgrading to this version.
Remember to verify that your deployment uses the correct variables.

f9e73cf add configuration for cdc queue size (#35739)
4b3a9bf 🤖 Bump patch version of Python CDK
349faed 🐛 Install arm64 emulator when building source_declarative_manifest (#35839)
67c918b 🤖 Bump minor version of Python CDK
5f48da9 [low-code] allow page size to be defined with string interpolation (#35735)
a871899 Revert "Do not build java base image when publishing python cdk"
58bde70 Do not build java base image when publishing python cdk
8b83f14 Destination postgres: upgrade cdk (#35528)
16c00da 🤖 Bump patch version of Python CDK
1caa79b docs about how to unarchive a connector (#35825)
6354733 Source Recurly: bump version to unarchive in Cloud (#35828)
7e4649e CDK: upgrade pyarrow (#35818)
bf7e158 🤖 Bump patch version of Python CDK
b254a64 Destination redshift: Upgrade cdk (#35316)
a090088 file cdk: handle scalar values that resolve to None (#35688)
08dd7de file cdk: fix typing, pull out non-scalar handling (#35687)
dcc3eb9 Archive destination-vertica, restore destination-vectara (#35806)
8209dad Source Recurly: update support level metadata (#35815)
7a85c0c Fix expected records
ef98194 Emit final state message for full refresh syncs and consolidate read flows (#35622)
e11f0fe minor changes to the java CDK test code (#35774)
160ec72 Destination bigquery: upgrade cdk (#35315)
24c8b44 airbyte-ci: add kotlin support, update license message template (#35784)
62abce9 Source Recurly: Unarchive and release as 1.0.0 (#35763)
e82ff2e 🏥Source Pinterest: fix CAT (#35788)
c5b8220 🐛 Source SalesForce: fix memory leak (OOM) (#35791)
8be5bbf 🏥Source Zendesk Talk: change order of authentication methods in spec (#35783)
2b08803 🏥Source Google Search Console: fix expected records (#35787)
8757058 🏥Source Paypal Transaction: fix CAT (#35781)
44668e4 airbyte-ci format: run a runner with more disk space (#35790)
dc35e13 add a timeout to junit test (#35767)
7063ea3 Postgres Strict Encrypt (#35762)
2a32688 Certify Postgres (#35760)
1685b27 Java CDK: Staging destinations include timezone in extracted_at in CSV file (#35313)
4efc065 DV2 destinations: Build DestinationState / Migration framework (#35303)
7277fc5 Use a separate concurrency group for Java CDK GH workflow. (#35758)
358a500 source-recurly is archived - remove from OSS registry
9e848c4 Archive the code of 8 sources with legacy state (#35757)
0f000b9 Archive connectors already hidden with legacy state (#35752)
e54f5de 🏥Source Sendgrid: fix CAT (#35753)
72f6362 🏥Source Twilio: fix CAT (#35751)
49f5dc1 remove archived connectors code (#35689)
540e0aa Omit run.py from test coverage for source Sendgrid, Sentry, Zendesk Chat (#35728)
1da8836 🏥Source Chargebee: fix CAT (#35750)
62daec6 ✨ Source Microsoft OneDrive: Enable connector in Cloud (#35584)
eb041d5 🏥Source Amplitude: fix formatting (#35748)
df71835 🐛 Source Google Ads: Fix error for new customers for incremental events streams (#35664)
55d206b 🏥Source Amplitude: fix CAT (#35743)
bcf32a2 ✨ Source Bing Ads: Stream budget and product dimension performance report (#35201)
9f28113 🏥Source Google Search Console: fix expected records (#35742)
61e0b3f improve airbyte-cdk (#35720)
68feeec connectors-test: 6H workflow timeout (#35734)
1ee2d8a Update getting-started.mdx (#35730)
2637e97 [source-mysql] merge state manager (#35529)
62ba6c9 update connector generators to use poetry (#35411)
b7ae6c4 🏥Source Google Search Console: fix expected records (#35723)
d0017da 🏥Source Google Sheets: add logic to emit stream statuses (#35722)
edcc2fa 🚨🚨🐛Source Amazon Seller Partner: update schema for GET_FBA_STORAGE_FEE_CHARGES_DATA stream (#35439)
deeb436 Source Google Ads: handle 2-Step Verification exception (#35709)
41834f6 Docs: adding pyairbyte to left nav bar (#35719)
f0f7a98 DV2 TyperDeduper: Extract migrations to separate method (#35376)
333adf7 [ISSUE #35112] clean acceptance-test-config.yml (#35708)
339f8d7 correct typo on-kubernetes-via-helm.md (#35711)
934de16 Docs index pages are not really docs pages (#35706)
c84c61b Update file.md (#35598)
c4d9759 Update okta.md (#35707)
16336c6 Helm setup instruction update (#35681)
357c2d6 Issue 35112/relax cats when not primary key (#35645)
543eaea Source Linnworks: re-enable in registry (#35557)
ed61d27 🏥Source Tiktok Marketing: update unit tests (#35698)
a3d1bb1 🤖 Bump patch version of Python CDK
30190ea [Source-mssql] : Add config to throw an error on invalid CDC position (#35566)
a24a208 🏥Source Mixpanel: fix expected records (#35697)
7ac622c Source Monday: fix empty activity logs extractor (#35696)
33f6759 🏥Source Recharge: fix expected records (#35695)
91f0218 🏥Source Stripe: fix expected records (#35692)
6f5c9a3 Docs/PyAirbyte: created pyairbyte folder for docs (#35690)
0a3fe3d Archive unpopular / unsupported destinations (#35359)
3d7ab9d Fix doc headers on sub-pages (#35683)
3e38909 Docs/PyAirbyte: Added basic demo notebook link (#35678)
4390db5 [source-mongodb-v2] remove default connection string options (#35673) (#35677)
ae39cbe Fix error message for saved offset not valid. (#35675)
f1924e5 unpin source-github in cloud (#35546)
fdfd048 python CDK: fix gradle task dependency (#35609)
7baf154 [ISSUE #35110] match CATs records only one primary key when primary k… (#35556)
5a8f43a 🏥Source Snapchat Marketing: add new fields (#35660)
a05b81e 🏥Source Zendesk Support: update expected records (#35658)
4369cee 🐛 Source Hubspot: make start date not required (#34597)
aa5b95e 🏥Source Jira: add new fields (#35656)
ab2f67a 🏥 Source Bing Ads:Fix basic read: add ignored fields, update expected records (#35630)
56d9942 Source Klaviyo: Fix predictive_analytics field in stream profiles (#35637)
21168f9 add a getNamespace to TestDataHolder (#35647)
d32d895 remove all display names (#35512)
7f9b202 add more logs into TestDatabase (#35507)
3543c3e fix HTML reports (#35639)
5f8b9e5 fix junit test error logging (#35495)

v0.50.54

26 Feb 23:19
Compare
Choose a tag to compare

d41cd62 airbyte-ci: set execute timeout on connector test pipelines (#35634)
5ff133f 🐛 Source Harvest: Improve HTTP Availability (#35541)
f509404 🐛 Source Shopify: Migrate from REST > GraphQL BULK Operations where possible, fixed STATE collisions for sub-streams (#32345)
5fc6ca2 🏥 Source Mixpanel: updated version in pyproject.toml (#35537)
2c91211 🏥Source Hubspot: fix version in pyproject.toml (#35629)
11bd882 🏥Source GitLab: fix version in pyproject.toml (#35627)
7c11ea7 🏥Source Klaviyo: fix version in pyproject.toml (#35626)
5139a29 🏥Source GitHub: fix version in pyproject.toml (#35625)
6ed63f5 Source S3: run incremental syncs with concurrency (#34895)
a6b3f0c Cleaned up PyAibyte docs (PR # 35603) (#35603)
3918dc2 Docs: Add depecration notices to sunsetting connectors (#35446)
b2b9b7f reduce interrupt and shutdown delays to 1 minutes and 2 minutes when stopping a connector (initially set at 60minutes and 70minutes) (#35527)
040d363 Source Recurly: Enable in registries with updated CDK (#34622)
b247f89 delete metadata checks workflow (#35580)
399fc33 Destination Redshift: CDK T+D initial state refactor (#35354)
f6aa9e5 Destination Snowflake: CDK T+D initial state refactor (#35456)
a13bd80 Destination Postgres: CDK T+D initial state gathering (#35385)

v0.50.53

23 Feb 19:40
Compare
Choose a tag to compare

9ff81e3 Changed tag to low code (#35594)
c379a7b Source File: change header=0 to header=null in docs (#35595)
e01c0a3 re-release source mssql with logger fixes (#35596)
edc58a7 🐛 Source BigQuery: fix error with RECORD REPEATED fields (#35503)
e671aa3 🐛 Source S3: fix exception when setting CSV stream delimiter to . (#35246)
d6346e1 Improve documentation on check command (#35542)
cb25bbe Microsoft Entra ID for Self-Managed Enterprise (#35585)
e2742bd connectors-ci: early exit when no connector changes (#35578)
77c7921 airbyte-ci-test.yml: checkout repo for path filters when not on PR (#35577)
f3dfcb1 airbyte-ci-test.yml: only run if modified internal poetry packages (#35551)
aa084a9 source-mongodb-v2: bump patch version following #35569 (#35571)
407cba8 source-postgres: bump patch version following #35569 (#35572)
2b370f8 source-mysql: bump patch version following #35569 (#35573)
084671b destination-bigquery: bump patch version following #35569 (#35574)
e10bbbf destination-snowflake: bump patch version following #35569 (#35575)
f44ea6a destination-s3: bump patch version following #35569 (#35576)
9144011 add entry into JAVA_OPTS to always select log4j2.xml as our logger configuration (#35569)

v0.50.52

23 Feb 01:53
Compare
Choose a tag to compare

11ea121 .github: fix python_cdk_tests.yml (#35567)
ad227e5 Destinations CDK: Refactor T+D to gather required world state upfront (#35342)
184d109 push new source-mssql version (#35564)
3285fd2 ✨ [source-mssql] skip sql server agent check if EngineEdition == 8 (#35368)
06d91e7 airbyte-cdk [python]: re-enable tests in CI (#35560)
7737816 gradle.yml: checkout the repo when not PR trigger (#35558)
98ed501 Source Monday: fix gql query to support inline fragment value for the Items stream (#35506)
8707fb9 gradle.yml: fix path filters (#35554)
4e548d3 Do not add connector header to source and destination index pages (#35553)
fbe0e8c 🤖 Bump minor version of Python CDK
970b24b Airbyte CDK: add CustomRecordFilter (#35283)
3e57e98 ✨ [greenhouse] [iterable] [linkedin-ads] [paypal-transactions] [pinterest] Bump cdk versions for to use continue on stream per-error reporting (#35465)
6a746e6 gradle.yml: use XXL runners but only if gradle related files are changed (#35548)
dd1991e Handle seeing uncompressed sendgrid contact data (#35343)
34956a1 🤖 Bump minor version of Python CDK
0954ad3 Airbyte CDK: add interpolation for request options (#35485)
2d80b56 Destination Clickhouse - 1.0, remove normalization (#34637)
64b54c1 Source SalesForce: Add Stream Slice Step option to specification (#35421)
e9ccc10 airbyte-ci: augment the report for java connectors (#35317)
757a42a gradle.yml: use a smaller runner (#35547)

v0.50.51

22 Feb 16:46
Compare
Choose a tag to compare

c2cf962 📚 Add documentation for Entra ID (#34569)
c06bd99 chore: remove upgrading-airbyte.md (#35545)
571d13a docs: update ALB configuration docs for exposing API (#35520)
a086e38 🐛 Source Facebook Marketing: Add missing config migration (#35539)
943785e Update docs to show archived information if connector is not in registries (#35468)
2458c9b airbyte-ci: make QA check work on strict-encrypt connectors (#35536)
833f336 🏥 Source Notion: update stream schema (#35409)
1162302 [Source-mysql] : Adopt 0.21.4 and reduce cdc state compression threshold to 1MB (#35525)
d2b5ac6 .github: fix java cdk publish workflow (#35533)
f106d11 Mangle unhandled MongoCommandException to prevent creating grouping o… (#35526)
9cb2371 🤖 Bump minor version of Python CDK
5724ca0 Add ignore_stream_slicer_parameters_on_paginated_requests flag (#35462)
c9b7d8a 🤖 Bump patch version of Python CDK
911cee4 [DB sources] : Reduce CDC state compression limit to 1MB (#35511)
602d3ce Fix syntax error in tools/bin/manage.sh, used to publish airbyte cdk (#35466)
35c73b3 Source Google Ads: rollback patch 500 Internal Server Error (#35493)
c9ba9df 🐛 Change null cursor value query to not use IIF sql function (#35405)
875df79 Source Quickbooks: fix spec (#35457)
3d99634 Airbyte docs: Fixed JSON schema rendering issues for dark mode (#35489)
3fa43b3 .github: tighter filtering for gradle workflow (#35492)
cf87e02 connectors_qa: bump to 1.0.3 (#35475)
5d00e5b .github: remove connector checklist (#35484)
6dbbcb0 🐛 Source Facebook Marketing: Fix error during transforming state (#35467)
198971b 🤖 Bump minor version of Python CDK
3355c5c Airbyte CDK: add filter to RemoveFields (#35326)
29bcceb Update on-kubernetes-via-helm.md - Add GCS Logging steps (#35455)
703aca1 pin to older version (#35469)
9a7da6d [Source-Mongodb] : Add config to throw an error on invalid CDC position (#35375)
40a5edc [Source-mysql] : Add config to throw an error on invalid CDC position (#35338)
d8bae3d Re-ignore documentation structure check for the time being (#35458)
afb231f add proper logging to junit runs (#35394)
dd01ba3 🚨🚨 Source Facebook Marketing: Add statuses filters (#32449)
e7ab4f5 restore kvdb to state from #35424 (#35454)
944c960 airbyte-ci: do no run QA checks on publish - only MetadataValidation (#35437)
bd52696 Revert "Add destination-kvdb to OSS registry" (#35453)
bbb06b8 Source S3: add filter by start date (#35392)
ba38b9d java-cdk:remove unused class (#35408)
0bf645c [Source-Postgres] : Add config to throw an error on invalid CDC position (#35304)
be6519f remove destination-kvdb one more time (#35382)
fa338ad Support archived connectors in Docs (#35374)
2a369e8 Normalization logs: remove json parse warnings (#34978)
95b05a8 Add destination-kvdb to OSS registry (#35444)
6c2c13a destination-kvdb QA checks (#35424)
2f77609 ci: check for required reviewers on destinations (#35428)
08fb4f7 airbyte-ci: disable a flaky test (#35418)
263699c airbyte-ci: disable telemetry with env var (#35438)
84cf592 doc: remove Node requirements on config based getting started tutorial (#35436)
534a640 java-connectors: add thread name as part of the log message (#35199)
98ed774 connectors-qa: fix connector type attribute access (#35435)
4889e6e 🧹 remove qa_checks.py (#35434)
05a1512 update doc to reference poetry (#35414)
92efefd Delete requirements.txt on poetry managed connectors (#35406)
d108b9d ✨Source Facebook Marketing: add integration tests (#35061)
b339aaf gradle: remove archived connectors (#35423)
a54b310 connectors_qa: make CheckPublishToPyPiIsEnabled only run on source connectors (#35426)
15f1d99 Bump destination-kvdb again to test metadata for archival (#35422)
fbbf8fe Update metadata-service to latest version + docs (#35419)
9525793 airbyte-ci: use connectors-qa instead of connector_ops.qa_check (#35325)
87d792e doc: Document our connectors QA checks (#35324)
f2efd27 🐛 Source Amazon Seller Partner: Fix check for Vendor accounts (#35331)
088b9b7 .github: fix python CDK publish (#35391)
22cf6ae 🏥 Source Pinterest: updated expected records (#35353)
553c9b0 Revamp QA checks into a battery included package (#35322)
27abc6d ✨ Source Paypal Transactions: Siver Certification (#34510)
6301a20 destination-kvdb bump to publish (#35381)
c99c0b1 🤖 Bump patch version of Python CDK
385a70d Support user-specified test read limits in connector_builder code (#35312)
6046581 destination-kvdb - publish for real (#35379)
8d92438 re-add destination-kvdb as archived connector (#35377)
6bbaa32 Destination redshift: delete some unused files (#35314)
2d132c5 Docs: update k8s instructions for upgrade (#35108)
27b0490 Remove octavia-cli (#33950)
bbb0831 Add archived as connector support level (#35355)
588ce56 Archive destination-kvdb (#35370)
eb16b58 🐛 Source OpsGenie: fix parsing of updated_at timestamps from OpsGenie (#35269)
ee7da12 Source S3: revert rollback to 4.4.1 (#35055)
08119e6 airbyte-ci: remove reference to buildConnectorImage (#35364)
e420ae2 Test PR to check Slack notifications (#35363)
ea5e388 Docs: Update stripe.md (#35142)
6aba750 docs: typos (#35302)
f93c0df gradle: overall simplification (#35307)
dc088bc gradle: split off python cdk (#35306)
b741045 🏥 Source Hubspot: updated marketing emails schema and expected records (#35328)
9af2c1c Source Klaviyo: added transform config for profile stream (#35336)
5c7e3b9 [source-postgres] Add test for legacy version of postgres (#35329)
34ca067 📝 add instructions for soft reset (#35335)
48e933b AirbyteLib: Fix no-such-table-error (#35311)
b05c490 ✨ Source GitHub: updating branches schema and unpin on cloud (#35271)
06ab099 🐛 Source Harvest: Fix pendulum parsing error (#35305)
a951624 destination-async-framework: move the state emission logic into GlobalAsyncStateManager (#35240)
a886ace ✨ Source File: support ZIP file (#32354)
e3ab5b6 source-mysql: add and adopt TestDatabaseWithInvalidDatabaseName (#35210)
4a2bf02 java CDK: improve blobstore module structure (#35285)
40ca9bd 🚨🚨🐛 Source Gitlab fix merge_request_commits stream (#34548)
8e7618f 🤖 Bump patch version of Python CDK
5a202f7 File-based CDK: enqueue AirbyteMessage of type record instead of sending to the message repository (#35318)
2b69341 ✨Source Amazon Seller Partner: add VendorOrders stream (#35273)
daa92a9 🤖 Bump minor version of Python CDK
2b87164 Emit multiple error trace messages and continue syncs by default (#35129)
3bd4b14 🤖 Bump patch version of Python CDK
fc87183 🐛 python cdk: mask oauth access key (#34931)
d520990 Source Google Ads: temporary patch to avoid 500 Internal server error (#35280)
a99bb8d AirbyteLib: suppress duckdb reflection warnings (#35300)
b9a86a9 Revert bad commit
b4a5acb Throw cdc cursor error
16821f0 source-tidb: adopt CDK 0.20.4 (#35218)
1cbc863 source-teradata: adopt CDK 0.20.4 (#35219)
b59098f source-snowflake: adopt CDK 0.20.4 (#35220)
0303ae5 source-sftp: adopt CDK 0.20.4 (#35221)
6eabaf2 source-scaffold-java-jdbc: adopt CDK 0.20.4 (#35222)
6367555 source-redshift: adopt CDK 0.20.4 (#35223)
ce44597 source-oracle: adopt CDK 0.20.4 (#35225)
80c7f10 source-kafka: adopt CDK 0.20.4 (#35229)
1c3a6e2 source-elasticsearch: adopt CDK 0.20.4 (#35230)
fd0b77e source-e2e-test: adopt CDK 0.20.4 (#35231)
c1c8088 source-dynamodb: adopt CDK 0.20.4 (#35232)
9a6dbac source-db2: adopt CDK 0.20.4 (#35233)
3b5ecfc source-cockroachdb: adopt CDK 0.20.4 (#35234)
9e7936e source-clickhouse: adopt CDK 0.20.4 (#35235)
8bd1c48 AirbyteLib: Mark and deprioritize slow tests (#35298)
8179156 🐛 Source Harvest: Revert poetry update (#35296)
20737b4 🎉 Source Intercom: Update the API Version to 2.10 (#35176)
077b078 Docs: add deprecation note for normalization and custom transformation (#35275)
686c31d AirbyteLib: Add support for JSON and VARIANT types (#35117)
ada1196 destination-e2e-test,dev-null: use CDK 0.20.6 (#35278)
cb3578c fix :airbyte-integrations:connectors:destination-duckdb' could not be found in project (#35279)
bc8eac8 destination-duckdb: remove superfluous build.gradle file (#35277)
ccafbe6 write logs to file in addition to stdout when running java connector tests (#35236)
308c4ed 🏥 Source Mixpanel: update stream Funnels with custom_event_id and custom_event fields fields (#35203)
0929d5d AirbyteLib: improve json schema type detection (#35263)
c07915b AirbyteLib: Docs: fix colab badge (#35248)
5bab3df Add airbyte trace utility to emit analytics messages & emit messages for MongoDB, Postgres & MySQL (#35036)
0aa2404 AirbyteLib: support secrets in dotenv files (#35244)
dba13b1 AirbyteLib: docs: add Colab quicklink (#35215)
0385a64 🐛 Set cdc record subsequent record wait time to initial wait time as a workaround (#35114)
edcd5ed source-postgres: adopt CDK 0.20.4 (#35224)
f6b4436 ✨ Source File: add fixed width file format support (#34678)
462970f airbyte-ci: run poetry check before poetry install on poetry package install (#35212)

v0.50.50

13 Feb 18:39
Compare
Choose a tag to compare

5d665ec Remove IAM Role Setup instructions from s3.md (#35190)
62e5528 Don't emit final state if there is an underlying stream failure (#34869)
fa66dc8 Source Chargebee: Updates schemas for validation and missing fields errors, updates test bypass, adds expected records, adds custom error handling, adds incremental support for three streams (#34053)
180335c ✨ source-harvest: migrate to poetry (#35154)
c1b5b43 ✨ source-slack: migrate to poetry (#35157)
103c9df ✨ source-file: migrate to poetry (#35186)
4bf3f02 ✨ source-shopify: migrate to poetry (#35166)
2573b6e ✨ source-s3: migrate to poetry (#35164)
4dcfc6a 🐛Source Amazon Seller Partner: add integration tests (#33996)
20535ea ✨ source-google-search-console: migrate to poetry (#35163)
e3cfcfa ✨ source-airtable: migrate to poetry (#35149)
3cb2c11 ✨ source-gitlab: migrate to poetry (#35167)
e09e6b4 ✨ source-sendgrid: migrate to poetry (#35181)
0c9ee2e ✨ source-zendesk-chat: migrate to poetry (#35185)
b262c00 Destination snowflake: reorder auth spec options (#35194)
23cf31e ✨ Destination Postgres: DV2 GA (#35042)

v0.50.49

12 Feb 20:57
Compare
Choose a tag to compare

ae465e7 ✨ source-tiktok-marketing: migrate to poetry (#35161)
4fab6f4 ✨ source-recharge: migrate to poetry (#35182)
a94a070 📚 Adjust documentation for corepack (#35192)
7693202 AirbyteLib: Release 0.1.0 (#35184)
82d9197 🐛 source-mysql Support special chars in dbname (#34580)
a317a59 ✨ source-freshdesk: migrate to poetry (#35187)
0c228f4 destination-async-framework: make emission of state from FlushWorkers synchronized (#35144)
e1a860f ✨ source-facebook-marketing: migrate to poetry (#35178)
7b0a820 ✨ source-instagram: migrate to poetry (#35177)
ac5deca ✨ source-bing-ads: migrate to poetry (#35179)
a48924a Source Github: add integration tests (#34933)
10afcc4 ✨ source-amazon-ads: migrate to poetry (#35180)
9db75b0 ✨ source-faker: migrate to poetry (#35174)
e30ad24 source-faker: adopt our base image (#35172)
cf881e6 ✨ source-snapchat-marketing: migrate to poetry (#35171)
ba93553 source-snapchat-marketing: adopt our base image (#35170)
068b364 ✨ source-chargebee: migrate to poetry (#35169)
3e9d3ce ✨ source-sentry: migrate to poetry (#35145)
481947f ✨ source-pinterest: migrate to poetry (#35159)
4e67be3 ✨ source-hubspot: migrate to poetry (#35165)
57dc471 🐛 Source Slack: Join to the channels while read instead of discovery (#35131)
9aba1a6 ✨ source-google-ads: migrate to poetry (#35158)
9ed7c63 ✨ source-jira: migrate to poetry (#35160)
dfdbaa9 ✨ source-amplitude: migrate to poetry (#35162)
8716e45 ✨ source-zendesk-talk: migrate to poetry (#35156)
7e6624e ✨ source-notion: migrate to poetry (#35155)
07587ae ✨ source-twilio: migrate to poetry (#35153)
2c63c9f ✨ source-typeform: migrate to poetry (#35152)
5386fc5 ✨ source-mixpanel: migrate to poetry (#35151)
0e6993c ✨ source-iterable: migrate to poetry (#35150)
62f5d8b ✨ source-intercom: migrate to poetry (#35148)
b164722 ✨ source-salesforce: migrate to poetry (#35147)
4fea80b ✨ source-monday: migrate to poetry (#35146)
2f9c884 ✨ source-surveymonkey: migrate to poetry (#35168)
8000fc0 ✨ Source Amazon Seller Partner: Add logs for the failed check command (#35106)
1b93ebe source-google-sheets: fix license in pyproject.toml (#35136)
7b44697 source-stripe: fix license in pyproject.toml (#35137)
a15bd21 destination-async-framework: use the value from stats counter for global state conversion (#35111)
d3523fa ✨ source-google-analytics-data-api: migrate to poetry (#35073)
feddd72 ✨ source-paypal-transaction: migrate to poetry (#35075)
51cc915 ✨ source-marketo: migrate to poetry (#35078)
dc94e7a ✨ source-zendesk-support: migrate to poetry (#35083)
e425926 ✨ source-klaviyo: migrate to poetry (#35088)
869c3ac ✨ source-mailchimp: migrate to poetry (#35092)
d3c4895 ✨ source-google-analytics-v4: migrate to poetry (#35101)
fb59300 [docs] On final table re-creation (#35124)
2be8431 Update airbyte-protocol.md (#35123)
b9ab3d1 migrate everything from java 17 to java 21 (#35103)
fdb3030 Update docs reference from Java 17 to 21 (#34418)
fca2e66 airbyte-lib: Escape column names (#34969)
cb81cb4 Destination snowflake: update test fixtures (#34574)
b85f999 [Source-mysql] Add soft link in mysql test db (#35045)
9132d3c Source Google Ads: add test for empty streams (#34983)
5a1f359 Destination bigquery: update test fixtures (#34575)
5ff7099 ✨ source-linkedin-ads: migrate to poetry (#35086)
796c0ee source-mysql: adopt cleaned-up cdk (#34750)
d80a9fc source-mssql: adopt cleaned-up cdk (#34749)
7ff4848 source-postgres: adopt cleaned-up cdk (#34751)
5435df6 source-mongodb-v2: adopt cleaned-up cdk (#34748)
ae2198d destination-snowflake: adopt cleaned-up cdk (#34747)
2b2408a Destination redshift: Switch back to jooq execution; add e2e special characters test (#34562)
80bd719 [Docs] Create homepage for Sources/Destinations (#34391)
aaa08fe ✨ source-stripe: migrate to poetry (#35068)
d6620f2 ✨ source-greenhouse: migrate to poetry (#35077)
d7e576f ✨ source-github: migrate to poetry (#35087)
083c573 🤖 Bump patch version of Python CDK
60a2618 [ISSUE #34910] add headers to HttpResponse for test framework (#35105)
ff4ed24 🐛 Source Amazon Seller Partner: Fix check command to check access to correct streams (#35062)
248f051 ✨ Source Intercom: Add missing fields (#35063)
0c3cccf Source Monday: add integration tests (#35016)
9257a31 Delete resources/example/airflow (#35056)
656beb8 ✨ Source Bing Ads: Add ignore fields for ads stream (#35019)
2080c8c Update documentation for aws secret manager configs (#35057)
d6c8738 [Docs] January 2024 release notes (#34753)
44ddfb8 undo useLocalCdk = true from #34745 (#35054)
796b2e8 java CDK: clean up dependencies, refactor modules (#34745)

v0.50.48

09 Feb 01:28
Compare
Choose a tag to compare

a146d8b Docs reference: Fix bug with hidden array item properties (#34946)
70d1942 airbyte-lib: Fix telemetry for streaming (#34955)
600388e airbyte-lib: Clean up test schema in Snowflake (#35015)
cf244b6 AirbyteLib: Show list of actually available connectors (#35018)
c8d5927 Checkpointing source-mssql (#34182)
e691b66 async-destination-framework: make GlobalAsyncStateManager entirely thread safe (#35027)
a96b7f4 CAT: add validation for stream statuses (#34675)
89accff airbyte-ci: fix missing test reports (#35039)
e6fff38 [source-postgres] : Provide option to advance LSN (#34781)
c32c2f2 🐛 Destination snowflake: use 200MB batches (#34502)
4f95b81 Remove sources with LEGACY STATE from registry (#35038)
b479497 Source Linnworks: CDK update (#34717)
72ee783 Source Klaviyo: Add missing fields to stream schemas (#34998)
623d481 fix low-code tags on source-sendgrid/sentry/intercom (#35028)
ddb35e2 Add Information about Snowflake Column Case change to V2 Doc (#34989)
45e136d 🐛 Source Freshservice - add backoff policy to requested_items stream and bump changelog (#34633)
936ce03 CDK: allow ConnectorStateManager stream_instance_map to take ConfiguredAirbyteStream or Stream (#35000)
8107081 CAT: Validate connector documentation (#34380)
2a323cc ✨ Source Amazon Ads: Add missing field to sponsored_display_budget_rules stream schema (#35013)
890d9e0 source-google-sheets: use poetry for dependency management [2] (#35008)
581118b publish-workflow: expose airbyte-ci-binary-url input (#35011)
9141d70 airbyte-ci: poetry install --no-root in builder (#35010)
8cd13f6 Revert "source-google-sheets: use poetry for dependency management (#… (#35007)
0a1cd31 source-google-sheets: use poetry for dependency management (#34944)
dd112ee airbyte-ci: only install main dependencies when calling poetry install (#34945)
955b9eb improve startup performance of airbyte-ci (#34430)
9933916 🤖 Bump minor version of Python CDK
25fa4cd AirbyteLib: Use case-insensitive method of finding column objects (#34985)
e8910e4 File-based CDK: make incremental syncs concurrent (#34540)
6068650 Revert "Emit multiple error trace messages and continue syncs by default" (#34990)
b11a29e AirbyteLib: Add 'get_available_connectors()' option (#34982)
e98d88e AirbyteLib: Require stream selection (#34979)
9dc5bf3 source-postgres/mysql: fix wrong tags in metadata (#34980)
05613a6 remove useLocalCdk for source-postgres (#34981)
e7dc82c make exclusive containers first class citizens (#34892)
e467d02 ✨ Source Hubspot: Add contacts form submissions stream (#34829)
c38b80d 🤖 Bump patch version of Python CDK
3d9f70f [ISSUE #34755] do not propagate parameters on InlineSchemaLoader (#34853)
6e4ed76 db-sources-java-cdk: fix logic to calculate the state stats count in db sources iterator (#34948)
fccc1d0 airbyte-ci: embed junit xml reports into user-facing html report (#34923)
e06243b AirbyteLib: Improved progress print, especially in the terminal (#34973)
cc2a6e2 Emit multiple error trace messages and continue syncs by default (#34636)
e1f7925 🤖 Bump patch version of Python CDK
f281672 fix version of airbyte-cdk in Dockerfile pip install (#34941)
3f47526 ✨ Source Google Analytics Data API: Replace convert_conversions_purchase with convert_conversions_event (#34951)
5af9696 airbyte-ci: run poe tasks declared in pyproject.toml file of internal poetry packages (#34736)
cee3a19 Update reset.md (#34855)
cf4cb22 internal poetry packages: declare poe tasks and airbyte-ci sections in pyproject.toml (#34735)
2f65766 Source S3: bump CDK version to fix issue when SyncMode is missing from catalog (#34930)
edfd287 Source Hubspot: add notes about property history stream (#34915)
a960d9f 🐛 Source Facebook Marketing: Add missing fields (#34845)
454b846 🐛Source Amazon Seller Partner: fix date formatting for ledger reports with aggregation by month (#34914)
58de015 File based sources fix sync mode bug (#34936)
7f97f24 CDK: fix flaky scenario-based tests by sorting on k & v (#34912)
6155363 AirbyteLib: Case insensitive missing column checks, deterministic column ordering in duckdb inserts (#34824)
45803a3 source-s3: pin to version 4.4.1 (#34926)
01b6f4b Destination Postgres: Remove varchar limit of 64k, defaults to 10MiB limit (#34891)
18de9d1 🤖 Bump minor version of Python CDK
a00aae5 Remove connector ops team (#34867)
be80bfc File-based CDK: log warning on no sync mode instead of raising exception (#34924)
264043f Connector templates: Publish by default (#34766)
e59b3f9 ✨ Source Google Analytics Data API: Add spec parameter to convert conversions:purchase to float (#34907)
5c54923 S3 and Google Analytics v4: Enable pypi publishing (#34903)
a28aab9 ✨ Source Stripe: Events stream concurrent on incremental syncs (#34619)
20bc4b4 Source Zendesk Support: integration tests for empty streams (#34840)
b2f6a93 airbyte-lib: Stream state (#34778)
03530ac airbyte-ci: Make pypi publish enabled for certified connectors (#34836)
a8ca2be airbyte-lib: Use proper segment key (#34863)
0b79b9e airbyte-lib: Improve source factory (#34849)
65002d4 airbyte-lib: Fix processed records counter (#34857)
5b91b5b ✨ Source S3: Add region to S3 source (#34842)
0b8496c airbyte-lib: Add testing to connectors (#34044)
540b9d4 AirbyteLib: Add basic secrets management (#34822)
6e8b87f AirbyteLib: detect REPL and disable Rich.Live if so (#34782)
22b63c7 AirbyteLib: Support write strategies: 'merge' and 'auto' (#34592)
5727127 rollback source-github to 1.5.7 (#34870)
c7a7b93 🤖 Bump patch version of Python CDK
f6afd80 Update http-streams.md typo (#34861)
06d44f8 Improve error messages for concurrent CDK (#34754)
ee39d40 Docs: update pg13 requirement for external db (#34858)
c7c51ea [source-mongodb-v2] : Fail sync if initial snapshot for any stream fails (#34759)
247bc17 Kubernetes docs: external logs with S3 (#34621)
529ff1a Source Gong: Adjust schemas (#34847)
865773a Source Zoom: Disable pypi (#34848)
df56dfe 🐛 Source Google Ads: Add ignore fields for multiple fields (#34844)
53d71f9 Source S3: updates for compatibility with the concurrent CDK (#34591)
5571fd0 Source Salesforce: concurrent incremental syncs (#33522)
66c7767 🐛 Source Coin API: Fix catalog typos (#34826)
63d0532 fix bullet style
d8341e6 AirbyteLib: Add pip_url helpers to streamline connector debugging (#34827)
1e856d0 AirbyteLib: friendly install and post-install messaging (#34816)
d9b500c AirbyteLib: Fix column count mismatch bug (#34783)

v0.50.47

03 Feb 00:20
Compare
Choose a tag to compare

0c09afe 📘Docs: Update source Linnworks page (#34788)
ec92971 AirbyteLib: Ignore unused Airbyte Protocol message types (#34779)
0f9401e Docs: Make sure reference section is always added (#34770)
b6b73bd AirbyteLib: Treat error trace as logs (#34771)
64d0a51 🎉 New Source: Microsoft SharePoint (#33537)
2bbeb4e AirbyteLib: Add len() support on SQL datasets and Mapping behaviors for ReadResult (#34763)
280fa1e AirbyteLib: fix examples in getting started (#34762)
683891d add log4jConfig to docs (#34777)
66ce98f Source Recharge: Fix airbyte-lib integration (#34772)
18cfa24 🐛 Source GitHub: Continue Sync on Stream failure (#34700)
5ecb971 🐛 Source Google Analytics Data API: Add rounding integer values that may be float (#34708)