-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add docs/blog for release #31094
Add docs/blog for release #31094
Changes from 1 commit
0d4395d
777e548
6e58532
3adab17
7d7a574
47df45d
910bac6
aa1b821
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,163 @@ | ||
--- | ||
title: "Apache Beam 2.56.0" | ||
date: TODO | ||
categories: | ||
- blog | ||
- release | ||
authors: | ||
- damccorm | ||
--- | ||
<!-- | ||
Licensed under the Apache License, Version 2.0 (the "License"); | ||
you may not use this file except in compliance with the License. | ||
You may obtain a copy of the License at | ||
http://www.apache.org/licenses/LICENSE-2.0 | ||
Unless required by applicable law or agreed to in writing, software | ||
distributed under the License is distributed on an "AS IS" BASIS, | ||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
See the License for the specific language governing permissions and | ||
limitations under the License. | ||
--> | ||
|
||
We are happy to present the new 2.56.0 release of Beam. | ||
This release includes both improvements and new functionality. | ||
See the [download page](/get-started/downloads/#2550-2023-03-25) for this release. | ||
|
||
<!--more--> | ||
|
||
For more information on changes in 2.56.0, check out the [detailed release notes](https://github.com/apache/beam/milestone/20). | ||
|
||
## Highlights | ||
|
||
* Added FlinkRunner for Flink 1.17, removed support for Flink 1.12 and 1.13. Previous version of Pipeline running on Flink 1.16 and below can be upgraded to 1.17, if the Pipeline is first updated to Beam 2.56.0 with the same Flink version. After Pipeline runs with Beam 2.56.0, it should be possible to upgrade to FlinkRunner with Flink 1.17. ([#29939](https://github.com/apache/beam/issues/29939)) | ||
|
||
## I/Os | ||
|
||
* Support for X source added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). | ||
* Upgraded Avro version to 1.11.3, kafka-avro-serializer and kafka-schema-registry-client versions to 7.6.0 (Java) ([#30638](https://github.com/apache/beam/pull/30638)). | ||
The newer Avro package is known to have breaking changes. If you are affected, you can keep pinned to older Avro versions which are also tested with Beam. | ||
|
||
## New Features / Improvements | ||
|
||
* Profiling of Cythonized code has been disabled by default. This might improve performance for some Python pipelines ([#30938](https://github.com/apache/beam/pull/30938)). | ||
* Bigtable enrichment handler now accepts a custom function to build a composite row key. (Python) ([#30974](https://github.com/apache/beam/issues/30975)). | ||
|
||
## Breaking Changes | ||
|
||
* Default consumer polling timeout for KafkaIO.Read was increased from 1 second to 2 seconds. Use KafkaIO.read().withConsumerPollingTimeout(Duration duration) to configure this timeout value when necessary ([#30870](https://github.com/apache/beam/issues/30870)). | ||
* Python Dataflow users no longer need to manually specify --streaming for pipelines using unbounded sources such as ReadFromPubSub. | ||
|
||
## Bugfixes | ||
|
||
* Fixed locking issue when shutting down inactive bundle processors. Symptoms of this issue include slowness or stuckness in long-running jobs (Python) ([#30679](https://github.com/apache/beam/pull/30679)). | ||
* Fixed logging issue that caused silecing the pip output when installing of dependencies provided in `--requirements_file` (Python). | ||
|
||
## List of Contributors | ||
|
||
According to git shortlog, the following people contributed to the {$RELEASE_VERSION} release. Thank you to all contributors! | ||
|
||
Abacn | ||
|
||
Ahmed Abualsaud | ||
|
||
Andrei Gurau | ||
|
||
Andrey Devyatkin | ||
|
||
Aravind Pedapudi | ||
|
||
Arun Pandian | ||
|
||
Arvind Ram | ||
|
||
Bartosz Zablocki | ||
|
||
Brachi Packter | ||
|
||
Byron Ellis | ||
|
||
Chamikara Jayalath | ||
|
||
Clement DAL PALU | ||
|
||
Damon | ||
|
||
Danny McCormick | ||
|
||
Daria Bezkorovaina | ||
|
||
Dip Patel | ||
|
||
Evan Burrell | ||
|
||
Hai Joey Tran | ||
|
||
Jack McCluskey | ||
|
||
Jan Lukavský | ||
|
||
JayajP | ||
|
||
Jeff Kinard | ||
|
||
Julien Tournay | ||
|
||
Kenneth Knowles | ||
|
||
Luís Bianchin | ||
|
||
Maciej Szwaja | ||
|
||
Melody Shen | ||
|
||
Oleh Borysevych | ||
|
||
Pablo Estrada | ||
|
||
Rebecca Szper | ||
|
||
Ritesh Ghorse | ||
|
||
Robert Bradshaw | ||
|
||
Sam Whittle | ||
|
||
Sergei Lilichenko | ||
|
||
Shahar Epstein | ||
|
||
Shunping Huang | ||
|
||
Svetak Sundhar | ||
|
||
Timothy Itodo | ||
|
||
Veronica Wasson | ||
|
||
Vitaly Terentyev | ||
|
||
Vlado Djerek | ||
|
||
Yi Hu | ||
|
||
akashorabek | ||
|
||
bzablocki | ||
|
||
clmccart | ||
|
||
damccorm | ||
|
||
dependabot[bot] | ||
|
||
dmitryor | ||
|
||
github-actions[bot] | ||
|
||
liferoad | ||
|
||
martin trieu | ||
|
||
tvalentyn | ||
|
||
xianhualiu |
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -96,10 +96,17 @@ versions denoted `0.x.y`. | |
|
||
## Releases | ||
|
||
### 2.56.0 (TODO) | ||
Official [source code download](https://downloads.apache.org/beam/2.56.0/apache-beam-2.56.0-source-release.zip). | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. they are not available yet. Checked that the url is correct. Maybe just a delay? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I think its because PMC finalization hasn't happened yet |
||
[SHA-512](https://downloads.apache.org/beam/2.56.0/apache-beam-2.56.0-source-release.zip.sha512). | ||
[signature](https://downloads.apache.org/beam/2.56.0/apache-beam-2.56.0-source-release.zip.asc). | ||
|
||
[Release notes](https://github.com/apache/beam/releases/tag/v2.56.0) | ||
|
||
### 2.55.1 (2024-03-25) | ||
Official [source code download](https://downloads.apache.org/beam/2.55.1/apache-beam-2.55.1-source-release.zip). | ||
[SHA-512](https://downloads.apache.org/beam/2.55.1/apache-beam-2.55.1-source-release.zip.sha512). | ||
[signature](https://downloads.apache.org/beam/2.55.1/apache-beam-2.55.1-source-release.zip.asc). | ||
Official [source code download](https://archive.apache.org/beam/2.55.1/apache-beam-2.55.1-source-release.zip). | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. the archive links to 2.55.0 / 2.55.1 are 404. It should read https://archive.apache.org/dist/beam/2.55.0/apache-beam-2.55.0-source-release.zip There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Good catch, fixed |
||
[SHA-512](https://archive.apache.org/beam/2.55.1/apache-beam-2.55.1-source-release.zip.sha512). | ||
[signature](https://archive.apache.org/beam/2.55.1/apache-beam-2.55.1-source-release.zip.asc). | ||
|
||
[Release notes](https://github.com/apache/beam/releases/tag/v2.55.1) | ||
|
||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
add date ( - 2024-05-01) ?
realize 2.55.1 also didn't have date, before that each section was dated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good call, fixed