New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update to Protobuf 4.x #11015
Comments
https://protobuf.dev/news/2023-12-05 Also, I'm wondering how this protobuf changes will affect
|
The protobuf breakage is pretty serious and goes against wisdom like https://jlbp.dev/JLBP-7 . I don't see how the community can absorb it. googleapis libraries are hit even harder than we are, so I think we'd wait until they have an idea how to deal with this (otherwise they couldn't upgrade to newer grpc versions). I don't expect that to be too big of a problem for the community, as I think most protobuf-using projects will be in shock. I'm in discussions with others, but I'd expect the process to figure this out to take months. |
After updating to Protobuf 4.26.0, we observe this issue:
The announcement of the Protobuf release contains this: So I guess this has to be adjusted. |
@neeme-praks-sympower Does any library or dependency require you to upgrade Protobuf runtime version to 4.x? |
It seems that |
Motivation: - grpc-java is not fully compatible with Protobuf 4; see: grpc/grpc-java#11015 - Protobuf 4 breaks our demo server due to an incompatibility between the generated code and what the grpc-java library expects. Modifications: - Downgrade to Protobuf 3 on all projects. - Prevent upgrade to Protobuf 4 in dependabot.yml (note: scala-steward doesn't seem to pick up Protobuf updates anyway, probably because it's not configured as a library dependency per se). Result: Stick to Protobuf 3 for now.
Motivation: - grpc-java is not fully compatible with Protobuf 4; see: grpc/grpc-java#11015 - Protobuf 4 breaks our demo server due to an incompatibility between the generated code and what the grpc-java library expects. Modifications: - Downgrade to Protobuf 3 on all projects. - Prevent upgrade to Protobuf 4 in dependabot.yml (note: scala-steward doesn't seem to pick up Protobuf updates anyway, probably because it's not configured as a library dependency per se). Result: Stick to Protobuf 3 for now.
Motivation: - grpc-java is not fully compatible with Protobuf 4; see: grpc/grpc-java#11015 - Protobuf 4 breaks our demo server due to an incompatibility between the generated code and what the grpc-java library expects. Modifications: - Downgrade to Protobuf 3 on all projects. - Prevent upgrade to Protobuf 4 in dependabot.yml (note: scala-steward doesn't seem to pick up Protobuf updates anyway, probably because it's not configured as a library dependency per se). Result: Stick to Protobuf 3 for now.
Why couldn't grpc just bring back generated message v3? The classes appear almost identical, I suppose it can just extend it? I tried that myself - it somewhat worked. I got past the generated message v3 error, but I was getting serializaiton errors everywhere. I think they may have changed the serializaiton spec too? Anyway, I'm looking forward to this fix. I might try this again today. |
No. We just try to keep our dependencies up-to-date. |
@neeme-praks-sympower Thank you. |
I've opened an issue at Protobuf for restoring |
I didn't think you're going to win that though It was a major upgrade with breaking changes. They deprecated V3 awhile ago, better to fix instead of bringing it back. It'll take some time, but GRPC isn't always caught up to the latest protocol buffers. |
The protobuf v4 release effectively breaks a ton of projects. Sure, it's a breaking change - but it is a breaking change without a migration path. The protobuf code generators generated IMHO, a breaking change must first provide a properly communicated migration path and then give all users and projects enough time to adopt. Bringing back GeneratedMessageV3 as a migration path SGTM - just not sure how good that'll work. |
I'm in for a fight. 😂 Anyway, if they deprecated V3 a while ago, how come code generated with protoc |
Quick update: protobuf understands the problem and are considering solutions, and they've said as much publicly. I expect a few more weeks to settle on the approach and then some time to make sure the details are right. For those watching at home and want to be prepared, use protobuf-java 3.25 and protoc 25. Also, if you have any non-generated code using (I'm assuming there's no references to |
…t libraries. grpc still is on 3.25 - 4.26 is going to be upgraded in the grpc branch and won't be the latest version until grpc/grpc-java#11015 is resolved.
Is your feature request related to a problem?
I would like to use the latest released version of Protobuf (4.26.0) but I cannot as gRPC is still using the old version.
Describe the solution you'd like
Update Protobuf dependency and make it work with the new version.
Describe alternatives you've considered
I hoped that the update would be easy (just a version bump) so I tried doing it myself but it resulted in a compilation failure so I'll leave it to you to figure it out.
The failure:
The text was updated successfully, but these errors were encountered: