Add support for Kafka 4.0.0 #11176
Draft
Add support for Kafka 4.0.0 #11176
+1,844
−266
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Jakub Scholz <www@scholzj.com>
|
/azp run upgrade |
|
Azure Pipelines successfully started running 1 pipeline(s). |
Signed-off-by: Jakub Scholz <www@scholzj.com>
Signed-off-by: Jakub Scholz <www@scholzj.com>
Signed-off-by: Jakub Scholz <www@scholzj.com>
Signed-off-by: Jakub Scholz <www@scholzj.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Type of change
Description
This PR adds support for Kafka 4.0.0 to test the 4.0.0-RC0.
The Kafka Agent has an issue because of backward incompatibilities between Jetty 9 used in Kafka 3 and Jetty 12 used in Kafka 4. The way this PR solves it is by creating two modules:
kafka-agent-3for Kafka 3 with Jetty 9kafka-agentfor Kafka 4 with Jetty 12During the container image build, the right version is copied. Once we drop support for Kafka 3.9, we will simply delete the
kafka-agent-3module.The log4j2 support relies on the Log4j2 reloading features instead of on Kafka APIs. The logging changes are also currently not fully documented and unit tested.
Checklist