[DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch

[jrmccluskey]

You can run many tests automatically using release/src/main/scripts/mass_comment.py.

[jrmccluskey]

Run CommunityMetrics PreCommit

[jrmccluskey]

Run Dataflow Runner Nexmark Tests

[jrmccluskey]

Run Dataflow Runner Tpcds Tests

[jrmccluskey]

Run Dataflow Runner V2 Java 11 Nexmark Tests

[jrmccluskey]

Run Dataflow Runner V2 Java 17 Nexmark Tests

[jrmccluskey]

Run Dataflow Runner V2 Nexmark Tests

[jrmccluskey]

Run Dataflow Streaming ValidatesRunner

[jrmccluskey]

Run Dataflow ValidatesRunner Java 11

[jrmccluskey]

Run Dataflow ValidatesRunner Java 17

[jrmccluskey]

Run Dataflow ValidatesRunner

[jrmccluskey]

Run Direct Runner Nexmark Tests

[jrmccluskey]

Run Direct ValidatesRunner Java 11

[jrmccluskey]

Run Direct ValidatesRunner Java 17

[jrmccluskey]

Run Direct ValidatesRunner in Java 11

[jrmccluskey]

Run Direct ValidatesRunner

[jrmccluskey]

Run Flink Runner Nexmark Tests

[jrmccluskey]

Run Flink ValidatesRunner Java 11

[jrmccluskey]

Run Flink Runner Tpcds Tests

[jrmccluskey]

Run Flink ValidatesRunner

[jrmccluskey]

Run Go Flink ValidatesRunner

[jrmccluskey]

Run Go PostCommit

[jrmccluskey]

Run Go PreCommit

[jrmccluskey]

Run Go Samza ValidatesRunner

[jrmccluskey]

Run Go Spark ValidatesRunner

[jrmccluskey]

Run GoPortable PreCommit

[jrmccluskey]

Run Java 11 Examples on Dataflow Runner V2

[jrmccluskey]

Run Java 17 Examples on Dataflow Runner V2

[jrmccluskey]

Run Java Dataflow V2 ValidatesRunner Streaming

[jrmccluskey]

Run Java Dataflow V2 ValidatesRunner

[jrmccluskey]

The GoUsingJava suite is perma-red on master, not a real failure (#21645)

[jrmccluskey]

Run XVR_Samza PostCommit

[jrmccluskey]

Run Java_Kafka_IO_Direct PreCommit

[jrmccluskey]

Run Java_Kafka_IO_Direct PreCommit

[jrmccluskey]

Run XVR_Spark3 PostCommit

[jrmccluskey]

Run XVR_Flink PostCommit

[jrmccluskey]

Run XVR_Direct PostCommit

[jrmccluskey]

Run Java Dataflow V2 ValidatesRunner

[jrmccluskey]

Run Dataflow ValidatesRunner Java 17

[jrmccluskey]

Run XVR_Direct PostCommit

[jrmccluskey]

Run XVR_Spark3 PostCommit

[tvalentyn]

Run Python Dataflow V2 ValidatesRunner

[tvalentyn]

Run Python Dataflow ValidatesRunner

[jrmccluskey]

Run Python ReleaseCandidate

[jrmccluskey]

Run Python Dataflow V2 ValidatesRunner

[tvalentyn]

It looks like the same test failed twice in Google Cloud Dataflow Runner V2 Python ValidatesRunner - could we investigate it? You can reach out to Py interrupts if you need help.

[jrmccluskey]

So the Python 3.7 ValidatesRunner Streaming test suite failed both times, but for different reasons in the last two builds: the first was an assertion failure in ExerciseStreamingMetricsPipelineTest.test_streaming_pipeline_returns_expected_user_metrics_fnapi_it while the second was a build timeout for apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs.

I'm not sure how known-flakey this test suite is though.

[tvalentyn]

Hmm I think I see the same test apache_beam.runners.dataflow.dataflow_exercise_streaming_metrics_pipeline_test.ExerciseStreamingMetricsPipelineTest.test_streaming_pipeline_returns_expected_user_metrics_fnapi_it on
https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2_PR/69/
https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2_PR/70/

but you are right that it can be a flake.

[jrmccluskey]

Run Python Dataflow V2 ValidatesRunner

[jrmccluskey]

Run Python_Integration PreCommit

[jrmccluskey]

Run Python_Integration PreCommit

[jrmccluskey]

Run Java_Kafka_IO_Direct PreCommit

[jrmccluskey]

Run Python Dataflow V2 ValidatesRunner

[jrmccluskey]

Run Java_Kafka_IO_Direct PreCommit

[jrmccluskey]

Run Python Dataflow V2 ValidatesRunner

[jrmccluskey]

Run Java_Kafka_IO_Direct PreCommit