[Perf] Windows/x64: 3 Regressions on 10/25/2022 10:16:52 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	f4b715f1cfadcbf85486f369724528c051be5733
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Text.Json.Tests.Perf_Strings

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteStringsUtf16 - Duration of single invocation	14.14 ms	15.35 ms	1.09	0.03	False
WriteStringsUtf16 - Duration of single invocation	7.31 ms	7.90 ms	1.08	0.04	False
WriteStringsUtf16 - Duration of single invocation	13.23 ms	14.41 ms	1.09	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

Related Issues

Regressions

• [Perf] Alpine/x64: 13 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/x64: 3 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Linux/x64: 5 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

• [Perf] Linux/x64: 3 Improvements on 10/25/2022 10:16:52 PM
• [Perf] Linux/arm64: 3 Improvements on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 4 Improvements on 10/25/2022 10:16:52 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: OneEscaped)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 15.350821666666667 > 14.916351333333333.
IsChangePoint: Marked as a change because one of 10/25/2022 7:09:53 PM, 11/1/2022 6:58:35 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 6:58:35 AM.
IsRegressionStdDev: Marked as regression because -7.604832934485676 (T) = (0 -15130159.414260732) / Math.Sqrt((43353365022.608925 / (22)) + (408701414486.7617 / (29))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (29) - 2, .025) and -0.06803882651298691 = (14166300.923402578 - 15130159.414260732) / 14166300.923402578 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 7.903938383838384 > 7.70626969815341.
IsChangePoint: Marked as a change because one of 10/25/2022 2:56:59 AM, 11/1/2022 6:58:35 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 6:58:35 AM.
IsRegressionStdDev: Marked as regression because -9.661913812478014 (T) = (0 -7818586.347074888) / Math.Sqrt((24030970943.013245 / (18)) + (16615276806.508728 / (33))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (33) - 2, .025) and -0.05595211886058328 = (7404300.069506438 - 7818586.347074888) / 7404300.069506438 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 14.413653333333334 > 14.136050020833336.
IsChangePoint: Marked as a change because one of 10/25/2022 8:17:52 AM, 11/1/2022 6:58:35 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 6:58:35 AM.
IsRegressionStdDev: Marked as regression because -12.425321223143667 (T) = (0 -14790063.21216748) / Math.Sqrt((44757204418.52601 / (19)) + (340166358922.52844 / (32))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (32) - 2, .025) and -0.10587102440414803 = (13374130.333269633 - 14790063.21216748) / 13374130.333269633 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

Duping to dotnet/runtime#77730