[Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM #9257

performanceautofiler · 2022-10-27T09:10:25Z

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
PropertyIndexer - Duration of single invocation	2.40 μs	2.56 μs	1.07	0.00	False
PropertyIndexer - Duration of single invocation	2.42 μs	2.56 μs	1.06	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 2.5621070044750054 > 2.519590929528722.
IsChangePoint: Marked as a change because one of 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -79.84841284466115 (T) = (0 -2562.839832465811) / Math.Sqrt((88.02103905198462 / (33)) + (5.963199813624955 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.06520302197319448 = (2405.9637267254243 - 2562.839832465811) / 2405.9637267254243 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 2.555629650752268 > 2.5192041681083257.
IsChangePoint: Marked as a change because one of 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -45.19374224179287 (T) = (0 -2562.3198686011565) / Math.Sqrt((129.14667737222592 / (33)) + (38.41666888905693 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.06390239429462732 = (2408.4163005385353 - 2562.3198686011565) / 2408.4163005385353 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.MathBenchmarks.Double

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Max - Duration of single invocation	3.20 μs	3.92 μs	1.22	0.10	False
Min - Duration of single invocation	3.20 μs	3.91 μs	1.22	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.MathBenchmarks.Double*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.MathBenchmarks.Double.Max

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 3.916188572380477 > 3.3611721632250458.
IsChangePoint: Marked as a change because one of 9/27/2022 12:44:07 AM, 9/27/2022 1:53:10 PM, 10/3/2022 1:11:02 PM, 10/4/2022 3:13:24 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -292.52383401949976 (T) = (0 -3912.0076069516786) / Math.Sqrt((0.6813527586709786 / (33)) + (29.410767541569356 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.22200553000052406 = (3201.301066902701 - 3912.0076069516786) / 3201.301066902701 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Double.Min

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 3.913515579438474 > 3.361850222134098.
IsChangePoint: Marked as a change because one of 9/24/2022 1:05:07 PM, 9/25/2022 1:34:22 AM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -284.44078392636703 (T) = (0 -3910.064110418898) / Math.Sqrt((0.6343485934983307 / (33)) + (30.93415518545664 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.22133528755267207 = (3201.4665835570318 - 3910.064110418898) / 3201.4665835570318 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
HeapSort - Duration of single invocation	7.55 μs	8.21 μs	1.09	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;Guid, Guid&gt;*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 100)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -37.13813146074411 (T) = (0 -8189.7287604201965) / Math.Sqrt((2440.965409058802 / (27)) + (1012.8163120435628 / (5))) is less than -2.0422724562973107 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (5) - 2, .025) and -0.08414935027570457 = (7554.059556773712 - 8189.7287604201965) / 7554.059556773712 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Text.Perf_Utf8Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetByteCount - Duration of single invocation	9.36 μs	10.09 μs	1.08	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Perf_Utf8Encoding*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Perf_Utf8Encoding.GetByteCount(Input: EnglishAllAscii)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.0873715437788 > 9.81159339452191.
IsChangePoint: Marked as a change because one of 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -295.3790915818668 (T) = (0 -10083.948626400292) / Math.Sqrt((155.78484181314982 / (33)) + (7.266505791997529 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.07849704249181373 = (9350.001186004025 - 10083.948626400292) / 9350.001186004025 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in Benchmark.GetChildKeysTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
AddChainedConfigurationEmpty - Duration of single invocation	36.03 ms	47.97 ms	1.33	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchmark.GetChildKeysTests*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

Benchmark.GetChildKeysTests.AddChainedConfigurationEmpty

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 47.969530666666664 > 37.85149191025642.
IsChangePoint: Marked as a change because one of 9/27/2022 6:39:02 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -1343.0880303210113 (T) = (0 -47967083.5003663) / Math.Sqrt((767248124.2282945 / (33)) + (276507151.579964 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.3300765725224793 = (36063400.026208356 - 47967083.5003663) / 36063400.026208356 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Text.Json.Tests.Perf_Strings

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteStringsUtf16 - Duration of single invocation	14.79 ms	15.58 ms	1.05	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: OneEscaped)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 15.581548333333334 > 15.531254855769234.
IsChangePoint: Marked as a change because one of 8/11/2022 10:02:44 AM, 8/30/2022 6:17:03 PM, 9/29/2022 1:36:12 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -44.379868911866694 (T) = (0 -15610472.333333332) / Math.Sqrt((7400900655.951304 / (33)) + (442841417.4999885 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.052946342175118434 = (14825515.515905663 - 15610472.333333332) / 14825515.515905663 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.MathBenchmarks.Single

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Tanh - Duration of single invocation	42.70 μs	48.67 μs	1.14	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.MathBenchmarks.Single*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.MathBenchmarks.Single.Tanh

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 48.666334109730855 > 44.49402512681359.
IsChangePoint: Marked as a change because one of 9/21/2022 8:02:52 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -12.732960347567975 (T) = (0 -47942.34425157511) / Math.Sqrt((131834.54731427645 / (33)) + (953913.6959286161 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.13277746276328659 = (42322.82670474835 - 47942.34425157511) / 42322.82670474835 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Count - Duration of single invocation	1.93 ms	2.09 ms	1.08	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?s).*", Options: None)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 2.088084888888889 > 2.025589015625.
IsChangePoint: Marked as a change because one of 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -1073.9148807255979 (T) = (0 -2088106.1628748327) / Math.Sqrt((182574.31168365123 / (33)) + (81752.28569866145 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.08234485963981134 = (1929242.925004258 - 2088106.1628748327) / 1929242.925004258 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Except - Duration of single invocation	4.03 μs	4.26 μs	1.06	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Related Issues

Regressions

[Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Linq.Tests.Perf_Enumerable.Except(input: IEnumerable)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 4.2645137344821205 > 4.227144244901915.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 9/22/2022 11:37:30 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsRegressionStdDev: Marked as regression because -12.143949035086388 (T) = (0 -4246.192413631439) / Math.Sqrt((653.0329657593794 / (33)) + (1321.1449641930599 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.05063918332358982 = (4041.5325080481416 - 4246.192413631439) / 4041.5325080481416 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

The text was updated successfully, but these errors were encountered:

AndyAyersMS · 2022-11-01T16:39:37Z

Duping to dotnet/runtime#77730

performanceautofiler bot added arm64 untriaged labels Oct 27, 2022

This was referenced Oct 27, 2022

[Perf] Windows/arm64: 4 Improvements on 10/25/2022 10:16:52 PM #9266

Closed

[Perf] Linux/arm64: 3 Improvements on 10/25/2022 10:16:52 PM #9271

Closed

dakersnar mentioned this issue Oct 27, 2022

[Perf] Linux/arm64: 8 Regressions on 10/25/2022 10:16:52 PM dotnet/runtime#77546

Closed

AndyAyersMS closed this as completed Nov 1, 2022

AndyAyersMS removed the untriaged label Nov 1, 2022

performanceautofiler bot added perf-regression os-windows and removed refs/heads/main labels Mar 24, 2023

performanceautofiler bot added branch-refs/heads/main arch-arm64 runtime-coreclr kind-micro labels Mar 24, 2023

[Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM #9257

[Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM #9257

Comments

performanceautofiler bot commented Oct 27, 2022 • edited Loading

Run Information

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)

Description of detection logic

Description of detection logic

Docs

Regressions in System.MathBenchmarks.Double

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.MathBenchmarks.Double.Max

Description of detection logic

Description of detection logic

Docs

Run Information

Regressions in System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 100)

Description of detection logic

Docs

Run Information

Regressions in System.Text.Perf_Utf8Encoding

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Text.Perf_Utf8Encoding.GetByteCount(Input: EnglishAllAscii)

Description of detection logic

Docs

Run Information

Regressions in Benchmark.GetChildKeysTests

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

Benchmark.GetChildKeysTests.AddChainedConfigurationEmpty

Description of detection logic

Docs

Run Information

Regressions in System.Text.Json.Tests.Perf_Strings

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: OneEscaped)

Description of detection logic

Docs

Run Information

Regressions in System.MathBenchmarks.Single

Repro

performanceautofiler bot commented Oct 27, 2022 •

edited

Loading