[Perf] Linux/x64: 86 Regressions on 3/11/2024 8:28:14 PM #31477
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | 5161ccd6662f656a1a7dd394264e61a9955536bf |
| Compare | 27214a0787f9a0ee95c799639431d9d16c25d1ac |
| Diff | Diff |
| Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Regressions in System.Numerics.Tests.Perf_VectorOf<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 16.89 ns | 23.74 ns | 1.41 | 0.76 | False | ||||
| 4.05 ns | 6.05 ns | 1.49 | 0.83 | False | ||||
| 4.67 ns | 6.26 ns | 1.34 | 0.87 | False | ||||
| 20.82 ns | 23.13 ns | 1.11 | 0.72 | False | ||||
| 3.44 ns | 6.36 ns | 1.85 | 0.84 | False | ||||
| 3.52 ns | 5.21 ns | 1.48 | 0.84 | False | ||||
| 2.06 ns | 4.47 ns | 2.17 | 0.88 | False | ||||
| 3.48 ns | 5.61 ns | 1.61 | 0.85 | False | ||||
| 3.61 ns | 7.43 ns | 2.06 | 0.86 | False | ||||
| 0.00 ns | 4.52 ns | ∞ | 0.91 | False | ||||
| 17.43 ns | 31.99 ns | 1.84 | 0.74 | False | ||||
| 4.22 ns | 5.91 ns | 1.40 | 0.84 | False | ||||
| 1.73 ns | 5.94 ns | 3.43 | 0.87 | False | ||||
| 0.57 ns | 2.85 ns | 4.97 | 0.90 | False | ||||
| 4.17 ns | 8.02 ns | 1.92 | 0.86 | False | ||||
| 3.24 ns | 6.15 ns | 1.90 | 0.85 | False | ||||
| 3.83 ns | 8.44 ns | 2.21 | 0.85 | False |
_1.png)
_2.png)
_3.png)
_4.png)
_5.png)
_6.png)
_7.png)
_8.png)
_9.png)
_10.png)
_11.png)
_12.png)
_13.png)
_14.png)
_15.png)
_16.png)
_17.png)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int32>*'Details
Payloads
System.Numerics.Tests.Perf_VectorOf<Int32>.SquareRootBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.XorBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.DivideBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyOperatorBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.UnaryNegateOperatorBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.OneBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.AbsBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanAnyBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.DivisionOperatorBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseAndOperatorBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.MinBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.InequalityOperatorBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Int32>.SubtractBenchmark
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | 5161ccd6662f656a1a7dd394264e61a9955536bf |
| Compare | 27214a0787f9a0ee95c799639431d9d16c25d1ac |
| Diff | Diff |
| Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Regressions in System.Tests.Perf_Version
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 56.26 ns | 66.81 ns | 1.19 | 0.66 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Version*'Details
Payloads
System.Tests.Perf_Version.TryFormat3
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | 5161ccd6662f656a1a7dd394264e61a9955536bf |
| Compare | 27214a0787f9a0ee95c799639431d9d16c25d1ac |
| Diff | Diff |
| Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Regressions in System.Text.Json.Tests.Perf_DateTimes
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 10.49 ms | 12.27 ms | 1.17 | 0.24 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_DateTimes*'Details
Payloads
System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: False)
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | 5161ccd6662f656a1a7dd394264e61a9955536bf |
| Compare | 27214a0787f9a0ee95c799639431d9d16c25d1ac |
| Diff | Diff |
| Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 3.61 ns | 6.14 ns | 1.70 | 0.88 | False | ||||
| 1.86 ns | 4.39 ns | 2.36 | 0.83 | False | ||||
| 4.07 ns | 6.91 ns | 1.69 | 0.87 | False | ||||
| 18.81 ns | 26.71 ns | 1.42 | 0.68 | False | ||||
| 20.01 ns | 27.08 ns | 1.35 | 0.67 | False | ||||
| 3.41 ns | 4.42 ns | 1.29 | 0.85 | False | ||||
| 4.36 ns | 7.70 ns | 1.76 | 0.88 | False | ||||
| 43.07 ns | 54.22 ns | 1.26 | 0.31 | False | ||||
| 0.00 ns | 3.00 ns | ∞ | 0.91 | False | ||||
| 44.31 ns | 53.79 ns | 1.21 | 0.32 | False |
_1.png)
_2.png)
_3.png)
_4.png)
_5.png)
_6.png)
_7.png)
_8.png)
_9.png)
_10.png)
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'Details
Payloads
System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseAndBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseOrBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.DotBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsStaticBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.DivideBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAnyBenchmark
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_VectorOf<Byte>.DivisionOperatorBenchmark
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository