Skip to content

Improve engine performance with ultra fine grain parallelism #508

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
nathanwbrei merged 16 commits into from
Jun 16, 2026
Merged

Improve engine performance with ultra fine grain parallelism #508

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
9b7e11d
Clean up PerfTests
nathanwbrei May 29, 2026
ebab677
Add MinimalUnfolderTopology perf test
nathanwbrei May 29, 2026
846a4e0
Fix JFactorySet::Print cout interleaving
nathanwbrei May 30, 2026
1af7be3
Add TapChainTests
nathanwbrei May 31, 2026
30ca2ac
PerfTests: Consistent, logarithmic plots
nathanwbrei May 31, 2026
35344a5
JBenchmarker: Make filenames configurable
nathanwbrei May 31, 2026
34892e2
Generate plot for tap chain scale tests
nathanwbrei Jun 1, 2026
ca70b5e
Fix MinimalPhysicsEventTopology scaling test
nathanwbrei Jun 1, 2026
d75c6ca
Move mini physics event topology perf test off of JTest
nathanwbrei Jun 12, 2026
b4d9c8e
perf_tests: Consistent naming conventions
nathanwbrei Jun 15, 2026
77fbbfc
perf_tests: Add {Small, Medium, Large} cases for each topology
nathanwbrei Jun 15, 2026
711b360
perf_tests: Add saturation and pipelining tests
nathanwbrei Jun 16, 2026
7bb48ca
perf_test: Add perf_test results to docs/
nathanwbrei Jun 16, 2026
c27c222
JExecutionEngine: Only check for pause when already pausing or draining
nathanwbrei Jun 1, 2026
bc8baa6
JExecutionEngine: Wake fewer workers
nathanwbrei Jun 1, 2026
13a0b93
Re-run perf tests
nathanwbrei Jun 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docs/perf_tests/basic_jtest.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 4.03 0.53
2 8.07 0.68
4 15.97 0.94
8 31.93 1.57
16 61.46 3.20
32 92.77 4.87
7 changes: 7 additions & 0 deletions docs/perf_tests/basic_large.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 5.00 0.00
2 10.00 0.00
4 21.70 6.56
8 39.43 1.72
16 80.01 2.43
32 158.83 2.24
17 changes: 17 additions & 0 deletions docs/perf_tests/basic_large_saturation.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# nthreads avg_rate rms
1 3.98 0.08
2 8.07 0.25
3 12.03 0.12
4 16.00 0.00
5 20.00 0.00
6 24.00 0.00
7 28.00 0.00
8 32.03 0.12
9 36.00 0.00
10 40.00 0.00
11 40.00 0.00
12 40.00 0.00
13 39.93 0.25
14 40.00 0.00
15 39.93 0.25
16 40.00 0.00
7 changes: 7 additions & 0 deletions docs/perf_tests/basic_medium.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 49.94 0.24
2 100.10 0.52
4 199.87 0.50
8 400.03 3.16
16 797.37 1.77
32 1385.96 11.83
17 changes: 17 additions & 0 deletions docs/perf_tests/basic_medium_saturation.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# nthreads avg_rate rms
1 40.01 0.03
2 79.93 0.25
3 119.93 0.25
4 159.90 0.37
5 199.83 0.35
6 239.90 0.27
7 279.87 0.34
8 319.70 0.44
9 359.73 0.44
10 397.67 0.79
11 397.23 0.75
12 396.83 0.85
13 397.30 0.57
14 397.30 0.44
15 397.27 0.77
16 396.63 2.13
7 changes: 7 additions & 0 deletions docs/perf_tests/basic_mini.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 192548.67 909.47
2 228309.97 8005.31
4 157134.13 2124.88
8 138713.43 2024.73
16 125931.90 4604.27
32 117078.33 6739.70
7 changes: 7 additions & 0 deletions docs/perf_tests/basic_small.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 4765.23 43.28
2 9643.33 33.80
4 19230.50 116.03
8 38369.27 139.56
16 67814.23 2100.95
32 46497.08 3820.91
17 changes: 17 additions & 0 deletions docs/perf_tests/basic_small_saturation.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# nthreads avg_rate rms
1 3878.47 11.41
2 7766.60 5.48
3 11638.87 15.66
4 15549.30 13.82
5 19365.33 25.11
6 23227.90 32.14
7 27069.33 52.31
8 30702.44 142.87
9 33474.97 108.34
10 33224.83 64.16
11 32529.70 327.39
12 32592.27 262.56
13 31563.40 847.31
14 31986.87 367.67
15 31814.23 348.19
16 31706.07 360.37
241 changes: 241 additions & 0 deletions docs/perf_tests/samples.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,241 @@
# nthreads rate
1 0.28
1 1.00
1 0.00
1 1.00
1 0.00
1 0.00
1 1.00
1 0.00
1 0.00
1 1.00
1 0.00
1 0.00
1 1.00
1 0.00
1 0.00
2 1.50
2 2.00
2 4.00
2 3.00
2 1.00
2 5.00
2 5.00
2 2.00
2 3.00
2 5.00
2 2.00
2 4.00
2 5.00
2 3.00
2 3.00
3 7.00
3 3.00
3 6.00
3 7.00
3 3.00
3 7.00
3 5.00
3 5.00
3 4.00
3 7.00
3 5.00
3 7.00
3 2.00
3 6.00
3 7.00
4 8.00
4 7.00
4 6.00
4 7.00
4 10.00
4 3.00
4 7.00
4 10.00
4 7.00
4 5.00
4 8.00
4 8.00
4 7.00
4 5.00
4 8.00
5 10.00
5 8.00
5 8.00
5 11.00
5 8.00
5 8.00
5 10.00
5 8.00
5 9.00
5 10.00
5 8.00
5 9.00
5 8.00
5 10.00
5 9.00
6 10.50
6 13.00
6 11.00
6 9.00
6 9.00
6 14.00
6 10.00
6 9.00
6 12.00
6 10.00
6 10.00
6 11.00
6 11.00
6 9.00
6 11.00
7 13.50
7 12.00
7 12.00
7 12.00
7 14.00
7 11.00
7 13.00
7 12.00
7 10.00
7 15.00
7 11.00
7 14.00
7 13.00
7 11.00
7 13.00
8 16.00
8 10.00
8 14.00
8 15.00
8 13.00
8 10.00
8 19.00
8 13.00
8 13.00
8 12.00
8 16.00
8 12.00
8 11.00
8 11.00
8 16.00
9 16.50
9 14.00
9 16.00
9 15.00
9 15.00
9 18.00
9 14.00
9 16.00
9 17.00
9 14.00
9 17.00
9 16.00
9 16.00
9 17.00
9 15.00
10 18.50
10 16.00
10 17.00
10 18.00
10 15.00
10 19.00
10 18.00
10 17.00
10 16.00
10 19.00
10 16.00
10 19.00
10 18.00
10 16.00
10 18.00
11 19.50
11 20.00
11 20.00
11 20.00
11 20.00
11 20.00
11 20.00
11 20.00
11 20.00
11 20.00
11 18.00
11 19.00
11 20.00
11 20.00
11 19.00
12 19.00
12 19.00
12 20.00
12 19.98
12 20.00
12 19.00
12 20.00
12 20.00
12 19.00
12 20.00
12 20.00
12 20.00
12 20.00
12 20.00
12 20.00
13 20.00
13 20.00
13 20.00
13 20.00
13 20.00
13 20.00
13 20.00
13 20.00
13 20.00
13 19.00
13 19.00
13 19.00
13 19.00
13 20.00
13 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
14 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 20.00
15 18.98
15 20.00
15 20.00
15 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
16 20.00
7 changes: 7 additions & 0 deletions docs/perf_tests/source_large.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 5.00 0.00
2 5.00 0.00
4 5.00 0.00
8 5.00 0.00
16 5.00 0.00
32 5.00 0.00
7 changes: 7 additions & 0 deletions docs/perf_tests/source_medium.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 99.65 0.46
2 99.80 0.40
4 99.73 0.44
8 99.87 0.34
16 99.73 0.44
32 99.93 0.25
7 changes: 7 additions & 0 deletions docs/perf_tests/source_mini.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 571538.63 1652.21
2 573767.63 4950.00
4 570312.60 6909.59
8 575544.80 710.41
16 574226.97 4402.65
32 576220.87 1423.82
7 changes: 7 additions & 0 deletions docs/perf_tests/source_small.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 19223.73 18.36
2 19160.77 63.97
4 19101.03 103.28
8 19138.20 26.04
16 19047.70 74.41
32 19060.43 91.53
23 changes: 23 additions & 0 deletions docs/perf_tests/tap_chain_plot.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@

title = "Chain length scaling"
output_filename = "chain_length_scaling.pdf"
use_latex = true

[[test]]
key = "1 JEventProcessor"
datafile = "tap_chain_tests_1.dat"
t_par = 1
t_seq = 1

[[test]]
key = "4 JEventProcessors"
datafile = "tap_chain_tests_4.dat"
t_par = 1
t_seq = 1

[[test]]
key = "16 JEventProcessors"
datafile = "tap_chain_tests_16.dat"
t_par = 1
t_seq = 1

7 changes: 7 additions & 0 deletions docs/perf_tests/tapchain_16_large.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nthreads avg_rate rms
1 5.00 0.00
2 10.00 0.00
4 20.07 0.57
8 40.13 0.81
16 79.83 5.17
32 158.82 1.51
Loading
Loading