Reduce cardinality estimation times #2642
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Direct optimizer time comparison (ms)TPC-H Item | old | new | Change
----------|----------|----------|--------
TPC-H 01 | 1.30 | 1.36 | +4%
+ TPC-H 02 | 12.32 | 8.10 | -34%
TPC-H 03 | 7.76 | 8.07 | +4%
+ TPC-H 04 | 1.01 | 0.95 | -6%
+ TPC-H 05 | 18.98 | 12.77 | -33%
- TPC-H 06 | 1.47 | 1.56 | +7%
+ TPC-H 07 | 25.05 | 17.98 | -28%
+ TPC-H 08 | 25.19 | 19.08 | -24%
+ TPC-H 09 | 26.21 | 16.07 | -39%
+ TPC-H 10 | 5.83 | 4.45 | -24%
+ TPC-H 11 | 3.17 | 2.75 | -13%
+ TPC-H 12 | 2.90 | 2.03 | -30%
+ TPC-H 13 | 3.80 | 1.21 | -68%
+ TPC-H 14 | 1.80 | 1.50 | -16%
+ TPC-H 15 | 2.39 | 2.18 | -9%
+ TPC-H 16 | 6.24 | 1.83 | -71%
+ TPC-H 17 | 2.50 | 1.96 | -22%
TPC-H 18 | 3.13 | 3.16 | +1%
+ TPC-H 19 | 11.01 | 4.85 | -56%
+ TPC-H 20 | 7.68 | 6.22 | -19%
+ TPC-H 21 | 12.71 | 7.65 | -40%
+ TPC-H 22 | 1.43 | 0.78 | -45%
----------|----------|----------|--------
+ Sum | 183.87 | 126.51 | -31%TPC-DS Item | old | new | Change
------|----------|----------|--------
+ 01 | 7.70 | 6.38 | -17%
+ 03 | 3.07 | 2.53 | -18%
+ 06 | 13.87 | 11.11 | -20%
+ 07 | 12.29 | 10.22 | -17%
09 | 9.82 | 9.73 | -1%
+ 10 | 31.52 | 18.27 | -42%
+ 13 | 93.94 | 57.16 | -39%
+ 15 | 15.30 | 8.44 | -45%
+ 16 | 14.05 | 11.11 | -21%
+ 17 | 254.54 | 172.85 | -32%
+ 19 | 46.57 | 33.90 | -27%
+ 25 | 252.63 | 172.17 | -32%
+ 26 | 13.47 | 11.02 | -18%
+ 28 | 9.77 | 8.10 | -17%
+ 29 | 254.01 | 172.85 | -32%
+ 31 | 38.73 | 30.54 | -21%
+ 32 | 7.23 | 5.85 | -19%
+ 34 | 10.68 | 7.93 | -26%
+ 35 | 8.88 | 7.60 | -14%
+ 37 | 11.15 | 9.06 | -19%
+ 39a | 13.98 | 9.91 | -29%
+ 39b | 13.94 | 10.61 | -24%
+ 41 | 3.43 | 3.05 | -11%
+ 42 | 3.14 | 2.60 | -17%
+ 43 | 2.75 | 2.44 | -11%
+ 45 | 26.24 | 17.83 | -32%
+ 48 | 43.33 | 22.85 | -47%
+ 50 | 25.51 | 20.29 | -20%
+ 52 | 3.21 | 2.62 | -19%
+ 55 | 3.25 | 2.69 | -17%
+ 62 | 10.21 | 8.56 | -16%
+ 65 | 7.58 | 5.83 | -23%
+ 69 | 13.02 | 11.46 | -12%
+ 73 | 10.77 | 7.98 | -26%
+ 79 | 10.00 | 7.59 | -24%
+ 81 | 20.04 | 14.18 | -29%
+ 82 | 13.00 | 7.64 | -41%
+ 83 | 14.14 | 10.40 | -26%
+ 85 | 808.87 | 447.59 | -45%
+ 88 | 57.38 | 45.43 | -21%
+ 91 | 39.80 | 32.66 | -18%
+ 92 | 7.32 | 5.88 | -20%
+ 93 | 1.74 | 1.44 | -17%
+ 94 | 14.92 | 11.73 | -21%
+ 95 | 31.67 | 19.10 | -40%
+ 96 | 4.63 | 4.15 | -10%
- 97 | 3.21 | 3.44 | +7%
+ 99 | 10.27 | 8.61 | -16%
------|----------|----------|--------
+ Sum | 2326.56 | 1515.36 | -35%TPC-C Item | old | new | Change
--------------|----------|----------|--------
+ Delivery | 40.76 | 16.53 | -59%
+ New-Order | 28.59 | 6.50 | -77%
+ Order-Status | 1.13 | 0.63 | -45%
+ Payment | 5.60 | 1.42 | -75%
+ Stock-Level | 2.22 | 1.18 | -47%
--------------|----------|----------|--------
+ Sum | 78.31 | 26.25 | -66%SSB Item | old | new | Change
------|----------|----------|--------
1.1 | 2.38 | 2.29 | -4%
1.2 | 2.25 | 2.31 | +3%
1.3 | 2.28 | 2.29 | 0%
+ 2.1 | 4.47 | 3.90 | -13%
+ 2.2 | 4.45 | 3.96 | -11%
+ 2.3 | 4.27 | 3.82 | -11%
+ 3.1 | 4.52 | 3.89 | -14%
+ 3.2 | 4.88 | 4.29 | -12%
+ 3.3 | 6.32 | 5.65 | -11%
+ 3.4 | 4.41 | 3.83 | -13%
+ 4.1 | 11.52 | 10.77 | -7%
+ 4.2 | 10.39 | 9.75 | -6%
+ 4.3 | 10.21 | 8.56 | -16%
------|----------|----------|--------
+ Sum | 72.34 | 65.30 | -10%JOB Item | old | new | Change
------|----------|----------|--------
+ 10a | 56.23 | 41.24 | -27%
+ 10b | 60.01 | 44.59 | -26%
+ 10c | 59.16 | 41.85 | -29%
+ 11a | 224.36 | 156.99 | -30%
+ 11b | 229.98 | 159.06 | -31%
+ 11c | 229.00 | 156.24 | -32%
+ 11d | 227.65 | 155.33 | -32%
+ 12a | 407.20 | 292.19 | -28%
+ 12b | 407.49 | 286.35 | -30%
+ 12c | 413.47 | 294.55 | -29%
+ 13a | 38.91 | 30.57 | -21%
+ 13b | 57.13 | 39.20 | -31%
+ 13c | 57.02 | 39.18 | -31%
+ 13d | 50.56 | 37.28 | -26%
+ 14a | 396.84 | 290.17 | -27%
+ 14b | 395.97 | 293.18 | -26%
+ 14c | 396.23 | 290.61 | -27%
+ 15a | 101.89 | 71.38 | -30%
+ 15b | 96.36 | 68.27 | -29%
+ 15c | 102.64 | 69.33 | -32%
+ 15d | 88.98 | 67.00 | -25%
+ 16a | 554.94 | 357.52 | -36%
+ 16b | 548.58 | 351.69 | -36%
+ 16c | 544.02 | 356.48 | -34%
+ 16d | 555.52 | 358.61 | -35%
+ 17a | 224.96 | 165.84 | -26%
+ 17b | 226.20 | 165.16 | -27%
+ 17c | 226.17 | 166.87 | -26%
+ 17d | 227.61 | 163.82 | -28%
+ 17e | 233.50 | 168.51 | -28%
+ 17f | 229.05 | 164.59 | -28%
+ 18a | 236.80 | 164.47 | -31%
+ 18b | 226.33 | 165.42 | -27%
+ 18c | 230.73 | 158.48 | -31%
+ 19a | 131.49 | 63.06 | -52%
+ 19b | 113.76 | 61.48 | -46%
+ 19c | 113.65 | 60.64 | -47%
+ 19d | 108.10 | 59.67 | -45%
+ 1a | 14.68 | 11.31 | -23%
+ 1b | 12.22 | 10.02 | -18%
+ 1c | 12.47 | 10.10 | -19%
+ 1d | 13.71 | 11.34 | -17%
+ 20a | 51.33 | 39.39 | -23%
+ 20b | 51.97 | 39.55 | -24%
+ 20c | 54.31 | 42.32 | -22%
+ 21a | 58.08 | 28.75 | -50%
+ 21b | 48.53 | 27.31 | -44%
+ 21c | 60.08 | 29.02 | -52%
+ 22a | 107.83 | 68.43 | -37%
+ 22b | 107.96 | 68.86 | -36%
+ 22c | 116.64 | 68.99 | -41%
+ 22d | 127.77 | 84.98 | -33%
+ 23a | 94.93 | 72.02 | -24%
+ 23b | 104.58 | 79.12 | -24%
+ 23c | 94.98 | 72.25 | -24%
+ 24a | 177.28 | 107.43 | -39%
+ 24b | 177.71 | 110.80 | -38%
+ 25a | 103.09 | 75.47 | -27%
+ 25b | 107.75 | 79.68 | -26%
+ 25c | 107.96 | 73.59 | -32%
+ 26a | 124.05 | 94.14 | -24%
+ 26b | 105.23 | 87.77 | -17%
+ 26c | 109.34 | 88.72 | -19%
+ 27a | 92.51 | 52.41 | -43%
+ 27b | 91.78 | 52.52 | -43%
+ 27c | 100.10 | 53.28 | -47%
+ 28a | 207.76 | 137.48 | -34%
+ 28b | 197.51 | 136.29 | -31%
+ 28c | 207.22 | 137.95 | -33%
+ 29a | 391.92 | 255.23 | -35%
+ 29b | 389.83 | 252.91 | -35%
+ 29c | 377.76 | 223.67 | -41%
+ 2a | 16.87 | 14.04 | -17%
+ 2b | 16.92 | 14.02 | -17%
+ 2c | 16.92 | 14.04 | -17%
+ 2d | 17.06 | 14.09 | -17%
+ 30a | 202.12 | 148.43 | -27%
+ 30b | 207.09 | 150.28 | -27%
+ 30c | 208.49 | 147.10 | -29%
+ 31a | 239.87 | 159.18 | -34%
+ 31b | 258.81 | 166.34 | -36%
+ 31c | 245.69 | 158.76 | -35%
+ 32a | 30.75 | 20.53 | -33%
+ 32b | 30.59 | 20.55 | -33%
+ 33a | 109.09 | 64.32 | -41%
+ 33b | 105.27 | 67.29 | -36%
+ 33c | 110.55 | 64.90 | -41%
+ 3a | 12.92 | 7.71 | -40%
+ 3b | 8.45 | 7.19 | -15%
+ 3c | 14.08 | 7.81 | -45%
+ 4a | 13.68 | 11.73 | -14%
+ 4b | 13.09 | 11.59 | -11%
+ 4c | 13.74 | 11.70 | -15%
+ 5a | 23.00 | 12.22 | -47%
+ 5b | 17.59 | 11.94 | -32%
+ 5c | 25.25 | 12.36 | -51%
+ 6a | 20.33 | 16.57 | -19%
+ 6b | 26.17 | 19.06 | -27%
+ 6c | 28.70 | 20.95 | -27%
+ 6d | 24.02 | 17.30 | -28%
+ 6e | 20.28 | 16.68 | -18%
+ 6f | 34.05 | 21.58 | -37%
+ 7a | 430.66 | 295.77 | -31%
+ 7b | 444.26 | 305.58 | -31%
+ 7c | 465.01 | 308.79 | -34%
+ 8a | 100.37 | 72.36 | -28%
+ 8b | 109.37 | 74.92 | -32%
+ 8c | 95.96 | 66.64 | -31%
+ 8d | 94.69 | 65.85 | -30%
+ 9a | 212.09 | 138.04 | -35%
+ 9b | 205.62 | 139.74 | -32%
+ 9c | 205.81 | 133.48 | -35%
+ 9d | 204.80 | 133.01 | -35%
------|----------|----------|--------
+ Sum | 17709.47 | 12024.40 | -32% |
|
Still, cardinality estimation is a black hole for performance, and I have not totally figured out all problems. However, I think that there's more than enough material for this PR. What's your opinion, @Bouncner? |
Bouncner
reviewed
May 8, 2024
| @@ -58,13 +52,13 @@ std::ostream& operator<<(std::ostream& stream, const AttributeStatistics<T>& att | |||
| } | |||
|
|
|||
| if (attribute_statistics.min_max_filter) { | |||
| // TODO(anybody) implement printing of MinMaxFilter if ever required | |||
| stream << "Has MinMaxFilter\n"; | |||
| stream << "MinMaxFilter: " << *attribute_statistics.min_max_filter << '\n'; | |||
There was a problem hiding this comment.
Reminder for me. Looks strange ...
| Has MinMaxFilter | ||
| Has RangeFilter | ||
| MinMaxFilter: {0 100} | ||
| RangeFilter: { 0->100 } |
There was a problem hiding this comment.
Not a big fan of this input. As we should test more ranges IMO.
Benchmark allTPC-H results are unexpected, I'll rerun those. See below for more recent version. nemea - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -17% || Geometric mean of throughput changes: +21%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_72005cad13851f371f2ae8db5998839820daba92_st.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 12:44:56 | 2024-05-27 02:42:43 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 8048.02 | 6475.15 | -20% || 0.12 | 0.15 | +24% | ˅ |
+| TPC-H 02 || 64.86 | 45.94 | -29%˄ || 15.42 | 21.76 | +41%˄ | (run time too short) |
+| TPC-H 03 || 1597.70 | 1322.16 | -17% || 0.63 | 0.76 | +21% | 0.0000 |
+| TPC-H 04 || 1745.14 | 1391.12 | -20% || 0.57 | 0.72 | +25% | 0.0000 |
+| TPC-H 05 || 2580.28 | 2211.39 | -14% || 0.39 | 0.45 | +17% | 0.0000 |
+| TPC-H 06 || 194.04 | 160.71 | -17%˄ || 5.15 | 6.22 | +21%˄ | (run time too short) |
+| TPC-H 07 || 1009.70 | 816.55 | -19%˄ || 0.99 | 1.22 | +24%˄ | (run time too short) |
+| TPC-H 08 || 637.86 | 516.65 | -19%˄ || 1.57 | 1.94 | +23%˄ | (run time too short) |
+| TPC-H 09 || 6224.41 | 5087.43 | -18% || 0.16 | 0.20 | +22% | 0.0000 |
+| TPC-H 10 || 1561.10 | 1283.42 | -18% || 0.64 | 0.78 | +22% | 0.0000 |
+| TPC-H 11 || 77.96 | 63.34 | -19%˄ || 12.83 | 15.79 | +23%˄ | (run time too short) |
+| TPC-H 12 || 1124.59 | 993.75 | -12%˄ || 0.89 | 1.01 | +13%˄ | (run time too short) |
+| TPC-H 13 || 6008.21 | 4855.71 | -19% || 0.17 | 0.21 | +24% | 0.0000 |
+| TPC-H 14 || 506.88 | 415.01 | -18%˄ || 1.97 | 2.41 | +22%˄ | (run time too short) |
+| TPC-H 15 || 215.97 | 185.42 | -14%˄ || 4.63 | 5.39 | +16%˄ | (run time too short) |
+| TPC-H 16 || 696.67 | 560.22 | -20%˄ || 1.44 | 1.79 | +24%˄ | (run time too short) |
+| TPC-H 17 || 270.92 | 221.56 | -18%˄ || 3.69 | 4.51 | +22%˄ | (run time too short) |
+| TPC-H 18 || 2189.00 | 1923.24 | -12% || 0.46 | 0.52 | +14% | 0.0002 |
+| TPC-H 19 || 249.52 | 208.20 | -17%˄ || 4.01 | 4.80 | +20%˄ | (run time too short) |
+| TPC-H 20 || 606.02 | 533.76 | -12%˄ || 1.65 | 1.87 | +14%˄ | (run time too short) |
+| TPC-H 21 || 4666.35 | 3970.45 | -15% || 0.21 | 0.25 | +18% | 0.0000 |
+| TPC-H 22 || 532.34 | 463.45 | -13%˄ || 1.88 | 2.16 | +15%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 40807.55 | 33704.65 | -17% || | | | |
+| Geomean || | | || | | +21% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
| || ˅ Insufficient number of runs for p-value calculation |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -36% || Geometric mean of throughput changes: +46%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st_s01.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_72005cad13851f371f2ae8db5998839820daba92_st_s01.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 13:01:57 | 2024-05-27 02:58:37 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.31 | 5.20 | -2%˄ || 188.42 | 192.29 | +2%˄ | (run time too short) |
+| TPC-H 02 || 5.63 | 4.03 | -28%˄ || 177.67 | 248.11 | +40%˄ | (run time too short) |
+| TPC-H 03 || 0.69 | 0.57 | -18%˄ || 1439.19 | 1748.79 | +22%˄ | (run time too short) |
+| TPC-H 04 || 0.59 | 0.44 | -25%˄ || 1703.41 | 2279.13 | +34%˄ | (run time too short) |
+| TPC-H 05 || 1.39 | 1.00 | -29%˄ || 716.97 | 1003.61 | +40%˄ | (run time too short) |
+| TPC-H 06 || 0.22 | 0.18 | -20%˄ || 4441.16 | 5529.39 | +25%˄ | (run time too short) |
+| TPC-H 07 || 17.97 | 9.94 | -45%˄ || 55.65 | 100.62 | +81%˄ | (run time too short) |
+| TPC-H 08 || 24.08 | 15.85 | -34%˄ || 41.53 | 63.10 | +52%˄ | (run time too short) |
+| TPC-H 09 || 8.50 | 3.93 | -54%˄ || 117.66 | 254.32 | +116%˄ | (run time too short) |
+| TPC-H 10 || 0.89 | 0.65 | -27%˄ || 1116.85 | 1537.02 | +38%˄ | (run time too short) |
+| TPC-H 11 || 0.32 | 0.21 | -34%˄ || 3148.99 | 4760.64 | +51%˄ | (run time too short) |
+| TPC-H 12 || 0.76 | 0.62 | -18%˄ || 1308.77 | 1600.24 | +22%˄ | (run time too short) |
+| TPC-H 13 || 2.63 | 2.07 | -21%˄ || 379.86 | 481.59 | +27%˄ | (run time too short) |
+| TPC-H 14 || 0.55 | 0.34 | -37%˄ || 1824.34 | 2910.40 | +60%˄ | (run time too short) |
+| TPC-H 15 || 1.85 | 1.23 | -33%˄ || 537.29 | 806.94 | +50%˄ | (run time too short) |
+| TPC-H 16 || 3.13 | 2.01 | -36%˄ || 318.77 | 496.74 | +56%˄ | (run time too short) |
+| TPC-H 17 || 1.19 | 0.68 | -43%˄ || 836.99 | 1462.48 | +75%˄ | (run time too short) |
+| TPC-H 18 || 1.54 | 1.15 | -25%˄ || 647.89 | 868.02 | +34%˄ | (run time too short) |
+| TPC-H 19 || 8.62 | 4.62 | -46%˄ || 115.99 | 216.27 | +86%˄ | (run time too short) |
+| TPC-H 20 || 4.11 | 2.69 | -35%˄ || 243.25 | 371.63 | +53%˄ | (run time too short) |
+| TPC-H 21 || 1.59 | 1.07 | -33%˄ || 626.74 | 929.76 | +48%˄ | (run time too short) |
+| TPC-H 22 || 1.66 | 1.15 | -31%˄ || 600.50 | 871.26 | +45%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 93.23 | 59.63 | -36% || | | | |
+| Geomean || | | || | | +46% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 28 cores, SF 10.0 Sum of avg. item runtimes: -11% || Geometric mean of throughput changes: +7%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_72005cad13851f371f2ae8db5998839820daba92_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 13:02:24 | 2024-05-27 02:59:02 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 5854.05 | 4672.96 | -20% || 0.17 | 0.21 | +25% | 0.0000 |
+| TPC-H 02 || 63.01 | 59.68 | -5%˄ || 15.86 | 16.71 | +5%˄ | (run time too short) |
+| TPC-H 03 || 659.43 | 582.43 | -12%˄ || 1.52 | 1.72 | +13%˄ | (run time too short) |
+| TPC-H 04 || 567.18 | 512.58 | -10%˄ || 1.76 | 1.95 | +11%˄ | (run time too short) |
+| TPC-H 05 || 582.47 | 517.37 | -11%˄ || 1.72 | 1.93 | +13%˄ | (run time too short) |
+| TPC-H 06 || 68.02 | 61.28 | -10%˄ || 14.69 | 16.27 | +11%˄ | (run time too short) |
+| TPC-H 07 || 289.72 | 257.36 | -11%˄ || 3.45 | 3.88 | +13%˄ | (run time too short) |
+| TPC-H 08 || 280.30 | 246.10 | -12%˄ || 3.57 | 4.06 | +14%˄ | (run time too short) |
+| TPC-H 09 || 1926.02 | 1637.80 | -15% || 0.52 | 0.61 | +18% | 0.0000 |
+| TPC-H 10 || 599.26 | 538.55 | -10%˄ || 1.67 | 1.86 | +11%˄ | (run time too short) |
| TPC-H 11 || 62.71 | 63.38 | +1%˄ || 15.91 | 15.74 | -1%˄ | (run time too short) |
| TPC-H 12 || 455.52 | 453.91 | -0%˄ || 2.19 | 2.20 | +0%˄ | (run time too short) |
| TPC-H 13 || 2207.62 | 2215.95 | +0% || 0.45 | 0.45 | -0% | 0.3520 |
| TPC-H 14 || 143.49 | 143.80 | +0%˄ || 6.96 | 6.95 | -0%˄ | (run time too short) |
| TPC-H 15 || 140.85 | 138.64 | -2%˄ || 7.09 | 7.21 | +2%˄ | (run time too short) |
| TPC-H 16 || 624.91 | 622.76 | -0%˄ || 1.60 | 1.61 | +0%˄ | (run time too short) |
| TPC-H 17 || 75.86 | 74.41 | -2%˄ || 13.15 | 13.41 | +2%˄ | (run time too short) |
| TPC-H 18 || 2210.68 | 2126.05 | -4% || 0.45 | 0.47 | +4% | 0.1220 |
+| TPC-H 19 || 123.86 | 110.74 | -11%˄ || 8.06 | 9.02 | +12%˄ | (run time too short) |
| TPC-H 20 || 213.87 | 204.71 | -4%˄ || 4.67 | 4.88 | +4%˄ | (run time too short) |
| TPC-H 21 || 880.12 | 867.44 | -1%˄ || 1.14 | 1.15 | +1%˄ | (run time too short) |
| TPC-H 22 || 146.25 | 148.04 | +1%˄ || 6.83 | 6.75 | -1%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18175.18 | 16255.94 | -11% || | | | |
+| Geomean || | | || | | +7% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 28 clients, 28 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_72005cad13851f371f2ae8db5998839820daba92_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 13:14:29 | 2024-05-27 03:10:24 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6442.16 | 6311.85 | -2% || 0.56 | 0.56 | +1% | 0.1469 |
| TPC-H 02 || 428.69 | 415.63 | -3% || 0.56 | 0.56 | +0% | 0.8688 |
| TPC-H 03 || 2219.02 | 2172.03 | -2% || 0.56 | 0.56 | +0% | 0.7306 |
| TPC-H 04 || 1983.94 | 1998.19 | +1% || 0.56 | 0.56 | +0% | 0.9206 |
| TPC-H 05 || 3138.91 | 3240.01 | +3% || 0.56 | 0.56 | +1% | 0.6063 |
| TPC-H 06 || 634.19 | 638.48 | +1% || 0.56 | 0.56 | +0% | 0.9580 |
+| TPC-H 07 || 2687.72 | 2444.46 | -9% || 0.56 | 0.56 | +0% | 0.1939 |
| TPC-H 08 || 1881.42 | 1951.50 | +4% || 0.56 | 0.56 | +1% | 0.6412 |
| TPC-H 09 || 4956.20 | 5038.38 | +2% || 0.56 | 0.56 | +0% | 0.6734 |
| TPC-H 10 || 2774.58 | 2744.57 | -1% || 0.56 | 0.56 | +1% | 0.8676 |
+| TPC-H 11 || 395.00 | 347.79 | -12% || 0.56 | 0.56 | +0% | 0.4622 |
-| TPC-H 12 || 1993.56 | 2100.10 | +5% || 0.56 | 0.56 | +0% | 0.4456 |
| TPC-H 13 || 4818.37 | 4852.43 | +1% || 0.56 | 0.56 | +0% | 0.7835 |
+| TPC-H 14 || 1041.57 | 819.57 | -21% || 0.56 | 0.56 | +0% | 0.0376 |
-| TPC-H 15 || 530.74 | 579.00 | +9% || 0.56 | 0.56 | +0% | 0.5110 |
-| TPC-H 16 || 1733.38 | 1812.90 | +5% || 0.56 | 0.56 | +0% | 0.5240 |
| TPC-H 17 || 800.40 | 774.02 | -3% || 0.56 | 0.56 | +0% | 0.8152 |
-| TPC-H 18 || 3509.53 | 3733.33 | +6% || 0.56 | 0.56 | +0% | 0.0845 |
| TPC-H 19 || 956.31 | 988.10 | +3% || 0.56 | 0.56 | +0% | 0.7899 |
| TPC-H 20 || 1522.73 | 1556.42 | +2% || 0.56 | 0.56 | +0% | 0.8050 |
+| TPC-H 21 || 4578.39 | 4078.21 | -11% || 0.56 | 0.56 | +0% | 0.0256 |
-| TPC-H 22 || 810.88 | 1053.69 | +30% || 0.56 | 0.56 | +0% | 0.0197 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 49837.69 | 49650.65 | -0% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_72005cad13851f371f2ae8db5998839820daba92_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 13:36:09 | 2024-05-27 03:32:02 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 244.74 | 244.67 | -0%˄ || 4.09 | 4.09 | +0%˄ | (run time too short) |
| 03 || 81.29 | 80.72 | -1%˄ || 12.30 | 12.39 | +1%˄ | (run time too short) |
| 06 || 198.89 | 197.32 | -1%˄ || 5.03 | 5.07 | +1%˄ | (run time too short) |
| 07 || 318.48 | 312.83 | -2%˄ || 3.14 | 3.20 | +2%˄ | (run time too short) |
| 09 || 673.89 | 666.26 | -1%˄ || 1.48 | 1.50 | +1%˄ | (run time too short) |
| 10 || 164.05 | 162.46 | -1%˄ || 6.10 | 6.16 | +1%˄ | (run time too short) |
| 13 || 519.10 | 517.43 | -0%˄ || 1.93 | 1.93 | +0%˄ | (run time too short) |
| 15 || 113.72 | 115.28 | +1%˄ || 8.79 | 8.67 | -1%˄ | (run time too short) |
| 16 || 82.70 | 82.02 | -1%˄ || 12.09 | 12.19 | +1%˄ | (run time too short) |
| 17 || 337.21 | 334.75 | -1%˄ || 2.97 | 2.99 | +1%˄ | (run time too short) |
| 19 || 118.87 | 117.69 | -1%˄ || 8.41 | 8.50 | +1%˄ | (run time too short) |
| 25 || 193.27 | 190.82 | -1%˄ || 5.17 | 5.24 | +1%˄ | (run time too short) |
| 26 || 139.16 | 137.84 | -1%˄ || 7.19 | 7.25 | +1%˄ | (run time too short) |
| 28 || 606.47 | 596.87 | -2%˄ || 1.65 | 1.68 | +2%˄ | (run time too short) |
| 29 || 495.33 | 497.50 | +0%˄ || 2.02 | 2.01 | -0%˄ | (run time too short) |
| 31 || 1355.40 | 1354.72 | -0% || 0.74 | 0.74 | +0% | 0.8081 |
| 32 || 40.91 | 42.54 | +4%˄ || 24.44 | 23.51 | -4%˄ | (run time too short) |
| 34 || 171.23 | 172.70 | +1%˄ || 5.84 | 5.79 | -1%˄ | (run time too short) |
| 35 || 628.19 | 628.08 | -0%˄ || 1.59 | 1.59 | +0%˄ | (run time too short) |
-| 37 || 490.05 | 524.34 | +7%˄ || 2.04 | 1.91 | -7%˄ | (run time too short) |
| 39a || 1703.01 | 1742.48 | +2% || 0.59 | 0.57 | -2% | 0.0117 |
| 39b || 1666.42 | 1714.36 | +3% || 0.60 | 0.58 | -3% | 0.0001 |
| 41 || 293.71 | 294.60 | +0%˄ || 3.40 | 3.39 | -0%˄ | (run time too short) |
| 42 || 100.62 | 103.42 | +3%˄ || 9.94 | 9.67 | -3%˄ | (run time too short) |
| 43 || 984.98 | 975.88 | -1%˄ || 1.02 | 1.02 | +1%˄ | (run time too short) |
| 45 || 119.14 | 119.36 | +0%˄ || 8.39 | 8.38 | -0%˄ | (run time too short) |
| 48 || 1055.30 | 1032.40 | -2%˄ || 0.95 | 0.97 | +2%˄ | (run time too short) |
| 50 || 135.90 | 135.29 | -0%˄ || 7.36 | 7.39 | +0%˄ | (run time too short) |
| 52 || 98.74 | 100.18 | +1%˄ || 10.13 | 9.98 | -1%˄ | (run time too short) |
| 55 || 96.13 | 97.57 | +1%˄ || 10.40 | 10.25 | -1%˄ | (run time too short) |
| 62 || 533.94 | 531.36 | -0%˄ || 1.87 | 1.88 | +0%˄ | (run time too short) |
| 65 || 1779.05 | 1743.64 | -2% || 0.56 | 0.57 | +2% | 0.0078 |
| 69 || 172.94 | 175.28 | +1%˄ || 5.78 | 5.71 | -1%˄ | (run time too short) |
| 73 || 95.66 | 98.17 | +3%˄ || 10.45 | 10.19 | -3%˄ | (run time too short) |
| 79 || 489.98 | 491.40 | +0%˄ || 2.04 | 2.03 | -0%˄ | (run time too short) |
| 81 || 153.99 | 152.17 | -1%˄ || 6.49 | 6.57 | +1%˄ | (run time too short) |
-| 82 || 553.71 | 604.12 | +9%˄ || 1.81 | 1.66 | -8%˄ | (run time too short) |
| 83 || 38.40 | 39.99 | +4%˄ || 26.04 | 25.00 | -4%˄ | (run time too short) |
| 84 || 13.29 | 13.29 | +0%˄ || 75.25 | 75.22 | -0%˄ | (run time too short) |
| 85 || 157.96 | 160.03 | +1%˄ || 6.33 | 6.25 | -1%˄ | (run time too short) |
| 88 || 775.17 | 792.62 | +2%˄ || 1.29 | 1.26 | -2%˄ | (run time too short) |
| 91 || 14.65 | 14.57 | -1%˄ || 68.26 | 68.62 | +1%˄ | (run time too short) |
| 92 || 30.35 | 30.08 | -1%˄ || 32.95 | 33.24 | +1%˄ | (run time too short) |
| 93 || 3861.01 | 3859.15 | -0% || 0.26 | 0.26 | +0% | 0.8964 |
| 94 || 47.14 | 47.12 | -0%˄ || 21.21 | 21.22 | +0%˄ | (run time too short) |
| 95 || 4706.05 | 4578.26 | -3% || 0.21 | 0.22 | +3% | 0.3490 |
| 96 || 78.41 | 77.61 | -1%˄ || 12.75 | 12.88 | +1%˄ | (run time too short) |
| 97 || 4330.39 | 4161.12 | -4% || 0.23 | 0.24 | +4% | 0.0022 |
| 99 || 1024.11 | 1025.98 | +0%˄ || 0.98 | 0.97 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 32083.09 | 31888.32 | -1% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_72005cad13851f371f2ae8db5998839820daba92_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 13:55:19 | 2024-05-27 03:51:19 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 231.59 | 233.91 | +1%˄ || 4.32 | 4.27 | -1%˄ | (run time too short) |
+| 03 || 40.56 | 38.30 | -6%˄ || 24.54 | 26.02 | +6%˄ | (run time too short) |
| 06 || 195.19 | 195.36 | +0%˄ || 5.12 | 5.12 | -0%˄ | (run time too short) |
| 07 || 177.66 | 178.05 | +0%˄ || 5.62 | 5.61 | -0%˄ | (run time too short) |
| 09 || 100.37 | 100.76 | +0%˄ || 9.95 | 9.91 | -0%˄ | (run time too short) |
| 10 || 48.56 | 49.17 | +1%˄ || 20.54 | 20.29 | -1%˄ | (run time too short) |
| 13 || 258.61 | 258.25 | -0%˄ || 3.86 | 3.87 | +0%˄ | (run time too short) |
| 15 || 69.52 | 69.70 | +0%˄ || 14.35 | 14.32 | -0%˄ | (run time too short) |
| 16 || 45.03 | 44.48 | -1%˄ || 22.16 | 22.43 | +1%˄ | (run time too short) |
| 17 || 147.72 | 147.78 | +0%˄ || 6.76 | 6.76 | -0%˄ | (run time too short) |
| 19 || 71.20 | 70.75 | -1%˄ || 14.02 | 14.11 | +1%˄ | (run time too short) |
| 25 || 112.13 | 112.33 | +0%˄ || 8.91 | 8.89 | -0%˄ | (run time too short) |
| 26 || 92.74 | 93.93 | +1%˄ || 10.77 | 10.63 | -1%˄ | (run time too short) |
| 28 || 95.39 | 94.49 | -1%˄ || 10.47 | 10.57 | +1%˄ | (run time too short) |
| 29 || 402.19 | 397.99 | -1%˄ || 2.49 | 2.51 | +1%˄ | (run time too short) |
| 31 || 462.97 | 451.62 | -2%˄ || 2.16 | 2.21 | +3%˄ | (run time too short) |
| 32 || 38.30 | 37.88 | -1%˄ || 26.02 | 26.31 | +1%˄ | (run time too short) |
| 34 || 94.65 | 94.66 | +0%˄ || 10.55 | 10.55 | -0%˄ | (run time too short) |
| 35 || 366.02 | 370.51 | +1%˄ || 2.73 | 2.70 | -1%˄ | (run time too short) |
| 37 || 162.85 | 159.70 | -2%˄ || 6.14 | 6.26 | +2%˄ | (run time too short) |
| 39a || 782.34 | 760.29 | -3%˄ || 1.28 | 1.31 | +3%˄ | (run time too short) |
| 39b || 750.79 | 736.24 | -2%˄ || 1.33 | 1.36 | +2%˄ | (run time too short) |
| 41 || 355.78 | 358.16 | +1%˄ || 2.81 | 2.79 | -1%˄ | (run time too short) |
| 42 || 54.92 | 56.98 | +4%˄ || 18.16 | 17.50 | -4%˄ | (run time too short) |
| 43 || 432.29 | 428.05 | -1%˄ || 2.31 | 2.34 | +1%˄ | (run time too short) |
| 45 || 56.49 | 57.41 | +2%˄ || 17.65 | 17.37 | -2%˄ | (run time too short) |
| 48 || 444.06 | 438.40 | -1%˄ || 2.25 | 2.28 | +1%˄ | (run time too short) |
| 50 || 106.19 | 105.90 | -0%˄ || 9.40 | 9.43 | +0%˄ | (run time too short) |
| 52 || 58.75 | 59.07 | +1%˄ || 16.97 | 16.89 | -0%˄ | (run time too short) |
| 55 || 51.58 | 53.39 | +3%˄ || 19.34 | 18.67 | -3%˄ | (run time too short) |
| 62 || 309.54 | 307.89 | -1%˄ || 3.23 | 3.25 | +1%˄ | (run time too short) |
| 65 || 1477.77 | 1490.66 | +1% || 0.68 | 0.67 | -1% | 0.1358 |
| 69 || 77.17 | 77.10 | -0%˄ || 12.93 | 12.95 | +0%˄ | (run time too short) |
| 73 || 61.55 | 60.53 | -2%˄ || 16.21 | 16.48 | +2%˄ | (run time too short) |
| 79 || 430.63 | 431.67 | +0%˄ || 2.32 | 2.32 | -0%˄ | (run time too short) |
| 81 || 194.15 | 189.01 | -3%˄ || 5.15 | 5.29 | +3%˄ | (run time too short) |
| 82 || 196.37 | 195.31 | -1%˄ || 5.09 | 5.12 | +1%˄ | (run time too short) |
| 83 || 46.02 | 46.18 | +0%˄ || 21.66 | 21.59 | -0%˄ | (run time too short) |
| 84 || 17.04 | 16.82 | -1%˄ || 58.18 | 58.98 | +1%˄ | (run time too short) |
| 85 || 65.94 | 63.50 | -4%˄ || 15.13 | 15.71 | +4%˄ | (run time too short) |
| 88 || 82.68 | 83.37 | +1%˄ || 12.08 | 11.98 | -1%˄ | (run time too short) |
| 91 || 20.58 | 20.89 | +2%˄ || 48.26 | 47.58 | -1%˄ | (run time too short) |
| 92 || 36.59 | 36.49 | -0%˄ || 27.22 | 27.30 | +0%˄ | (run time too short) |
| 93 || 634.38 | 626.33 | -1%˄ || 1.58 | 1.60 | +1%˄ | (run time too short) |
| 94 || 42.40 | 43.14 | +2%˄ || 23.52 | 23.10 | -2%˄ | (run time too short) |
| 95 || 651.54 | 651.88 | +0%˄ || 1.53 | 1.53 | -0%˄ | (run time too short) |
| 96 || 55.92 | 54.90 | -2%˄ || 17.85 | 18.18 | +2%˄ | (run time too short) |
| 97 || 1507.70 | 1502.07 | -0% || 0.66 | 0.67 | +0% | 0.7237 |
| 99 || 594.40 | 598.02 | +1%˄ || 1.68 | 1.67 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 12808.81 | 12749.27 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_72005cad13851f371f2ae8db5998839820daba92_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 14:07:13 | 2024-05-27 04:03:11 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 01 || 625.02 | 640.77 | +3% || 0.55 | 0.54 | -0% | 0.7606 |
-| 03 || 273.13 | 330.47 | +21% || 0.54 | 0.54 | +0% | 0.2198 |
-| 06 || 779.67 | 885.04 | +14% || 0.55 | 0.54 | -0% | 0.2026 |
+| 07 || 878.94 | 808.63 | -8% || 0.55 | 0.54 | -0% | 0.2886 |
| 09 || 641.91 | 617.90 | -4% || 0.54 | 0.54 | +0% | 0.6648 |
| 10 || 691.40 | 703.45 | +2% || 0.54 | 0.54 | +0% | 0.8641 |
| 13 || 1414.43 | 1424.31 | +1% || 0.54 | 0.54 | +0% | 0.9076 |
| 15 || 449.07 | 434.98 | -3% || 0.54 | 0.54 | +0% | 0.7863 |
-| 16 || 406.04 | 430.99 | +6% || 0.55 | 0.54 | -0% | 0.6252 |
+| 17 || 1183.56 | 1068.07 | -10% || 0.55 | 0.54 | -0% | 0.1718 |
-| 19 || 544.56 | 581.94 | +7% || 0.54 | 0.54 | +0% | 0.4903 |
-| 25 || 816.34 | 872.95 | +7% || 0.54 | 0.54 | +0% | 0.5014 |
+| 26 || 495.11 | 469.38 | -5% || 0.55 | 0.54 | -0% | 0.6184 |
-| 28 || 1141.81 | 1223.15 | +7% || 0.54 | 0.54 | -0% | 0.3680 |
| 29 || 1309.49 | 1334.61 | +2% || 0.54 | 0.54 | -0% | 0.7448 |
| 31 || 2071.84 | 2091.14 | +1% || 0.54 | 0.54 | -0% | 0.8580 |
-| 32 || 174.87 | 208.44 | +19% || 0.55 | 0.54 | -0% | 0.3779 |
| 34 || 710.19 | 682.54 | -4% || 0.54 | 0.54 | +0% | 0.6986 |
| 35 || 1682.23 | 1670.74 | -1% || 0.55 | 0.54 | -0% | 0.9041 |
| 37 || 687.85 | 718.80 | +4% || 0.54 | 0.54 | -0% | 0.5738 |
| 39a || 2371.17 | 2290.40 | -3% || 0.54 | 0.54 | +0% | 0.4262 |
| 39b || 2317.43 | 2263.84 | -2% || 0.54 | 0.54 | +0% | 0.5707 |
| 41 || 1966.91 | 1883.73 | -4% || 0.54 | 0.54 | -0% | 0.4427 |
-| 42 || 422.00 | 480.33 | +14% || 0.55 | 0.54 | -0% | 0.2556 |
| 43 || 1481.71 | 1489.99 | +1% || 0.55 | 0.54 | -0% | 0.9199 |
+| 45 || 651.46 | 620.82 | -5% || 0.55 | 0.54 | -0% | 0.6168 |
| 48 || 2114.49 | 2054.52 | -3% || 0.54 | 0.54 | -0% | 0.5858 |
+| 50 || 972.19 | 878.15 | -10% || 0.54 | 0.54 | +0% | 0.2078 |
| 52 || 410.91 | 413.92 | +1% || 0.55 | 0.54 | -0% | 0.9470 |
-| 55 || 316.29 | 407.99 | +29% || 0.54 | 0.54 | +0% | 0.0226 |
| 62 || 884.71 | 849.60 | -4% || 0.54 | 0.54 | +0% | 0.5185 |
| 65 || 3372.20 | 3463.96 | +3% || 0.54 | 0.54 | -0% | 0.2958 |
-| 69 || 831.49 | 903.57 | +9% || 0.54 | 0.54 | -0% | 0.3480 |
+| 73 || 514.85 | 465.03 | -10% || 0.55 | 0.54 | -0% | 0.3123 |
| 79 || 1391.39 | 1366.07 | -2% || 0.54 | 0.54 | +0% | 0.7578 |
+| 81 || 581.97 | 526.44 | -10% || 0.55 | 0.54 | -0% | 0.3022 |
| 82 || 891.23 | 920.16 | +3% || 0.55 | 0.54 | -0% | 0.6915 |
| 83 || 250.05 | 242.12 | -3% || 0.55 | 0.54 | -0% | 0.8223 |
+| 84 || 158.31 | 139.92 | -12% || 0.54 | 0.54 | +0% | 0.5865 |
| 85 || 719.60 | 710.64 | -1% || 0.55 | 0.54 | -0% | 0.8991 |
| 88 || 1908.48 | 1991.63 | +4% || 0.54 | 0.54 | +0% | 0.4912 |
-| 91 || 122.56 | 256.45 | +109% || 0.55 | 0.54 | -0% | 0.0006 |
| 92 || 271.94 | 279.20 | +3% || 0.55 | 0.54 | -0% | 0.8677 |
| 93 || 1772.78 | 1756.66 | -1% || 0.54 | 0.54 | +0% | 0.8494 |
+| 94 || 433.53 | 376.32 | -13% || 0.55 | 0.54 | -0% | 0.3030 |
| 95 || 1964.18 | 1883.02 | -4% || 0.54 | 0.54 | -0% | 0.3550 |
-| 96 || 355.96 | 412.11 | +16% || 0.55 | 0.54 | -0% | 0.2276 |
| 97 || 3705.22 | 3596.81 | -3% || 0.54 | 0.54 | -0% | 0.2932 |
-| 99 || 1151.86 | 1223.55 | +6% || 0.54 | 0.54 | -0% | 0.2056 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 51284.36 | 51345.26 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -59% || Geometric mean of throughput changes: +199%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_72005cad13851f371f2ae8db5998839820daba92_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 14:27:36 | 2024-05-27 04:23:33 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 57.55 | 27.69 | -52% || 1.55 | 4.32 | +179% | (run time too short) |
+| New-Order || 42.54 | 13.22 | -69% || 18.24 | 55.59 | +205% | 0.0000 |
+| Order-Status || 1.92 | 1.24 | -36% || 1.47 | 4.73 | +223% | (run time too short) |
+| Payment || 7.27 | 2.37 | -67% || 17.13 | 53.44 | +212% | 0.0000 |
+| Stock-Level || 3.45 | 2.00 | -42% || 1.90 | 5.35 | +182% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 112.73 | 46.52 | -59% || | | | |
+| Geomean || | | || | | +199% | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 28 clients, 10 warehouses, 28 cores (high contention) Sum of avg. item runtimes: -32% || Geometric mean of throughput changes: +61%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_highcont.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_72005cad13851f371f2ae8db5998839820daba92_mt_highcont.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 14:28:42 | 2024-05-27 04:24:39 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 129.36 | 95.87 | -26% || 22.40 | 34.37 | +53% | 0.0000 |
| unsucc.: || 1.73 | 2.24 | +29% || 8.59 | 16.17 | +88% | |
+| New-Order || 78.55 | 45.05 | -43% || 264.12 | 435.04 | +65% | 0.0000 |
| unsucc.: || 6.42 | 6.28 | -2% || 86.22 | 133.34 | +55% | |
+| Order-Status || 6.42 | 5.47 | -15% || 30.91 | 50.22 | +62% | 0.0000 |
+| Payment || 14.86 | 8.87 | -40% || 187.65 | 304.31 | +62% | 0.0000 |
| unsucc.: || 3.02 | 3.26 | +8% || 147.92 | 237.77 | +61% | |
+| Stock-Level || 10.64 | 8.84 | -17% || 30.92 | 50.67 | +64% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 239.83 | 164.10 | -32% || | | | |
+| Geomean || | | || | | +61% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 28 cores (low contention) Sum of avg. item runtimes: -44% || Geometric mean of throughput changes: +102%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_lowcont.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_72005cad13851f371f2ae8db5998839820daba92_mt_lowcont.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 14:38:51 | 2024-05-27 04:34:50 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 91.14 | 56.32 | -38% || 9.82 | 19.34 | +97% | 0.0000 |
| unsucc.: || 0.79 | 0.87 | +10% || 0.85 | 2.06 | +142% | |
+| New-Order || 64.57 | 30.93 | -52% || 109.32 | 220.55 | +102% | 0.0000 |
| unsucc.: || 4.20 | 2.88 | -31% || 10.80 | 19.88 | +84% | |
+| Order-Status || 6.82 | 5.00 | -27% || 10.50 | 21.51 | +105% | 0.0000 |
+| Payment || 19.84 | 9.17 | -54% || 88.65 | 181.98 | +105% | 0.0000 |
| unsucc.: || 2.27 | 2.17 | -5% || 25.50 | 48.47 | +90% | |
+| Stock-Level || 9.56 | 6.23 | -35% || 10.70 | 21.62 | +102% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 191.93 | 107.65 | -44% || | | | |
+| Geomean || | | || | | +102% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_72005cad13851f371f2ae8db5998839820daba92_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 14:48:59 | 2024-05-27 04:44:58 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 110.60 | 112.02 | +1%˄ || 9.04 | 8.93 | -1%˄ | (run time too short) |
| 10b || 71.01 | 68.27 | -4%˄ || 14.08 | 14.65 | +4%˄ | (run time too short) |
| 10c || 336.68 | 331.86 | -1%˄ || 2.97 | 3.01 | +1%˄ | (run time too short) |
| 11a || 96.63 | 96.51 | -0%˄ || 10.35 | 10.36 | +0%˄ | (run time too short) |
| 11b || 93.34 | 91.78 | -2%˄ || 10.71 | 10.90 | +2%˄ | (run time too short) |
| 11c || 25.18 | 25.05 | -1%˄ || 39.70 | 39.92 | +1%˄ | (run time too short) |
| 11d || 27.22 | 27.09 | -0%˄ || 36.74 | 36.91 | +0%˄ | (run time too short) |
| 12a || 29.24 | 30.53 | +4%˄ || 34.20 | 32.75 | -4%˄ | (run time too short) |
| 12b || 39.88 | 41.32 | +4%˄ || 25.08 | 24.20 | -3%˄ | (run time too short) |
| 12c || 62.78 | 63.48 | +1%˄ || 15.93 | 15.75 | -1%˄ | (run time too short) |
| 13a || 192.18 | 188.38 | -2%˄ || 5.20 | 5.31 | +2%˄ | (run time too short) |
+| 13b || 241.98 | 227.62 | -6%˄ || 4.13 | 4.39 | +6%˄ | (run time too short) |
+| 13c || 202.85 | 191.66 | -6%˄ || 4.93 | 5.22 | +6%˄ | (run time too short) |
| 13d || 499.16 | 509.48 | +2%˄ || 2.00 | 1.96 | -2%˄ | (run time too short) |
| 14a || 99.19 | 97.86 | -1%˄ || 10.08 | 10.22 | +1%˄ | (run time too short) |
| 14b || 112.58 | 110.03 | -2%˄ || 8.88 | 9.09 | +2%˄ | (run time too short) |
| 14c || 208.60 | 204.37 | -2%˄ || 4.79 | 4.89 | +2%˄ | (run time too short) |
| 15a || 55.22 | 54.72 | -1%˄ || 18.11 | 18.27 | +1%˄ | (run time too short) |
| 15b || 55.71 | 55.36 | -1%˄ || 17.95 | 18.06 | +1%˄ | (run time too short) |
| 15c || 46.52 | 46.37 | -0%˄ || 21.50 | 21.56 | +0%˄ | (run time too short) |
| 15d || 44.03 | 43.99 | -0%˄ || 22.71 | 22.73 | +0%˄ | (run time too short) |
| 16a || 1332.13 | 1326.23 | -0% || 0.75 | 0.75 | +0% | 0.4137 |
| 16b || 2450.99 | 2409.47 | -2% || 0.41 | 0.42 | +2% | 0.0008 |
| 16c || 1491.79 | 1487.13 | -0% || 0.67 | 0.67 | +0% | 0.4065 |
| 16d || 1439.78 | 1445.19 | +0% || 0.69 | 0.69 | -0% | 0.2615 |
| 17a || 459.88 | 463.67 | +1%˄ || 2.17 | 2.16 | -1%˄ | (run time too short) |
| 17b || 377.71 | 380.41 | +1%˄ || 2.65 | 2.63 | -1%˄ | (run time too short) |
| 17c || 361.26 | 363.94 | +1%˄ || 2.77 | 2.75 | -1%˄ | (run time too short) |
| 17d || 430.63 | 435.89 | +1%˄ || 2.32 | 2.29 | -1%˄ | (run time too short) |
| 17e || 1533.40 | 1521.35 | -1% || 0.65 | 0.66 | +1% | 0.0505 |
| 17f || 889.36 | 888.05 | -0%˄ || 1.12 | 1.13 | +0%˄ | (run time too short) |
| 18a || 144.33 | 144.12 | -0%˄ || 6.93 | 6.94 | +0%˄ | (run time too short) |
| 18b || 105.37 | 104.06 | -1%˄ || 9.49 | 9.61 | +1%˄ | (run time too short) |
-| 18c || 202.44 | 221.26 | +9%˄ || 4.94 | 4.52 | -9%˄ | (run time too short) |
| 19a || 229.56 | 228.23 | -1%˄ || 4.36 | 4.38 | +1%˄ | (run time too short) |
| 19b || 191.21 | 188.06 | -2%˄ || 5.23 | 5.32 | +2%˄ | (run time too short) |
| 19c || 273.55 | 271.10 | -1%˄ || 3.66 | 3.69 | +1%˄ | (run time too short) |
| 19d || 654.40 | 667.55 | +2%˄ || 1.53 | 1.50 | -2%˄ | (run time too short) |
| 1a || 12.41 | 12.47 | +0%˄ || 80.55 | 80.19 | -0%˄ | (run time too short) |
| 1b || 14.10 | 14.11 | +0%˄ || 70.92 | 70.88 | -0%˄ | (run time too short) |
| 1c || 14.27 | 14.16 | -1%˄ || 70.06 | 70.62 | +1%˄ | (run time too short) |
| 1d || 11.82 | 11.84 | +0%˄ || 84.59 | 84.23 | -0%˄ | (run time too short) |
| 20a || 634.51 | 616.45 | -3%˄ || 1.58 | 1.62 | +3%˄ | (run time too short) |
| 20b || 668.38 | 652.68 | -2%˄ || 1.50 | 1.53 | +2%˄ | (run time too short) |
| 20c || 382.75 | 381.69 | -0%˄ || 2.61 | 2.62 | +0%˄ | (run time too short) |
| 21a || 111.06 | 110.37 | -1%˄ || 9.00 | 9.06 | +1%˄ | (run time too short) |
| 21b || 103.57 | 102.71 | -1%˄ || 9.65 | 9.74 | +1%˄ | (run time too short) |
| 21c || 113.99 | 113.06 | -1%˄ || 8.77 | 8.84 | +1%˄ | (run time too short) |
| 22a || 173.14 | 170.64 | -1%˄ || 5.78 | 5.86 | +1%˄ | (run time too short) |
| 22b || 157.65 | 154.35 | -2%˄ || 6.34 | 6.48 | +2%˄ | (run time too short) |
| 22c || 230.07 | 227.10 | -1%˄ || 4.35 | 4.40 | +1%˄ | (run time too short) |
| 22d || 349.55 | 344.41 | -1%˄ || 2.86 | 2.90 | +1%˄ | (run time too short) |
| 23a || 49.28 | 48.83 | -1%˄ || 20.29 | 20.48 | +1%˄ | (run time too short) |
| 23b || 53.79 | 53.56 | -0%˄ || 18.59 | 18.67 | +0%˄ | (run time too short) |
| 23c || 51.75 | 51.53 | -0%˄ || 19.32 | 19.40 | +0%˄ | (run time too short) |
| 24a || 225.46 | 224.41 | -0%˄ || 4.44 | 4.46 | +0%˄ | (run time too short) |
| 24b || 220.01 | 218.97 | -0%˄ || 4.55 | 4.57 | +0%˄ | (run time too short) |
| 25a || 114.63 | 112.52 | -2%˄ || 8.72 | 8.89 | +2%˄ | (run time too short) |
| 25b || 72.38 | 71.66 | -1%˄ || 13.82 | 13.95 | +1%˄ | (run time too short) |
| 25c || 254.35 | 252.53 | -1%˄ || 3.93 | 3.96 | +1%˄ | (run time too short) |
| 26a || 186.15 | 183.61 | -1%˄ || 5.37 | 5.45 | +1%˄ | (run time too short) |
| 26b || 154.65 | 152.92 | -1%˄ || 6.47 | 6.54 | +1%˄ | (run time too short) |
| 26c || 313.06 | 306.57 | -2%˄ || 3.19 | 3.26 | +2%˄ | (run time too short) |
| 27a || 106.20 | 105.30 | -1%˄ || 9.42 | 9.50 | +1%˄ | (run time too short) |
| 27b || 97.96 | 97.26 | -1%˄ || 10.21 | 10.28 | +1%˄ | (run time too short) |
| 27c || 114.40 | 112.45 | -2%˄ || 8.74 | 8.89 | +2%˄ | (run time too short) |
| 28a || 208.43 | 202.39 | -3%˄ || 4.80 | 4.94 | +3%˄ | (run time too short) |
| 28b || 65.96 | 64.76 | -2%˄ || 15.16 | 15.44 | +2%˄ | (run time too short) |
| 28c || 169.82 | 167.94 | -1%˄ || 5.89 | 5.95 | +1%˄ | (run time too short) |
| 29a || 189.63 | 188.84 | -0%˄ || 5.27 | 5.30 | +0%˄ | (run time too short) |
| 29b || 779.62 | 764.69 | -2%˄ || 1.28 | 1.31 | +2%˄ | (run time too short) |
| 29c || 227.38 | 226.64 | -0%˄ || 4.40 | 4.41 | +0%˄ | (run time too short) |
| 2a || 31.12 | 30.83 | -1%˄ || 32.13 | 32.44 | +1%˄ | (run time too short) |
| 2b || 29.04 | 29.00 | -0%˄ || 34.43 | 34.49 | +0%˄ | (run time too short) |
| 2c || 25.97 | 25.68 | -1%˄ || 38.51 | 38.94 | +1%˄ | (run time too short) |
| 2d || 53.42 | 52.63 | -1%˄ || 18.72 | 19.00 | +1%˄ | (run time too short) |
| 30a || 106.16 | 105.34 | -1%˄ || 9.42 | 9.49 | +1%˄ | (run time too short) |
| 30b || 114.12 | 110.15 | -3%˄ || 8.76 | 9.08 | +4%˄ | (run time too short) |
| 30c || 172.29 | 170.90 | -1%˄ || 5.80 | 5.85 | +1%˄ | (run time too short) |
| 31a || 92.73 | 92.00 | -1%˄ || 10.78 | 10.87 | +1%˄ | (run time too short) |
| 31b || 90.78 | 89.90 | -1%˄ || 11.02 | 11.12 | +1%˄ | (run time too short) |
| 31c || 105.23 | 104.21 | -1%˄ || 9.50 | 9.60 | +1%˄ | (run time too short) |
| 32a || 17.08 | 16.95 | -1%˄ || 58.55 | 58.99 | +1%˄ | (run time too short) |
| 32b || 33.11 | 32.77 | -1%˄ || 30.20 | 30.52 | +1%˄ | (run time too short) |
| 33a || 38.56 | 37.74 | -2%˄ || 25.93 | 26.49 | +2%˄ | (run time too short) |
| 33b || 26.19 | 26.07 | -0%˄ || 38.18 | 38.36 | +0%˄ | (run time too short) |
| 33c || 44.31 | 44.26 | -0%˄ || 22.57 | 22.59 | +0%˄ | (run time too short) |
| 3a || 61.18 | 60.84 | -1%˄ || 16.34 | 16.44 | +1%˄ | (run time too short) |
| 3b || 18.45 | 18.23 | -1%˄ || 54.19 | 54.86 | +1%˄ | (run time too short) |
| 3c || 225.76 | 221.56 | -2%˄ || 4.43 | 4.51 | +2%˄ | (run time too short) |
| 4a || 136.09 | 134.36 | -1%˄ || 7.35 | 7.44 | +1%˄ | (run time too short) |
| 4b || 17.67 | 17.72 | +0%˄ || 56.59 | 56.41 | -0%˄ | (run time too short) |
| 4c || 190.11 | 188.93 | -1%˄ || 5.26 | 5.29 | +1%˄ | (run time too short) |
| 5a || 43.00 | 42.64 | -1%˄ || 23.25 | 23.45 | +1%˄ | (run time too short) |
| 5b || 47.38 | 47.10 | -1%˄ || 21.10 | 21.23 | +1%˄ | (run time too short) |
| 5c || 88.42 | 87.73 | -1%˄ || 11.31 | 11.40 | +1%˄ | (run time too short) |
| 6a || 174.78 | 172.04 | -2%˄ || 5.72 | 5.81 | +2%˄ | (run time too short) |
| 6b || 183.75 | 182.36 | -1%˄ || 5.44 | 5.48 | +1%˄ | (run time too short) |
| 6c || 165.76 | 163.95 | -1%˄ || 6.03 | 6.10 | +1%˄ | (run time too short) |
| 6d || 395.59 | 396.77 | +0%˄ || 2.53 | 2.52 | -0%˄ | (run time too short) |
| 6e || 173.11 | 171.23 | -1%˄ || 5.78 | 5.84 | +1%˄ | (run time too short) |
| 6f || 696.33 | 688.67 | -1%˄ || 1.44 | 1.45 | +1%˄ | (run time too short) |
| 7a || 111.49 | 110.51 | -1%˄ || 8.97 | 9.05 | +1%˄ | (run time too short) |
| 7b || 104.59 | 103.92 | -1%˄ || 9.56 | 9.62 | +1%˄ | (run time too short) |
| 7c || 586.35 | 594.15 | +1%˄ || 1.71 | 1.68 | -1%˄ | (run time too short) |
| 8a || 172.32 | 171.59 | -0%˄ || 5.80 | 5.83 | +0%˄ | (run time too short) |
| 8b || 167.45 | 167.19 | -0%˄ || 5.97 | 5.98 | +0%˄ | (run time too short) |
| 8c || 1847.45 | 1847.79 | +0% || 0.54 | 0.54 | -0% | 0.9411 |
| 8d || 322.44 | 321.36 | -0%˄ || 3.10 | 3.11 | +0%˄ | (run time too short) |
| 9a || 249.89 | 248.17 | -1%˄ || 4.00 | 4.03 | +1%˄ | (run time too short) |
| 9b || 154.46 | 153.18 | -1%˄ || 6.47 | 6.53 | +1%˄ | (run time too short) |
| 9c || 276.98 | 274.60 | -1%˄ || 3.61 | 3.64 | +1%˄ | (run time too short) |
| 9d || 420.82 | 422.23 | +0%˄ || 2.38 | 2.37 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 29862.33 | 29674.13 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_72005cad13851f371f2ae8db5998839820daba92_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 15:14:07 | 2024-05-27 05:09:57 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 43.47 | 43.07 | -1%˄ || 22.93 | 23.15 | +1%˄ | (run time too short) |
| 10b || 25.09 | 25.01 | -0%˄ || 39.64 | 39.78 | +0%˄ | (run time too short) |
| 10c || 142.17 | 142.08 | -0%˄ || 7.03 | 7.03 | +0%˄ | (run time too short) |
| 11a || 28.13 | 28.02 | -0%˄ || 35.43 | 35.57 | +0%˄ | (run time too short) |
| 11b || 26.47 | 26.49 | +0%˄ || 37.62 | 37.58 | -0%˄ | (run time too short) |
| 11c || 30.41 | 30.04 | -1%˄ || 32.72 | 33.12 | +1%˄ | (run time too short) |
| 11d || 34.47 | 34.54 | +0%˄ || 28.88 | 28.82 | -0%˄ | (run time too short) |
| 12a || 30.21 | 30.09 | -0%˄ || 32.93 | 33.08 | +0%˄ | (run time too short) |
| 12b || 20.25 | 19.76 | -2%˄ || 49.04 | 50.36 | +3%˄ | (run time too short) |
| 12c || 60.37 | 59.89 | -1%˄ || 16.52 | 16.65 | +1%˄ | (run time too short) |
| 13a || 146.06 | 144.25 | -1%˄ || 6.84 | 6.92 | +1%˄ | (run time too short) |
| 13b || 105.20 | 104.78 | -0%˄ || 9.50 | 9.53 | +0%˄ | (run time too short) |
| 13c || 97.99 | 94.75 | -3%˄ || 10.19 | 10.54 | +3%˄ | (run time too short) |
| 13d || 389.40 | 384.96 | -1%˄ || 2.57 | 2.60 | +1%˄ | (run time too short) |
| 14a || 62.12 | 61.87 | -0%˄ || 16.06 | 16.14 | +0%˄ | (run time too short) |
| 14b || 74.43 | 74.26 | -0%˄ || 13.42 | 13.44 | +0%˄ | (run time too short) |
| 14c || 182.69 | 182.03 | -0%˄ || 5.47 | 5.49 | +0%˄ | (run time too short) |
| 15a || 33.22 | 32.52 | -2%˄ || 29.98 | 30.63 | +2%˄ | (run time too short) |
+| 15b || 30.54 | 29.12 | -5%˄ || 32.59 | 34.22 | +5%˄ | (run time too short) |
+| 15c || 30.97 | 26.64 | -14%˄ || 32.13 | 37.44 | +17%˄ | (run time too short) |
| 15d || 36.60 | 36.54 | -0%˄ || 27.20 | 27.25 | +0%˄ | (run time too short) |
| 16a || 736.17 | 741.11 | +1%˄ || 1.36 | 1.35 | -1%˄ | (run time too short) |
| 16b || 1788.81 | 1806.97 | +1% || 0.56 | 0.55 | -1% | 0.0339 |
| 16c || 898.64 | 898.68 | +0%˄ || 1.11 | 1.11 | -0%˄ | (run time too short) |
| 16d || 874.50 | 873.34 | -0%˄ || 1.14 | 1.14 | +0%˄ | (run time too short) |
| 17a || 208.57 | 210.07 | +1%˄ || 4.79 | 4.76 | -1%˄ | (run time too short) |
| 17b || 180.46 | 182.77 | +1%˄ || 5.54 | 5.47 | -1%˄ | (run time too short) |
| 17c || 152.64 | 154.10 | +1%˄ || 6.55 | 6.48 | -1%˄ | (run time too short) |
| 17d || 149.28 | 149.00 | -0%˄ || 6.69 | 6.70 | +0%˄ | (run time too short) |
| 17e || 741.53 | 746.80 | +1%˄ || 1.35 | 1.34 | -1%˄ | (run time too short) |
| 17f || 330.32 | 331.61 | +0%˄ || 3.03 | 3.01 | -0%˄ | (run time too short) |
| 18a || 61.55 | 61.47 | -0%˄ || 16.21 | 16.23 | +0%˄ | (run time too short) |
| 18b || 58.96 | 57.58 | -2%˄ || 16.92 | 17.33 | +2%˄ | (run time too short) |
-| 18c || 93.45 | 133.65 | +43%˄ || 10.68 | 7.47 | -30%˄ | (run time too short) |
| 19a || 115.85 | 115.21 | -1%˄ || 8.62 | 8.67 | +1%˄ | (run time too short) |
| 19b || 78.88 | 77.43 | -2%˄ || 12.66 | 12.90 | +2%˄ | (run time too short) |
| 19c || 129.81 | 130.78 | +1%˄ || 7.69 | 7.64 | -1%˄ | (run time too short) |
| 19d || 511.77 | 523.67 | +2%˄ || 1.95 | 1.91 | -2%˄ | (run time too short) |
| 1a || 11.12 | 10.98 | -1%˄ || 88.71 | 89.91 | +1%˄ | (run time too short) |
| 1b || 6.58 | 6.68 | +1%˄ || 148.89 | 146.84 | -1%˄ | (run time too short) |
| 1c || 6.54 | 6.47 | -1%˄ || 149.80 | 151.31 | +1%˄ | (run time too short) |
| 1d || 9.12 | 9.20 | +1%˄ || 108.31 | 106.96 | -1%˄ | (run time too short) |
| 20a || 87.96 | 87.97 | +0%˄ || 11.36 | 11.36 | -0%˄ | (run time too short) |
| 20b || 67.30 | 69.29 | +3%˄ || 14.84 | 14.42 | -3%˄ | (run time too short) |
| 20c || 87.31 | 86.23 | -1%˄ || 11.43 | 11.58 | +1%˄ | (run time too short) |
| 21a || 32.49 | 32.36 | -0%˄ || 30.67 | 30.80 | +0%˄ | (run time too short) |
| 21b || 30.56 | 30.17 | -1%˄ || 32.58 | 33.03 | +1%˄ | (run time too short) |
| 21c || 34.37 | 33.97 | -1%˄ || 28.99 | 29.31 | +1%˄ | (run time too short) |
| 22a || 68.93 | 70.14 | +2%˄ || 14.48 | 14.23 | -2%˄ | (run time too short) |
| 22b || 60.38 | 59.74 | -1%˄ || 16.53 | 16.71 | +1%˄ | (run time too short) |
| 22c || 137.12 | 137.27 | +0%˄ || 7.28 | 7.28 | -0%˄ | (run time too short) |
| 22d || 237.63 | 246.30 | +4%˄ || 4.21 | 4.06 | -4%˄ | (run time too short) |
| 23a || 23.84 | 24.64 | +3%˄ || 41.73 | 40.39 | -3%˄ | (run time too short) |
+| 23b || 34.43 | 32.64 | -5%˄ || 28.93 | 30.55 | +6%˄ | (run time too short) |
| 23c || 26.23 | 25.51 | -3%˄ || 37.95 | 39.02 | +3%˄ | (run time too short) |
| 24a || 69.36 | 69.47 | +0%˄ || 14.39 | 14.37 | -0%˄ | (run time too short) |
| 24b || 62.71 | 62.36 | -1%˄ || 15.91 | 16.00 | +1%˄ | (run time too short) |
| 25a || 60.89 | 60.44 | -1%˄ || 16.37 | 16.50 | +1%˄ | (run time too short) |
| 25b || 37.94 | 38.84 | +2%˄ || 26.27 | 25.66 | -2%˄ | (run time too short) |
| 25c || 162.83 | 162.86 | +0%˄ || 6.14 | 6.13 | -0%˄ | (run time too short) |
| 26a || 92.10 | 92.07 | -0%˄ || 10.84 | 10.84 | +0%˄ | (run time too short) |
| 26b || 71.20 | 70.88 | -0%˄ || 14.02 | 14.08 | +0%˄ | (run time too short) |
| 26c || 150.43 | 149.80 | -0%˄ || 6.64 | 6.67 | +0%˄ | (run time too short) |
| 27a || 30.73 | 30.65 | -0%˄ || 32.42 | 32.53 | +0%˄ | (run time too short) |
| 27b || 30.57 | 30.77 | +1%˄ || 32.58 | 32.36 | -1%˄ | (run time too short) |
| 27c || 34.96 | 34.21 | -2%˄ || 28.51 | 29.14 | +2%˄ | (run time too short) |
| 28a || 149.43 | 150.29 | +1%˄ || 6.68 | 6.65 | -1%˄ | (run time too short) |
| 28b || 34.47 | 35.19 | +2%˄ || 28.91 | 28.31 | -2%˄ | (run time too short) |
| 28c || 120.87 | 119.43 | -1%˄ || 8.26 | 8.36 | +1%˄ | (run time too short) |
| 29a || 64.40 | 64.64 | +0%˄ || 15.50 | 15.45 | -0%˄ | (run time too short) |
| 29b || 109.78 | 112.81 | +3%˄ || 9.10 | 8.85 | -3%˄ | (run time too short) |
| 29c || 68.05 | 68.56 | +1%˄ || 14.66 | 14.55 | -1%˄ | (run time too short) |
| 2a || 33.24 | 33.23 | -0%˄ || 29.93 | 29.94 | +0%˄ | (run time too short) |
-| 2b || 27.32 | 30.10 | +10%˄ || 36.46 | 33.05 | -9%˄ | (run time too short) |
| 2c || 22.85 | 22.54 | -1%˄ || 43.49 | 44.09 | +1%˄ | (run time too short) |
| 2d || 58.92 | 58.14 | -1%˄ || 16.92 | 17.15 | +1%˄ | (run time too short) |
| 30a || 54.10 | 53.91 | -0%˄ || 18.43 | 18.50 | +0%˄ | (run time too short) |
| 30b || 45.47 | 45.31 | -0%˄ || 21.93 | 22.00 | +0%˄ | (run time too short) |
| 30c || 113.57 | 113.61 | +0%˄ || 8.79 | 8.79 | -0%˄ | (run time too short) |
| 31a || 41.16 | 41.05 | -0%˄ || 24.21 | 24.28 | +0%˄ | (run time too short) |
| 31b || 39.28 | 39.69 | +1%˄ || 25.37 | 25.11 | -1%˄ | (run time too short) |
| 31c || 46.56 | 46.77 | +0%˄ || 21.41 | 21.32 | -0%˄ | (run time too short) |
| 32a || 11.35 | 11.39 | +0%˄ || 87.09 | 86.61 | -1%˄ | (run time too short) |
| 32b || 40.50 | 40.53 | +0%˄ || 24.60 | 24.58 | -0%˄ | (run time too short) |
| 33a || 15.65 | 15.93 | +2%˄ || 63.35 | 62.25 | -2%˄ | (run time too short) |
| 33b || 13.76 | 13.98 | +2%˄ || 71.89 | 70.79 | -2%˄ | (run time too short) |
-| 33c || 22.97 | 24.62 | +7%˄ || 43.31 | 40.35 | -7%˄ | (run time too short) |
| 3a || 43.14 | 43.63 | +1%˄ || 23.09 | 22.84 | -1%˄ | (run time too short) |
| 3b || 11.00 | 10.84 | -1%˄ || 89.77 | 91.02 | +1%˄ | (run time too short) |
-| 3c || 85.35 | 89.57 | +5%˄ || 11.69 | 11.14 | -5%˄ | (run time too short) |
| 4a || 76.93 | 75.86 | -1%˄ || 12.97 | 13.15 | +1%˄ | (run time too short) |
| 4b || 9.02 | 9.07 | +1%˄ || 109.16 | 108.62 | -0%˄ | (run time too short) |
| 4c || 100.68 | 98.64 | -2%˄ || 9.92 | 10.12 | +2%˄ | (run time too short) |
+| 5a || 33.84 | 32.24 | -5%˄ || 29.43 | 30.90 | +5%˄ | (run time too short) |
| 5b || 28.74 | 28.15 | -2%˄ || 34.63 | 35.33 | +2%˄ | (run time too short) |
| 5c || 54.56 | 54.04 | -1%˄ || 18.29 | 18.46 | +1%˄ | (run time too short) |
| 6a || 33.21 | 33.16 | -0%˄ || 30.04 | 30.09 | +0%˄ | (run time too short) |
| 6b || 57.18 | 57.14 | -0%˄ || 17.46 | 17.47 | +0%˄ | (run time too short) |
| 6c || 31.30 | 31.83 | +2%˄ || 31.86 | 31.34 | -2%˄ | (run time too short) |
| 6d || 161.93 | 160.15 | -1%˄ || 6.17 | 6.24 | +1%˄ | (run time too short) |
| 6e || 33.22 | 33.19 | -0%˄ || 30.03 | 30.05 | +0%˄ | (run time too short) |
| 6f || 482.91 | 487.65 | +1%˄ || 2.07 | 2.05 | -1%˄ | (run time too short) |
| 7a || 33.86 | 34.00 | +0%˄ || 29.44 | 29.32 | -0%˄ | (run time too short) |
| 7b || 33.42 | 33.08 | -1%˄ || 29.81 | 30.12 | +1%˄ | (run time too short) |
| 7c || 315.51 | 318.98 | +1%˄ || 3.17 | 3.13 | -1%˄ | (run time too short) |
| 8a || 40.82 | 40.65 | -0%˄ || 24.42 | 24.50 | +0%˄ | (run time too short) |
| 8b || 37.50 | 37.61 | +0%˄ || 26.59 | 26.51 | -0%˄ | (run time too short) |
| 8c || 1182.60 | 1195.29 | +1%˄ || 0.85 | 0.84 | -1%˄ | 0.0012 |
| 8d || 247.66 | 243.92 | -2%˄ || 4.04 | 4.10 | +2%˄ | (run time too short) |
| 9a || 146.37 | 146.54 | +0%˄ || 6.83 | 6.82 | -0%˄ | (run time too short) |
| 9b || 85.44 | 84.94 | -1%˄ || 11.69 | 11.76 | +1%˄ | (run time too short) |
| 9c || 148.59 | 145.92 | -2%˄ || 6.72 | 6.84 | +2%˄ | (run time too short) |
| 9d || 340.92 | 345.18 | +1%˄ || 2.93 | 2.90 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15496.51 | 15589.81 | +1% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_72005cad13851f371f2ae8db5998839820daba92_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 15:29:34 | 2024-05-27 05:25:27 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 195.69 | 175.14 | -10% || 0.60 | 0.60 | -0% | 0.3365 |
| 10b || 132.73 | 136.77 | +3% || 0.60 | 0.60 | -0% | 0.8651 |
| 10c || 464.97 | 485.43 | +4% || 0.60 | 0.60 | -0% | 0.5850 |
-| 11a || 108.09 | 127.87 | +18% || 0.60 | 0.60 | -0% | 0.2501 |
-| 11b || 99.21 | 129.38 | +30% || 0.60 | 0.60 | -0% | 0.1593 |
+| 11c || 96.13 | 86.91 | -10% || 0.60 | 0.60 | -0% | 0.4872 |
+| 11d || 102.88 | 94.21 | -8% || 0.60 | 0.60 | -0% | 0.5678 |
+| 12a || 176.12 | 155.38 | -12% || 0.60 | 0.60 | -0% | 0.3866 |
| 12b || 83.15 | 83.86 | +1% || 0.60 | 0.60 | -0% | 0.9598 |
-| 12c || 304.75 | 339.01 | +11% || 0.60 | 0.60 | -0% | 0.2854 |
| 13a || 437.47 | 454.83 | +4% || 0.60 | 0.60 | -0% | 0.6040 |
| 13b || 313.77 | 327.44 | +4% || 0.60 | 0.60 | -0% | 0.6960 |
-| 13c || 304.87 | 323.28 | +6% || 0.60 | 0.60 | -0% | 0.5766 |
| 13d || 792.42 | 788.92 | -0% || 0.60 | 0.60 | -0% | 0.9249 |
+| 14a || 402.35 | 382.23 | -5% || 0.60 | 0.60 | -0% | 0.6130 |
| 14b || 355.91 | 356.11 | +0% || 0.60 | 0.60 | -0% | 0.9950 |
-| 14c || 470.27 | 498.23 | +6% || 0.60 | 0.60 | -0% | 0.4039 |
+| 15a || 132.27 | 108.15 | -18% || 0.60 | 0.60 | -0% | 0.1255 |
+| 15b || 132.64 | 123.84 | -7% || 0.60 | 0.60 | -0% | 0.6848 |
-| 15c || 128.76 | 138.93 | +8% || 0.60 | 0.60 | -0% | 0.5844 |
-| 15d || 154.59 | 180.20 | +17% || 0.60 | 0.60 | -0% | 0.3002 |
| 16a || 1414.77 | 1423.85 | +1% || 0.60 | 0.60 | -0% | 0.8653 |
| 16b || 2826.56 | 2768.73 | -2% || 0.60 | 0.60 | -0% | 0.3395 |
| 16c || 1644.58 | 1652.46 | +0% || 0.60 | 0.60 | -0% | 0.8811 |
-| 16d || 1577.60 | 1656.73 | +5% || 0.60 | 0.60 | +0% | 0.1520 |
+| 17a || 850.10 | 804.22 | -5% || 0.60 | 0.60 | -0% | 0.3486 |
+| 17b || 627.46 | 586.30 | -7% || 0.60 | 0.60 | +0% | 0.3473 |
| 17c || 561.85 | 550.23 | -2% || 0.60 | 0.60 | -0% | 0.7692 |
| 17d || 573.73 | 568.48 | -1% || 0.60 | 0.60 | -0% | 0.8993 |
| 17e || 1473.34 | 1491.21 | +1% || 0.60 | 0.60 | -0% | 0.7412 |
| 17f || 1059.79 | 1048.22 | -1% || 0.60 | 0.60 | +0% | 0.8221 |
-| 18a || 222.58 | 248.16 | +11% || 0.60 | 0.60 | -0% | 0.2683 |
+| 18b || 375.97 | 331.96 | -12% || 0.60 | 0.60 | -0% | 0.1938 |
-| 18c || 519.90 | 610.20 | +17% || 0.60 | 0.60 | -0% | 0.0269 |
| 19a || 527.56 | 547.55 | +4% || 0.60 | 0.60 | -0% | 0.6272 |
+| 19b || 390.58 | 331.06 | -15% || 0.60 | 0.60 | -0% | 0.0939 |
| 19c || 587.88 | 571.68 | -3% || 0.60 | 0.60 | -0% | 0.7037 |
| 19d || 1248.20 | 1282.28 | +3% || 0.60 | 0.60 | +0% | 0.4760 |
| 1a || 42.12 | 40.64 | -4% || 0.60 | 0.60 | -0% | 0.8627 |
| 1b || 41.75 | 42.73 | +2% || 0.60 | 0.60 | +0% | 0.9128 |
-| 1c || 45.09 | 80.11 | +78% || 0.60 | 0.60 | -0% | 0.0460 |
+| 1d || 45.46 | 41.77 | -8% || 0.60 | 0.60 | -0% | 0.7359 |
+| 20a || 433.55 | 400.12 | -8% || 0.60 | 0.60 | -0% | 0.3213 |
| 20b || 405.51 | 421.97 | +4% || 0.60 | 0.60 | -0% | 0.6761 |
+| 20c || 370.31 | 304.04 | -18% || 0.60 | 0.60 | -0% | 0.0087 |
-| 21a || 148.73 | 182.90 | +23% || 0.60 | 0.60 | -0% | 0.1187 |
+| 21b || 148.77 | 136.08 | -9% || 0.60 | 0.60 | -0% | 0.4993 |
-| 21c || 158.47 | 189.70 | +20% || 0.60 | 0.60 | -0% | 0.1959 |
+| 22a || 436.41 | 401.81 | -8% || 0.60 | 0.60 | -0% | 0.3589 |
| 22b || 333.69 | 347.73 | +4% || 0.60 | 0.60 | +0% | 0.6432 |
-| 22c || 544.55 | 570.08 | +5% || 0.60 | 0.60 | -0% | 0.5430 |
| 22d || 755.61 | 750.56 | -1% || 0.60 | 0.60 | -0% | 0.9148 |
+| 23a || 170.60 | 120.87 | -29% || 0.60 | 0.60 | -0% | 0.0194 |
| 23b || 135.59 | 132.82 | -2% || 0.60 | 0.60 | +0% | 0.8949 |
-| 23c || 147.13 | 171.33 | +16% || 0.60 | 0.60 | -0% | 0.2615 |
+| 24a || 452.76 | 412.65 | -9% || 0.60 | 0.60 | +0% | 0.3424 |
-| 24b || 295.52 | 312.62 | +6% || 0.60 | 0.60 | -0% | 0.6273 |
| 25a || 358.41 | 371.94 | +4% || 0.60 | 0.60 | -0% | 0.7036 |
-| 25b || 194.72 | 208.38 | +7% || 0.60 | 0.60 | -0% | 0.5896 |
-| 25c || 794.78 | 836.79 | +5% || 0.60 | 0.60 | -0% | 0.4230 |
+| 26a || 389.00 | 338.44 | -13% || 0.60 | 0.60 | -0% | 0.0849 |
-| 26b || 235.67 | 248.34 | +5% || 0.60 | 0.60 | -0% | 0.5982 |
+| 26c || 593.03 | 539.66 | -9% || 0.60 | 0.60 | +0% | 0.1861 |
| 27a || 173.63 | 175.03 | +1% || 0.60 | 0.60 | -0% | 0.9527 |
+| 27b || 192.34 | 135.50 | -30% || 0.60 | 0.60 | -0% | 0.0381 |
-| 27c || 167.19 | 209.76 | +25% || 0.60 | 0.60 | -0% | 0.1106 |
| 28a || 532.25 | 549.73 | +3% || 0.60 | 0.60 | -0% | 0.6306 |
+| 28b || 263.68 | 229.04 | -13% || 0.60 | 0.60 | -0% | 0.2748 |
-| 28c || 494.41 | 527.00 | +7% || 0.60 | 0.60 | -0% | 0.3506 |
-| 29a || 267.34 | 302.50 | +13% || 0.60 | 0.60 | -0% | 0.2366 |
-| 29b || 337.67 | 396.83 | +18% || 0.60 | 0.60 | -0% | 0.0894 |
| 29c || 380.37 | 391.66 | +3% || 0.60 | 0.60 | -0% | 0.7787 |
| 2a || 121.59 | 122.34 | +1% || 0.60 | 0.60 | -0% | 0.9634 |
+| 2b || 114.91 | 104.54 | -9% || 0.60 | 0.60 | -0% | 0.4762 |
+| 2c || 100.81 | 95.08 | -6% || 0.60 | 0.60 | -0% | 0.6972 |
+| 2d || 250.45 | 202.66 | -19% || 0.60 | 0.60 | -0% | 0.0668 |
-| 30a || 280.37 | 333.27 | +19% || 0.60 | 0.60 | -0% | 0.0862 |
+| 30b || 363.27 | 280.86 | -23% || 0.60 | 0.60 | -0% | 0.0232 |
+| 30c || 683.34 | 550.18 | -19% || 0.60 | 0.60 | -0% | 0.0035 |
-| 31a || 212.35 | 302.72 | +43% || 0.60 | 0.60 | -0% | 0.0023 |
| 31b || 241.04 | 249.39 | +3% || 0.60 | 0.60 | -0% | 0.7964 |
+| 31c || 316.11 | 293.09 | -7% || 0.60 | 0.60 | -0% | 0.5401 |
-| 32a || 36.56 | 58.67 | +60% || 0.60 | 0.60 | -0% | 0.0123 |
| 32b || 133.48 | 136.60 | +2% || 0.60 | 0.60 | -0% | 0.8171 |
+| 33a || 121.60 | 99.40 | -18% || 0.60 | 0.60 | -0% | 0.2142 |
| 33b || 101.33 | 97.56 | -4% || 0.60 | 0.60 | -0% | 0.8295 |
+| 33c || 157.23 | 147.04 | -6% || 0.60 | 0.60 | +0% | 0.6567 |
-| 3a || 212.90 | 231.95 | +9% || 0.60 | 0.60 | -0% | 0.4802 |
+| 3b || 94.40 | 69.03 | -27% || 0.60 | 0.60 | -0% | 0.1508 |
-| 3c || 276.67 | 379.26 | +37% || 0.60 | 0.60 | +0% | 0.0010 |
| 4a || 234.59 | 227.34 | -3% || 0.60 | 0.60 | -0% | 0.7577 |
+| 4b || 84.95 | 66.34 | -22% || 0.60 | 0.60 | -0% | 0.3893 |
-| 4c || 260.29 | 281.67 | +8% || 0.60 | 0.60 | -0% | 0.3495 |
| 5a || 196.49 | 196.15 | -0% || 0.60 | 0.60 | -0% | 0.9885 |
-| 5b || 147.48 | 161.67 | +10% || 0.60 | 0.60 | -0% | 0.5760 |
-| 5c || 280.35 | 319.55 | +14% || 0.60 | 0.60 | -0% | 0.2127 |
+| 6a || 140.43 | 132.24 | -6% || 0.60 | 0.60 | -0% | 0.6507 |
+| 6b || 186.62 | 177.28 | -5% || 0.60 | 0.60 | +0% | 0.6509 |
+| 6c || 138.03 | 108.07 | -22% || 0.60 | 0.60 | +0% | 0.0488 |
| 6d || 503.14 | 506.83 | +1% || 0.60 | 0.60 | -0% | 0.9150 |
+| 6e || 147.91 | 133.55 | -10% || 0.60 | 0.60 | -0% | 0.4347 |
| 6f || 1053.76 | 1077.15 | +2% || 0.60 | 0.60 | -0% | 0.5869 |
+| 7a || 171.10 | 157.46 | -8% || 0.60 | 0.60 | -0% | 0.5369 |
+| 7b || 151.27 | 137.77 | -9% || 0.60 | 0.60 | -0% | 0.4165 |
| 7c || 1018.85 | 1037.32 | +2% || 0.60 | 0.60 | -0% | 0.7134 |
-| 8a || 184.64 | 199.34 | +8% || 0.60 | 0.60 | -0% | 0.5731 |
| 8b || 190.97 | 186.63 | -2% || 0.60 | 0.60 | -0% | 0.8777 |
| 8c || 2055.53 | 2085.88 | +1% || 0.60 | 0.60 | -0% | 0.5697 |
+| 8d || 603.58 | 571.85 | -5% || 0.60 | 0.60 | -0% | 0.3026 |
+| 9a || 574.03 | 536.22 | -7% || 0.60 | 0.60 | -0% | 0.3160 |
-| 9b || 410.38 | 440.74 | +7% || 0.60 | 0.60 | -0% | 0.4274 |
| 9c || 579.39 | 577.80 | -0% || 0.60 | 0.60 | -0% | 0.9686 |
+| 9d || 1006.01 | 932.59 | -7% || 0.60 | 0.60 | -0% | 0.1276 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 46495.75 | 46495.65 | -0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_72005cad13851f371f2ae8db5998839820daba92_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 15:50:00 | 2024-05-27 05:45:55 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 323.18 | 339.42 | +5%˄ || 3.09 | 2.95 | -5%˄ | (run time too short) |
| 1.2 || 151.62 | 155.49 | +3%˄ || 6.60 | 6.43 | -2%˄ | (run time too short) |
| 1.3 || 147.47 | 148.85 | +1%˄ || 6.78 | 6.72 | -1%˄ | (run time too short) |
| 2.1 || 559.72 | 557.17 | -0%˄ || 1.79 | 1.79 | +0%˄ | (run time too short) |
| 2.2 || 296.01 | 297.30 | +0%˄ || 3.38 | 3.36 | -0%˄ | (run time too short) |
| 2.3 || 201.02 | 200.84 | -0%˄ || 4.97 | 4.98 | +0%˄ | (run time too short) |
+| 3.1 || 3046.60 | 2877.34 | -6% || 0.33 | 0.35 | +6% | 0.0004 |
| 3.2 || 304.70 | 292.58 | -4%˄ || 3.28 | 3.42 | +4%˄ | (run time too short) |
| 3.3 || 151.88 | 148.31 | -2%˄ || 6.58 | 6.74 | +2%˄ | (run time too short) |
| 3.4 || 144.88 | 141.56 | -2%˄ || 6.90 | 7.06 | +2%˄ | (run time too short) |
| 4.1 || 2893.79 | 2944.53 | +2% || 0.35 | 0.34 | -2% | 0.2026 |
| 4.2 || 906.73 | 903.27 | -0%˄ || 1.10 | 1.11 | +0%˄ | (run time too short) |
| 4.3 || 277.13 | 272.17 | -2%˄ || 3.61 | 3.67 | +2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 9404.73 | 9278.82 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_72005cad13851f371f2ae8db5998839820daba92_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 15:55:35 | 2024-05-27 05:51:30 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 103.78 | 104.07 | +0%˄ || 9.62 | 9.59 | -0%˄ | (run time too short) |
| 1.2 || 89.62 | 90.54 | +1%˄ || 11.14 | 11.02 | -1%˄ | (run time too short) |
| 1.3 || 85.45 | 82.94 | -3%˄ || 11.68 | 12.04 | +3%˄ | (run time too short) |
| 2.1 || 340.19 | 342.95 | +1%˄ || 2.94 | 2.91 | -1%˄ | (run time too short) |
| 2.2 || 165.37 | 164.86 | -0%˄ || 6.04 | 6.06 | +0%˄ | (run time too short) |
| 2.3 || 60.57 | 60.27 | -1%˄ || 16.47 | 16.55 | +0%˄ | (run time too short) |
| 3.1 || 837.40 | 839.94 | +0%˄ || 1.19 | 1.19 | -0%˄ | (run time too short) |
| 3.2 || 158.07 | 157.17 | -1%˄ || 6.32 | 6.36 | +1%˄ | (run time too short) |
| 3.3 || 79.83 | 81.00 | +1%˄ || 12.50 | 12.32 | -1%˄ | (run time too short) |
| 3.4 || 75.70 | 75.79 | +0%˄ || 13.19 | 13.17 | -0%˄ | (run time too short) |
| 4.1 || 697.24 | 684.01 | -2%˄ || 1.43 | 1.46 | +2%˄ | (run time too short) |
| 4.2 || 386.05 | 384.74 | -0%˄ || 2.59 | 2.60 | +0%˄ | (run time too short) |
| 4.3 || 115.58 | 115.34 | -0%˄ || 8.64 | 8.66 | +0%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3194.85 | 3183.62 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_72005cad13851f371f2ae8db5998839820daba92_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 72005cad13851f371f2ae8db5998839820daba92-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-26 15:58:58 | 2024-05-27 05:54:52 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 641.90 | 649.80 | +1% || 2.08 | 2.08 | +0% | 0.7482 |
| 1.2 || 375.21 | 390.52 | +4% || 2.08 | 2.08 | +0% | 0.4060 |
+| 1.3 || 368.34 | 345.39 | -6% || 2.08 | 2.08 | +0% | 0.1714 |
| 2.1 || 1598.35 | 1654.15 | +3% || 2.08 | 2.08 | +0% | 0.1313 |
| 2.2 || 887.54 | 911.63 | +3% || 2.08 | 2.08 | +0% | 0.4081 |
+| 2.3 || 335.19 | 308.22 | -8% || 2.08 | 2.09 | +0% | 0.1034 |
| 3.1 || 2570.03 | 2538.90 | -1% || 2.08 | 2.08 | +0% | 0.3885 |
| 3.2 || 829.25 | 805.39 | -3% || 2.08 | 2.08 | +0% | 0.3808 |
-| 3.3 || 435.09 | 471.84 | +8% || 2.08 | 2.08 | +0% | 0.0905 |
| 3.4 || 445.14 | 450.66 | +1% || 2.08 | 2.09 | +0% | 0.8090 |
| 4.1 || 2306.89 | 2308.52 | +0% || 2.08 | 2.08 | +0% | 0.9683 |
| 4.2 || 1993.31 | 1931.03 | -3% || 2.08 | 2.08 | +0% | 0.1335 |
-| 4.3 || 611.27 | 647.12 | +6% || 2.08 | 2.08 | +0% | 0.1132 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 13397.53 | 13413.17 | +0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
…e/hyrise into dey4ss/reference-histogram
benchmark_allSystem nemea - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_77c385084b79495fa645430506d4c92457ca02f1_st.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:10:21 | 2024-05-28 10:01:57 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 6387.28 | 6448.66 | +1% || 0.16 | 0.16 | -1% | 0.7049 |
+| TPC-H 02 || 49.92 | 45.49 | -9%˄ || 20.03 | 21.98 | +10%˄ | (run time too short) |
| TPC-H 03 || 1317.25 | 1307.92 | -1% || 0.76 | 0.76 | +1% | 0.6835 |
| TPC-H 04 || 1422.93 | 1424.59 | +0% || 0.70 | 0.70 | -0% | 0.9371 |
| TPC-H 05 || 2231.55 | 2220.11 | -1% || 0.45 | 0.45 | +1% | 0.4319 |
| TPC-H 06 || 161.68 | 165.00 | +2%˄ || 6.19 | 6.06 | -2%˄ | (run time too short) |
| TPC-H 07 || 830.50 | 821.37 | -1%˄ || 1.20 | 1.22 | +1%˄ | (run time too short) |
| TPC-H 08 || 509.16 | 515.54 | +1%˄ || 1.96 | 1.94 | -1%˄ | (run time too short) |
| TPC-H 09 || 5123.82 | 5140.02 | +0% || 0.20 | 0.19 | -0% | 0.5619 |
| TPC-H 10 || 1304.80 | 1288.79 | -1% || 0.77 | 0.78 | +1% | 0.1059 |
| TPC-H 11 || 63.12 | 63.29 | +0%˄ || 15.84 | 15.80 | -0%˄ | (run time too short) |
-| TPC-H 12 || 938.48 | 996.44 | +6%˄ || 1.07 | 1.00 | -6%˄ | (run time too short) |
| TPC-H 13 || 4874.43 | 4964.53 | +2% || 0.21 | 0.20 | -2% | 0.0057 |
| TPC-H 14 || 417.42 | 416.88 | -0%˄ || 2.40 | 2.40 | +0%˄ | (run time too short) |
| TPC-H 15 || 189.68 | 189.45 | -0%˄ || 5.27 | 5.28 | +0%˄ | (run time too short) |
| TPC-H 16 || 554.90 | 565.74 | +2%˄ || 1.80 | 1.77 | -2%˄ | (run time too short) |
| TPC-H 17 || 221.23 | 222.21 | +0%˄ || 4.52 | 4.50 | -0%˄ | (run time too short) |
| TPC-H 18 || 1773.24 | 1789.91 | +1% || 0.56 | 0.56 | -1% | 0.5283 |
| TPC-H 19 || 217.66 | 217.00 | -0%˄ || 4.59 | 4.61 | +0%˄ | (run time too short) |
| TPC-H 20 || 541.56 | 540.84 | -0%˄ || 1.85 | 1.85 | +0%˄ | (run time too short) |
| TPC-H 21 || 3850.97 | 3879.82 | +1% || 0.26 | 0.26 | -1% | 0.5930 |
-| TPC-H 22 || 430.01 | 467.43 | +9%˄ || 2.33 | 2.14 | -8%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 33411.59 | 33691.02 | +1% || | | | |
| Geomean || | | || | | -1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -7% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st_s01.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_77c385084b79495fa645430506d4c92457ca02f1_st_s01.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:26:07 | 2024-05-28 10:17:52 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.30 | 5.18 | -2%˄ || 188.78 | 192.82 | +2%˄ | (run time too short) |
| TPC-H 02 || 3.84 | 3.92 | +2%˄ || 260.19 | 255.08 | -2%˄ | (run time too short) |
| TPC-H 03 || 0.57 | 0.57 | +0%˄ || 1759.12 | 1751.49 | -0%˄ | (run time too short) |
| TPC-H 04 || 0.43 | 0.44 | +2%˄ || 2310.54 | 2269.97 | -2%˄ | (run time too short) |
| TPC-H 05 || 1.02 | 1.03 | +1%˄ || 981.78 | 974.15 | -1%˄ | (run time too short) |
| TPC-H 06 || 0.18 | 0.18 | +3%˄ || 5549.29 | 5413.81 | -2%˄ | (run time too short) |
+| TPC-H 07 || 11.78 | 9.40 | -20%˄ || 84.85 | 106.32 | +25%˄ | (run time too short) |
| TPC-H 08 || 16.52 | 16.20 | -2%˄ || 60.51 | 61.73 | +2%˄ | (run time too short) |
| TPC-H 09 || 4.02 | 4.13 | +3%˄ || 248.95 | 242.23 | -3%˄ | (run time too short) |
| TPC-H 10 || 0.65 | 0.65 | +0%˄ || 1538.57 | 1536.64 | -0%˄ | (run time too short) |
| TPC-H 11 || 0.20 | 0.21 | +1%˄ || 4872.99 | 4807.57 | -1%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.62 | -0%˄ || 1602.87 | 1609.34 | +0%˄ | (run time too short) |
| TPC-H 13 || 2.03 | 2.04 | +0%˄ || 491.24 | 490.33 | -0%˄ | (run time too short) |
| TPC-H 14 || 0.33 | 0.33 | +1%˄ || 3061.69 | 3018.76 | -1%˄ | (run time too short) |
+| TPC-H 15 || 1.33 | 1.25 | -6%˄ || 747.67 | 797.21 | +7%˄ | (run time too short) |
+| TPC-H 16 || 2.32 | 2.04 | -12%˄ || 430.72 | 490.31 | +14%˄ | (run time too short) |
+| TPC-H 17 || 0.75 | 0.66 | -12%˄ || 1328.46 | 1514.27 | +14%˄ | (run time too short) |
| TPC-H 18 || 1.15 | 1.15 | -0%˄ || 868.12 | 869.25 | +0%˄ | (run time too short) |
+| TPC-H 19 || 5.93 | 4.69 | -21%˄ || 168.66 | 212.98 | +26%˄ | (run time too short) |
+| TPC-H 20 || 2.80 | 2.56 | -9%˄ || 356.34 | 389.89 | +9%˄ | (run time too short) |
| TPC-H 21 || 1.11 | 1.14 | +2%˄ || 895.23 | 879.43 | -2%˄ | (run time too short) |
+| TPC-H 22 || 1.19 | 1.14 | -4%˄ || 838.53 | 877.67 | +5%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 64.08 | 59.52 | -7% || | | | |
| Geomean || | | || | | +4% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 28 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_77c385084b79495fa645430506d4c92457ca02f1_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:26:32 | 2024-05-28 10:18:17 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4679.34 | 4605.88 | -2% || 0.21 | 0.22 | +2% | 0.0272 |
+| TPC-H 02 || 65.01 | 54.52 | -16%˄ || 15.34 | 18.29 | +19%˄ | (run time too short) |
| TPC-H 03 || 585.09 | 582.64 | -0%˄ || 1.71 | 1.72 | +0%˄ | (run time too short) |
| TPC-H 04 || 528.51 | 515.94 | -2%˄ || 1.89 | 1.94 | +2%˄ | (run time too short) |
| TPC-H 05 || 506.77 | 521.09 | +3%˄ || 1.97 | 1.92 | -3%˄ | (run time too short) |
+| TPC-H 06 || 62.33 | 59.15 | -5%˄ || 16.00 | 16.86 | +5%˄ | (run time too short) |
| TPC-H 07 || 271.05 | 260.32 | -4%˄ || 3.69 | 3.84 | +4%˄ | (run time too short) |
| TPC-H 08 || 249.12 | 246.92 | -1%˄ || 4.01 | 4.05 | +1%˄ | (run time too short) |
| TPC-H 09 || 1650.78 | 1643.82 | -0% || 0.61 | 0.61 | +0% | 0.5523 |
| TPC-H 10 || 533.24 | 539.60 | +1%˄ || 1.87 | 1.85 | -1%˄ | (run time too short) |
| TPC-H 11 || 62.89 | 62.49 | -1%˄ || 15.86 | 15.97 | +1%˄ | (run time too short) |
| TPC-H 12 || 457.78 | 456.68 | -0%˄ || 2.18 | 2.19 | +0%˄ | (run time too short) |
| TPC-H 13 || 2208.98 | 2226.34 | +1% || 0.45 | 0.45 | -1% | 0.0261 |
| TPC-H 14 || 146.10 | 142.70 | -2%˄ || 6.84 | 7.00 | +2%˄ | (run time too short) |
| TPC-H 15 || 141.87 | 139.61 | -2%˄ || 7.04 | 7.16 | +2%˄ | (run time too short) |
| TPC-H 16 || 624.99 | 631.42 | +1%˄ || 1.60 | 1.58 | -1%˄ | (run time too short) |
| TPC-H 17 || 76.27 | 75.86 | -1%˄ || 13.08 | 13.15 | +1%˄ | (run time too short) |
| TPC-H 18 || 2108.70 | 2148.42 | +2% || 0.47 | 0.47 | -2% | 0.4183 |
+| TPC-H 19 || 125.67 | 110.51 | -12%˄ || 7.95 | 9.04 | +14%˄ | (run time too short) |
| TPC-H 20 || 198.92 | 199.72 | +0%˄ || 5.02 | 5.00 | -0%˄ | (run time too short) |
| TPC-H 21 || 879.28 | 859.78 | -2%˄ || 1.14 | 1.16 | +2%˄ | (run time too short) |
| TPC-H 22 || 144.17 | 146.02 | +1%˄ || 6.93 | 6.84 | -1%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 16306.89 | 16229.45 | -0% || | | | |
| Geomean || | | || | | +2% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 28 clients, 28 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_77c385084b79495fa645430506d4c92457ca02f1_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:37:57 | 2024-05-28 10:29:40 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6353.79 | 6358.78 | +0% || 0.56 | 0.56 | +0% | 0.9575 |
| TPC-H 02 || 381.64 | 373.68 | -2% || 0.56 | 0.56 | +0% | 0.9151 |
| TPC-H 03 || 2148.14 | 2210.55 | +3% || 0.56 | 0.56 | +0% | 0.6566 |
| TPC-H 04 || 2088.48 | 2026.77 | -3% || 0.56 | 0.56 | +0% | 0.7027 |
+| TPC-H 05 || 3162.43 | 2894.33 | -8% || 0.56 | 0.56 | +0% | 0.1677 |
-| TPC-H 06 || 517.79 | 548.52 | +6% || 0.56 | 0.56 | +0% | 0.6353 |
| TPC-H 07 || 2789.55 | 2720.14 | -2% || 0.56 | 0.56 | +0% | 0.7206 |
| TPC-H 08 || 1868.80 | 1943.50 | +4% || 0.56 | 0.56 | +1% | 0.6359 |
| TPC-H 09 || 5262.56 | 5150.92 | -2% || 0.56 | 0.56 | +0% | 0.6161 |
-| TPC-H 10 || 2577.21 | 2766.41 | +7% || 0.56 | 0.56 | +0% | 0.2611 |
-| TPC-H 11 || 382.07 | 445.62 | +17% || 0.56 | 0.56 | +0% | 0.3750 |
| TPC-H 12 || 2066.24 | 2044.62 | -1% || 0.56 | 0.56 | +0% | 0.8776 |
| TPC-H 13 || 4829.33 | 4941.24 | +2% || 0.56 | 0.56 | +0% | 0.3710 |
+| TPC-H 14 || 960.87 | 870.47 | -9% || 0.56 | 0.56 | +0% | 0.4006 |
-| TPC-H 15 || 461.16 | 593.20 | +29% || 0.56 | 0.56 | +0% | 0.0402 |
| TPC-H 16 || 1814.32 | 1840.28 | +1% || 0.56 | 0.56 | +0% | 0.8473 |
| TPC-H 17 || 749.83 | 723.87 | -3% || 0.56 | 0.56 | +0% | 0.7744 |
| TPC-H 18 || 3487.99 | 3390.91 | -3% || 0.56 | 0.56 | +0% | 0.3869 |
-| TPC-H 19 || 836.35 | 909.99 | +9% || 0.56 | 0.56 | +0% | 0.5009 |
| TPC-H 20 || 1462.45 | 1482.42 | +1% || 0.56 | 0.56 | +0% | 0.8855 |
+| TPC-H 21 || 4678.25 | 4347.74 | -7% || 0.56 | 0.56 | +0% | 0.1765 |
-| TPC-H 22 || 1028.20 | 1111.97 | +8% || 0.56 | 0.56 | +0% | 0.4971 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 49907.47 | 49695.92 | -0% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_77c385084b79495fa645430506d4c92457ca02f1_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:59:37 | 2024-05-28 10:51:19 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 247.00 | 243.47 | -1%˄ || 4.05 | 4.11 | +1%˄ | (run time too short) |
| 03 || 81.27 | 81.08 | -0%˄ || 12.30 | 12.33 | +0%˄ | (run time too short) |
| 06 || 198.51 | 198.93 | +0%˄ || 5.04 | 5.03 | -0%˄ | (run time too short) |
| 07 || 311.02 | 321.14 | +3%˄ || 3.22 | 3.11 | -3%˄ | (run time too short) |
| 09 || 673.16 | 659.40 | -2%˄ || 1.49 | 1.52 | +2%˄ | (run time too short) |
| 10 || 166.72 | 162.21 | -3%˄ || 6.00 | 6.16 | +3%˄ | (run time too short) |
| 13 || 537.14 | 536.71 | -0%˄ || 1.86 | 1.86 | +0%˄ | (run time too short) |
| 15 || 114.43 | 115.67 | +1%˄ || 8.74 | 8.65 | -1%˄ | (run time too short) |
| 16 || 83.72 | 83.10 | -1%˄ || 11.94 | 12.03 | +1%˄ | (run time too short) |
+| 17 || 357.01 | 338.92 | -5%˄ || 2.80 | 2.95 | +5%˄ | (run time too short) |
| 19 || 122.47 | 119.35 | -3%˄ || 8.17 | 8.38 | +3%˄ | (run time too short) |
| 25 || 203.40 | 195.74 | -4%˄ || 4.92 | 5.11 | +4%˄ | (run time too short) |
| 26 || 144.79 | 143.42 | -1%˄ || 6.91 | 6.97 | +1%˄ | (run time too short) |
| 28 || 608.72 | 600.16 | -1%˄ || 1.64 | 1.67 | +1%˄ | (run time too short) |
| 29 || 496.51 | 502.52 | +1%˄ || 2.01 | 1.99 | -1%˄ | (run time too short) |
| 31 || 1348.35 | 1356.94 | +1% || 0.74 | 0.74 | -1% | 0.0011 |
| 32 || 42.65 | 42.44 | -0%˄ || 23.45 | 23.56 | +0%˄ | (run time too short) |
| 34 || 177.88 | 180.14 | +1%˄ || 5.62 | 5.55 | -1%˄ | (run time too short) |
| 35 || 639.07 | 630.20 | -1%˄ || 1.56 | 1.59 | +1%˄ | (run time too short) |
| 37 || 527.12 | 550.77 | +4%˄ || 1.90 | 1.82 | -4%˄ | (run time too short) |
| 39a || 1743.65 | 1732.44 | -1% || 0.57 | 0.58 | +1% | 0.2511 |
| 39b || 1695.59 | 1692.74 | -0% || 0.59 | 0.59 | +0% | 0.6825 |
| 41 || 294.19 | 294.86 | +0%˄ || 3.40 | 3.39 | -0%˄ | (run time too short) |
| 42 || 103.67 | 101.96 | -2%˄ || 9.65 | 9.81 | +2%˄ | (run time too short) |
| 43 || 979.73 | 982.34 | +0%˄ || 1.02 | 1.02 | -0%˄ | (run time too short) |
| 45 || 120.51 | 118.48 | -2%˄ || 8.30 | 8.44 | +2%˄ | (run time too short) |
| 48 || 1059.66 | 1062.60 | +0%˄ || 0.94 | 0.94 | -0%˄ | (run time too short) |
| 50 || 135.91 | 137.23 | +1%˄ || 7.36 | 7.29 | -1%˄ | (run time too short) |
| 52 || 99.25 | 100.92 | +2%˄ || 10.08 | 9.91 | -2%˄ | (run time too short) |
| 55 || 96.00 | 98.19 | +2%˄ || 10.42 | 10.18 | -2%˄ | (run time too short) |
| 62 || 531.52 | 541.60 | +2%˄ || 1.88 | 1.85 | -2%˄ | (run time too short) |
| 65 || 1771.14 | 1733.69 | -2% || 0.56 | 0.58 | +2% | 0.0005 |
| 69 || 174.40 | 172.97 | -1%˄ || 5.73 | 5.78 | +1%˄ | (run time too short) |
| 73 || 96.96 | 95.91 | -1%˄ || 10.31 | 10.43 | +1%˄ | (run time too short) |
| 79 || 493.21 | 489.01 | -1%˄ || 2.03 | 2.04 | +1%˄ | (run time too short) |
| 81 || 154.59 | 152.60 | -1%˄ || 6.47 | 6.55 | +1%˄ | (run time too short) |
| 82 || 571.21 | 595.25 | +4%˄ || 1.75 | 1.68 | -4%˄ | (run time too short) |
| 83 || 38.68 | 38.39 | -1%˄ || 25.85 | 26.05 | +1%˄ | (run time too short) |
| 84 || 13.40 | 13.72 | +2%˄ || 74.64 | 72.85 | -2%˄ | (run time too short) |
| 85 || 157.69 | 156.42 | -1%˄ || 6.34 | 6.39 | +1%˄ | (run time too short) |
| 88 || 776.45 | 775.94 | -0%˄ || 1.29 | 1.29 | +0%˄ | (run time too short) |
| 91 || 14.55 | 14.47 | -1%˄ || 68.70 | 69.10 | +1%˄ | (run time too short) |
| 92 || 30.68 | 30.37 | -1%˄ || 32.59 | 32.92 | +1%˄ | (run time too short) |
| 93 || 3870.33 | 3788.97 | -2% || 0.26 | 0.26 | +2% | 0.0000 |
| 94 || 47.24 | 47.29 | +0%˄ || 21.17 | 21.15 | -0%˄ | (run time too short) |
| 95 || 5079.59 | 4885.86 | -4% || 0.20 | 0.20 | +4% | 0.2371 |
| 96 || 78.41 | 77.53 | -1%˄ || 12.75 | 12.90 | +1%˄ | (run time too short) |
| 97 || 4324.59 | 4263.89 | -1% || 0.23 | 0.23 | +1% | 0.1003 |
| 99 || 1031.73 | 1022.35 | -1%˄ || 0.97 | 0.98 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 32665.51 | 32280.31 | -1% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_77c385084b79495fa645430506d4c92457ca02f1_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:18:53 | 2024-05-28 11:10:40 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 231.02 | 238.80 | +3%˄ || 4.33 | 4.19 | -3%˄ | (run time too short) |
| 03 || 40.64 | 40.61 | -0%˄ || 24.49 | 24.52 | +0%˄ | (run time too short) |
| 06 || 194.41 | 196.45 | +1%˄ || 5.14 | 5.09 | -1%˄ | (run time too short) |
| 07 || 178.01 | 180.25 | +1%˄ || 5.61 | 5.54 | -1%˄ | (run time too short) |
| 09 || 101.92 | 100.08 | -2%˄ || 9.80 | 9.98 | +2%˄ | (run time too short) |
| 10 || 49.08 | 49.43 | +1%˄ || 20.34 | 20.18 | -1%˄ | (run time too short) |
| 13 || 259.75 | 258.51 | -0%˄ || 3.85 | 3.87 | +0%˄ | (run time too short) |
| 15 || 68.96 | 69.70 | +1%˄ || 14.47 | 14.32 | -1%˄ | (run time too short) |
| 16 || 44.53 | 44.15 | -1%˄ || 22.41 | 22.60 | +1%˄ | (run time too short) |
| 17 || 148.53 | 147.56 | -1%˄ || 6.73 | 6.77 | +1%˄ | (run time too short) |
| 19 || 71.24 | 70.62 | -1%˄ || 14.01 | 14.14 | +1%˄ | (run time too short) |
| 25 || 112.33 | 111.88 | -0%˄ || 8.89 | 8.93 | +0%˄ | (run time too short) |
| 26 || 92.67 | 93.52 | +1%˄ || 10.78 | 10.68 | -1%˄ | (run time too short) |
| 28 || 94.47 | 91.84 | -3%˄ || 10.57 | 10.87 | +3%˄ | (run time too short) |
| 29 || 402.63 | 401.55 | -0%˄ || 2.48 | 2.49 | +0%˄ | (run time too short) |
| 31 || 449.18 | 461.01 | +3%˄ || 2.23 | 2.17 | -3%˄ | (run time too short) |
| 32 || 37.90 | 36.80 | -3%˄ || 26.29 | 27.07 | +3%˄ | (run time too short) |
| 34 || 94.69 | 94.95 | +0%˄ || 10.54 | 10.51 | -0%˄ | (run time too short) |
| 35 || 370.07 | 369.53 | -0%˄ || 2.70 | 2.70 | +0%˄ | (run time too short) |
| 37 || 158.38 | 163.57 | +3%˄ || 6.31 | 6.11 | -3%˄ | (run time too short) |
| 39a || 755.09 | 771.91 | +2%˄ || 1.32 | 1.30 | -2%˄ | (run time too short) |
| 39b || 745.99 | 746.59 | +0%˄ || 1.34 | 1.34 | -0%˄ | (run time too short) |
| 41 || 357.50 | 358.23 | +0%˄ || 2.80 | 2.79 | -0%˄ | (run time too short) |
| 42 || 55.63 | 56.84 | +2%˄ || 17.92 | 17.54 | -2%˄ | (run time too short) |
| 43 || 429.64 | 426.46 | -1%˄ || 2.33 | 2.34 | +1%˄ | (run time too short) |
| 45 || 57.02 | 57.37 | +1%˄ || 17.50 | 17.39 | -1%˄ | (run time too short) |
| 48 || 438.60 | 440.94 | +1%˄ || 2.28 | 2.27 | -1%˄ | (run time too short) |
| 50 || 105.40 | 104.33 | -1%˄ || 9.47 | 9.57 | +1%˄ | (run time too short) |
| 52 || 58.70 | 59.82 | +2%˄ || 16.99 | 16.67 | -2%˄ | (run time too short) |
| 55 || 52.47 | 51.83 | -1%˄ || 19.01 | 19.23 | +1%˄ | (run time too short) |
| 62 || 318.42 | 311.27 | -2%˄ || 3.14 | 3.21 | +2%˄ | (run time too short) |
| 65 || 1479.10 | 1483.23 | +0% || 0.68 | 0.67 | -0% | 0.5973 |
| 69 || 76.56 | 77.26 | +1%˄ || 13.04 | 12.92 | -1%˄ | (run time too short) |
| 73 || 60.97 | 61.69 | +1%˄ || 16.37 | 16.18 | -1%˄ | (run time too short) |
| 79 || 432.04 | 434.52 | +1%˄ || 2.31 | 2.30 | -1%˄ | (run time too short) |
| 81 || 192.53 | 193.40 | +0%˄ || 5.19 | 5.17 | -0%˄ | (run time too short) |
| 82 || 191.62 | 196.51 | +3%˄ || 5.22 | 5.09 | -2%˄ | (run time too short) |
| 83 || 45.34 | 45.06 | -1%˄ || 21.98 | 22.12 | +1%˄ | (run time too short) |
| 84 || 16.64 | 16.38 | -2%˄ || 59.51 | 60.47 | +2%˄ | (run time too short) |
| 85 || 62.78 | 62.84 | +0%˄ || 15.89 | 15.88 | -0%˄ | (run time too short) |
| 88 || 82.30 | 82.59 | +0%˄ || 12.14 | 12.09 | -0%˄ | (run time too short) |
| 91 || 20.38 | 20.14 | -1%˄ || 48.77 | 49.37 | +1%˄ | (run time too short) |
| 92 || 37.33 | 37.59 | +1%˄ || 26.69 | 26.50 | -1%˄ | (run time too short) |
| 93 || 630.12 | 630.70 | +0%˄ || 1.59 | 1.59 | -0%˄ | (run time too short) |
| 94 || 42.65 | 42.60 | -0%˄ || 23.38 | 23.40 | +0%˄ | (run time too short) |
| 95 || 648.89 | 663.85 | +2%˄ || 1.54 | 1.51 | -2%˄ | (run time too short) |
| 96 || 53.72 | 55.68 | +4%˄ || 18.59 | 17.93 | -4%˄ | (run time too short) |
| 97 || 1484.52 | 1497.15 | +1% || 0.67 | 0.67 | -1% | 0.4218 |
| 99 || 598.80 | 603.65 | +1%˄ || 1.67 | 1.66 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 12731.18 | 12811.24 | +1% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_77c385084b79495fa645430506d4c92457ca02f1_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:30:45 | 2024-05-28 11:22:37 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 01 || 648.33 | 665.43 | +3% || 0.54 | 0.55 | +0% | 0.7609 |
-| 03 || 243.28 | 282.81 | +16% || 0.54 | 0.55 | +0% | 0.2440 |
| 06 || 729.26 | 726.80 | -0% || 0.54 | 0.55 | +0% | 0.9691 |
| 07 || 826.31 | 859.16 | +4% || 0.54 | 0.55 | +0% | 0.6626 |
| 09 || 667.05 | 692.05 | +4% || 0.54 | 0.55 | +0% | 0.6957 |
| 10 || 712.26 | 693.54 | -3% || 0.54 | 0.54 | +0% | 0.7986 |
+| 13 || 1502.90 | 1422.33 | -5% || 0.54 | 0.55 | +0% | 0.3614 |
+| 15 || 449.41 | 398.78 | -11% || 0.54 | 0.55 | +0% | 0.3173 |
+| 16 || 569.35 | 366.53 | -36% || 0.54 | 0.54 | +0% | 0.0014 |
| 17 || 1059.19 | 1071.14 | +1% || 0.54 | 0.55 | +0% | 0.8755 |
| 19 || 624.04 | 604.56 | -3% || 0.54 | 0.55 | +0% | 0.7666 |
-| 25 || 841.44 | 964.06 | +15% || 0.54 | 0.54 | +0% | 0.1478 |
| 26 || 465.24 | 481.42 | +3% || 0.54 | 0.54 | +0% | 0.7307 |
-| 28 || 1076.88 | 1146.91 | +7% || 0.54 | 0.55 | +0% | 0.4081 |
| 29 || 1420.13 | 1358.53 | -4% || 0.54 | 0.54 | +0% | 0.4920 |
| 31 || 2052.76 | 2068.20 | +1% || 0.54 | 0.54 | +0% | 0.8937 |
+| 32 || 170.17 | 161.03 | -5% || 0.54 | 0.55 | +0% | 0.7409 |
| 34 || 732.88 | 718.42 | -2% || 0.54 | 0.55 | +0% | 0.8394 |
| 35 || 1725.42 | 1771.87 | +3% || 0.54 | 0.54 | +0% | 0.6491 |
+| 37 || 862.66 | 716.46 | -17% || 0.54 | 0.55 | +0% | 0.0142 |
| 39a || 2265.52 | 2241.85 | -1% || 0.54 | 0.54 | +0% | 0.7833 |
| 39b || 2279.20 | 2318.19 | +2% || 0.54 | 0.54 | +0% | 0.6795 |
-| 41 || 1882.63 | 1975.78 | +5% || 0.54 | 0.54 | +0% | 0.3861 |
-| 42 || 430.05 | 452.15 | +5% || 0.54 | 0.55 | +0% | 0.6618 |
| 43 || 1541.86 | 1486.92 | -4% || 0.54 | 0.54 | +0% | 0.5098 |
-| 45 || 651.85 | 742.58 | +14% || 0.54 | 0.55 | +0% | 0.2568 |
+| 48 || 2229.83 | 1977.38 | -11% || 0.54 | 0.55 | +0% | 0.0228 |
+| 50 || 928.04 | 824.75 | -11% || 0.54 | 0.54 | -0% | 0.1070 |
| 52 || 485.17 | 492.60 | +2% || 0.54 | 0.54 | +0% | 0.9207 |
| 55 || 385.77 | 400.67 | +4% || 0.55 | 0.55 | +0% | 0.7324 |
| 62 || 919.69 | 944.99 | +3% || 0.54 | 0.54 | +0% | 0.6779 |
| 65 || 3288.62 | 3217.85 | -2% || 0.54 | 0.54 | +0% | 0.2939 |
| 69 || 862.27 | 876.43 | +2% || 0.54 | 0.54 | +0% | 0.8638 |
| 73 || 463.30 | 445.22 | -4% || 0.54 | 0.55 | +0% | 0.6883 |
+| 79 || 1471.00 | 1270.03 | -14% || 0.54 | 0.55 | +0% | 0.0072 |
-| 81 || 495.70 | 540.65 | +9% || 0.54 | 0.55 | +0% | 0.3250 |
-| 82 || 882.40 | 933.32 | +6% || 0.54 | 0.55 | +0% | 0.4181 |
+| 83 || 332.49 | 317.37 | -5% || 0.54 | 0.55 | +0% | 0.7556 |
-| 84 || 87.33 | 135.77 | +55% || 0.54 | 0.55 | +0% | 0.0449 |
-| 85 || 620.85 | 759.36 | +22% || 0.54 | 0.54 | +0% | 0.0372 |
-| 88 || 1907.52 | 2004.44 | +5% || 0.54 | 0.54 | -0% | 0.4220 |
-| 91 || 160.08 | 216.85 | +35% || 0.55 | 0.55 | +0% | 0.1877 |
-| 92 || 238.91 | 254.31 | +6% || 0.55 | 0.55 | +0% | 0.6902 |
| 93 || 1737.90 | 1762.97 | +1% || 0.54 | 0.54 | +0% | 0.7493 |
+| 94 || 391.89 | 350.87 | -10% || 0.54 | 0.55 | +0% | 0.3874 |
| 95 || 1806.98 | 1853.81 | +3% || 0.54 | 0.54 | +0% | 0.5593 |
-| 96 || 375.93 | 411.13 | +9% || 0.54 | 0.54 | +0% | 0.4537 |
| 97 || 3504.42 | 3567.49 | +2% || 0.54 | 0.54 | +0% | 0.5144 |
| 99 || 1263.50 | 1240.39 | -2% || 0.54 | 0.55 | +0% | 0.7096 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 51269.65 | 51186.16 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -59% || Geometric mean of throughput changes: +195%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_77c385084b79495fa645430506d4c92457ca02f1_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:51:07 | 2024-05-28 11:43:00 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 57.77 | 27.37 | -53% || 1.62 | 4.93 | +205% | (run time too short) |
+| New-Order || 42.59 | 13.18 | -69% || 17.99 | 55.01 | +206% | 0.0000 |
+| Order-Status || 1.92 | 1.22 | -37% || 1.53 | 4.23 | +176% | (run time too short) |
+| Payment || 7.25 | 2.36 | -67% || 18.10 | 52.03 | +187% | 0.0000 |
+| Stock-Level || 3.48 | 2.02 | -42% || 1.63 | 4.88 | +199% | (run time too short) |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 113.00 | 46.15 | -59% || | | | |
+| Geomean || | | || | | +195% | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 28 clients, 10 warehouses, 28 cores (high contention) Sum of avg. item runtimes: -32% || Geometric mean of throughput changes: +61%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_highcont.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_77c385084b79495fa645430506d4c92457ca02f1_mt_highcont.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:52:14 | 2024-05-28 11:44:06 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 130.00 | 95.88 | -26% || 22.58 | 34.61 | +53% | 0.0000 |
| unsucc.: || 1.87 | 1.98 | +6% || 8.75 | 16.01 | +83% | |
+| New-Order || 78.51 | 44.90 | -43% || 263.94 | 438.23 | +66% | 0.0000 |
| unsucc.: || 6.35 | 5.55 | -12% || 86.84 | 129.90 | +50% | |
+| Order-Status || 6.28 | 5.57 | -11% || 31.31 | 50.68 | +62% | 0.0000 |
+| Payment || 14.72 | 8.90 | -40% || 188.52 | 305.15 | +62% | 0.0000 |
| unsucc.: || 2.97 | 3.24 | +9% || 147.25 | 239.63 | +63% | |
+| Stock-Level || 10.72 | 8.76 | -18% || 31.59 | 50.93 | +61% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 240.24 | 164.02 | -32% || | | | |
+| Geomean || | | || | | +61% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 28 cores (low contention) Sum of avg. item runtimes: -44% || Geometric mean of throughput changes: +101%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_lowcont.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_77c385084b79495fa645430506d4c92457ca02f1_mt_lowcont.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:02:23 | 2024-05-28 11:54:18 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 91.30 | 56.07 | -39% || 9.91 | 19.29 | +95% | 0.0000 |
| unsucc.: || 0.82 | 0.91 | +12% || 0.84 | 2.09 | +150% | |
+| New-Order || 64.72 | 30.91 | -52% || 108.99 | 221.62 | +103% | 0.0000 |
| unsucc.: || 4.07 | 2.72 | -33% || 10.45 | 19.56 | +87% | |
+| Order-Status || 6.84 | 4.97 | -27% || 10.51 | 21.29 | +103% | 0.0000 |
+| Payment || 19.85 | 9.14 | -54% || 88.58 | 181.38 | +105% | 0.0000 |
| unsucc.: || 2.29 | 2.13 | -7% || 25.18 | 47.90 | +90% | |
+| Stock-Level || 9.52 | 6.25 | -34% || 10.71 | 21.31 | +99% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 192.23 | 107.35 | -44% || | | | |
+| Geomean || | | || | | +101% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_77c385084b79495fa645430506d4c92457ca02f1_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:12:30 | 2024-05-28 12:04:26 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 109.76 | 112.46 | +2%˄ || 9.11 | 8.89 | -2%˄ | (run time too short) |
| 10b || 72.10 | 69.54 | -4%˄ || 13.87 | 14.38 | +4%˄ | (run time too short) |
| 10c || 333.88 | 337.15 | +1%˄ || 3.00 | 2.97 | -1%˄ | (run time too short) |
| 11a || 95.85 | 96.13 | +0%˄ || 10.43 | 10.40 | -0%˄ | (run time too short) |
| 11b || 92.10 | 90.97 | -1%˄ || 10.86 | 10.99 | +1%˄ | (run time too short) |
| 11c || 25.05 | 25.20 | +1%˄ || 39.91 | 39.68 | -1%˄ | (run time too short) |
| 11d || 27.19 | 27.07 | -0%˄ || 36.78 | 36.94 | +0%˄ | (run time too short) |
| 12a || 28.94 | 29.07 | +0%˄ || 34.55 | 34.39 | -0%˄ | (run time too short) |
| 12b || 40.16 | 40.26 | +0%˄ || 24.90 | 24.84 | -0%˄ | (run time too short) |
| 12c || 62.12 | 62.39 | +0%˄ || 16.10 | 16.03 | -0%˄ | (run time too short) |
| 13a || 192.13 | 190.48 | -1%˄ || 5.20 | 5.25 | +1%˄ | (run time too short) |
| 13b || 241.50 | 232.71 | -4%˄ || 4.14 | 4.30 | +4%˄ | (run time too short) |
| 13c || 203.00 | 195.93 | -3%˄ || 4.93 | 5.10 | +4%˄ | (run time too short) |
| 13d || 498.76 | 503.11 | +1%˄ || 2.00 | 1.99 | -1%˄ | (run time too short) |
| 14a || 99.19 | 98.16 | -1%˄ || 10.08 | 10.19 | +1%˄ | (run time too short) |
| 14b || 111.75 | 112.19 | +0%˄ || 8.95 | 8.91 | -0%˄ | (run time too short) |
| 14c || 207.52 | 207.29 | -0%˄ || 4.82 | 4.82 | +0%˄ | (run time too short) |
| 15a || 55.11 | 54.80 | -1%˄ || 18.14 | 18.25 | +1%˄ | (run time too short) |
| 15b || 55.51 | 55.68 | +0%˄ || 18.01 | 17.96 | -0%˄ | (run time too short) |
| 15c || 46.61 | 46.53 | -0%˄ || 21.45 | 21.49 | +0%˄ | (run time too short) |
| 15d || 44.02 | 44.05 | +0%˄ || 22.71 | 22.70 | -0%˄ | (run time too short) |
| 16a || 1328.35 | 1323.89 | -0% || 0.75 | 0.76 | +0% | 0.4627 |
| 16b || 2463.52 | 2401.52 | -3% || 0.41 | 0.42 | +3% | 0.0001 |
| 16c || 1506.76 | 1487.30 | -1% || 0.66 | 0.67 | +1% | 0.0046 |
| 16d || 1472.82 | 1448.28 | -2% || 0.68 | 0.69 | +2% | 0.0000 |
| 17a || 457.10 | 465.01 | +2%˄ || 2.19 | 2.15 | -2%˄ | (run time too short) |
| 17b || 375.30 | 382.52 | +2%˄ || 2.66 | 2.61 | -2%˄ | (run time too short) |
| 17c || 358.58 | 366.50 | +2%˄ || 2.79 | 2.73 | -2%˄ | (run time too short) |
| 17d || 427.90 | 433.05 | +1%˄ || 2.34 | 2.31 | -1%˄ | (run time too short) |
| 17e || 1499.49 | 1530.47 | +2% || 0.67 | 0.65 | -2% | 0.0000 |
| 17f || 876.28 | 888.55 | +1%˄ || 1.14 | 1.13 | -1%˄ | (run time too short) |
| 18a || 144.26 | 144.36 | +0%˄ || 6.93 | 6.93 | -0%˄ | (run time too short) |
| 18b || 103.88 | 105.08 | +1%˄ || 9.63 | 9.52 | -1%˄ | (run time too short) |
-| 18c || 203.00 | 223.73 | +10%˄ || 4.93 | 4.47 | -9%˄ | (run time too short) |
| 19a || 229.30 | 229.75 | +0%˄ || 4.36 | 4.35 | -0%˄ | (run time too short) |
| 19b || 191.54 | 188.88 | -1%˄ || 5.22 | 5.29 | +1%˄ | (run time too short) |
| 19c || 272.97 | 272.39 | -0%˄ || 3.66 | 3.67 | +0%˄ | (run time too short) |
| 19d || 652.88 | 659.21 | +1%˄ || 1.53 | 1.52 | -1%˄ | (run time too short) |
| 1a || 12.40 | 12.33 | -1%˄ || 80.65 | 81.12 | +1%˄ | (run time too short) |
| 1b || 14.13 | 14.02 | -1%˄ || 70.78 | 71.30 | +1%˄ | (run time too short) |
| 1c || 14.23 | 14.18 | -0%˄ || 70.26 | 70.51 | +0%˄ | (run time too short) |
| 1d || 11.87 | 11.87 | -0%˄ || 84.21 | 84.27 | +0%˄ | (run time too short) |
| 20a || 631.27 | 623.17 | -1%˄ || 1.58 | 1.60 | +1%˄ | (run time too short) |
| 20b || 664.61 | 656.11 | -1%˄ || 1.50 | 1.52 | +1%˄ | (run time too short) |
| 20c || 381.36 | 382.39 | +0%˄ || 2.62 | 2.62 | -0%˄ | (run time too short) |
| 21a || 110.15 | 109.56 | -1%˄ || 9.08 | 9.13 | +1%˄ | (run time too short) |
| 21b || 103.43 | 102.01 | -1%˄ || 9.67 | 9.80 | +1%˄ | (run time too short) |
| 21c || 113.58 | 112.64 | -1%˄ || 8.80 | 8.88 | +1%˄ | (run time too short) |
| 22a || 172.17 | 172.10 | -0%˄ || 5.81 | 5.81 | +0%˄ | (run time too short) |
| 22b || 157.87 | 156.69 | -1%˄ || 6.33 | 6.38 | +1%˄ | (run time too short) |
| 22c || 231.20 | 229.10 | -1%˄ || 4.33 | 4.36 | +1%˄ | (run time too short) |
| 22d || 348.26 | 349.15 | +0%˄ || 2.87 | 2.86 | -0%˄ | (run time too short) |
| 23a || 49.39 | 49.28 | -0%˄ || 20.25 | 20.29 | +0%˄ | (run time too short) |
| 23b || 53.83 | 53.81 | -0%˄ || 18.58 | 18.58 | +0%˄ | (run time too short) |
| 23c || 51.83 | 51.74 | -0%˄ || 19.29 | 19.33 | +0%˄ | (run time too short) |
| 24a || 225.01 | 225.29 | +0%˄ || 4.44 | 4.44 | -0%˄ | (run time too short) |
| 24b || 219.61 | 219.73 | +0%˄ || 4.55 | 4.55 | -0%˄ | (run time too short) |
| 25a || 113.58 | 114.00 | +0%˄ || 8.80 | 8.77 | -0%˄ | (run time too short) |
| 25b || 72.31 | 72.42 | +0%˄ || 13.83 | 13.81 | -0%˄ | (run time too short) |
| 25c || 254.77 | 255.21 | +0%˄ || 3.93 | 3.92 | -0%˄ | (run time too short) |
| 26a || 185.28 | 185.55 | +0%˄ || 5.40 | 5.39 | -0%˄ | (run time too short) |
| 26b || 154.00 | 154.47 | +0%˄ || 6.49 | 6.47 | -0%˄ | (run time too short) |
| 26c || 310.66 | 310.36 | -0%˄ || 3.22 | 3.22 | +0%˄ | (run time too short) |
| 27a || 105.78 | 106.04 | +0%˄ || 9.45 | 9.43 | -0%˄ | (run time too short) |
| 27b || 97.43 | 96.72 | -1%˄ || 10.26 | 10.34 | +1%˄ | (run time too short) |
| 27c || 113.67 | 112.56 | -1%˄ || 8.80 | 8.88 | +1%˄ | (run time too short) |
| 28a || 207.20 | 204.68 | -1%˄ || 4.83 | 4.89 | +1%˄ | (run time too short) |
| 28b || 65.94 | 66.14 | +0%˄ || 15.17 | 15.12 | -0%˄ | (run time too short) |
| 28c || 173.05 | 170.48 | -1%˄ || 5.78 | 5.87 | +2%˄ | (run time too short) |
| 29a || 189.26 | 189.26 | +0%˄ || 5.28 | 5.28 | -0%˄ | (run time too short) |
| 29b || 775.69 | 768.85 | -1%˄ || 1.29 | 1.30 | +1%˄ | (run time too short) |
| 29c || 226.80 | 227.08 | +0%˄ || 4.41 | 4.40 | -0%˄ | (run time too short) |
| 2a || 30.85 | 31.04 | +1%˄ || 32.41 | 32.22 | -1%˄ | (run time too short) |
| 2b || 28.94 | 29.11 | +1%˄ || 34.55 | 34.36 | -1%˄ | (run time too short) |
| 2c || 25.87 | 25.91 | +0%˄ || 38.65 | 38.59 | -0%˄ | (run time too short) |
| 2d || 53.15 | 52.79 | -1%˄ || 18.81 | 18.94 | +1%˄ | (run time too short) |
| 30a || 105.51 | 106.43 | +1%˄ || 9.48 | 9.40 | -1%˄ | (run time too short) |
| 30b || 113.64 | 111.30 | -2%˄ || 8.80 | 8.98 | +2%˄ | (run time too short) |
| 30c || 173.36 | 172.89 | -0%˄ || 5.77 | 5.78 | +0%˄ | (run time too short) |
| 31a || 92.73 | 92.45 | -0%˄ || 10.78 | 10.82 | +0%˄ | (run time too short) |
| 31b || 90.43 | 90.51 | +0%˄ || 11.06 | 11.05 | -0%˄ | (run time too short) |
| 31c || 104.74 | 105.22 | +0%˄ || 9.55 | 9.50 | -0%˄ | (run time too short) |
| 32a || 17.06 | 17.04 | -0%˄ || 58.62 | 58.67 | +0%˄ | (run time too short) |
| 32b || 33.22 | 33.02 | -1%˄ || 30.10 | 30.28 | +1%˄ | (run time too short) |
| 33a || 37.89 | 38.28 | +1%˄ || 26.39 | 26.12 | -1%˄ | (run time too short) |
| 33b || 26.07 | 26.21 | +1%˄ || 38.35 | 38.15 | -1%˄ | (run time too short) |
| 33c || 44.28 | 44.70 | +1%˄ || 22.58 | 22.37 | -1%˄ | (run time too short) |
| 3a || 60.97 | 61.35 | +1%˄ || 16.40 | 16.30 | -1%˄ | (run time too short) |
| 3b || 18.37 | 18.42 | +0%˄ || 54.42 | 54.29 | -0%˄ | (run time too short) |
| 3c || 222.94 | 224.83 | +1%˄ || 4.49 | 4.45 | -1%˄ | (run time too short) |
| 4a || 136.04 | 136.25 | +0%˄ || 7.35 | 7.34 | -0%˄ | (run time too short) |
| 4b || 17.72 | 17.83 | +1%˄ || 56.42 | 56.07 | -1%˄ | (run time too short) |
| 4c || 191.10 | 191.59 | +0%˄ || 5.23 | 5.22 | -0%˄ | (run time too short) |
| 5a || 42.91 | 43.13 | +1%˄ || 23.30 | 23.19 | -1%˄ | (run time too short) |
| 5b || 47.05 | 47.52 | +1%˄ || 21.25 | 21.04 | -1%˄ | (run time too short) |
| 5c || 88.38 | 88.42 | +0%˄ || 11.31 | 11.31 | -0%˄ | (run time too short) |
| 6a || 171.99 | 172.50 | +0%˄ || 5.81 | 5.80 | -0%˄ | (run time too short) |
| 6b || 183.07 | 183.60 | +0%˄ || 5.46 | 5.45 | -0%˄ | (run time too short) |
| 6c || 164.28 | 164.49 | +0%˄ || 6.09 | 6.08 | -0%˄ | (run time too short) |
| 6d || 384.97 | 398.11 | +3%˄ || 2.60 | 2.51 | -3%˄ | (run time too short) |
| 6e || 171.61 | 172.10 | +0%˄ || 5.83 | 5.81 | -0%˄ | (run time too short) |
| 6f || 689.02 | 686.15 | -0%˄ || 1.45 | 1.46 | +0%˄ | (run time too short) |
| 7a || 110.90 | 110.76 | -0%˄ || 9.02 | 9.03 | +0%˄ | (run time too short) |
| 7b || 104.19 | 104.10 | -0%˄ || 9.60 | 9.61 | +0%˄ | (run time too short) |
| 7c || 581.01 | 589.81 | +2%˄ || 1.72 | 1.70 | -1%˄ | (run time too short) |
| 8a || 171.53 | 171.98 | +0%˄ || 5.83 | 5.81 | -0%˄ | (run time too short) |
| 8b || 167.18 | 167.64 | +0%˄ || 5.98 | 5.97 | -0%˄ | (run time too short) |
| 8c || 1829.28 | 1814.51 | -1% || 0.55 | 0.55 | +1% | 0.0001 |
| 8d || 320.50 | 320.30 | -0%˄ || 3.12 | 3.12 | +0%˄ | (run time too short) |
| 9a || 249.99 | 249.80 | -0%˄ || 4.00 | 4.00 | +0%˄ | (run time too short) |
| 9b || 154.56 | 154.75 | +0%˄ || 6.47 | 6.46 | -0%˄ | (run time too short) |
| 9c || 276.80 | 276.03 | -0%˄ || 3.61 | 3.62 | +0%˄ | (run time too short) |
| 9d || 421.40 | 420.39 | -0%˄ || 2.37 | 2.38 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 29773.27 | 29723.87 | -0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_77c385084b79495fa645430506d4c92457ca02f1_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:37:34 | 2024-05-28 12:29:31 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 43.52 | 43.54 | +0%˄ || 22.91 | 22.91 | -0%˄ | (run time too short) |
| 10b || 25.09 | 25.03 | -0%˄ || 39.63 | 39.73 | +0%˄ | (run time too short) |
| 10c || 141.44 | 142.62 | +1%˄ || 7.06 | 7.00 | -1%˄ | (run time too short) |
| 11a || 28.34 | 28.21 | -0%˄ || 35.18 | 35.32 | +0%˄ | (run time too short) |
| 11b || 26.22 | 26.65 | +2%˄ || 38.01 | 37.38 | -2%˄ | (run time too short) |
| 11c || 30.36 | 29.57 | -3%˄ || 32.77 | 33.65 | +3%˄ | (run time too short) |
| 11d || 34.56 | 34.37 | -1%˄ || 28.80 | 28.95 | +1%˄ | (run time too short) |
| 12a || 29.49 | 30.10 | +2%˄ || 33.75 | 33.06 | -2%˄ | (run time too short) |
| 12b || 20.05 | 20.26 | +1%˄ || 49.60 | 49.06 | -1%˄ | (run time too short) |
| 12c || 60.98 | 60.97 | -0%˄ || 16.35 | 16.35 | +0%˄ | (run time too short) |
| 13a || 144.95 | 144.16 | -1%˄ || 6.89 | 6.93 | +1%˄ | (run time too short) |
+| 13b || 105.79 | 98.56 | -7%˄ || 9.44 | 10.13 | +7%˄ | (run time too short) |
-| 13c || 92.96 | 100.52 | +8%˄ || 10.74 | 9.93 | -8%˄ | (run time too short) |
| 13d || 385.77 | 380.77 | -1%˄ || 2.59 | 2.63 | +1%˄ | (run time too short) |
| 14a || 61.87 | 61.43 | -1%˄ || 16.13 | 16.25 | +1%˄ | (run time too short) |
| 14b || 73.28 | 73.94 | +1%˄ || 13.63 | 13.51 | -1%˄ | (run time too short) |
| 14c || 183.69 | 182.92 | -0%˄ || 5.44 | 5.46 | +0%˄ | (run time too short) |
| 15a || 32.25 | 32.71 | +1%˄ || 30.90 | 30.45 | -1%˄ | (run time too short) |
| 15b || 29.40 | 28.71 | -2%˄ || 33.86 | 34.68 | +2%˄ | (run time too short) |
| 15c || 31.06 | 30.88 | -1%˄ || 32.02 | 32.22 | +1%˄ | (run time too short) |
| 15d || 36.06 | 36.50 | +1%˄ || 27.61 | 27.28 | -1%˄ | (run time too short) |
| 16a || 736.61 | 731.47 | -1%˄ || 1.36 | 1.37 | +1%˄ | (run time too short) |
| 16b || 1799.00 | 1795.64 | -0% || 0.56 | 0.56 | +0% | 0.7051 |
| 16c || 896.54 | 901.12 | +1%˄ || 1.12 | 1.11 | -1%˄ | (run time too short) |
| 16d || 868.49 | 872.53 | +0%˄ || 1.15 | 1.15 | -0%˄ | (run time too short) |
| 17a || 207.28 | 210.59 | +2%˄ || 4.82 | 4.75 | -2%˄ | (run time too short) |
| 17b || 182.99 | 180.49 | -1%˄ || 5.46 | 5.54 | +1%˄ | (run time too short) |
| 17c || 151.57 | 152.69 | +1%˄ || 6.59 | 6.54 | -1%˄ | (run time too short) |
| 17d || 149.77 | 149.64 | -0%˄ || 6.67 | 6.68 | +0%˄ | (run time too short) |
| 17e || 741.50 | 744.16 | +0%˄ || 1.35 | 1.34 | -0%˄ | (run time too short) |
| 17f || 331.04 | 331.56 | +0%˄ || 3.02 | 3.01 | -0%˄ | (run time too short) |
| 18a || 61.12 | 61.13 | +0%˄ || 16.33 | 16.32 | -0%˄ | (run time too short) |
| 18b || 58.60 | 58.82 | +0%˄ || 17.02 | 16.96 | -0%˄ | (run time too short) |
-| 18c || 93.22 | 132.70 | +42%˄ || 10.71 | 7.53 | -30%˄ | (run time too short) |
| 19a || 115.25 | 114.68 | -0%˄ || 8.67 | 8.71 | +1%˄ | (run time too short) |
| 19b || 77.38 | 78.15 | +1%˄ || 12.91 | 12.78 | -1%˄ | (run time too short) |
| 19c || 129.37 | 128.75 | -0%˄ || 7.72 | 7.76 | +0%˄ | (run time too short) |
| 19d || 514.03 | 515.72 | +0%˄ || 1.94 | 1.94 | -0%˄ | (run time too short) |
-| 1a || 10.44 | 11.03 | +6%˄ || 94.73 | 89.67 | -5%˄ | (run time too short) |
| 1b || 6.75 | 6.57 | -3%˄ || 145.49 | 149.36 | +3%˄ | (run time too short) |
| 1c || 6.49 | 6.32 | -3%˄ || 150.71 | 154.70 | +3%˄ | (run time too short) |
| 1d || 9.20 | 9.16 | -0%˄ || 106.99 | 107.59 | +1%˄ | (run time too short) |
| 20a || 85.75 | 88.44 | +3%˄ || 11.65 | 11.29 | -3%˄ | (run time too short) |
| 20b || 68.29 | 68.22 | -0%˄ || 14.63 | 14.64 | +0%˄ | (run time too short) |
| 20c || 86.33 | 87.43 | +1%˄ || 11.56 | 11.42 | -1%˄ | (run time too short) |
| 21a || 32.19 | 32.74 | +2%˄ || 30.94 | 30.43 | -2%˄ | (run time too short) |
| 21b || 30.45 | 30.69 | +1%˄ || 32.71 | 32.46 | -1%˄ | (run time too short) |
| 21c || 34.36 | 34.46 | +0%˄ || 29.00 | 28.91 | -0%˄ | (run time too short) |
| 22a || 69.71 | 69.20 | -1%˄ || 14.31 | 14.42 | +1%˄ | (run time too short) |
| 22b || 59.51 | 58.51 | -2%˄ || 16.77 | 17.05 | +2%˄ | (run time too short) |
| 22c || 137.06 | 136.60 | -0%˄ || 7.29 | 7.31 | +0%˄ | (run time too short) |
| 22d || 241.44 | 240.21 | -1%˄ || 4.14 | 4.16 | +1%˄ | (run time too short) |
| 23a || 24.63 | 23.63 | -4%˄ || 40.39 | 42.14 | +4%˄ | (run time too short) |
| 23b || 33.43 | 34.28 | +3%˄ || 29.80 | 29.06 | -2%˄ | (run time too short) |
| 23c || 26.15 | 25.99 | -1%˄ || 38.09 | 38.30 | +1%˄ | (run time too short) |
| 24a || 68.88 | 68.20 | -1%˄ || 14.49 | 14.64 | +1%˄ | (run time too short) |
| 24b || 62.05 | 62.66 | +1%˄ || 16.08 | 15.93 | -1%˄ | (run time too short) |
| 25a || 60.42 | 62.04 | +3%˄ || 16.51 | 16.07 | -3%˄ | (run time too short) |
| 25b || 39.18 | 39.69 | +1%˄ || 25.43 | 25.10 | -1%˄ | (run time too short) |
| 25c || 163.24 | 161.87 | -1%˄ || 6.12 | 6.17 | +1%˄ | (run time too short) |
| 26a || 92.15 | 92.09 | -0%˄ || 10.83 | 10.84 | +0%˄ | (run time too short) |
| 26b || 71.19 | 71.22 | +0%˄ || 14.02 | 14.01 | -0%˄ | (run time too short) |
| 26c || 150.15 | 150.30 | +0%˄ || 6.65 | 6.65 | -0%˄ | (run time too short) |
| 27a || 30.81 | 30.77 | -0%˄ || 32.33 | 32.37 | +0%˄ | (run time too short) |
| 27b || 30.74 | 30.65 | -0%˄ || 32.43 | 32.50 | +0%˄ | (run time too short) |
| 27c || 34.27 | 34.62 | +1%˄ || 29.09 | 28.80 | -1%˄ | (run time too short) |
| 28a || 150.50 | 149.33 | -1%˄ || 6.64 | 6.69 | +1%˄ | (run time too short) |
| 28b || 34.41 | 34.67 | +1%˄ || 28.96 | 28.74 | -1%˄ | (run time too short) |
| 28c || 120.07 | 119.38 | -1%˄ || 8.32 | 8.37 | +1%˄ | (run time too short) |
| 29a || 64.30 | 64.95 | +1%˄ || 15.52 | 15.37 | -1%˄ | (run time too short) |
| 29b || 109.23 | 112.95 | +3%˄ || 9.15 | 8.84 | -3%˄ | (run time too short) |
| 29c || 67.90 | 68.47 | +1%˄ || 14.69 | 14.58 | -1%˄ | (run time too short) |
-| 2a || 31.36 | 33.09 | +6%˄ || 31.76 | 30.07 | -5%˄ | (run time too short) |
+| 2b || 30.22 | 27.96 | -7%˄ || 32.92 | 35.62 | +8%˄ | (run time too short) |
| 2c || 22.46 | 23.19 | +3%˄ || 44.25 | 42.87 | -3%˄ | (run time too short) |
-| 2d || 55.65 | 58.52 | +5%˄ || 17.92 | 17.04 | -5%˄ | (run time too short) |
| 30a || 54.46 | 53.93 | -1%˄ || 18.31 | 18.49 | +1%˄ | (run time too short) |
| 30b || 45.50 | 46.07 | +1%˄ || 21.92 | 21.65 | -1%˄ | (run time too short) |
| 30c || 113.09 | 112.76 | -0%˄ || 8.83 | 8.86 | +0%˄ | (run time too short) |
| 31a || 40.94 | 40.87 | -0%˄ || 24.34 | 24.39 | +0%˄ | (run time too short) |
| 31b || 39.52 | 39.47 | -0%˄ || 25.22 | 25.25 | +0%˄ | (run time too short) |
| 31c || 46.39 | 46.92 | +1%˄ || 21.49 | 21.24 | -1%˄ | (run time too short) |
| 32a || 11.52 | 11.49 | -0%˄ || 85.66 | 85.84 | +0%˄ | (run time too short) |
-| 32b || 38.14 | 40.45 | +6%˄ || 26.12 | 24.62 | -6%˄ | (run time too short) |
| 33a || 16.43 | 16.18 | -2%˄ || 60.31 | 61.28 | +2%˄ | (run time too short) |
| 33b || 13.86 | 13.54 | -2%˄ || 71.39 | 73.10 | +2%˄ | (run time too short) |
| 33c || 24.00 | 23.33 | -3%˄ || 41.42 | 42.65 | +3%˄ | (run time too short) |
| 3a || 43.46 | 43.30 | -0%˄ || 22.93 | 23.02 | +0%˄ | (run time too short) |
| 3b || 10.74 | 10.70 | -0%˄ || 91.93 | 92.36 | +0%˄ | (run time too short) |
| 3c || 87.16 | 86.32 | -1%˄ || 11.45 | 11.56 | +1%˄ | (run time too short) |
| 4a || 78.92 | 77.70 | -2%˄ || 12.64 | 12.84 | +2%˄ | (run time too short) |
| 4b || 8.77 | 8.93 | +2%˄ || 112.34 | 110.28 | -2%˄ | (run time too short) |
| 4c || 98.46 | 99.97 | +2%˄ || 10.14 | 9.99 | -1%˄ | (run time too short) |
| 5a || 33.91 | 32.79 | -3%˄ || 29.36 | 30.37 | +3%˄ | (run time too short) |
| 5b || 27.62 | 27.37 | -1%˄ || 36.02 | 36.36 | +1%˄ | (run time too short) |
| 5c || 53.73 | 55.77 | +4%˄ || 18.57 | 17.88 | -4%˄ | (run time too short) |
| 6a || 33.05 | 33.23 | +1%˄ || 30.18 | 30.02 | -1%˄ | (run time too short) |
| 6b || 57.92 | 57.67 | -0%˄ || 17.24 | 17.31 | +0%˄ | (run time too short) |
| 6c || 31.48 | 31.28 | -1%˄ || 31.70 | 31.88 | +1%˄ | (run time too short) |
| 6d || 159.74 | 160.93 | +1%˄ || 6.26 | 6.21 | -1%˄ | (run time too short) |
| 6e || 33.08 | 33.07 | -0%˄ || 30.16 | 30.17 | +0%˄ | (run time too short) |
| 6f || 482.61 | 480.71 | -0%˄ || 2.07 | 2.08 | +0%˄ | (run time too short) |
| 7a || 34.32 | 33.74 | -2%˄ || 29.05 | 29.55 | +2%˄ | (run time too short) |
| 7b || 33.43 | 33.29 | -0%˄ || 29.80 | 29.95 | +1%˄ | (run time too short) |
| 7c || 315.37 | 321.07 | +2%˄ || 3.17 | 3.11 | -2%˄ | (run time too short) |
| 8a || 40.87 | 41.10 | +1%˄ || 24.38 | 24.25 | -1%˄ | (run time too short) |
| 8b || 37.41 | 37.59 | +0%˄ || 26.65 | 26.52 | -0%˄ | (run time too short) |
| 8c || 1188.09 | 1174.65 | -1%˄ || 0.84 | 0.85 | +1%˄ | (run time too short) |
| 8d || 245.94 | 246.49 | +0%˄ || 4.06 | 4.05 | -0%˄ | (run time too short) |
| 9a || 147.45 | 147.60 | +0%˄ || 6.78 | 6.77 | -0%˄ | (run time too short) |
| 9b || 84.10 | 85.66 | +2%˄ || 11.87 | 11.66 | -2%˄ | (run time too short) |
| 9c || 145.55 | 145.85 | +0%˄ || 6.86 | 6.85 | -0%˄ | (run time too short) |
| 9d || 342.04 | 343.42 | +0%˄ || 2.92 | 2.91 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15481.26 | 15527.57 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_77c385084b79495fa645430506d4c92457ca02f1_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:52:59 | 2024-05-28 12:44:57 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 10a || 201.87 | 194.45 | -4% || 0.60 | 0.60 | -0% | 0.7744 |
+| 10b || 156.36 | 148.99 | -5% || 0.60 | 0.60 | -0% | 0.7272 |
+| 10c || 503.76 | 478.68 | -5% || 0.60 | 0.60 | -0% | 0.5256 |
| 11a || 123.72 | 129.10 | +4% || 0.60 | 0.60 | -0% | 0.7899 |
+| 11b || 122.03 | 106.63 | -13% || 0.60 | 0.60 | -0% | 0.3970 |
-| 11c || 80.61 | 96.74 | +20% || 0.60 | 0.60 | -0% | 0.2565 |
+| 11d || 89.81 | 84.04 | -6% || 0.60 | 0.60 | -0% | 0.6603 |
-| 12a || 153.61 | 170.56 | +11% || 0.60 | 0.60 | -0% | 0.4632 |
-| 12b || 78.80 | 94.28 | +20% || 0.60 | 0.60 | -0% | 0.2653 |
| 12c || 290.45 | 291.85 | +0% || 0.60 | 0.60 | -0% | 0.9590 |
+| 13a || 472.41 | 433.95 | -8% || 0.60 | 0.60 | -0% | 0.2962 |
-| 13b || 270.24 | 340.20 | +26% || 0.60 | 0.60 | -0% | 0.0143 |
| 13c || 320.99 | 309.04 | -4% || 0.60 | 0.60 | -0% | 0.6879 |
| 13d || 814.80 | 809.60 | -1% || 0.60 | 0.60 | -0% | 0.8940 |
+| 14a || 397.71 | 356.00 | -10% || 0.60 | 0.60 | -0% | 0.2387 |
+| 14b || 386.85 | 366.92 | -5% || 0.60 | 0.60 | -0% | 0.5398 |
| 14c || 509.83 | 503.82 | -1% || 0.60 | 0.60 | +0% | 0.8872 |
+| 15a || 121.52 | 112.17 | -8% || 0.60 | 0.60 | -0% | 0.6094 |
-| 15b || 126.00 | 140.77 | +12% || 0.60 | 0.60 | -0% | 0.5233 |
-| 15c || 118.60 | 130.62 | +10% || 0.60 | 0.60 | -0% | 0.4893 |
+| 15d || 158.04 | 142.48 | -10% || 0.60 | 0.60 | -0% | 0.4028 |
+| 16a || 1476.83 | 1392.84 | -6% || 0.60 | 0.60 | -0% | 0.0993 |
| 16b || 2820.26 | 2827.21 | +0% || 0.60 | 0.60 | -0% | 0.9039 |
| 16c || 1662.80 | 1589.99 | -4% || 0.60 | 0.60 | -0% | 0.1790 |
| 16d || 1572.09 | 1586.20 | +1% || 0.60 | 0.60 | -0% | 0.7830 |
| 17a || 794.16 | 785.36 | -1% || 0.60 | 0.60 | -0% | 0.8518 |
-| 17b || 556.42 | 609.56 | +10% || 0.60 | 0.60 | -0% | 0.1587 |
+| 17c || 563.26 | 510.63 | -9% || 0.60 | 0.60 | -0% | 0.1227 |
| 17d || 547.32 | 560.68 | +2% || 0.60 | 0.60 | -0% | 0.7119 |
| 17e || 1464.06 | 1485.46 | +1% || 0.60 | 0.60 | +0% | 0.6723 |
-| 17f || 1000.05 | 1095.60 | +10% || 0.60 | 0.60 | -0% | 0.0706 |
+| 18a || 296.36 | 274.44 | -7% || 0.60 | 0.60 | -0% | 0.4790 |
| 18b || 375.32 | 366.97 | -2% || 0.60 | 0.60 | -0% | 0.8128 |
| 18c || 531.51 | 555.24 | +4% || 0.60 | 0.60 | -0% | 0.5971 |
| 19a || 552.00 | 533.24 | -3% || 0.60 | 0.60 | -0% | 0.6809 |
-| 19b || 339.56 | 378.70 | +12% || 0.60 | 0.60 | -0% | 0.2404 |
| 19c || 575.40 | 562.93 | -2% || 0.60 | 0.60 | -0% | 0.7392 |
| 19d || 1293.44 | 1262.76 | -2% || 0.60 | 0.60 | -0% | 0.5505 |
+| 1a || 35.95 | 32.20 | -10% || 0.60 | 0.60 | -0% | 0.5439 |
| 1b || 48.35 | 47.99 | -1% || 0.60 | 0.60 | -0% | 0.9720 |
-| 1c || 38.80 | 53.87 | +39% || 0.60 | 0.60 | -0% | 0.1198 |
| 1d || 35.66 | 36.35 | +2% || 0.60 | 0.60 | -0% | 0.9226 |
| 20a || 434.63 | 427.05 | -2% || 0.60 | 0.60 | -0% | 0.8403 |
-| 20b || 377.28 | 394.33 | +5% || 0.60 | 0.60 | -0% | 0.6686 |
| 20c || 368.87 | 370.07 | +0% || 0.60 | 0.60 | -0% | 0.9713 |
+| 21a || 201.18 | 177.67 | -12% || 0.60 | 0.60 | -0% | 0.3635 |
+| 21b || 140.13 | 130.13 | -7% || 0.60 | 0.60 | -0% | 0.6333 |
-| 21c || 183.02 | 192.84 | +5% || 0.60 | 0.60 | -0% | 0.6977 |
+| 22a || 413.73 | 387.07 | -6% || 0.60 | 0.60 | -0% | 0.4480 |
| 22b || 359.16 | 373.87 | +4% || 0.60 | 0.60 | -0% | 0.6933 |
-| 22c || 516.15 | 587.83 | +14% || 0.60 | 0.60 | -0% | 0.0821 |
| 22d || 744.10 | 751.83 | +1% || 0.60 | 0.60 | -0% | 0.8640 |
-| 23a || 132.07 | 149.13 | +13% || 0.60 | 0.60 | +0% | 0.3931 |
+| 23b || 134.66 | 125.80 | -7% || 0.60 | 0.60 | -0% | 0.7135 |
+| 23c || 156.35 | 136.09 | -13% || 0.60 | 0.60 | -0% | 0.3087 |
| 24a || 408.61 | 391.16 | -4% || 0.60 | 0.60 | -0% | 0.6548 |
| 24b || 292.99 | 305.95 | +4% || 0.60 | 0.60 | -0% | 0.7055 |
+| 25a || 384.33 | 344.36 | -10% || 0.60 | 0.60 | -0% | 0.2268 |
| 25b || 216.24 | 218.35 | +1% || 0.60 | 0.60 | -0% | 0.9402 |
+| 25c || 834.05 | 786.50 | -6% || 0.60 | 0.60 | -0% | 0.3461 |
| 26a || 368.41 | 358.58 | -3% || 0.60 | 0.60 | -0% | 0.7158 |
-| 26b || 214.47 | 228.75 | +7% || 0.60 | 0.60 | -0% | 0.5117 |
+| 26c || 582.66 | 537.96 | -8% || 0.60 | 0.60 | +0% | 0.2728 |
| 27a || 178.15 | 173.67 | -3% || 0.60 | 0.60 | -0% | 0.8576 |
| 27b || 190.05 | 186.79 | -2% || 0.60 | 0.60 | -0% | 0.9058 |
| 27c || 193.84 | 192.00 | -1% || 0.60 | 0.60 | -0% | 0.9454 |
-| 28a || 555.27 | 599.90 | +8% || 0.60 | 0.60 | -0% | 0.3225 |
-| 28b || 207.28 | 242.02 | +17% || 0.60 | 0.60 | -0% | 0.2186 |
+| 28c || 577.94 | 542.73 | -6% || 0.60 | 0.60 | -0% | 0.3944 |
-| 29a || 255.88 | 281.46 | +10% || 0.60 | 0.60 | -0% | 0.2884 |
| 29b || 346.98 | 341.96 | -1% || 0.60 | 0.60 | -0% | 0.8723 |
+| 29c || 377.85 | 347.04 | -8% || 0.60 | 0.60 | -0% | 0.3943 |
| 2a || 140.29 | 142.61 | +2% || 0.60 | 0.60 | -0% | 0.9127 |
+| 2b || 107.78 | 98.11 | -9% || 0.60 | 0.60 | -0% | 0.4708 |
+| 2c || 97.08 | 86.31 | -11% || 0.60 | 0.60 | -0% | 0.4397 |
-| 2d || 193.77 | 215.31 | +11% || 0.60 | 0.60 | -0% | 0.3083 |
+| 30a || 331.31 | 309.62 | -7% || 0.60 | 0.60 | -0% | 0.4969 |
-| 30b || 300.64 | 319.59 | +6% || 0.60 | 0.60 | -0% | 0.5399 |
| 30c || 641.58 | 622.98 | -3% || 0.60 | 0.60 | -0% | 0.7054 |
+| 31a || 252.20 | 219.58 | -13% || 0.60 | 0.60 | -0% | 0.2015 |
| 31b || 205.02 | 206.37 | +1% || 0.60 | 0.60 | -0% | 0.9571 |
-| 31c || 278.59 | 300.46 | +8% || 0.60 | 0.60 | -0% | 0.5145 |
+| 32a || 66.18 | 50.08 | -24% || 0.60 | 0.60 | -0% | 0.1825 |
+| 32b || 145.10 | 138.14 | -5% || 0.60 | 0.60 | -0% | 0.6798 |
-| 33a || 124.14 | 130.77 | +5% || 0.60 | 0.60 | -0% | 0.7195 |
-| 33b || 88.89 | 93.57 | +5% || 0.60 | 0.60 | -0% | 0.7590 |
+| 33c || 204.13 | 152.33 | -25% || 0.60 | 0.60 | -0% | 0.0544 |
| 3a || 235.57 | 234.27 | -1% || 0.60 | 0.60 | -0% | 0.9644 |
-| 3b || 70.83 | 79.15 | +12% || 0.60 | 0.60 | -0% | 0.6025 |
-| 3c || 362.81 | 382.52 | +5% || 0.60 | 0.60 | -0% | 0.6181 |
| 4a || 233.45 | 237.59 | +2% || 0.60 | 0.60 | -0% | 0.8730 |
-| 4b || 50.13 | 54.12 | +8% || 0.60 | 0.60 | -0% | 0.7060 |
| 4c || 310.51 | 299.43 | -4% || 0.60 | 0.60 | -0% | 0.7131 |
-| 5a || 219.17 | 239.30 | +9% || 0.60 | 0.60 | -0% | 0.5590 |
+| 5b || 145.02 | 131.65 | -9% || 0.60 | 0.60 | -0% | 0.4913 |
-| 5c || 241.59 | 302.31 | +25% || 0.60 | 0.60 | -0% | 0.0345 |
+| 6a || 148.20 | 132.63 | -11% || 0.60 | 0.60 | -0% | 0.3392 |
-| 6b || 163.96 | 179.22 | +9% || 0.60 | 0.60 | +0% | 0.3621 |
-| 6c || 114.91 | 133.30 | +16% || 0.60 | 0.60 | -0% | 0.2564 |
| 6d || 500.19 | 504.44 | +1% || 0.60 | 0.60 | -0% | 0.8983 |
+| 6e || 180.94 | 162.37 | -10% || 0.60 | 0.60 | -0% | 0.4596 |
| 6f || 1039.49 | 1044.43 | +0% || 0.60 | 0.60 | -0% | 0.9097 |
+| 7a || 212.91 | 203.15 | -5% || 0.60 | 0.60 | -0% | 0.7580 |
-| 7b || 152.71 | 165.22 | +8% || 0.60 | 0.60 | -0% | 0.5720 |
| 7c || 984.34 | 1005.97 | +2% || 0.60 | 0.60 | -0% | 0.6517 |
-| 8a || 195.45 | 229.24 | +17% || 0.60 | 0.60 | -0% | 0.2617 |
+| 8b || 192.66 | 165.22 | -14% || 0.60 | 0.60 | -0% | 0.2176 |
| 8c || 1957.65 | 2037.39 | +4% || 0.60 | 0.60 | -0% | 0.1051 |
-| 8d || 570.02 | 597.05 | +5% || 0.60 | 0.60 | -0% | 0.4011 |
-| 9a || 593.06 | 644.41 | +9% || 0.60 | 0.60 | -0% | 0.2796 |
| 9b || 411.76 | 426.37 | +4% || 0.60 | 0.60 | -0% | 0.6804 |
| 9c || 601.59 | 606.46 | +1% || 0.60 | 0.60 | -0% | 0.9077 |
| 9d || 998.65 | 997.75 | -0% || 0.60 | 0.60 | -0% | 0.9852 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 46488.20 | 46552.81 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_77c385084b79495fa645430506d4c92457ca02f1_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 05:13:25 | 2024-05-28 13:05:23 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 320.48 | 310.06 | -3%˄ || 3.12 | 3.23 | +3%˄ | (run time too short) |
| 1.2 || 153.47 | 153.91 | +0%˄ || 6.52 | 6.50 | -0%˄ | (run time too short) |
| 1.3 || 152.66 | 148.27 | -3%˄ || 6.55 | 6.74 | +3%˄ | (run time too short) |
| 2.1 || 555.85 | 559.25 | +1%˄ || 1.80 | 1.79 | -1%˄ | (run time too short) |
| 2.2 || 295.25 | 299.85 | +2%˄ || 3.39 | 3.34 | -2%˄ | (run time too short) |
| 2.3 || 200.04 | 203.19 | +2%˄ || 5.00 | 4.92 | -2%˄ | (run time too short) |
| 3.1 || 2977.48 | 2882.75 | -3% || 0.34 | 0.35 | +3% | 0.0273 |
| 3.2 || 300.65 | 296.59 | -1%˄ || 3.33 | 3.37 | +1%˄ | (run time too short) |
| 3.3 || 153.28 | 151.95 | -1%˄ || 6.52 | 6.58 | +1%˄ | (run time too short) |
| 3.4 || 144.85 | 144.91 | +0%˄ || 6.90 | 6.90 | -0%˄ | (run time too short) |
| 4.1 || 2941.64 | 2973.99 | +1% || 0.34 | 0.34 | -1% | 0.3983 |
| 4.2 || 891.86 | 918.40 | +3%˄ || 1.12 | 1.09 | -3%˄ | (run time too short) |
| 4.3 || 273.38 | 271.71 | -1%˄ || 3.66 | 3.68 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 9360.89 | 9314.83 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_77c385084b79495fa645430506d4c92457ca02f1_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 05:19:01 | 2024-05-28 13:10:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 104.54 | 104.52 | -0%˄ || 9.55 | 9.55 | +0%˄ | (run time too short) |
| 1.2 || 88.78 | 88.25 | -1%˄ || 11.24 | 11.31 | +1%˄ | (run time too short) |
| 1.3 || 85.48 | 85.16 | -0%˄ || 11.68 | 11.72 | +0%˄ | (run time too short) |
| 2.1 || 341.28 | 342.32 | +0%˄ || 2.93 | 2.92 | -0%˄ | (run time too short) |
| 2.2 || 165.69 | 165.32 | -0%˄ || 6.03 | 6.04 | +0%˄ | (run time too short) |
| 2.3 || 59.98 | 59.01 | -2%˄ || 16.63 | 16.91 | +2%˄ | (run time too short) |
| 3.1 || 844.76 | 846.58 | +0%˄ || 1.18 | 1.18 | -0%˄ | (run time too short) |
| 3.2 || 157.67 | 155.21 | -2%˄ || 6.34 | 6.44 | +2%˄ | (run time too short) |
| 3.3 || 80.49 | 80.90 | +1%˄ || 12.40 | 12.34 | -1%˄ | (run time too short) |
| 3.4 || 74.98 | 74.71 | -0%˄ || 13.32 | 13.36 | +0%˄ | (run time too short) |
| 4.1 || 688.81 | 693.83 | +1%˄ || 1.45 | 1.44 | -1%˄ | (run time too short) |
| 4.2 || 387.95 | 387.67 | -0%˄ || 2.58 | 2.58 | +0%˄ | (run time too short) |
| 4.3 || 118.31 | 116.68 | -1%˄ || 8.44 | 8.56 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3198.70 | 3200.16 | +0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_77c385084b79495fa645430506d4c92457ca02f1_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | 77c385084b79495fa645430506d4c92457ca02f1-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 05:22:24 | 2024-05-28 13:14:22 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 635.76 | 658.79 | +4% || 2.08 | 2.08 | -0% | 0.3165 |
-| 1.2 || 369.90 | 390.44 | +6% || 2.09 | 2.08 | -0% | 0.2440 |
| 1.3 || 363.06 | 349.26 | -4% || 2.09 | 2.08 | -0% | 0.4024 |
| 2.1 || 1678.17 | 1675.85 | -0% || 2.08 | 2.08 | -0% | 0.9522 |
| 2.2 || 900.32 | 882.25 | -2% || 2.09 | 2.09 | +0% | 0.5303 |
| 2.3 || 329.72 | 331.01 | +0% || 2.09 | 2.09 | -0% | 0.9402 |
| 3.1 || 2563.89 | 2562.57 | -0% || 2.08 | 2.08 | +0% | 0.9721 |
| 3.2 || 823.65 | 836.64 | +2% || 2.09 | 2.08 | -0% | 0.6316 |
+| 3.3 || 441.17 | 418.15 | -5% || 2.09 | 2.08 | -0% | 0.2347 |
-| 3.4 || 415.95 | 435.77 | +5% || 2.09 | 2.08 | -0% | 0.3363 |
| 4.1 || 2276.30 | 2293.99 | +1% || 2.08 | 2.08 | +0% | 0.6526 |
| 4.2 || 1959.67 | 1932.95 | -1% || 2.08 | 2.08 | -0% | 0.5198 |
| 4.3 || 641.71 | 647.64 | +1% || 2.08 | 2.09 | +0% | 0.8040 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 13399.29 | 13415.31 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
|
System nemea - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_st.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:10:21 | 2024-05-30 09:11:35 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 6387.28 | 6287.15 | -2% || 0.16 | 0.16 | +2% | 0.5158 |
+| TPC-H 02 || 49.92 | 45.17 | -10%˄ || 20.03 | 22.14 | +11%˄ | (run time too short) |
| TPC-H 03 || 1317.25 | 1334.75 | +1% || 0.76 | 0.75 | -1% | 0.4290 |
| TPC-H 04 || 1422.93 | 1372.84 | -4% || 0.70 | 0.73 | +4% | 0.0080 |
| TPC-H 05 || 2231.55 | 2202.54 | -1% || 0.45 | 0.45 | +1% | 0.0469 |
| TPC-H 06 || 161.68 | 155.92 | -4%˄ || 6.19 | 6.41 | +4%˄ | (run time too short) |
| TPC-H 07 || 830.50 | 834.19 | +0%˄ || 1.20 | 1.20 | -0%˄ | (run time too short) |
| TPC-H 08 || 509.16 | 525.57 | +3%˄ || 1.96 | 1.90 | -3%˄ | (run time too short) |
| TPC-H 09 || 5123.82 | 5161.51 | +1% || 0.20 | 0.19 | -1% | 0.1949 |
| TPC-H 10 || 1304.80 | 1290.37 | -1% || 0.77 | 0.77 | +1% | 0.0912 |
| TPC-H 11 || 63.12 | 63.39 | +0%˄ || 15.84 | 15.77 | -0%˄ | (run time too short) |
-| TPC-H 12 || 938.48 | 1001.31 | +7%˄ || 1.07 | 1.00 | -6%˄ | (run time too short) |
| TPC-H 13 || 4874.43 | 4951.15 | +2% || 0.21 | 0.20 | -2% | 0.0392 |
| TPC-H 14 || 417.42 | 420.11 | +1%˄ || 2.40 | 2.38 | -1%˄ | (run time too short) |
| TPC-H 15 || 189.68 | 188.22 | -1%˄ || 5.27 | 5.31 | +1%˄ | (run time too short) |
| TPC-H 16 || 554.90 | 564.73 | +2%˄ || 1.80 | 1.77 | -2%˄ | (run time too short) |
| TPC-H 17 || 221.23 | 222.55 | +1%˄ || 4.52 | 4.49 | -1%˄ | (run time too short) |
-| TPC-H 18 || 1773.24 | 1859.08 | +5% || 0.56 | 0.54 | -5% | 0.0093 |
| TPC-H 19 || 217.66 | 219.99 | +1%˄ || 4.59 | 4.55 | -1%˄ | (run time too short) |
| TPC-H 20 || 541.56 | 535.42 | -1%˄ || 1.85 | 1.87 | +1%˄ | (run time too short) |
| TPC-H 21 || 3850.97 | 3966.73 | +3% || 0.26 | 0.25 | -3% | 0.0217 |
-| TPC-H 22 || 430.01 | 471.39 | +10%˄ || 2.33 | 2.12 | -9%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 33411.59 | 33674.07 | +1% || | | | |
| Geomean || | | || | | -1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -9% || Geometric mean of throughput changes: +6%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st_s01.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_st_s01.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:26:07 | 2024-05-30 09:27:31 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.30 | 5.18 | -2%˄ || 188.78 | 192.91 | +2%˄ | (run time too short) |
| TPC-H 02 || 3.84 | 3.75 | -2%˄ || 260.19 | 266.27 | +2%˄ | (run time too short) |
| TPC-H 03 || 0.57 | 0.56 | -1%˄ || 1759.12 | 1779.58 | +1%˄ | (run time too short) |
| TPC-H 04 || 0.43 | 0.43 | +0%˄ || 2310.54 | 2302.22 | -0%˄ | (run time too short) |
| TPC-H 05 || 1.02 | 0.99 | -3%˄ || 981.78 | 1011.52 | +3%˄ | (run time too short) |
| TPC-H 06 || 0.18 | 0.18 | -0%˄ || 5549.29 | 5550.24 | +0%˄ | (run time too short) |
+| TPC-H 07 || 11.78 | 10.18 | -14%˄ || 84.85 | 98.23 | +16%˄ | (run time too short) |
+| TPC-H 08 || 16.52 | 15.15 | -8%˄ || 60.51 | 65.99 | +9%˄ | (run time too short) |
+| TPC-H 09 || 4.02 | 3.38 | -16%˄ || 248.95 | 295.70 | +19%˄ | (run time too short) |
| TPC-H 10 || 0.65 | 0.64 | -1%˄ || 1538.57 | 1558.04 | +1%˄ | (run time too short) |
| TPC-H 11 || 0.20 | 0.21 | +1%˄ || 4872.99 | 4818.05 | -1%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.60 | -4%˄ || 1602.87 | 1672.41 | +4%˄ | (run time too short) |
| TPC-H 13 || 2.03 | 2.04 | +0%˄ || 491.24 | 489.65 | -0%˄ | (run time too short) |
| TPC-H 14 || 0.33 | 0.34 | +4%˄ || 3061.69 | 2941.50 | -4%˄ | (run time too short) |
+| TPC-H 15 || 1.33 | 1.23 | -8%˄ || 747.67 | 811.80 | +9%˄ | (run time too short) |
+| TPC-H 16 || 2.32 | 1.98 | -15%˄ || 430.72 | 503.81 | +17%˄ | (run time too short) |
+| TPC-H 17 || 0.75 | 0.72 | -5%˄ || 1328.46 | 1391.97 | +5%˄ | (run time too short) |
| TPC-H 18 || 1.15 | 1.14 | -1%˄ || 868.12 | 875.19 | +1%˄ | (run time too short) |
+| TPC-H 19 || 5.93 | 4.59 | -23%˄ || 168.66 | 217.65 | +29%˄ | (run time too short) |
+| TPC-H 20 || 2.80 | 2.59 | -8%˄ || 356.34 | 386.29 | +8%˄ | (run time too short) |
| TPC-H 21 || 1.11 | 1.10 | -1%˄ || 895.23 | 909.33 | +2%˄ | (run time too short) |
+| TPC-H 22 || 1.19 | 1.13 | -5%˄ || 838.53 | 883.84 | +5%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 64.08 | 58.11 | -9% || | | | |
+| Geomean || | | || | | +6% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 28 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:26:32 | 2024-05-30 09:27:56 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4679.34 | 4629.47 | -1% || 0.21 | 0.22 | +1% | 0.3548 |
+| TPC-H 02 || 65.01 | 56.24 | -13%˄ || 15.34 | 17.73 | +16%˄ | (run time too short) |
| TPC-H 03 || 585.09 | 586.13 | +0%˄ || 1.71 | 1.71 | -0%˄ | (run time too short) |
| TPC-H 04 || 528.51 | 515.41 | -2%˄ || 1.89 | 1.94 | +3%˄ | (run time too short) |
| TPC-H 05 || 506.77 | 519.72 | +3%˄ || 1.97 | 1.92 | -2%˄ | (run time too short) |
+| TPC-H 06 || 62.33 | 59.17 | -5%˄ || 16.00 | 16.87 | +5%˄ | (run time too short) |
+| TPC-H 07 || 271.05 | 258.49 | -5%˄ || 3.69 | 3.87 | +5%˄ | (run time too short) |
| TPC-H 08 || 249.12 | 246.15 | -1%˄ || 4.01 | 4.06 | +1%˄ | (run time too short) |
| TPC-H 09 || 1650.78 | 1634.87 | -1% || 0.61 | 0.61 | +1% | 0.1948 |
| TPC-H 10 || 533.24 | 536.43 | +1%˄ || 1.87 | 1.86 | -1%˄ | (run time too short) |
| TPC-H 11 || 62.89 | 65.45 | +4%˄ || 15.86 | 15.25 | -4%˄ | (run time too short) |
| TPC-H 12 || 457.78 | 454.89 | -1%˄ || 2.18 | 2.20 | +1%˄ | (run time too short) |
| TPC-H 13 || 2208.98 | 2216.64 | +0% || 0.45 | 0.45 | -0% | 0.2530 |
| TPC-H 14 || 146.10 | 143.97 | -1%˄ || 6.84 | 6.94 | +1%˄ | (run time too short) |
| TPC-H 15 || 141.87 | 138.86 | -2%˄ || 7.04 | 7.20 | +2%˄ | (run time too short) |
| TPC-H 16 || 624.99 | 618.71 | -1%˄ || 1.60 | 1.62 | +1%˄ | (run time too short) |
| TPC-H 17 || 76.27 | 73.90 | -3%˄ || 13.08 | 13.50 | +3%˄ | (run time too short) |
| TPC-H 18 || 2108.70 | 2141.39 | +2% || 0.47 | 0.47 | -2% | 0.5118 |
+| TPC-H 19 || 125.67 | 111.98 | -11%˄ || 7.95 | 8.92 | +12%˄ | (run time too short) |
| TPC-H 20 || 198.92 | 203.30 | +2%˄ || 5.02 | 4.92 | -2%˄ | (run time too short) |
| TPC-H 21 || 879.28 | 875.45 | -0%˄ || 1.14 | 1.14 | +0%˄ | (run time too short) |
| TPC-H 22 || 144.17 | 146.86 | +2%˄ || 6.93 | 6.80 | -2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 16306.89 | 16233.46 | -0% || | | | |
| Geomean || | | || | | +2% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 28 clients, 28 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:37:57 | 2024-05-30 09:39:22 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6353.79 | 6475.19 | +2% || 0.56 | 0.56 | +0% | 0.2727 |
-| TPC-H 02 || 381.64 | 403.11 | +6% || 0.56 | 0.56 | +0% | 0.8057 |
-| TPC-H 03 || 2148.14 | 2282.72 | +6% || 0.56 | 0.56 | -0% | 0.3842 |
| TPC-H 04 || 2088.48 | 2058.34 | -1% || 0.56 | 0.56 | +0% | 0.8523 |
| TPC-H 05 || 3162.43 | 3229.43 | +2% || 0.56 | 0.56 | -0% | 0.7498 |
-| TPC-H 06 || 517.79 | 748.34 | +45% || 0.56 | 0.56 | +0% | 0.0062 |
+| TPC-H 07 || 2789.55 | 2382.34 | -15% || 0.56 | 0.56 | +0% | 0.0345 |
| TPC-H 08 || 1868.80 | 1806.50 | -3% || 0.56 | 0.56 | +0% | 0.6930 |
| TPC-H 09 || 5262.56 | 5054.84 | -4% || 0.56 | 0.56 | +0% | 0.3511 |
| TPC-H 10 || 2577.21 | 2668.55 | +4% || 0.56 | 0.56 | +0% | 0.5965 |
-| TPC-H 11 || 382.07 | 560.03 | +47% || 0.56 | 0.56 | +0% | 0.0285 |
| TPC-H 12 || 2066.24 | 1980.99 | -4% || 0.56 | 0.56 | +0% | 0.5358 |
| TPC-H 13 || 4829.33 | 4838.17 | +0% || 0.56 | 0.56 | -0% | 0.9395 |
-| TPC-H 14 || 960.87 | 1017.49 | +6% || 0.56 | 0.56 | +0% | 0.6452 |
-| TPC-H 15 || 461.16 | 572.07 | +24% || 0.56 | 0.56 | +0% | 0.0314 |
+| TPC-H 16 || 1814.32 | 1693.17 | -7% || 0.56 | 0.56 | +0% | 0.3405 |
+| TPC-H 17 || 749.83 | 653.94 | -13% || 0.56 | 0.56 | +0% | 0.2752 |
| TPC-H 18 || 3487.99 | 3379.65 | -3% || 0.56 | 0.56 | +0% | 0.3616 |
-| TPC-H 19 || 836.35 | 948.78 | +13% || 0.56 | 0.56 | +0% | 0.3083 |
-| TPC-H 20 || 1462.45 | 1537.50 | +5% || 0.56 | 0.56 | +0% | 0.6097 |
| TPC-H 21 || 4678.25 | 4503.70 | -4% || 0.56 | 0.56 | +0% | 0.5147 |
| TPC-H 22 || 1028.20 | 998.02 | -3% || 0.56 | 0.56 | +0% | 0.8256 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 49907.47 | 49792.87 | -0% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_a2eb2dc2b624be46891fda0325a39c381724937f_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 02:59:37 | 2024-05-30 10:01:02 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 247.00 | 246.56 | -0%˄ || 4.05 | 4.06 | +0%˄ | (run time too short) |
| 03 || 81.27 | 81.12 | -0%˄ || 12.30 | 12.33 | +0%˄ | (run time too short) |
| 06 || 198.51 | 199.86 | +1%˄ || 5.04 | 5.00 | -1%˄ | (run time too short) |
| 07 || 311.02 | 311.06 | +0%˄ || 3.22 | 3.21 | -0%˄ | (run time too short) |
| 09 || 673.16 | 679.62 | +1%˄ || 1.49 | 1.47 | -1%˄ | (run time too short) |
| 10 || 166.72 | 165.18 | -1%˄ || 6.00 | 6.05 | +1%˄ | (run time too short) |
| 13 || 537.14 | 523.48 | -3%˄ || 1.86 | 1.91 | +3%˄ | (run time too short) |
| 15 || 114.43 | 113.17 | -1%˄ || 8.74 | 8.84 | +1%˄ | (run time too short) |
| 16 || 83.72 | 81.88 | -2%˄ || 11.94 | 12.21 | +2%˄ | (run time too short) |
+| 17 || 357.01 | 336.12 | -6%˄ || 2.80 | 2.98 | +6%˄ | (run time too short) |
| 19 || 122.47 | 118.19 | -3%˄ || 8.17 | 8.46 | +4%˄ | (run time too short) |
+| 25 || 203.40 | 191.84 | -6%˄ || 4.92 | 5.21 | +6%˄ | (run time too short) |
+| 26 || 144.79 | 137.03 | -5%˄ || 6.91 | 7.30 | +6%˄ | (run time too short) |
| 28 || 608.72 | 601.38 | -1%˄ || 1.64 | 1.66 | +1%˄ | (run time too short) |
| 29 || 496.51 | 492.67 | -1%˄ || 2.01 | 2.03 | +1%˄ | (run time too short) |
| 31 || 1348.35 | 1351.81 | +0% || 0.74 | 0.74 | -0% | 0.0741 |
+| 32 || 42.65 | 40.63 | -5%˄ || 23.45 | 24.61 | +5%˄ | (run time too short) |
| 34 || 177.88 | 172.70 | -3%˄ || 5.62 | 5.79 | +3%˄ | (run time too short) |
| 35 || 639.07 | 630.32 | -1%˄ || 1.56 | 1.59 | +1%˄ | (run time too short) |
-| 37 || 527.12 | 562.52 | +7%˄ || 1.90 | 1.78 | -6%˄ | (run time too short) |
| 39a || 1743.65 | 1757.97 | +1% || 0.57 | 0.57 | -1% | 0.1760 |
| 39b || 1695.59 | 1740.90 | +3% || 0.59 | 0.57 | -3% | 0.0001 |
| 41 || 294.19 | 294.48 | +0%˄ || 3.40 | 3.40 | -0%˄ | (run time too short) |
| 42 || 103.67 | 101.69 | -2%˄ || 9.65 | 9.83 | +2%˄ | (run time too short) |
| 43 || 979.73 | 985.03 | +1%˄ || 1.02 | 1.02 | -1%˄ | (run time too short) |
| 45 || 120.51 | 119.50 | -1%˄ || 8.30 | 8.37 | +1%˄ | (run time too short) |
| 48 || 1059.66 | 1078.30 | +2%˄ || 0.94 | 0.93 | -2%˄ | (run time too short) |
| 50 || 135.91 | 136.17 | +0%˄ || 7.36 | 7.34 | -0%˄ | (run time too short) |
| 52 || 99.25 | 98.85 | -0%˄ || 10.08 | 10.12 | +0%˄ | (run time too short) |
| 55 || 96.00 | 96.02 | +0%˄ || 10.42 | 10.41 | -0%˄ | (run time too short) |
| 62 || 531.52 | 531.03 | -0%˄ || 1.88 | 1.88 | +0%˄ | (run time too short) |
| 65 || 1771.14 | 1783.98 | +1% || 0.56 | 0.56 | -1% | 0.2477 |
| 69 || 174.40 | 174.18 | -0%˄ || 5.73 | 5.74 | +0%˄ | (run time too short) |
| 73 || 96.96 | 97.40 | +0%˄ || 10.31 | 10.27 | -0%˄ | (run time too short) |
| 79 || 493.21 | 494.28 | +0%˄ || 2.03 | 2.02 | -0%˄ | (run time too short) |
| 81 || 154.59 | 154.29 | -0%˄ || 6.47 | 6.48 | +0%˄ | (run time too short) |
| 82 || 571.21 | 589.93 | +3%˄ || 1.75 | 1.70 | -3%˄ | (run time too short) |
| 83 || 38.68 | 37.40 | -3%˄ || 25.85 | 26.74 | +3%˄ | (run time too short) |
| 84 || 13.40 | 13.67 | +2%˄ || 74.64 | 73.17 | -2%˄ | (run time too short) |
| 85 || 157.69 | 160.34 | +2%˄ || 6.34 | 6.24 | -2%˄ | (run time too short) |
| 88 || 776.45 | 789.53 | +2%˄ || 1.29 | 1.27 | -2%˄ | (run time too short) |
| 91 || 14.55 | 14.57 | +0%˄ || 68.70 | 68.61 | -0%˄ | (run time too short) |
| 92 || 30.68 | 30.57 | -0%˄ || 32.59 | 32.70 | +0%˄ | (run time too short) |
| 93 || 3870.33 | 3806.95 | -2% || 0.26 | 0.26 | +2% | 0.0000 |
| 94 || 47.24 | 47.16 | -0%˄ || 21.17 | 21.21 | +0%˄ | (run time too short) |
| 95 || 5079.59 | 5022.97 | -1% || 0.20 | 0.20 | +1% | 0.6627 |
| 96 || 78.41 | 77.53 | -1%˄ || 12.75 | 12.90 | +1%˄ | (run time too short) |
| 97 || 4324.59 | 4314.73 | -0% || 0.23 | 0.23 | +0% | 0.7721 |
| 99 || 1031.73 | 1027.94 | -0%˄ || 0.97 | 0.97 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 32665.51 | 32614.48 | -0% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:18:53 | 2024-05-30 10:20:18 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 231.02 | 231.53 | +0%˄ || 4.33 | 4.32 | -0%˄ | (run time too short) |
| 03 || 40.64 | 40.82 | +0%˄ || 24.49 | 24.38 | -0%˄ | (run time too short) |
| 06 || 194.41 | 195.51 | +1%˄ || 5.14 | 5.11 | -1%˄ | (run time too short) |
| 07 || 178.01 | 177.98 | -0%˄ || 5.61 | 5.61 | +0%˄ | (run time too short) |
| 09 || 101.92 | 100.28 | -2%˄ || 9.80 | 9.96 | +2%˄ | (run time too short) |
| 10 || 49.08 | 48.15 | -2%˄ || 20.34 | 20.72 | +2%˄ | (run time too short) |
| 13 || 259.75 | 258.75 | -0%˄ || 3.85 | 3.86 | +0%˄ | (run time too short) |
| 15 || 68.96 | 69.85 | +1%˄ || 14.47 | 14.29 | -1%˄ | (run time too short) |
| 16 || 44.53 | 44.68 | +0%˄ || 22.41 | 22.34 | -0%˄ | (run time too short) |
| 17 || 148.53 | 147.23 | -1%˄ || 6.73 | 6.79 | +1%˄ | (run time too short) |
| 19 || 71.24 | 70.85 | -1%˄ || 14.01 | 14.09 | +1%˄ | (run time too short) |
| 25 || 112.33 | 112.54 | +0%˄ || 8.89 | 8.87 | -0%˄ | (run time too short) |
| 26 || 92.67 | 93.02 | +0%˄ || 10.78 | 10.73 | -0%˄ | (run time too short) |
| 28 || 94.47 | 92.56 | -2%˄ || 10.57 | 10.79 | +2%˄ | (run time too short) |
| 29 || 402.63 | 397.37 | -1%˄ || 2.48 | 2.52 | +1%˄ | (run time too short) |
| 31 || 449.18 | 468.91 | +4%˄ || 2.23 | 2.13 | -4%˄ | (run time too short) |
| 32 || 37.90 | 37.77 | -0%˄ || 26.29 | 26.38 | +0%˄ | (run time too short) |
| 34 || 94.69 | 94.28 | -0%˄ || 10.54 | 10.59 | +0%˄ | (run time too short) |
| 35 || 370.07 | 369.28 | -0%˄ || 2.70 | 2.71 | +0%˄ | (run time too short) |
| 37 || 158.38 | 160.51 | +1%˄ || 6.31 | 6.22 | -1%˄ | (run time too short) |
| 39a || 755.09 | 757.18 | +0%˄ || 1.32 | 1.32 | -0%˄ | (run time too short) |
| 39b || 745.99 | 742.41 | -0%˄ || 1.34 | 1.35 | +0%˄ | (run time too short) |
| 41 || 357.50 | 355.64 | -1%˄ || 2.80 | 2.81 | +1%˄ | (run time too short) |
| 42 || 55.63 | 56.37 | +1%˄ || 17.92 | 17.68 | -1%˄ | (run time too short) |
| 43 || 429.64 | 427.97 | -0%˄ || 2.33 | 2.34 | +0%˄ | (run time too short) |
| 45 || 57.02 | 57.61 | +1%˄ || 17.50 | 17.32 | -1%˄ | (run time too short) |
| 48 || 438.60 | 447.26 | +2%˄ || 2.28 | 2.23 | -2%˄ | (run time too short) |
| 50 || 105.40 | 106.03 | +1%˄ || 9.47 | 9.42 | -1%˄ | (run time too short) |
| 52 || 58.70 | 59.57 | +1%˄ || 16.99 | 16.74 | -1%˄ | (run time too short) |
| 55 || 52.47 | 54.76 | +4%˄ || 19.01 | 18.20 | -4%˄ | (run time too short) |
| 62 || 318.42 | 307.43 | -3%˄ || 3.14 | 3.25 | +4%˄ | (run time too short) |
| 65 || 1479.10 | 1477.47 | -0% || 0.68 | 0.68 | +0% | 0.8498 |
| 69 || 76.56 | 75.94 | -1%˄ || 13.04 | 13.14 | +1%˄ | (run time too short) |
| 73 || 60.97 | 60.63 | -1%˄ || 16.37 | 16.46 | +1%˄ | (run time too short) |
| 79 || 432.04 | 434.40 | +1%˄ || 2.31 | 2.30 | -1%˄ | (run time too short) |
| 81 || 192.53 | 189.24 | -2%˄ || 5.19 | 5.28 | +2%˄ | (run time too short) |
| 82 || 191.62 | 192.36 | +0%˄ || 5.22 | 5.20 | -0%˄ | (run time too short) |
| 83 || 45.34 | 46.73 | +3%˄ || 21.98 | 21.33 | -3%˄ | (run time too short) |
| 84 || 16.64 | 17.15 | +3%˄ || 59.51 | 57.85 | -3%˄ | (run time too short) |
| 85 || 62.78 | 64.22 | +2%˄ || 15.89 | 15.53 | -2%˄ | (run time too short) |
| 88 || 82.30 | 81.39 | -1%˄ || 12.14 | 12.27 | +1%˄ | (run time too short) |
| 91 || 20.38 | 21.04 | +3%˄ || 48.77 | 47.26 | -3%˄ | (run time too short) |
| 92 || 37.33 | 36.00 | -4%˄ || 26.69 | 27.67 | +4%˄ | (run time too short) |
| 93 || 630.12 | 622.52 | -1%˄ || 1.59 | 1.61 | +1%˄ | (run time too short) |
| 94 || 42.65 | 42.93 | +1%˄ || 23.38 | 23.23 | -1%˄ | (run time too short) |
| 95 || 648.89 | 661.64 | +2%˄ || 1.54 | 1.51 | -2%˄ | (run time too short) |
| 96 || 53.72 | 54.32 | +1%˄ || 18.59 | 18.38 | -1%˄ | (run time too short) |
| 97 || 1484.52 | 1509.55 | +2% || 0.67 | 0.66 | -2% | 0.1794 |
| 99 || 598.80 | 602.06 | +1%˄ || 1.67 | 1.66 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 12731.18 | 12773.73 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_a2eb2dc2b624be46891fda0325a39c381724937f_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:30:45 | 2024-05-30 10:32:11 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 648.33 | 602.36 | -7% || 0.54 | 0.54 | -0% | 0.3689 |
-| 03 || 243.28 | 303.86 | +25% || 0.54 | 0.55 | +0% | 0.1411 |
| 06 || 729.26 | 722.55 | -1% || 0.54 | 0.54 | -0% | 0.9101 |
-| 07 || 826.31 | 874.21 | +6% || 0.54 | 0.55 | +0% | 0.4999 |
+| 09 || 667.05 | 633.98 | -5% || 0.54 | 0.54 | -0% | 0.5584 |
+| 10 || 712.26 | 649.69 | -9% || 0.54 | 0.54 | -0% | 0.3957 |
| 13 || 1502.90 | 1517.26 | +1% || 0.54 | 0.54 | -0% | 0.8708 |
+| 15 || 449.41 | 373.71 | -17% || 0.54 | 0.55 | +0% | 0.0918 |
+| 16 || 569.35 | 431.68 | -24% || 0.54 | 0.54 | -0% | 0.0411 |
| 17 || 1059.19 | 1059.63 | +0% || 0.54 | 0.54 | -0% | 0.9955 |
+| 19 || 624.04 | 583.73 | -6% || 0.54 | 0.54 | -0% | 0.4953 |
| 25 || 841.44 | 869.14 | +3% || 0.54 | 0.54 | -0% | 0.7067 |
+| 26 || 465.24 | 437.61 | -6% || 0.54 | 0.55 | +0% | 0.5424 |
-| 28 || 1076.88 | 1146.66 | +6% || 0.54 | 0.54 | -0% | 0.4236 |
| 29 || 1420.13 | 1397.97 | -2% || 0.54 | 0.54 | -0% | 0.8084 |
| 31 || 2052.76 | 2138.16 | +4% || 0.54 | 0.54 | -0% | 0.4415 |
-| 32 || 170.17 | 203.36 | +20% || 0.54 | 0.54 | -0% | 0.3089 |
+| 34 || 732.88 | 633.75 | -14% || 0.54 | 0.54 | -0% | 0.1299 |
| 35 || 1725.42 | 1730.57 | +0% || 0.54 | 0.54 | +0% | 0.9606 |
+| 37 || 862.66 | 821.60 | -5% || 0.54 | 0.54 | -0% | 0.5447 |
| 39a || 2265.52 | 2294.69 | +1% || 0.54 | 0.54 | -0% | 0.7507 |
| 39b || 2279.20 | 2299.80 | +1% || 0.54 | 0.54 | +0% | 0.8336 |
| 41 || 1882.63 | 1849.69 | -2% || 0.54 | 0.54 | -0% | 0.7506 |
+| 42 || 430.05 | 376.43 | -12% || 0.54 | 0.54 | -0% | 0.2054 |
| 43 || 1541.86 | 1494.43 | -3% || 0.54 | 0.54 | -0% | 0.5935 |
+| 45 || 651.85 | 555.87 | -15% || 0.54 | 0.54 | -0% | 0.0895 |
+| 48 || 2229.83 | 1950.86 | -13% || 0.54 | 0.54 | -0% | 0.0094 |
+| 50 || 928.04 | 851.25 | -8% || 0.54 | 0.54 | -0% | 0.2439 |
+| 52 || 485.17 | 410.42 | -15% || 0.54 | 0.54 | -0% | 0.2437 |
+| 55 || 385.77 | 355.97 | -8% || 0.55 | 0.54 | -0% | 0.4660 |
-| 62 || 919.69 | 1064.05 | +16% || 0.54 | 0.54 | -0% | 0.0445 |
| 65 || 3288.62 | 3354.98 | +2% || 0.54 | 0.54 | +0% | 0.3896 |
-| 69 || 862.27 | 994.11 | +15% || 0.54 | 0.54 | -0% | 0.1494 |
| 73 || 463.30 | 473.66 | +2% || 0.54 | 0.54 | -0% | 0.8269 |
+| 79 || 1471.00 | 1315.39 | -11% || 0.54 | 0.54 | -0% | 0.0398 |
-| 81 || 495.70 | 573.06 | +16% || 0.54 | 0.54 | -0% | 0.0854 |
-| 82 || 882.40 | 944.64 | +7% || 0.54 | 0.54 | +0% | 0.3578 |
+| 83 || 332.49 | 229.44 | -31% || 0.54 | 0.54 | +0% | 0.0155 |
-| 84 || 87.33 | 123.15 | +41% || 0.54 | 0.54 | -0% | 0.1496 |
-| 85 || 620.85 | 707.17 | +14% || 0.54 | 0.54 | -0% | 0.1632 |
-| 88 || 1907.52 | 2097.09 | +10% || 0.54 | 0.54 | -0% | 0.1073 |
| 91 || 160.08 | 164.34 | +3% || 0.55 | 0.54 | -0% | 0.8961 |
-| 92 || 238.91 | 302.86 | +27% || 0.55 | 0.54 | -0% | 0.1212 |
| 93 || 1737.90 | 1754.80 | +1% || 0.54 | 0.54 | -0% | 0.8308 |
| 94 || 391.89 | 377.06 | -4% || 0.54 | 0.54 | -0% | 0.7663 |
-| 95 || 1806.98 | 1955.25 | +8% || 0.54 | 0.54 | +0% | 0.0830 |
| 96 || 375.93 | 364.79 | -3% || 0.54 | 0.54 | -0% | 0.7931 |
| 97 || 3504.42 | 3508.94 | +0% || 0.54 | 0.54 | +0% | 0.9594 |
| 99 || 1263.50 | 1305.11 | +3% || 0.54 | 0.54 | -0% | 0.5066 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 51269.65 | 51180.79 | -0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -59% || Geometric mean of throughput changes: +204%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_a2eb2dc2b624be46891fda0325a39c381724937f_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:51:07 | 2024-05-30 10:52:34 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 57.77 | 27.33 | -53% || 1.62 | 5.18 | +221% | (run time too short) |
+| New-Order || 42.59 | 13.21 | -69% || 17.99 | 54.76 | +204% | 0.0000 |
+| Order-Status || 1.92 | 1.22 | -36% || 1.53 | 5.02 | +227% | (run time too short) |
+| Payment || 7.25 | 2.35 | -68% || 18.10 | 49.76 | +175% | 0.0000 |
+| Stock-Level || 3.48 | 2.02 | -42% || 1.63 | 4.83 | +196% | (run time too short) |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 113.00 | 46.13 | -59% || | | | |
+| Geomean || | | || | | +204% | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 28 clients, 10 warehouses, 28 cores (high contention) Sum of avg. item runtimes: -32% || Geometric mean of throughput changes: +60%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_highcont.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_a2eb2dc2b624be46891fda0325a39c381724937f_mt_highcont.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 03:52:14 | 2024-05-30 10:53:40 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 130.00 | 95.81 | -26% || 22.58 | 34.52 | +53% | 0.0000 |
| unsucc.: || 1.87 | 2.20 | +18% || 8.75 | 16.21 | +85% | |
+| New-Order || 78.51 | 45.04 | -43% || 263.94 | 434.32 | +65% | 0.0000 |
| unsucc.: || 6.35 | 6.33 | -0% || 86.84 | 133.57 | +54% | |
+| Order-Status || 6.28 | 5.59 | -11% || 31.31 | 50.35 | +61% | 0.0000 |
+| Payment || 14.72 | 8.92 | -39% || 188.52 | 304.90 | +62% | 0.0000 |
| unsucc.: || 2.97 | 3.20 | +8% || 147.25 | 237.81 | +61% | |
+| Stock-Level || 10.72 | 9.00 | -16% || 31.59 | 50.49 | +60% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 240.24 | 164.35 | -32% || | | | |
+| Geomean || | | || | | +60% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 28 cores (low contention) Sum of avg. item runtimes: -44% || Geometric mean of throughput changes: +101%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_lowcont.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_a2eb2dc2b624be46891fda0325a39c381724937f_mt_lowcont.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:02:23 | 2024-05-30 11:03:50 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 91.30 | 56.13 | -39% || 9.91 | 19.20 | +94% | 0.0000 |
| unsucc.: || 0.82 | 0.90 | +11% || 0.84 | 2.04 | +144% | |
+| New-Order || 64.72 | 30.94 | -52% || 108.99 | 221.47 | +103% | 0.0000 |
| unsucc.: || 4.07 | 2.96 | -27% || 10.45 | 19.70 | +88% | |
+| Order-Status || 6.84 | 5.02 | -27% || 10.51 | 21.43 | +104% | 0.0000 |
+| Payment || 19.85 | 9.12 | -54% || 88.58 | 181.18 | +105% | 0.0000 |
| unsucc.: || 2.29 | 2.14 | -6% || 25.18 | 48.19 | +91% | |
+| Stock-Level || 9.52 | 6.22 | -35% || 10.71 | 21.49 | +101% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 192.23 | 107.43 | -44% || | | | |
+| Geomean || | | || | | +101% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_a2eb2dc2b624be46891fda0325a39c381724937f_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:12:30 | 2024-05-30 11:13:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 109.76 | 111.38 | +1%˄ || 9.11 | 8.98 | -1%˄ | (run time too short) |
| 10b || 72.10 | 72.10 | -0%˄ || 13.87 | 13.87 | +0%˄ | (run time too short) |
| 10c || 333.88 | 335.79 | +1%˄ || 3.00 | 2.98 | -1%˄ | (run time too short) |
| 11a || 95.85 | 95.20 | -1%˄ || 10.43 | 10.50 | +1%˄ | (run time too short) |
| 11b || 92.10 | 90.61 | -2%˄ || 10.86 | 11.04 | +2%˄ | (run time too short) |
| 11c || 25.05 | 25.20 | +1%˄ || 39.91 | 39.68 | -1%˄ | (run time too short) |
| 11d || 27.19 | 27.11 | -0%˄ || 36.78 | 36.89 | +0%˄ | (run time too short) |
| 12a || 28.94 | 29.83 | +3%˄ || 34.55 | 33.52 | -3%˄ | (run time too short) |
| 12b || 40.16 | 40.86 | +2%˄ || 24.90 | 24.47 | -2%˄ | (run time too short) |
| 12c || 62.12 | 62.46 | +1%˄ || 16.10 | 16.01 | -1%˄ | (run time too short) |
| 13a || 192.13 | 192.51 | +0%˄ || 5.20 | 5.19 | -0%˄ | (run time too short) |
| 13b || 241.50 | 233.95 | -3%˄ || 4.14 | 4.27 | +3%˄ | (run time too short) |
| 13c || 203.00 | 196.85 | -3%˄ || 4.93 | 5.08 | +3%˄ | (run time too short) |
| 13d || 498.76 | 500.71 | +0%˄ || 2.00 | 2.00 | -0%˄ | (run time too short) |
| 14a || 99.19 | 98.96 | -0%˄ || 10.08 | 10.11 | +0%˄ | (run time too short) |
| 14b || 111.75 | 110.36 | -1%˄ || 8.95 | 9.06 | +1%˄ | (run time too short) |
| 14c || 207.52 | 205.63 | -1%˄ || 4.82 | 4.86 | +1%˄ | (run time too short) |
| 15a || 55.11 | 54.97 | -0%˄ || 18.14 | 18.19 | +0%˄ | (run time too short) |
| 15b || 55.51 | 55.55 | +0%˄ || 18.01 | 18.00 | -0%˄ | (run time too short) |
| 15c || 46.61 | 46.45 | -0%˄ || 21.45 | 21.53 | +0%˄ | (run time too short) |
| 15d || 44.02 | 44.08 | +0%˄ || 22.71 | 22.69 | -0%˄ | (run time too short) |
| 16a || 1328.35 | 1327.48 | -0% || 0.75 | 0.75 | +0% | 0.8858 |
| 16b || 2463.52 | 2425.15 | -2% || 0.41 | 0.41 | +2% | 0.0130 |
| 16c || 1506.76 | 1497.25 | -1% || 0.66 | 0.67 | +1% | 0.1572 |
| 16d || 1472.82 | 1459.41 | -1% || 0.68 | 0.69 | +1% | 0.0187 |
| 17a || 457.10 | 464.40 | +2%˄ || 2.19 | 2.15 | -2%˄ | (run time too short) |
| 17b || 375.30 | 379.90 | +1%˄ || 2.66 | 2.63 | -1%˄ | (run time too short) |
| 17c || 358.58 | 363.10 | +1%˄ || 2.79 | 2.75 | -1%˄ | (run time too short) |
| 17d || 427.90 | 433.01 | +1%˄ || 2.34 | 2.31 | -1%˄ | (run time too short) |
| 17e || 1499.49 | 1532.29 | +2% || 0.67 | 0.65 | -2% | 0.0000 |
| 17f || 876.28 | 894.42 | +2%˄ || 1.14 | 1.12 | -2%˄ | (run time too short) |
| 18a || 144.26 | 144.37 | +0%˄ || 6.93 | 6.93 | -0%˄ | (run time too short) |
| 18b || 103.88 | 104.50 | +1%˄ || 9.63 | 9.57 | -1%˄ | (run time too short) |
-| 18c || 203.00 | 222.91 | +10%˄ || 4.93 | 4.49 | -9%˄ | (run time too short) |
| 19a || 229.30 | 229.38 | +0%˄ || 4.36 | 4.36 | -0%˄ | (run time too short) |
| 19b || 191.54 | 189.24 | -1%˄ || 5.22 | 5.28 | +1%˄ | (run time too short) |
| 19c || 272.97 | 272.98 | +0%˄ || 3.66 | 3.66 | -0%˄ | (run time too short) |
| 19d || 652.88 | 657.30 | +1%˄ || 1.53 | 1.52 | -1%˄ | (run time too short) |
| 1a || 12.40 | 12.36 | -0%˄ || 80.65 | 80.91 | +0%˄ | (run time too short) |
| 1b || 14.13 | 14.08 | -0%˄ || 70.78 | 70.99 | +0%˄ | (run time too short) |
| 1c || 14.23 | 14.21 | -0%˄ || 70.26 | 70.36 | +0%˄ | (run time too short) |
| 1d || 11.87 | 11.86 | -0%˄ || 84.21 | 84.33 | +0%˄ | (run time too short) |
| 20a || 631.27 | 621.27 | -2%˄ || 1.58 | 1.61 | +2%˄ | (run time too short) |
| 20b || 664.61 | 654.55 | -2%˄ || 1.50 | 1.53 | +2%˄ | (run time too short) |
| 20c || 381.36 | 381.93 | +0%˄ || 2.62 | 2.62 | -0%˄ | (run time too short) |
| 21a || 110.15 | 109.26 | -1%˄ || 9.08 | 9.15 | +1%˄ | (run time too short) |
| 21b || 103.43 | 101.87 | -2%˄ || 9.67 | 9.82 | +2%˄ | (run time too short) |
| 21c || 113.58 | 112.12 | -1%˄ || 8.80 | 8.92 | +1%˄ | (run time too short) |
| 22a || 172.17 | 172.60 | +0%˄ || 5.81 | 5.79 | -0%˄ | (run time too short) |
| 22b || 157.87 | 155.97 | -1%˄ || 6.33 | 6.41 | +1%˄ | (run time too short) |
| 22c || 231.20 | 228.95 | -1%˄ || 4.33 | 4.37 | +1%˄ | (run time too short) |
| 22d || 348.26 | 347.91 | -0%˄ || 2.87 | 2.87 | +0%˄ | (run time too short) |
| 23a || 49.39 | 49.29 | -0%˄ || 20.25 | 20.29 | +0%˄ | (run time too short) |
| 23b || 53.83 | 53.71 | -0%˄ || 18.58 | 18.62 | +0%˄ | (run time too short) |
| 23c || 51.83 | 51.77 | -0%˄ || 19.29 | 19.31 | +0%˄ | (run time too short) |
| 24a || 225.01 | 225.44 | +0%˄ || 4.44 | 4.44 | -0%˄ | (run time too short) |
| 24b || 219.61 | 219.64 | +0%˄ || 4.55 | 4.55 | -0%˄ | (run time too short) |
| 25a || 113.58 | 113.01 | -1%˄ || 8.80 | 8.85 | +1%˄ | (run time too short) |
| 25b || 72.31 | 71.80 | -1%˄ || 13.83 | 13.93 | +1%˄ | (run time too short) |
| 25c || 254.77 | 254.78 | +0%˄ || 3.93 | 3.92 | -0%˄ | (run time too short) |
| 26a || 185.28 | 185.73 | +0%˄ || 5.40 | 5.38 | -0%˄ | (run time too short) |
| 26b || 154.00 | 154.35 | +0%˄ || 6.49 | 6.48 | -0%˄ | (run time too short) |
| 26c || 310.66 | 310.99 | +0%˄ || 3.22 | 3.22 | -0%˄ | (run time too short) |
| 27a || 105.78 | 105.74 | -0%˄ || 9.45 | 9.46 | +0%˄ | (run time too short) |
| 27b || 97.43 | 97.03 | -0%˄ || 10.26 | 10.31 | +0%˄ | (run time too short) |
| 27c || 113.67 | 112.93 | -1%˄ || 8.80 | 8.85 | +1%˄ | (run time too short) |
| 28a || 207.20 | 205.83 | -1%˄ || 4.83 | 4.86 | +1%˄ | (run time too short) |
| 28b || 65.94 | 65.67 | -0%˄ || 15.17 | 15.23 | +0%˄ | (run time too short) |
| 28c || 173.05 | 170.29 | -2%˄ || 5.78 | 5.87 | +2%˄ | (run time too short) |
| 29a || 189.26 | 189.22 | -0%˄ || 5.28 | 5.28 | +0%˄ | (run time too short) |
| 29b || 775.69 | 771.41 | -1%˄ || 1.29 | 1.30 | +1%˄ | (run time too short) |
| 29c || 226.80 | 227.55 | +0%˄ || 4.41 | 4.39 | -0%˄ | (run time too short) |
| 2a || 30.85 | 31.07 | +1%˄ || 32.41 | 32.19 | -1%˄ | (run time too short) |
| 2b || 28.94 | 29.16 | +1%˄ || 34.55 | 34.29 | -1%˄ | (run time too short) |
| 2c || 25.87 | 25.93 | +0%˄ || 38.65 | 38.56 | -0%˄ | (run time too short) |
| 2d || 53.15 | 52.42 | -1%˄ || 18.81 | 19.07 | +1%˄ | (run time too short) |
| 30a || 105.51 | 105.81 | +0%˄ || 9.48 | 9.45 | -0%˄ | (run time too short) |
| 30b || 113.64 | 110.90 | -2%˄ || 8.80 | 9.02 | +2%˄ | (run time too short) |
| 30c || 173.36 | 172.71 | -0%˄ || 5.77 | 5.79 | +0%˄ | (run time too short) |
| 31a || 92.73 | 92.56 | -0%˄ || 10.78 | 10.80 | +0%˄ | (run time too short) |
| 31b || 90.43 | 90.21 | -0%˄ || 11.06 | 11.08 | +0%˄ | (run time too short) |
| 31c || 104.74 | 104.66 | -0%˄ || 9.55 | 9.55 | +0%˄ | (run time too short) |
| 32a || 17.06 | 17.09 | +0%˄ || 58.62 | 58.52 | -0%˄ | (run time too short) |
| 32b || 33.22 | 33.23 | +0%˄ || 30.10 | 30.09 | -0%˄ | (run time too short) |
| 33a || 37.89 | 37.61 | -1%˄ || 26.39 | 26.59 | +1%˄ | (run time too short) |
| 33b || 26.07 | 26.19 | +0%˄ || 38.35 | 38.18 | -0%˄ | (run time too short) |
| 33c || 44.28 | 44.30 | +0%˄ || 22.58 | 22.57 | -0%˄ | (run time too short) |
| 3a || 60.97 | 61.42 | +1%˄ || 16.40 | 16.28 | -1%˄ | (run time too short) |
| 3b || 18.37 | 18.38 | +0%˄ || 54.42 | 54.41 | -0%˄ | (run time too short) |
| 3c || 222.94 | 223.67 | +0%˄ || 4.49 | 4.47 | -0%˄ | (run time too short) |
| 4a || 136.04 | 136.49 | +0%˄ || 7.35 | 7.33 | -0%˄ | (run time too short) |
| 4b || 17.72 | 17.80 | +0%˄ || 56.42 | 56.18 | -0%˄ | (run time too short) |
| 4c || 191.10 | 191.26 | +0%˄ || 5.23 | 5.23 | -0%˄ | (run time too short) |
| 5a || 42.91 | 42.84 | -0%˄ || 23.30 | 23.34 | +0%˄ | (run time too short) |
| 5b || 47.05 | 47.33 | +1%˄ || 21.25 | 21.13 | -1%˄ | (run time too short) |
| 5c || 88.38 | 88.29 | -0%˄ || 11.31 | 11.33 | +0%˄ | (run time too short) |
| 6a || 171.99 | 172.54 | +0%˄ || 5.81 | 5.80 | -0%˄ | (run time too short) |
| 6b || 183.07 | 183.84 | +0%˄ || 5.46 | 5.44 | -0%˄ | (run time too short) |
| 6c || 164.28 | 164.33 | +0%˄ || 6.09 | 6.09 | -0%˄ | (run time too short) |
| 6d || 384.97 | 401.20 | +4%˄ || 2.60 | 2.49 | -4%˄ | (run time too short) |
| 6e || 171.61 | 172.58 | +1%˄ || 5.83 | 5.79 | -1%˄ | (run time too short) |
| 6f || 689.02 | 691.65 | +0%˄ || 1.45 | 1.45 | -0%˄ | (run time too short) |
| 7a || 110.90 | 111.10 | +0%˄ || 9.02 | 9.00 | -0%˄ | (run time too short) |
| 7b || 104.19 | 104.45 | +0%˄ || 9.60 | 9.57 | -0%˄ | (run time too short) |
| 7c || 581.01 | 606.13 | +4%˄ || 1.72 | 1.65 | -4%˄ | (run time too short) |
| 8a || 171.53 | 172.62 | +1%˄ || 5.83 | 5.79 | -1%˄ | (run time too short) |
| 8b || 167.18 | 167.70 | +0%˄ || 5.98 | 5.96 | -0%˄ | (run time too short) |
| 8c || 1829.28 | 1858.21 | +2% || 0.55 | 0.54 | -2% | 0.0000 |
| 8d || 320.50 | 321.89 | +0%˄ || 3.12 | 3.11 | -0%˄ | (run time too short) |
| 9a || 249.99 | 248.85 | -0%˄ || 4.00 | 4.02 | +0%˄ | (run time too short) |
| 9b || 154.56 | 153.89 | -0%˄ || 6.47 | 6.50 | +0%˄ | (run time too short) |
| 9c || 276.80 | 276.41 | -0%˄ || 3.61 | 3.62 | +0%˄ | (run time too short) |
| 9d || 421.40 | 420.25 | -0%˄ || 2.37 | 2.38 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 29773.27 | 29831.68 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:37:34 | 2024-05-30 11:39:05 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 43.52 | 43.00 | -1%˄ || 22.91 | 23.20 | +1%˄ | (run time too short) |
| 10b || 25.09 | 25.18 | +0%˄ || 39.63 | 39.51 | -0%˄ | (run time too short) |
| 10c || 141.44 | 142.64 | +1%˄ || 7.06 | 7.00 | -1%˄ | (run time too short) |
| 11a || 28.34 | 28.10 | -1%˄ || 35.18 | 35.48 | +1%˄ | (run time too short) |
| 11b || 26.22 | 26.65 | +2%˄ || 38.01 | 37.37 | -2%˄ | (run time too short) |
| 11c || 30.36 | 29.83 | -2%˄ || 32.77 | 33.35 | +2%˄ | (run time too short) |
| 11d || 34.56 | 34.28 | -1%˄ || 28.80 | 29.04 | +1%˄ | (run time too short) |
| 12a || 29.49 | 29.20 | -1%˄ || 33.75 | 34.09 | +1%˄ | (run time too short) |
| 12b || 20.05 | 20.23 | +1%˄ || 49.60 | 49.12 | -1%˄ | (run time too short) |
| 12c || 60.98 | 60.54 | -1%˄ || 16.35 | 16.47 | +1%˄ | (run time too short) |
| 13a || 144.95 | 144.26 | -0%˄ || 6.89 | 6.92 | +0%˄ | (run time too short) |
| 13b || 105.79 | 107.06 | +1%˄ || 9.44 | 9.33 | -1%˄ | (run time too short) |
-| 13c || 92.96 | 100.26 | +8%˄ || 10.74 | 9.96 | -7%˄ | (run time too short) |
| 13d || 385.77 | 387.54 | +0%˄ || 2.59 | 2.58 | -0%˄ | (run time too short) |
| 14a || 61.87 | 62.58 | +1%˄ || 16.13 | 15.95 | -1%˄ | (run time too short) |
| 14b || 73.28 | 73.12 | -0%˄ || 13.63 | 13.66 | +0%˄ | (run time too short) |
| 14c || 183.69 | 184.45 | +0%˄ || 5.44 | 5.42 | -0%˄ | (run time too short) |
| 15a || 32.25 | 31.70 | -2%˄ || 30.90 | 31.44 | +2%˄ | (run time too short) |
| 15b || 29.40 | 28.88 | -2%˄ || 33.86 | 34.48 | +2%˄ | (run time too short) |
| 15c || 31.06 | 31.37 | +1%˄ || 32.02 | 31.71 | -1%˄ | (run time too short) |
| 15d || 36.06 | 36.17 | +0%˄ || 27.61 | 27.52 | -0%˄ | (run time too short) |
| 16a || 736.61 | 742.17 | +1%˄ || 1.36 | 1.35 | -1%˄ | (run time too short) |
| 16b || 1799.00 | 1795.22 | -0% || 0.56 | 0.56 | +0% | 0.6834 |
| 16c || 896.54 | 905.87 | +1%˄ || 1.12 | 1.10 | -1%˄ | (run time too short) |
| 16d || 868.49 | 874.34 | +1%˄ || 1.15 | 1.14 | -1%˄ | (run time too short) |
| 17a || 207.28 | 210.60 | +2%˄ || 4.82 | 4.75 | -2%˄ | (run time too short) |
| 17b || 182.99 | 182.28 | -0%˄ || 5.46 | 5.48 | +0%˄ | (run time too short) |
| 17c || 151.57 | 152.41 | +1%˄ || 6.59 | 6.55 | -1%˄ | (run time too short) |
| 17d || 149.77 | 149.36 | -0%˄ || 6.67 | 6.69 | +0%˄ | (run time too short) |
| 17e || 741.50 | 740.33 | -0%˄ || 1.35 | 1.35 | +0%˄ | (run time too short) |
| 17f || 331.04 | 331.19 | +0%˄ || 3.02 | 3.02 | -0%˄ | (run time too short) |
| 18a || 61.12 | 61.17 | +0%˄ || 16.33 | 16.31 | -0%˄ | (run time too short) |
| 18b || 58.60 | 58.82 | +0%˄ || 17.02 | 16.96 | -0%˄ | (run time too short) |
-| 18c || 93.22 | 131.60 | +41%˄ || 10.71 | 7.59 | -29%˄ | (run time too short) |
| 19a || 115.25 | 117.24 | +2%˄ || 8.67 | 8.52 | -2%˄ | (run time too short) |
| 19b || 77.38 | 77.36 | -0%˄ || 12.91 | 12.91 | +0%˄ | (run time too short) |
| 19c || 129.37 | 130.37 | +1%˄ || 7.72 | 7.66 | -1%˄ | (run time too short) |
| 19d || 514.03 | 513.29 | -0%˄ || 1.94 | 1.95 | +0%˄ | (run time too short) |
-| 1a || 10.44 | 11.05 | +6%˄ || 94.73 | 89.31 | -6%˄ | (run time too short) |
| 1b || 6.75 | 6.54 | -3%˄ || 145.49 | 149.95 | +3%˄ | (run time too short) |
| 1c || 6.49 | 6.51 | +0%˄ || 150.71 | 150.23 | -0%˄ | (run time too short) |
| 1d || 9.20 | 9.03 | -2%˄ || 106.99 | 109.04 | +2%˄ | (run time too short) |
| 20a || 85.75 | 86.95 | +1%˄ || 11.65 | 11.49 | -1%˄ | (run time too short) |
| 20b || 68.29 | 70.51 | +3%˄ || 14.63 | 14.16 | -3%˄ | (run time too short) |
| 20c || 86.33 | 85.78 | -1%˄ || 11.56 | 11.64 | +1%˄ | (run time too short) |
| 21a || 32.19 | 32.29 | +0%˄ || 30.94 | 30.86 | -0%˄ | (run time too short) |
| 21b || 30.45 | 30.71 | +1%˄ || 32.71 | 32.44 | -1%˄ | (run time too short) |
| 21c || 34.36 | 34.64 | +1%˄ || 29.00 | 28.76 | -1%˄ | (run time too short) |
| 22a || 69.71 | 70.27 | +1%˄ || 14.31 | 14.20 | -1%˄ | (run time too short) |
| 22b || 59.51 | 59.70 | +0%˄ || 16.77 | 16.72 | -0%˄ | (run time too short) |
| 22c || 137.06 | 137.29 | +0%˄ || 7.29 | 7.28 | -0%˄ | (run time too short) |
| 22d || 241.44 | 246.89 | +2%˄ || 4.14 | 4.05 | -2%˄ | (run time too short) |
| 23a || 24.63 | 24.55 | -0%˄ || 40.39 | 40.52 | +0%˄ | (run time too short) |
| 23b || 33.43 | 32.46 | -3%˄ || 29.80 | 30.73 | +3%˄ | (run time too short) |
| 23c || 26.15 | 26.46 | +1%˄ || 38.09 | 37.61 | -1%˄ | (run time too short) |
| 24a || 68.88 | 68.46 | -1%˄ || 14.49 | 14.58 | +1%˄ | (run time too short) |
| 24b || 62.05 | 62.23 | +0%˄ || 16.08 | 16.03 | -0%˄ | (run time too short) |
| 25a || 60.42 | 60.33 | -0%˄ || 16.51 | 16.53 | +0%˄ | (run time too short) |
| 25b || 39.18 | 39.49 | +1%˄ || 25.43 | 25.23 | -1%˄ | (run time too short) |
| 25c || 163.24 | 161.29 | -1%˄ || 6.12 | 6.19 | +1%˄ | (run time too short) |
| 26a || 92.15 | 91.99 | -0%˄ || 10.83 | 10.85 | +0%˄ | (run time too short) |
| 26b || 71.19 | 70.95 | -0%˄ || 14.02 | 14.07 | +0%˄ | (run time too short) |
| 26c || 150.15 | 150.28 | +0%˄ || 6.65 | 6.65 | -0%˄ | (run time too short) |
| 27a || 30.81 | 30.70 | -0%˄ || 32.33 | 32.45 | +0%˄ | (run time too short) |
| 27b || 30.74 | 30.69 | -0%˄ || 32.43 | 32.44 | +0%˄ | (run time too short) |
| 27c || 34.27 | 35.02 | +2%˄ || 29.09 | 28.44 | -2%˄ | (run time too short) |
| 28a || 150.50 | 150.24 | -0%˄ || 6.64 | 6.65 | +0%˄ | (run time too short) |
| 28b || 34.41 | 35.11 | +2%˄ || 28.96 | 28.39 | -2%˄ | (run time too short) |
| 28c || 120.07 | 119.45 | -1%˄ || 8.32 | 8.36 | +1%˄ | (run time too short) |
| 29a || 64.30 | 64.08 | -0%˄ || 15.52 | 15.58 | +0%˄ | (run time too short) |
| 29b || 109.23 | 110.22 | +1%˄ || 9.15 | 9.06 | -1%˄ | (run time too short) |
| 29c || 67.90 | 67.74 | -0%˄ || 14.69 | 14.73 | +0%˄ | (run time too short) |
| 2a || 31.36 | 30.55 | -3%˄ || 31.76 | 32.60 | +3%˄ | (run time too short) |
+| 2b || 30.22 | 27.89 | -8%˄ || 32.92 | 35.71 | +8%˄ | (run time too short) |
| 2c || 22.46 | 23.21 | +3%˄ || 44.25 | 42.75 | -3%˄ | (run time too short) |
-| 2d || 55.65 | 58.28 | +5%˄ || 17.92 | 17.11 | -5%˄ | (run time too short) |
| 30a || 54.46 | 53.75 | -1%˄ || 18.31 | 18.55 | +1%˄ | (run time too short) |
| 30b || 45.50 | 44.88 | -1%˄ || 21.92 | 22.22 | +1%˄ | (run time too short) |
| 30c || 113.09 | 113.21 | +0%˄ || 8.83 | 8.82 | -0%˄ | (run time too short) |
| 31a || 40.94 | 40.71 | -1%˄ || 24.34 | 24.48 | +1%˄ | (run time too short) |
| 31b || 39.52 | 39.53 | +0%˄ || 25.22 | 25.21 | -0%˄ | (run time too short) |
| 31c || 46.39 | 47.02 | +1%˄ || 21.49 | 21.21 | -1%˄ | (run time too short) |
| 32a || 11.52 | 11.48 | -0%˄ || 85.66 | 85.86 | +0%˄ | (run time too short) |
-| 32b || 38.14 | 40.20 | +5%˄ || 26.12 | 24.78 | -5%˄ | (run time too short) |
| 33a || 16.43 | 15.96 | -3%˄ || 60.31 | 62.14 | +3%˄ | (run time too short) |
| 33b || 13.86 | 14.05 | +1%˄ || 71.39 | 70.40 | -1%˄ | (run time too short) |
| 33c || 24.00 | 23.62 | -2%˄ || 41.42 | 42.09 | +2%˄ | (run time too short) |
| 3a || 43.46 | 42.81 | -1%˄ || 22.93 | 23.29 | +2%˄ | (run time too short) |
| 3b || 10.74 | 10.88 | +1%˄ || 91.93 | 90.61 | -1%˄ | (run time too short) |
| 3c || 87.16 | 86.00 | -1%˄ || 11.45 | 11.60 | +1%˄ | (run time too short) |
| 4a || 78.92 | 77.67 | -2%˄ || 12.64 | 12.85 | +2%˄ | (run time too short) |
| 4b || 8.77 | 9.05 | +3%˄ || 112.34 | 108.88 | -3%˄ | (run time too short) |
| 4c || 98.46 | 95.72 | -3%˄ || 10.14 | 10.43 | +3%˄ | (run time too short) |
| 5a || 33.91 | 34.20 | +1%˄ || 29.36 | 29.12 | -1%˄ | (run time too short) |
| 5b || 27.62 | 27.63 | +0%˄ || 36.02 | 36.00 | -0%˄ | (run time too short) |
| 5c || 53.73 | 54.12 | +1%˄ || 18.57 | 18.43 | -1%˄ | (run time too short) |
| 6a || 33.05 | 33.10 | +0%˄ || 30.18 | 30.14 | -0%˄ | (run time too short) |
| 6b || 57.92 | 56.74 | -2%˄ || 17.24 | 17.60 | +2%˄ | (run time too short) |
| 6c || 31.48 | 31.48 | +0%˄ || 31.70 | 31.69 | -0%˄ | (run time too short) |
| 6d || 159.74 | 160.51 | +0%˄ || 6.26 | 6.23 | -0%˄ | (run time too short) |
| 6e || 33.08 | 33.16 | +0%˄ || 30.16 | 30.08 | -0%˄ | (run time too short) |
| 6f || 482.61 | 481.64 | -0%˄ || 2.07 | 2.08 | +0%˄ | (run time too short) |
| 7a || 34.32 | 33.52 | -2%˄ || 29.05 | 29.73 | +2%˄ | (run time too short) |
| 7b || 33.43 | 33.09 | -1%˄ || 29.80 | 30.11 | +1%˄ | (run time too short) |
| 7c || 315.37 | 319.19 | +1%˄ || 3.17 | 3.13 | -1%˄ | (run time too short) |
| 8a || 40.87 | 40.92 | +0%˄ || 24.38 | 24.34 | -0%˄ | (run time too short) |
| 8b || 37.41 | 37.55 | +0%˄ || 26.65 | 26.55 | -0%˄ | (run time too short) |
| 8c || 1188.09 | 1181.69 | -1%˄ || 0.84 | 0.85 | +1%˄ | 0.1455 |
| 8d || 245.94 | 242.78 | -1%˄ || 4.06 | 4.12 | +1%˄ | (run time too short) |
| 9a || 147.45 | 147.44 | -0%˄ || 6.78 | 6.78 | +0%˄ | (run time too short) |
| 9b || 84.10 | 85.15 | +1%˄ || 11.87 | 11.73 | -1%˄ | (run time too short) |
| 9c || 145.55 | 144.91 | -0%˄ || 6.86 | 6.89 | +0%˄ | (run time too short) |
| 9d || 342.04 | 340.07 | -1%˄ || 2.92 | 2.94 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15481.26 | 15545.94 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_a2eb2dc2b624be46891fda0325a39c381724937f_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 04:52:59 | 2024-05-30 11:54:33 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 201.87 | 188.30 | -7% || 0.60 | 0.60 | -0% | 0.5919 |
| 10b || 156.36 | 161.31 | +3% || 0.60 | 0.60 | -1% | 0.8453 |
| 10c || 503.76 | 517.63 | +3% || 0.60 | 0.60 | -0% | 0.7242 |
+| 11a || 123.72 | 115.51 | -7% || 0.60 | 0.60 | -0% | 0.6643 |
+| 11b || 122.03 | 115.48 | -5% || 0.60 | 0.60 | -0% | 0.7348 |
| 11c || 80.61 | 79.23 | -2% || 0.60 | 0.60 | -0% | 0.8942 |
-| 11d || 89.81 | 97.76 | +9% || 0.60 | 0.60 | -0% | 0.5735 |
| 12a || 153.61 | 148.99 | -3% || 0.60 | 0.60 | -0% | 0.8169 |
-| 12b || 78.80 | 96.84 | +23% || 0.60 | 0.60 | -1% | 0.1694 |
-| 12c || 290.45 | 370.64 | +28% || 0.60 | 0.60 | -0% | 0.0099 |
+| 13a || 472.41 | 429.70 | -9% || 0.60 | 0.60 | -0% | 0.2085 |
-| 13b || 270.24 | 317.66 | +18% || 0.60 | 0.60 | -0% | 0.0647 |
+| 13c || 320.99 | 260.78 | -19% || 0.60 | 0.60 | -0% | 0.0249 |
| 13d || 814.80 | 836.99 | +3% || 0.60 | 0.60 | -1% | 0.5730 |
+| 14a || 397.71 | 369.14 | -7% || 0.60 | 0.60 | -1% | 0.4382 |
+| 14b || 386.85 | 316.35 | -18% || 0.60 | 0.60 | -0% | 0.0119 |
-| 14c || 509.83 | 563.32 | +10% || 0.60 | 0.60 | -0% | 0.1848 |
| 15a || 121.52 | 125.60 | +3% || 0.60 | 0.60 | -0% | 0.8317 |
+| 15b || 126.00 | 101.50 | -19% || 0.60 | 0.60 | -0% | 0.1377 |
-| 15c || 118.60 | 150.00 | +26% || 0.60 | 0.60 | -0% | 0.1441 |
+| 15d || 158.04 | 138.40 | -12% || 0.60 | 0.60 | -0% | 0.2705 |
| 16a || 1476.83 | 1425.11 | -4% || 0.60 | 0.60 | -0% | 0.3019 |
| 16b || 2820.26 | 2842.34 | +1% || 0.60 | 0.60 | -0% | 0.6982 |
| 16c || 1662.80 | 1676.45 | +1% || 0.60 | 0.60 | -0% | 0.8125 |
| 16d || 1572.09 | 1578.13 | +0% || 0.60 | 0.60 | -0% | 0.9065 |
+| 17a || 794.16 | 740.39 | -7% || 0.60 | 0.60 | -0% | 0.2378 |
| 17b || 556.42 | 574.64 | +3% || 0.60 | 0.60 | -0% | 0.5998 |
+| 17c || 563.26 | 534.24 | -5% || 0.60 | 0.60 | -1% | 0.4212 |
-| 17d || 547.32 | 609.86 | +11% || 0.60 | 0.60 | -0% | 0.1020 |
| 17e || 1464.06 | 1440.47 | -2% || 0.60 | 0.60 | -0% | 0.6163 |
-| 17f || 1000.05 | 1096.66 | +10% || 0.60 | 0.60 | -0% | 0.0763 |
+| 18a || 296.36 | 223.34 | -25% || 0.60 | 0.60 | -0% | 0.0098 |
| 18b || 375.32 | 375.88 | +0% || 0.60 | 0.60 | -0% | 0.9876 |
-| 18c || 531.51 | 632.65 | +19% || 0.60 | 0.60 | -1% | 0.0385 |
| 19a || 552.00 | 531.61 | -4% || 0.60 | 0.60 | -1% | 0.6341 |
-| 19b || 339.56 | 379.48 | +12% || 0.60 | 0.60 | -0% | 0.1853 |
-| 19c || 575.40 | 633.76 | +10% || 0.60 | 0.60 | -0% | 0.1574 |
| 19d || 1293.44 | 1280.03 | -1% || 0.60 | 0.60 | -1% | 0.7839 |
-| 1a || 35.95 | 52.95 | +47% || 0.60 | 0.60 | -1% | 0.1091 |
+| 1b || 48.35 | 36.00 | -26% || 0.60 | 0.60 | -0% | 0.1797 |
-| 1c || 38.80 | 56.06 | +44% || 0.60 | 0.60 | -0% | 0.1297 |
+| 1d || 35.66 | 31.43 | -12% || 0.60 | 0.60 | -0% | 0.4745 |
| 20a || 434.63 | 437.17 | +1% || 0.60 | 0.60 | -0% | 0.9502 |
| 20b || 377.28 | 387.51 | +3% || 0.60 | 0.60 | -0% | 0.7672 |
| 20c || 368.87 | 369.78 | +0% || 0.60 | 0.60 | -0% | 0.9784 |
+| 21a || 201.18 | 172.00 | -15% || 0.60 | 0.60 | -1% | 0.2452 |
-| 21b || 140.13 | 155.10 | +11% || 0.60 | 0.60 | -0% | 0.5252 |
| 21c || 183.02 | 190.33 | +4% || 0.60 | 0.60 | -0% | 0.7752 |
| 22a || 413.73 | 418.13 | +1% || 0.60 | 0.60 | -1% | 0.9001 |
+| 22b || 359.16 | 342.13 | -5% || 0.60 | 0.60 | -0% | 0.6142 |
-| 22c || 516.15 | 556.69 | +8% || 0.60 | 0.60 | -1% | 0.2961 |
| 22d || 744.10 | 742.58 | -0% || 0.60 | 0.60 | -0% | 0.9729 |
-| 23a || 132.07 | 178.19 | +35% || 0.60 | 0.60 | -0% | 0.0485 |
| 23b || 134.66 | 137.72 | +2% || 0.60 | 0.60 | -0% | 0.8944 |
-| 23c || 156.35 | 172.58 | +10% || 0.60 | 0.60 | -1% | 0.5104 |
-| 24a || 408.61 | 437.35 | +7% || 0.60 | 0.60 | -0% | 0.4828 |
+| 24b || 292.99 | 275.43 | -6% || 0.60 | 0.60 | -0% | 0.5731 |
| 25a || 384.33 | 368.38 | -4% || 0.60 | 0.60 | -0% | 0.6653 |
| 25b || 216.24 | 214.52 | -1% || 0.60 | 0.60 | -0% | 0.9537 |
+| 25c || 834.05 | 752.45 | -10% || 0.60 | 0.60 | -0% | 0.0762 |
-| 26a || 368.41 | 403.16 | +9% || 0.60 | 0.60 | -0% | 0.2995 |
-| 26b || 214.47 | 246.65 | +15% || 0.60 | 0.60 | -0% | 0.1641 |
+| 26c || 582.66 | 538.61 | -8% || 0.60 | 0.60 | -0% | 0.2903 |
+| 27a || 178.15 | 164.83 | -7% || 0.60 | 0.60 | -0% | 0.5750 |
+| 27b || 190.05 | 157.89 | -17% || 0.60 | 0.60 | -0% | 0.2039 |
| 27c || 193.84 | 191.65 | -1% || 0.60 | 0.60 | -1% | 0.9347 |
-| 28a || 555.27 | 597.57 | +8% || 0.60 | 0.60 | -0% | 0.3590 |
-| 28b || 207.28 | 242.71 | +17% || 0.60 | 0.60 | -0% | 0.1882 |
+| 28c || 577.94 | 507.98 | -12% || 0.60 | 0.60 | -0% | 0.0717 |
-| 29a || 255.88 | 309.59 | +21% || 0.60 | 0.60 | -0% | 0.0496 |
| 29b || 346.98 | 354.70 | +2% || 0.60 | 0.60 | -1% | 0.8010 |
+| 29c || 377.85 | 320.16 | -15% || 0.60 | 0.60 | -1% | 0.0853 |
+| 2a || 140.29 | 130.79 | -7% || 0.60 | 0.60 | -0% | 0.6329 |
-| 2b || 107.78 | 124.91 | +16% || 0.60 | 0.60 | -0% | 0.2782 |
+| 2c || 97.08 | 89.73 | -8% || 0.60 | 0.60 | -0% | 0.5797 |
-| 2d || 193.77 | 205.91 | +6% || 0.60 | 0.60 | -0% | 0.5826 |
| 30a || 331.31 | 335.39 | +1% || 0.60 | 0.60 | -1% | 0.9091 |
| 30b || 300.64 | 308.81 | +3% || 0.60 | 0.60 | -0% | 0.7945 |
| 30c || 641.58 | 660.00 | +3% || 0.60 | 0.60 | -0% | 0.7057 |
-| 31a || 252.20 | 268.81 | +7% || 0.60 | 0.60 | -0% | 0.5611 |
-| 31b || 205.02 | 230.99 | +13% || 0.60 | 0.60 | -1% | 0.3801 |
+| 31c || 278.59 | 243.44 | -13% || 0.60 | 0.60 | -0% | 0.2013 |
+| 32a || 66.18 | 43.66 | -34% || 0.60 | 0.60 | -0% | 0.0752 |
-| 32b || 145.10 | 156.81 | +8% || 0.60 | 0.60 | -0% | 0.5404 |
| 33a || 124.14 | 122.81 | -1% || 0.60 | 0.60 | -0% | 0.9467 |
+| 33b || 88.89 | 74.30 | -16% || 0.60 | 0.60 | -0% | 0.2369 |
+| 33c || 204.13 | 126.97 | -38% || 0.60 | 0.60 | -0% | 0.0023 |
| 3a || 235.57 | 229.43 | -3% || 0.60 | 0.60 | -1% | 0.8325 |
-| 3b || 70.83 | 90.60 | +28% || 0.60 | 0.60 | -1% | 0.2329 |
| 3c || 362.81 | 347.64 | -4% || 0.60 | 0.60 | -0% | 0.6539 |
+| 4a || 233.45 | 220.63 | -5% || 0.60 | 0.60 | -0% | 0.5940 |
-| 4b || 50.13 | 70.88 | +41% || 0.60 | 0.60 | -0% | 0.1403 |
+| 4c || 310.51 | 278.50 | -10% || 0.60 | 0.60 | -0% | 0.2828 |
+| 5a || 219.17 | 180.54 | -18% || 0.60 | 0.60 | -0% | 0.1804 |
+| 5b || 145.02 | 110.10 | -24% || 0.60 | 0.60 | -0% | 0.0415 |
-| 5c || 241.59 | 269.91 | +12% || 0.60 | 0.60 | -0% | 0.2468 |
| 6a || 148.20 | 149.70 | +1% || 0.60 | 0.60 | -0% | 0.9364 |
| 6b || 163.96 | 170.52 | +4% || 0.60 | 0.60 | -0% | 0.6915 |
| 6c || 114.91 | 112.07 | -2% || 0.60 | 0.60 | -0% | 0.8384 |
| 6d || 500.19 | 516.98 | +3% || 0.60 | 0.60 | -0% | 0.6249 |
+| 6e || 180.94 | 172.50 | -5% || 0.60 | 0.60 | -0% | 0.7450 |
| 6f || 1039.49 | 1032.26 | -1% || 0.60 | 0.60 | -0% | 0.8628 |
+| 7a || 212.91 | 179.24 | -16% || 0.60 | 0.60 | -0% | 0.2494 |
| 7b || 152.71 | 148.59 | -3% || 0.60 | 0.60 | -0% | 0.8530 |
-| 7c || 984.34 | 1074.08 | +9% || 0.60 | 0.60 | -0% | 0.0679 |
| 8a || 195.45 | 203.44 | +4% || 0.60 | 0.60 | -0% | 0.7519 |
+| 8b || 192.66 | 164.49 | -15% || 0.60 | 0.60 | -0% | 0.2690 |
| 8c || 1957.65 | 1969.99 | +1% || 0.60 | 0.60 | -0% | 0.7688 |
-| 8d || 570.02 | 609.21 | +7% || 0.60 | 0.60 | -0% | 0.2427 |
+| 9a || 593.06 | 564.93 | -5% || 0.60 | 0.60 | -0% | 0.4854 |
| 9b || 411.76 | 403.64 | -2% || 0.60 | 0.60 | -1% | 0.8080 |
-| 9c || 601.59 | 646.40 | +7% || 0.60 | 0.60 | -0% | 0.3291 |
| 9d || 998.65 | 966.27 | -3% || 0.60 | 0.60 | -0% | 0.4832 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 46488.20 | 46602.01 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_st.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_a2eb2dc2b624be46891fda0325a39c381724937f_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 05:13:25 | 2024-05-30 12:15:01 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 320.48 | 332.06 | +4%˄ || 3.12 | 3.01 | -3%˄ | (run time too short) |
| 1.2 || 153.47 | 153.39 | -0%˄ || 6.52 | 6.52 | +0%˄ | (run time too short) |
| 1.3 || 152.66 | 150.23 | -2%˄ || 6.55 | 6.66 | +2%˄ | (run time too short) |
| 2.1 || 555.85 | 557.76 | +0%˄ || 1.80 | 1.79 | -0%˄ | (run time too short) |
| 2.2 || 295.25 | 296.21 | +0%˄ || 3.39 | 3.38 | -0%˄ | (run time too short) |
| 2.3 || 200.04 | 201.11 | +1%˄ || 5.00 | 4.97 | -1%˄ | (run time too short) |
| 3.1 || 2977.48 | 2937.01 | -1% || 0.34 | 0.34 | +1% | 0.2712 |
| 3.2 || 300.65 | 299.49 | -0%˄ || 3.33 | 3.34 | +0%˄ | (run time too short) |
| 3.3 || 153.28 | 152.39 | -1%˄ || 6.52 | 6.56 | +1%˄ | (run time too short) |
| 3.4 || 144.85 | 144.74 | -0%˄ || 6.90 | 6.91 | +0%˄ | (run time too short) |
| 4.1 || 2941.64 | 2929.73 | -0% || 0.34 | 0.34 | +0% | 0.6826 |
| 4.2 || 891.86 | 869.85 | -2%˄ || 1.12 | 1.15 | +3%˄ | (run time too short) |
| 4.3 || 273.38 | 272.79 | -0%˄ || 3.66 | 3.67 | +0%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 9360.89 | 9296.75 | -1% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 05:19:01 | 2024-05-30 12:20:36 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 104.54 | 103.48 | -1%˄ || 9.55 | 9.65 | +1%˄ | (run time too short) |
| 1.2 || 88.78 | 89.32 | +1%˄ || 11.24 | 11.17 | -1%˄ | (run time too short) |
| 1.3 || 85.48 | 84.63 | -1%˄ || 11.68 | 11.79 | +1%˄ | (run time too short) |
| 2.1 || 341.28 | 341.93 | +0%˄ || 2.93 | 2.92 | -0%˄ | (run time too short) |
| 2.2 || 165.69 | 165.41 | -0%˄ || 6.03 | 6.04 | +0%˄ | (run time too short) |
| 2.3 || 59.98 | 59.76 | -0%˄ || 16.63 | 16.69 | +0%˄ | (run time too short) |
| 3.1 || 844.76 | 844.22 | -0%˄ || 1.18 | 1.18 | +0%˄ | (run time too short) |
| 3.2 || 157.67 | 157.40 | -0%˄ || 6.34 | 6.35 | +0%˄ | (run time too short) |
| 3.3 || 80.49 | 80.22 | -0%˄ || 12.40 | 12.44 | +0%˄ | (run time too short) |
| 3.4 || 74.98 | 75.61 | +1%˄ || 13.32 | 13.20 | -1%˄ | (run time too short) |
| 4.1 || 688.81 | 694.71 | +1%˄ || 1.45 | 1.44 | -1%˄ | (run time too short) |
| 4.2 || 387.95 | 386.13 | -0%˄ || 2.58 | 2.59 | +0%˄ | (run time too short) |
| 4.3 || 118.31 | 115.10 | -3%˄ || 8.44 | 8.68 | +3%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3198.70 | 3197.92 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_a2eb2dc2b624be46891fda0325a39c381724937f_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-28 05:22:24 | 2024-05-30 12:23:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 635.76 | 648.65 | +2% || 2.08 | 2.09 | +0% | 0.5716 |
-| 1.2 || 369.90 | 398.49 | +8% || 2.09 | 2.09 | +0% | 0.1153 |
| 1.3 || 363.06 | 374.05 | +3% || 2.09 | 2.09 | +0% | 0.5679 |
| 2.1 || 1678.17 | 1694.17 | +1% || 2.08 | 2.09 | +0% | 0.6879 |
| 2.2 || 900.32 | 876.92 | -3% || 2.09 | 2.09 | +0% | 0.4010 |
+| 2.3 || 329.72 | 311.10 | -6% || 2.09 | 2.09 | +0% | 0.2637 |
| 3.1 || 2563.89 | 2576.56 | +0% || 2.08 | 2.08 | +0% | 0.7431 |
| 3.2 || 823.65 | 818.67 | -1% || 2.09 | 2.09 | +0% | 0.8566 |
| 3.3 || 441.17 | 448.22 | +2% || 2.09 | 2.09 | +0% | 0.7374 |
| 3.4 || 415.95 | 413.75 | -1% || 2.09 | 2.09 | -0% | 0.9160 |
| 4.1 || 2276.30 | 2255.55 | -1% || 2.08 | 2.08 | +0% | 0.5939 |
| 4.2 || 1959.67 | 1948.75 | -1% || 2.08 | 2.08 | +0% | 0.7937 |
| 4.3 || 641.71 | 627.88 | -2% || 2.08 | 2.09 | +0% | 0.5682 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 13399.29 | 13392.77 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
|
I'm currently re-running all benchmarks with pipeline metrics (no SQL caches) again. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
#2626 showed that we spend long times in the optimizer, especially during cardinality estimation. We do not really see this issue in our benchmarks because we do not have changing query templates in TPC-DS and JOB. Instead, we retrieve the chached plans and do not measure optimization overhead.
This PR reduces these runtimes by addressing multiple issues:
CardinalityEstimatorcaches statistics internally. This is useful when we have diamonds.AttributeStatisticscreated during estimation are constant. Instead of copying unmodified statistics, we reuse them.ScaledHistogramreferences the original histogram and recalculates the counts on request using the selctivity used for scaling.There are still bottlenecks during optimization, often by the shere amount of calls to
AttributeStatistics::scaled()and by join ordering (MANY candidates and building new histograms for joins).Benchmarks (
benchmark_all.sh)See #2642 (comment).
Benchmarks (with
--pipeline_metrics, i.e., no plan caching)System
nemea - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_st_metrics.json | +--------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 02:30:03 | 2024-05-31 06:53:03 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +--------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -8% || Geometric mean of throughput changes: +7%
Configuration Overview - click to expand
+Configuration Overview----+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_st_s01_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_st_s01_metrics.json | +--------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 02:45:48 | 2024-05-31 07:08:56 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | scale_factor | 0.009999999776482582 | 0.009999999776482582 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +--------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 28 cores, SF 10.0
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered_metrics.json | +-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 02:46:15 | 2024-05-31 07:09:23 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 28 clients, 28 cores, SF 10.0
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_804f9ed10d7ee197868614287ec5403b3728c205_mt_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCH_a2eb2dc2b624be46891fda0325a39c381724937f_mt_metrics.json | +-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 28 | 28 | | clustering | None | None | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 02:57:37 | 2024-05-31 07:20:43 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +3%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_st_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_a2eb2dc2b624be46891fda0325a39c381724937f_st_metrics.json | +-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 03:19:15 | 2024-05-31 07:42:24 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 28 cores
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +6%
Configuration Overview - click to expand
+Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered_metrics.json | +-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 03:40:27 | 2024-05-31 08:02:57 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 28 clients, 28 cores
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +3%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_804f9ed10d7ee197868614287ec5403b3728c205_mt_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCDS_a2eb2dc2b624be46891fda0325a39c381724937f_mt_metrics.json | +-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 28 | 28 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 03:55:01 | 2024-05-31 08:16:42 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: -55% || Geometric mean of throughput changes: +179%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_st_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_a2eb2dc2b624be46891fda0325a39c381724937f_st_metrics.json | +-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-06-03 13:38:50 | 2024-06-03 13:40:35 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | -1 | -1 | | scale_factor | 10 | 10 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 28 clients, 10 warehouses, 28 cores (high contention)
Sum of avg. item runtimes: -26% || Geometric mean of throughput changes: +49%
Configuration Overview - click to expand
+Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_highcont_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_a2eb2dc2b624be46891fda0325a39c381724937f_mt_highcont_metrics.json | +-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 28 | 28 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 04:15:25 | 2024-05-31 08:37:06 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 600000000000 | 600000000000 | | max_runs | -1 | -1 | | scale_factor | 10 | 10 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 28 cores (low contention)
Sum of avg. item runtimes: -42% || Geometric mean of throughput changes: +99%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_804f9ed10d7ee197868614287ec5403b3728c205_mt_lowcont_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkTPCC_a2eb2dc2b624be46891fda0325a39c381724937f_mt_lowcont_metrics.json | +-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 10 | 10 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 04:33:36 | 2024-05-31 08:59:11 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 600000000000 | 600000000000 | | max_runs | -1 | -1 | | scale_factor | 10 | 10 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: -11% || Geometric mean of throughput changes: +16%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_st_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_a2eb2dc2b624be46891fda0325a39c381724937f_st_metrics.json | +-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 04:46:53 | 2024-05-31 09:15:24 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 28 cores
Sum of avg. item runtimes: -18% || Geometric mean of throughput changes: +23%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered_metrics.json | +-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 05:24:49 | 2024-05-31 09:49:25 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 28 clients, 28 cores
Sum of avg. item runtimes: -12% || Geometric mean of throughput changes: +14%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_804f9ed10d7ee197868614287ec5403b3728c205_mt_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkJoinOrder_a2eb2dc2b624be46891fda0325a39c381724937f_mt_metrics.json | +-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 28 | 28 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 05:56:52 | 2024-05-31 10:16:32 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_st_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_a2eb2dc2b624be46891fda0325a39c381724937f_st_metrics.json | +-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 06:17:21 | 2024-05-31 10:37:00 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 28 cores
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt_ordered_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_a2eb2dc2b624be46891fda0325a39c381724937f_mt_ordered_metrics.json | +-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 06:23:00 | 2024-05-31 10:42:41 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 50 | 50 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 28 clients, 28 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ | Parameter | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_804f9ed10d7ee197868614287ec5403b3728c205_mt_metrics.json | /home/Daniel.Lindner/hyrise/clang15-release/benchmark_all_results/hyriseBenchmarkStarSchema_a2eb2dc2b624be46891fda0325a39c381724937f_mt_metrics.json | +-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 804f9ed10d7ee197868614287ec5403b3728c205-dirty | a2eb2dc2b624be46891fda0325a39c381724937f-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 28 | 28 | | compiler | clang 15.0.7 | clang 15.0.7 | | cores | 28 | 28 | | data_preparation_cores | 0 | 0 | | date | 2024-05-31 06:26:34 | 2024-05-31 10:46:13 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [0, 0, 28] | [0, 0, 28] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+