Skip to content

Commit b4bbff4

Browse files
dongjoon-hyundongjoon-hyun
committed
[SPARK-29320][TESTS] Compare sql/core module in JDK8/11 (Part 1)
1 parent 3b1674c commit b4bbff4

File tree

48 files changed

+1675
-3064
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

48 files changed

+1675
-3064
lines changed

‎sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt

Lines changed: 143 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,143 @@
1+
================================================================================================
2+
aggregate without grouping
3+
================================================================================================
4+
5+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
6+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7+
agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
8+
------------------------------------------------------------------------------------------------------------------------
9+
agg w/o group wholestage off 55644 59484 NaN 37.7 26.5 1.0X
10+
agg w/o group wholestage on 896 906 8 2340.7 0.4 62.1X
11+
12+
13+
================================================================================================
14+
stat functions
15+
================================================================================================
16+
17+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
18+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
19+
stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
20+
------------------------------------------------------------------------------------------------------------------------
21+
stddev wholestage off 8655 9022 519 12.1 82.5 1.0X
22+
stddev wholestage on 1306 1323 13 80.3 12.5 6.6X
23+
24+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
25+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
26+
kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
27+
------------------------------------------------------------------------------------------------------------------------
28+
kurtosis wholestage off 40795 41041 349 2.6 389.0 1.0X
29+
kurtosis wholestage on 1441 1468 22 72.8 13.7 28.3X
30+
31+
32+
================================================================================================
33+
aggregate with linear keys
34+
================================================================================================
35+
36+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
37+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
38+
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
39+
------------------------------------------------------------------------------------------------------------------------
40+
codegen = F 10559 10956 562 7.9 125.9 1.0X
41+
codegen = T hashmap = F 6533 6567 34 12.8 77.9 1.6X
42+
codegen = T hashmap = T 1362 1377 22 61.6 16.2 7.8X
43+
44+
45+
================================================================================================
46+
aggregate with randomized keys
47+
================================================================================================
48+
49+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
50+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
51+
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
52+
------------------------------------------------------------------------------------------------------------------------
53+
codegen = F 12631 12634 3 6.6 150.6 1.0X
54+
codegen = T hashmap = F 8434 8478 44 9.9 100.5 1.5X
55+
codegen = T hashmap = T 2484 2598 117 33.8 29.6 5.1X
56+
57+
58+
================================================================================================
59+
aggregate with string key
60+
================================================================================================
61+
62+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
63+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
64+
Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
65+
------------------------------------------------------------------------------------------------------------------------
66+
codegen = F 4173 4204 44 5.0 199.0 1.0X
67+
codegen = T hashmap = F 2664 2721 81 7.9 127.0 1.6X
68+
codegen = T hashmap = T 1178 1219 59 17.8 56.2 3.5X
69+
70+
71+
================================================================================================
72+
aggregate with decimal key
73+
================================================================================================
74+
75+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
76+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
77+
Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
78+
------------------------------------------------------------------------------------------------------------------------
79+
codegen = F 3740 3747 9 5.6 178.3 1.0X
80+
codegen = T hashmap = F 2398 2528 184 8.7 114.3 1.6X
81+
codegen = T hashmap = T 638 644 7 32.9 30.4 5.9X
82+
83+
84+
================================================================================================
85+
aggregate with multiple key types
86+
================================================================================================
87+
88+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
89+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
90+
Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
91+
------------------------------------------------------------------------------------------------------------------------
92+
codegen = F 6874 6896 31 3.1 327.8 1.0X
93+
codegen = T hashmap = F 3866 3886 28 5.4 184.3 1.8X
94+
codegen = T hashmap = T 2619 2641 31 8.0 124.9 2.6X
95+
96+
97+
================================================================================================
98+
max function bytecode size of wholestagecodegen
99+
================================================================================================
100+
101+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
102+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
103+
max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
104+
------------------------------------------------------------------------------------------------------------------------
105+
codegen = F 793 806 19 0.8 1209.7 1.0X
106+
codegen = T hugeMethodLimit = 10000 401 456 61 1.6 611.2 2.0X
107+
codegen = T hugeMethodLimit = 1500 694 715 19 0.9 1059.3 1.1X
108+
109+
110+
================================================================================================
111+
cube
112+
================================================================================================
113+
114+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
115+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
116+
cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
117+
------------------------------------------------------------------------------------------------------------------------
118+
cube wholestage off 3616 3630 19 1.4 689.8 1.0X
119+
cube wholestage on 1819 1866 41 2.9 347.0 2.0X
120+
121+
122+
================================================================================================
123+
hash and BytesToBytesMap
124+
================================================================================================
125+
126+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
127+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
128+
BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
129+
------------------------------------------------------------------------------------------------------------------------
130+
UnsafeRowhash 321 321 1 65.4 15.3 1.0X
131+
murmur3 hash 145 145 0 144.5 6.9 2.2X
132+
fast hash 70 71 1 298.9 3.3 4.6X
133+
arrayEqual 198 199 2 105.7 9.5 1.6X
134+
Java HashMap (Long) 132 136 3 158.6 6.3 2.4X
135+
Java HashMap (two ints) 152 156 4 138.3 7.2 2.1X
136+
Java HashMap (UnsafeRow) 819 839 17 25.6 39.1 0.4X
137+
LongToUnsafeRowMap (opt=false) 459 472 25 45.7 21.9 0.7X
138+
LongToUnsafeRowMap (opt=true) 107 108 1 195.5 5.1 3.0X
139+
BytesToBytesMap (off Heap) 1012 1019 10 20.7 48.3 0.3X
140+
BytesToBytesMap (on Heap) 963 974 18 21.8 45.9 0.3X
141+
Aggregate HashMap 41 43 2 515.1 1.9 7.9X
142+
143+

0 commit comments

Comments
 (0)