Skip to content

Commit 98bb243

Browse files
dongjoon-hyundongjoon-hyun
committed
[SPARK-29320][TESTS] Compare sql/core module in JDK8/11 (Part 1)
1 parent 0cf2f48 commit 98bb243

File tree

48 files changed

+1073
-3220
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

48 files changed

+1073
-3220
lines changed

‎sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt

Lines changed: 143 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,143 @@
1+
================================================================================================
2+
aggregate without grouping
3+
================================================================================================
4+
5+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
6+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7+
agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
8+
------------------------------------------------------------------------------------------------------------------------
9+
agg w/o group wholestage off 59000 61042 2888 35.5 28.1 1.0X
10+
agg w/o group wholestage on 876 920 38 2394.8 0.4 67.4X
11+
12+
13+
================================================================================================
14+
stat functions
15+
================================================================================================
16+
17+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
18+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
19+
stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
20+
------------------------------------------------------------------------------------------------------------------------
21+
stddev wholestage off 8693 8780 122 12.1 82.9 1.0X
22+
stddev wholestage on 1284 1303 18 81.6 12.2 6.8X
23+
24+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
25+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
26+
kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
27+
------------------------------------------------------------------------------------------------------------------------
28+
kurtosis wholestage off 41451 41609 224 2.5 395.3 1.0X
29+
kurtosis wholestage on 1450 1478 29 72.3 13.8 28.6X
30+
31+
32+
================================================================================================
33+
aggregate with linear keys
34+
================================================================================================
35+
36+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
37+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
38+
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
39+
------------------------------------------------------------------------------------------------------------------------
40+
codegen = F 10740 11022 400 7.8 128.0 1.0X
41+
codegen = T hashmap = F 6594 6636 55 12.7 78.6 1.6X
42+
codegen = T hashmap = T 1399 1410 7 60.0 16.7 7.7X
43+
44+
45+
================================================================================================
46+
aggregate with randomized keys
47+
================================================================================================
48+
49+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
50+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
51+
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
52+
------------------------------------------------------------------------------------------------------------------------
53+
codegen = F 11496 11598 144 7.3 137.0 1.0X
54+
codegen = T hashmap = F 7547 7575 35 11.1 90.0 1.5X
55+
codegen = T hashmap = T 2439 2484 45 34.4 29.1 4.7X
56+
57+
58+
================================================================================================
59+
aggregate with string key
60+
================================================================================================
61+
62+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
63+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
64+
Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
65+
------------------------------------------------------------------------------------------------------------------------
66+
codegen = F 3913 3981 95 5.4 186.6 1.0X
67+
codegen = T hashmap = F 2443 2521 83 8.6 116.5 1.6X
68+
codegen = T hashmap = T 1150 1181 40 18.2 54.8 3.4X
69+
70+
71+
================================================================================================
72+
aggregate with decimal key
73+
================================================================================================
74+
75+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
76+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
77+
Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
78+
------------------------------------------------------------------------------------------------------------------------
79+
codegen = F 3789 3814 35 5.5 180.7 1.0X
80+
codegen = T hashmap = F 2336 2405 96 9.0 111.4 1.6X
81+
codegen = T hashmap = T 619 652 36 33.9 29.5 6.1X
82+
83+
84+
================================================================================================
85+
aggregate with multiple key types
86+
================================================================================================
87+
88+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
89+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
90+
Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
91+
------------------------------------------------------------------------------------------------------------------------
92+
codegen = F 6390 6496 149 3.3 304.7 1.0X
93+
codegen = T hashmap = F 3516 3594 110 6.0 167.6 1.8X
94+
codegen = T hashmap = T 2612 2636 34 8.0 124.5 2.4X
95+
96+
97+
================================================================================================
98+
max function bytecode size of wholestagecodegen
99+
================================================================================================
100+
101+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
102+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
103+
max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
104+
------------------------------------------------------------------------------------------------------------------------
105+
codegen = F 646 680 30 1.0 986.4 1.0X
106+
codegen = T hugeMethodLimit = 10000 371 396 19 1.8 566.8 1.7X
107+
codegen = T hugeMethodLimit = 1500 651 675 31 1.0 993.3 1.0X
108+
109+
110+
================================================================================================
111+
cube
112+
================================================================================================
113+
114+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
115+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
116+
cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
117+
------------------------------------------------------------------------------------------------------------------------
118+
cube wholestage off 3180 3199 26 1.6 606.6 1.0X
119+
cube wholestage on 1576 1587 16 3.3 300.6 2.0X
120+
121+
122+
================================================================================================
123+
hash and BytesToBytesMap
124+
================================================================================================
125+
126+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
127+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
128+
BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
129+
------------------------------------------------------------------------------------------------------------------------
130+
UnsafeRowhash 323 324 1 65.0 15.4 1.0X
131+
murmur3 hash 145 145 0 144.7 6.9 2.2X
132+
fast hash 71 73 2 293.7 3.4 4.5X
133+
arrayEqual 199 199 0 105.6 9.5 1.6X
134+
Java HashMap (Long) 128 129 3 164.3 6.1 2.5X
135+
Java HashMap (two ints) 139 142 3 151.0 6.6 2.3X
136+
Java HashMap (UnsafeRow) 800 805 4 26.2 38.2 0.4X
137+
LongToUnsafeRowMap (opt=false) 444 451 13 47.3 21.2 0.7X
138+
LongToUnsafeRowMap (opt=true) 108 109 0 193.7 5.2 3.0X
139+
BytesToBytesMap (off Heap) 1028 1046 27 20.4 49.0 0.3X
140+
BytesToBytesMap (on Heap) 994 1012 26 21.1 47.4 0.3X
141+
Aggregate HashMap 44 44 0 475.5 2.1 7.3X
142+
143+

0 commit comments

Comments
 (0)