Skip to content

Commit 4e5341f

Browse files
c21c21
committed
Address all comments and update benchmark result
1 parent 07ed459 commit 4e5341f

File tree

4 files changed

+93
-77
lines changed

4 files changed

+93
-77
lines changed

‎sql/core/benchmarks/JoinBenchmark-jdk11-results.txt

Lines changed: 39 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -2,74 +2,81 @@
22
Join Benchmark
33
================================================================================================
44

5-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
5+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
66
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
77
Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
88
------------------------------------------------------------------------------------------------------------------------
9-
Join w long wholestage off 4441 4572 185 4.7 211.8 1.0X
10-
Join w long wholestage on 1409 1500 96 14.9 67.2 3.2X
9+
Join w long wholestage off 3931 3998 95 5.3 187.4 1.0X
10+
Join w long wholestage on 1507 1769 178 13.9 71.9 2.6X
1111

12-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
12+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
1313
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
1414
Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
1515
------------------------------------------------------------------------------------------------------------------------
16-
Join w long duplicated wholestage off 5111 5116 7 4.1 243.7 1.0X
17-
Join w long duplicated wholestage on 1493 1518 22 14.0 71.2 3.4X
16+
Join w long duplicated wholestage off 5582 5617 50 3.8 266.2 1.0X
17+
Join w long duplicated wholestage on 1435 1451 19 14.6 68.4 3.9X
1818

19-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
19+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
2020
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
2121
Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
2222
------------------------------------------------------------------------------------------------------------------------
23-
Join w 2 ints wholestage off 171821 171906 121 0.1 8193.0 1.0X
24-
Join w 2 ints wholestage on 166559 166975 263 0.1 7942.1 1.0X
23+
Join w 2 ints wholestage off 171470 171478 11 0.1 8176.3 1.0X
24+
Join w 2 ints wholestage on 166612 166762 123 0.1 7944.7 1.0X
2525

26-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
26+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
2727
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
2828
Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
2929
------------------------------------------------------------------------------------------------------------------------
30-
Join w 2 longs wholestage off 7511 7555 62 2.8 358.2 1.0X
31-
Join w 2 longs wholestage on 3776 4119 232 5.6 180.1 2.0X
30+
Join w 2 longs wholestage off 6065 6093 40 3.5 289.2 1.0X
31+
Join w 2 longs wholestage on 3285 3375 97 6.4 156.7 1.8X
3232

33-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
33+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
3434
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
3535
Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
3636
------------------------------------------------------------------------------------------------------------------------
37-
Join w 2 longs duplicated wholestage off 13563 13617 77 1.5 646.7 1.0X
38-
Join w 2 longs duplicated wholestage on 7947 8053 71 2.6 378.9 1.7X
37+
Join w 2 longs duplicated wholestage off 14969 15027 82 1.4 713.8 1.0X
38+
Join w 2 longs duplicated wholestage on 7902 8151 406 2.7 376.8 1.9X
3939

40-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
40+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
4141
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
4242
outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
4343
------------------------------------------------------------------------------------------------------------------------
44-
outer join w long wholestage off 3915 3923 12 5.4 186.7 1.0X
45-
outer join w long wholestage on 1421 1461 30 14.8 67.8 2.8X
44+
outer join w long wholestage off 2822 2823 1 7.4 134.6 1.0X
45+
outer join w long wholestage on 1419 1436 19 14.8 67.7 2.0X
4646

47-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
47+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
4848
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
4949
semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
5050
------------------------------------------------------------------------------------------------------------------------
51-
semi join w long wholestage off 2310 2332 30 9.1 110.2 1.0X
52-
semi join w long wholestage on 835 860 34 25.1 39.8 2.8X
51+
semi join w long wholestage off 1821 1832 15 11.5 86.8 1.0X
52+
semi join w long wholestage on 828 853 36 25.3 39.5 2.2X
5353

54-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
54+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
5555
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
5656
sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
5757
------------------------------------------------------------------------------------------------------------------------
58-
sort merge join wholestage off 1846 1886 56 1.1 880.5 1.0X
59-
sort merge join wholestage on 1402 1654 234 1.5 668.3 1.3X
58+
sort merge join wholestage off 1371 1380 13 1.5 653.7 1.0X
59+
sort merge join wholestage on 1197 1244 37 1.8 570.9 1.1X
6060

61-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
61+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
6262
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
63-
sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
64-
------------------------------------------------------------------------------------------------------------------------
65-
sort merge join with duplicates wholestage off 2852 2879 38 0.7 1360.0 1.0X
66-
sort merge join with duplicates wholestage on 2645 2742 156 0.8 1261.0 1.1X
63+
sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
64+
------------------------------------------------------------------------------------------------------------------------------
65+
sort merge join with duplicates wholestage off 1920 1933 20 1.1 915.3 1.0X
66+
sort merge join with duplicates wholestage on 1871 1912 27 1.1 892.0 1.0X
6767

68-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
68+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
6969
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7070
shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
7171
------------------------------------------------------------------------------------------------------------------------
72-
shuffle hash join wholestage off 1506 1564 82 2.8 359.1 1.0X
73-
shuffle hash join wholestage on 1303 1330 23 3.2 310.6 1.2X
72+
shuffle hash join wholestage off 1102 1122 28 3.8 262.8 1.0X
73+
shuffle hash join wholestage on 657 674 13 6.4 156.6 1.7X
74+
75+
OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64
76+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
77+
broadcast nested loop join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
78+
-------------------------------------------------------------------------------------------------------------------------
79+
broadcast nested loop join wholestage off 62922 63052 184 0.3 3000.3 1.0X
80+
broadcast nested loop join wholestage on 30946 30972 26 0.7 1475.6 2.0X
7481

7582

0 commit comments

Comments
 (0)