Skip to content

Commit 0f576e5

Browse files
suhstevesuhsteve
authored
Prep 0.12.0 release (#564)
1 parent c889f39 commit 0f576e5

File tree

5 files changed

+119
-4
lines changed

5 files changed

+119
-4
lines changed

‎README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@
3939
<tbody align="center">
4040
<tr>
4141
<td >2.3.*</td>
42-
<td rowspan=6><a href="https://github.com/dotnet/spark/releases/tag/v0.11.0">v0.11.0</a></td>
42+
<td rowspan=6><a href="https://github.com/dotnet/spark/releases/tag/v0.12.0">v0.12.0</a></td>
4343
</tr>
4444
<tr>
4545
<td>2.4.0</td>

‎benchmark/scala/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
<modelVersion>4.0.0</modelVersion>
44
<groupId>com.microsoft.spark</groupId>
55
<artifactId>microsoft-spark-benchmark</artifactId>
6-
<version>0.11.0</version>
6+
<version>0.12.0</version>
77
<inceptionYear>2019</inceptionYear>
88
<properties>
99
<encoding>UTF-8</encoding>

‎docs/release-notes/0.12/release-0.12.md

Lines changed: 115 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,115 @@
1+
# .NET for Apache Spark 0.12 Release Notes
2+
3+
### New Features/Improvements and Bug Fixes
4+
5+
* Expose `DataStreamWriter.ForeachBatch` API ([#549](https://github.com/dotnet/spark/pull/549))
6+
* Support for [dotnet-interactive](https://github.com/dotnet/interactive) ([#515](https://github.com/dotnet/spark/pull/515)) ([#517](https://github.com/dotnet/spark/pull/517)) ([#554](https://github.com/dotnet/spark/pull/554))
7+
* Support for [Hyperspace v0.1.0](https://github.com/microsoft/hyperspace) APIs ([#555](https://github.com/dotnet/spark/pull/555))
8+
* Support for Spark 2.4.6 ([#547](https://github.com/dotnet/spark/pull/547))
9+
* Bug fixes:
10+
* Udf bug caused by `BroadcastVariablesRegistry` ([#551](https://github.com/dotnet/spark/pull/551))
11+
* Null checks for `TimestampType` and `DateType` ([#530](https://github.com/dotnet/spark/pull/530))
12+
* Update `Microsoft.Data.Analysis` to v`0.4.0` ([#528](https://github.com/dotnet/spark/pull/528))
13+
14+
### Infrastructure / Documentation / Etc.
15+
16+
* Improve build pipeline ([#510](https://github.com/dotnet/spark/pull/510)) ([#511](https://github.com/dotnet/spark/pull/511)) ([#512](https://github.com/dotnet/spark/pull/512)) ([#513](https://github.com/dotnet/spark/pull/513)) ([#524](https://github.com/dotnet/spark/pull/524))
17+
* Update AppName for the C# Spark Examples ([#548](https://github.com/dotnet/spark/pull/548))
18+
* Update maven links in build documentation ([#558](https://github.com/dotnet/spark/pull/558)) ([#560](https://github.com/dotnet/spark/pull/560))
19+
20+
### Breaking Changes
21+
22+
* None
23+
24+
### Known Issues
25+
26+
* Broadcast variables do not work with [dotnet-interactive](https://github.com/dotnet/interactive) ([#561](https://github.com/dotnet/spark/pull/561))
27+
28+
### Compatibility
29+
30+
#### Backward compatibility
31+
32+
The following table describes the oldest version of the worker that the current version is compatible with, along with new features that are incompatible with the worker.
33+
34+
<table>
35+
<thead>
36+
<tr>
37+
<th>Oldest compatible Microsoft.Spark.Worker version</th>
38+
<th>Incompatible features</th>
39+
</tr>
40+
</thead>
41+
<tbody align="center">
42+
<tr>
43+
<td rowspan=4>v0.9.0</td>
44+
<td>DataFrame with Grouped Map UDF <a href="https://github.com/dotnet/spark/pull/277">(#277)</a></td>
45+
</tr>
46+
<tr>
47+
<td>DataFrame with Vector UDF <a href="https://github.com/dotnet/spark/pull/277">(#277)</a></td>
48+
</tr>
49+
<tr>
50+
<td>Support for Broadcast Variables <a href="https://github.com/dotnet/spark/pull/414">(#414)</a></td>
51+
</tr>
52+
<tr>
53+
<td>Support for TimestampType <a href="https://github.com/dotnet/spark/pull/428">(#428)</a></td>
54+
</tr>
55+
</tbody>
56+
</table>
57+
58+
#### Forward compatibility
59+
60+
The following table describes the oldest version of .NET for Apache Spark release that the current worker is compatible with.
61+
62+
<table>
63+
<thead>
64+
<tr>
65+
<th>Oldest compatible .NET for Apache Spark release version</th>
66+
</tr>
67+
</thead>
68+
<tbody align="center">
69+
<tr>
70+
<td>v0.9.0</td>
71+
</tr>
72+
</tbody>
73+
</table>
74+
75+
### Supported Spark Versions
76+
77+
The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:
78+
79+
<table>
80+
<thead>
81+
<tr>
82+
<th>Spark Version</th>
83+
<th>microsoft-spark JAR</th>
84+
</tr>
85+
</thead>
86+
<tbody align="center">
87+
<tr>
88+
<td>2.3.*</td>
89+
<td>microsoft-spark-2.3.x-0.12.0.jar</td>
90+
</tr>
91+
<tr>
92+
<td>2.4.0</td>
93+
<td rowspan=6>microsoft-spark-2.4.x-0.12.0.jar</td>
94+
</tr>
95+
<tr>
96+
<td>2.4.1</td>
97+
</tr>
98+
<tr>
99+
<td>2.4.3</td>
100+
</tr>
101+
<tr>
102+
<td>2.4.4</td>
103+
</tr>
104+
<tr>
105+
<td>2.4.5</td>
106+
</tr>
107+
<tr>
108+
<td>2.4.6</td>
109+
</tr>
110+
<tr>
111+
<td>2.4.2</td>
112+
<td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td>
113+
</tr>
114+
</tbody>
115+
</table>

‎eng/Versions.props

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
<?xml version="1.0" encoding="utf-8"?>
22
<Project ToolsVersion="4.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
33
<PropertyGroup>
4-
<VersionPrefix>0.11.0</VersionPrefix>
4+
<VersionPrefix>0.12.0</VersionPrefix>
55
<PreReleaseVersionLabel>prerelease</PreReleaseVersionLabel>
66
<RestoreSources>
77
$(RestoreSources);

‎src/scala/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@
77
<version>${microsoft-spark.version}</version>
88
<properties>
99
<encoding>UTF-8</encoding>
10-
<microsoft-spark.version>0.11.0</microsoft-spark.version>
10+
<microsoft-spark.version>0.12.0</microsoft-spark.version>
1111
</properties>
1212

1313
<modules>

0 commit comments

Comments
 (0)