Skip to content

Commit b40e9fd

Browse files
gczsjdyChenzhao Guo
andauthored
Clarified deprecating Spark 2.3- support (#640)
Co-authored-by: Chenzhao Guo <chenzhao.guo@intel.com>
1 parent 9fee30b commit b40e9fd

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -151,7 +151,7 @@ There are totally 29 workloads in HiBench. The workloads are divided into 6 cate
151151

152152
### Supported Hadoop/Spark/Flink/Storm/Gearpump releases: ###
153153

154-
- Hadoop: Apache Hadoop 3.0.x, Apache Hadoop 3.1.x, Apache Hadoop 3.2.x, Apache Hadoop 2.x, CDH5, HDP
154+
- Hadoop: Apache Hadoop 3.0.x, 3.1.x, 3.2.x, 2.x, CDH5, HDP
155155
- Spark: Spark 2.4.x, Spark 3.0.x
156156
- Flink: 1.0.3
157157
- Storm: 1.0.1

docs/run-sparkbench.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4,15 +4,15 @@
44

55
* `bc` is required to generate the HiBench report.
66

7-
* Supported Hadoop version: Apache Hadoop 2.x, CDH5.x, HDP
7+
* Supported Hadoop version: Apache Hadoop 2.x, 3.0.x, 3.1.x, 3.2.x, CDH5.x, HDP
88

9-
* Supported Spark version: 1.6.x, 2.0.x, 2.1.x, 2.2.x
9+
* Supported Spark version: 2.4.x, 3.0.x
1010

1111
* Build HiBench according to [build HiBench](build-hibench.md).
1212

1313
* Start HDFS, Yarn, Spark in the cluster.
1414

15-
15+
Note: Starting from HiBench 8.0, the support of Spark before 2.3.x(inclusive) was deprecated, please either leverage former version HiBench or upgrade your Spark.
1616

1717
### 2. Configure `hadoop.conf` ###
1818

0 commit comments

Comments
 (0)