Skip to content

Commit 3c42e50

Browse files
authored
doc: Scala 2.11 cannot resolve dependencies
#172
1 parent ee83b09 commit 3c42e50

File tree

1 file changed

+24
-1
lines changed

1 file changed

+24
-1
lines changed

README.md

Lines changed: 24 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -304,11 +304,34 @@ You should also provide Scala and Spark in your pom file. SETL is tested against
304304
| ------------- | ------------- | -----------------------------|
305305
| 3.0 | 2.12 | :heavy_check_mark: Ok |
306306
| 2.4 | 2.12 | :heavy_check_mark: Ok |
307-
| 2.4 | 2.11 | :heavy_check_mark: Ok |
307+
| 2.4 | 2.11 | :warning: see *known issues* |
308308
| 2.3 | 2.11 | :warning: see *known issues* |
309309

310310
## Known issues
311311

312+
### Spark 2.4 with Scala 2.11
313+
314+
When using `setl_2.11-1.x.x` with Spark 2.4 and Scala 2.11, you may need to include manually these following dependencies to override the default version:
315+
```xml
316+
<dependency>
317+
<groupId>com.audienceproject</groupId>
318+
<artifactId>spark-dynamodb_2.11</artifactId>
319+
<version>1.0.4</version>
320+
</dependency>
321+
<dependency>
322+
<groupId>io.delta</groupId>
323+
<artifactId>delta-core_2.11</artifactId>
324+
<version>0.6.1</version>
325+
</dependency>
326+
<dependency>
327+
<groupId>com.datastax.spark</groupId>
328+
<artifactId>spark-cassandra-connector_2.11</artifactId>
329+
<version>2.5.1</version>
330+
</dependency>
331+
```
332+
333+
### Spark 2.3 with Scala 2.11
334+
312335
- `DynamoDBConnector` doesn't work with Spark version 2.3
313336
- `Compress` annotation can only be used on Struct field or Array of Struct field with Spark 2.3
314337

0 commit comments

Comments
 (0)