- Spark 1.3+
- This SDK supports interaction with Aliyun's base service, e.g. OSS, ODPS, LogService and ONS, in Spark runtime environment.
git clone https://github.com/aliyun/aliyun-spark-sdk.git cd aliyun-spark-sdk mvn clean package -DskipTests - copy sdk jar to your project
- right click Eclipse project -> Properties -> Java Build Path -> Add JARs
- choose and import the sdk
- you can use the sdk in your Eclipse project
<dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-maxcompute_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-logservice_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-tablestore</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-ons_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-datahub_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-jdbc_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-druid_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-hbase_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-kudu_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-redis_2.11</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>com.aliyun.emr</groupId> <artifactId>emr-common_2.11</artifactId> <version>2.1.0</version> </dependency> - Hadoop on JindoFS/OSS (Hive, Spark, Presto, Impala, Hbase and Flink are also supported)
Licensed under the Apache License 2.0