Skip to content

polomarcus/Spark-Structured-Streaming-Examples

Repository files navigation

Kafka / Cassandra / Spark Structured Streaming Example

Input data

Coming from radio stations stored inside a parquet file, the stream is emulated with .option("maxFilesPerTrigger", 1) option.

Output data

Stored inside Kafka and Cassandra for example only

./cqlsh SELECT * FROM test.kv; 

Requirements

  • Cassandra
  • Kafka 0.10+ (with Zookeeper)

About

Spark Structured Streaming / Kafka / Cassandra / Elastic

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •