Apache Spark streaming vs Spring XD Streams

Question

I am looking for use cases in which Apache Spark will work, and situations in which Spring XD threads are best suited.

Is there a technology overlap here? Does anyone face a situation where both are used?

+7

spring-xd apache-spark

Rishitesh mishra 01 Oct '14 at 17:36

source share

2 answers

Tim spann · Answer 1 · 2014-10-20T18:44:20+0000

Spring XD works great when you do not want to do any encodings and work with streams included in RabbitMQ, Gemfire, JDBC, HDFS, Redis, MongoDB.

Ilayaperumal gopinathan · Answer 2 · 2015-07-15T00:16:06+0000

Spring XD provides integration with the Spark stream to get the best of both. You can refer to the documentation here