Geek Answers Handbook

Apache Spark Streaming feed from Amazon SQS?

A spark can be supplied in many ways, as explained in the documentation (e.g. Kafka, Flume, Twitter, ZeroMQ, Kinesis, or plain old TCP sockets). Does anyone know how to submit Spark Streaming from Amazon SQS?

+4
source share
1 answer

There, the github project is called spark-sql-receiver. It was uploaded to the maven repository using groupId from com.github.imapi artifactId from spark-sqs-receiver_2.10. It is currently in version 1.0.1. In appearance, the github project is actively supported. The following is an example of code shamelessly copied from the README.md project file:

ssc.receiverStream(new SQSReceiver("sample")
      .credentials(<key>, <secret>)
      .at(Regions.US_EAST_1)
      .withTimeout(2))
+5

More articles:


All Articles