How to convert an Avro structure to SchemaRDD and vice versa?

Is there a way to convert an Avro framework to SchemaRDD ? I see an example for JavaRDD at https://issues.apache.org/jira/browse/SPARK-2736 , but could not find anything to create SchemaRDD.

There is a link that shows how to convert SchemaRDD to Avro, but I wanted to know if there is anything in Spark 1.1

https://issues.apache.org/jira/browse/SPARK-3350

+4
source share
1 answer

Yes, there is a separate package that allows you to do this: https://github.com/databricks/spark-avro

Avro → SparkSQL, SparkSQL → Avro.

, Spark, , Spark, Spark. . http://spark-packages.org/

0

All Articles