Zeppelin SQL: reuse query data without another interpreter or new query

Question

I am using Zeppelin 0.7.2. I have only one frame with sql query, for example select colum1,colum2 from table and I can list and build data using the built-in tools. But is this the end?

How can I reuse request data? Maybe I want to build it using matplotlib and filter other things that I can not do with sql? Should I run the query again or run the query from an interpreter such as python or scala, with more features?

Answer 1

you can run the request in spark mode. programmatically

• https://spark.apache.org/docs/2.1.0/sql-programming-guide.html#running-sql-queries-programmatically
• https://spark.apache.org/docs/latest/sql-programming-guide.html#jdbc-to-other-databases
• https://sparkour.urizone.net/recipes/using-jdbc/

This means that you can access the result data in the same paragraph.

 // read a table in postgre using jdbc val jdbcDF = spark.read .format("jdbc") .option("url", "jdbc:postgresql:dbserver") .option("dbtable", "schema.tablename") .option("user", "username") .option("password", "password") .load() // do other things using `jdbcDF` 

And you can also use other programming models, such as RDD, DataSet. Please follow the link above.