Is there a spd SQL jdbc driver?

Question

I am looking for a jdbc driver for a client that supports Spark SQL.

I have used Jupyter so far to run SQL queries on Spark (works on HDInsight), and I would like to be able to connect via JDBC to use third-party SQL clients (e.g. SQuirreL, SQL Explorer, etc ..) instead of a laptop interface.

I found the ODBC driver from Microsoft, but that does not help me with Java-based Java clients. I also tried downloading the hive jdbc driver from my cluster, but the Jive Jive Jive driver does not support the more advanced SQL functions that Spark does. For example, the Hive driver complains that it does not support connection statements that are not equajoins, where I know that it is a supported Spark function because I successfully executed the same SQL in Jupyter.

Answer 1

Hive JDBC driver does not support the more advanced SQL functions that Spark does

Regardless of the support it provides, Spark Thrift Server is fully compatible with Jive / Hib / JeeBel connectivity .

Therefore, this is the JAR you need to use. I checked this in DBVisualizer.

An alternative solution would be to run the Spark code on your Java clients (third-party tools) directly and skip the need to connect JDBC.