Get a list of data types from a schema in Apache Spark

Question

I have the following code in Spark-Python to get a list of names from a DataFrame schema that works fine, but how can I get a list of data types?

columnNames = df.schema.names 

For example, something like:

 columnTypes = df.schema.types 

Is there a way to get a separate list of data types contained in a DataFrame schema?

Answer 1

Here is a suggestion:

 df = sqlContext.createDataFrame([('a', 1)]) types = [f.dataType for f in df.schema.fields] types > [StringType, LongType] 

Link:

• pyspark.sql.types.StructType
• pyspark.sql.types.StructField