Export Spark ml and PMML

Question

I know that you can export models as PMMLwith Spark-MLlib, but what about Spark-ML?

Can I convert LinearRegressionModelfrom org.apache.spark.ml.regressionto LinearRegressionModelfrom org.apache.spark.mllib.regressionto call a method toPMML()?

Answer 1

You can convert Spark ML pipelines to PMML using the JPMML-SparkML library :

StructType schema = dataFrame.schema()
PipelineModel pipelineModel = pipeline.fit(dataFrame);
org.dmg.pmml.PMML pmml = org.jpmml.sparkml.ConverterUtil.toPMML(schema, pipelineModel);
JAXBUtil.marshalPMML(pmml, new StreamResult(System.out));