I use onoop streams and I want to specify the input format as OrcNewFormat. I execute the command: -
hasoop jar hasoop-streaming.jar -libjars / usr / hdp / 2.2.4.2-2 / hive / lib / hive-exec.jar -input / user / orcfiles -output / streamf -mapper 'cat' -inputformat org.apache. hadoop.hive.ql.io.orc.OrcNewInputFormat -outputformat org.apache.hadoop.hive.ql.io.orc.OrcNewOutputFormat
But I get below exceptions:
Exception in thread "main" java.lang.RuntimeException: class org.apache.hadoop.hive.ql.io.orc.OrcNewInputFormat not org.apache.hadoop.mapred.InputFormat
at org.apache.hadoop.conf.Configuration.setClass(Configuration.java:2150)
at org.apache.hadoop.mapred.JobConf.setInputFormat(JobConf.java:702)
at org.apache.hadoop.streaming.StreamJob.setJobConf(StreamJob.java:796)
at org.apache.hadoop.streaming.StreamJob.run(StreamJob.java:128)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
from this link
http://hive.apache.org/javadocs/r1.2.0/api/
I could see that the OrcNewInputFormat class extends org.apache.hadoop.mapreduce.InputFormat, but from an exception, I could find out that the org.apache.hadoop.hive.ql.io.orc.OrcNewInputFormat class is not org.apache.hadoop. mapred.InputFormat.
What am I missing here?