How to install RHadoop packages (Rmr, Rhdfs, Rhbase)?

Question

In fact, I try to make my level integrate better with R, but I got this error.

packages 'rmr,' rJava ',' RJSONIO ',' rhdfs, 'rhbase,' plyrmr are not available (for version R 3.1.3)

Steps to integrate Hadoop with R:

Installed R and Hadoop on ubuntu.

Add these three lines to the ~ / .bashrc file.

* export HADOOP_PREFIX = / Users / hadoop / hadoop-1.1.2

export HADOOP_CMD = / Users / hadoop / hadoop-1.1.2 / bin / hadoop

export HADOOP_STREAMING = / Users / hadoop / hadoop-1.1.2 / contrib / streaming / hadoop-streaming-1.1.2.jar *

Installed R packages with this command

install.packages(c("rJava", "RJSONIO", "rmr", "rhdfs", "rhbase", "plyrmr"). 

But I got the error above. What is the main problem with integrating R and Hadoop. I followed this link for integration .

Answer 1

Download the rhdfs, rhbase, rmr2, and plyrmr packages from https://github.com/RevolutionAnalytics/RHadoop/wiki and install them as shown below:

 install.packages("<path>/rhdfs_1.0.8.tar.gz", repos=NULL, type="source") install.packages("<path>/rmr2_2.2.2.tar.gz", repos=NULL, type="source") install.packages("<path>plyrmr_0.2.0.tar.gz", repos=NULL, type="source") install.packages("<path>/rhbase_1.2.0.tar.gz", repos=NULL, type="source") 

Answer 2

With devtools you can install directly from Github:

 install.packages('devtools') devtools::install_github(c('RevolutionAnalytics/rmr2/pkg', 'RevolutionAnalytics/plyrmr/pkg')) 

Answer 3

you can try installing these packages by specifying the repository:

 install.packages(c("rJava", "RJSONIO", "rmr", "rhdfs", "rhbase", "plyrmr"), repos="http://cran.r-project.org/") 

Answer 4

You can download packages from the CRAN website and install them without connecting to the repository.

For example, to download the "rJava" package, you can follow this link: http://cran.r-project.org/web/packages/rJava/index.html

From there, download the “Package Source” and manually install them as follows:

 install.packages('path to downloads/rJava_0.9-6.tar.gz',repos=NULL) 

You can follow the same pattern for the other packages mentioned. The rhdfs, rhbase and rmr packages are located at https://github.com/RevolutionAnalytics/RHadoop/wiki/Downloads