Spark launch: find version

Question

My environment is Windows 7, and scala 2.11.4 (works well), Java 1.8

I tried spark-1.2.0-bin-hadoop2.4 and spark-1.2.1-bin-hadoop2.4, and every time I put

bin\spark-shell.cmd

I just got an error message from Windows:

find: 'version': No such file or directory
else was unexpected at this time.

I have not ignored anything here?

Thank you very much.

updated: (from spark-class2.cmd)

C:\Users\spark-1.2.1-bin-hadoop2.4>for /F "tokens=3" %i in ('java -version 2>&1 | find "version"') do set jversi on=%i
find: 'version': No such file or directory
else was unexpected at this time.

and if I try java -version, it seems to work on the java side

C:\Users\spark-1.2.1-bin-hadoop2.4>java -version
java version "1.8.0_31"
Java(TM) SE Runtime Environment (build 1.8.0_31-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.31-b07, mixed mode)

Answer 1

I solved this problem. Here is my solution.

I have cygwin installed and the system variable PATH pointed to C: \ cygwin64 \ bin \ where there is find.exe.

Hence the line in spark-class2.cmd

for /f "tokens=3" %%i in ('java -version 2^>^&1 ^| find "version"') do set jversion=%%i

did not use the correct find find executable.

Change this line to

for /f "tokens=3" %%i in ('java -version 2^>^&1 ^| C:\Windows\System32\find.exe "version"') do set jversion=%%i

fixed my problem.

Answer 2

, JVM, 1.8.0_31. :

rem Set JAVA_OPTS to be able to load native libraries and to set heap size
rem for /f "tokens=3" %%i in ('java -version 2^>^&1 ^| %windir%\system32\FIND.exe "version"') do echo %%i
rem for /f "tokens=1 delims=_" %%i in ("%jversion:~1,-1%") do set jversion=%%i
rem if "%jversion%" geq "1.8.0" (
  set JAVA_OPTS=%OUR_JAVA_OPTS% -Xms%OUR_JAVA_MEM% -Xmx%OUR_JAVA_MEM%
rem ) else (
rem   set JAVA_OPTS=-XX:MaxPermSize=128m %OUR_JAVA_OPTS% -Xms%OUR_JAVA_MEM% -Xmx%OUR_JAVA_MEM%
rem )

, Spark

rem JAVA_OPTS,    for/f "tokens = 3" %% in ('java -version 2 ^ > ^ & 1 ^ |% windir%\system32\FIND.exe "version" ') do echo %%    for/f "tokens = 1 delims = _" %% in ( "% jversion: ~ 1, -1%" ) jversion = %% i

Answer 3

. , - java. java-sdk (1.7) , JAVA_HOME. spark-shell.cmd spark-submit.cmd .

: Windows 8.