zincを入れてSparkのincremental compileをする。


zincのbinaryをdownload

wget http://downloads.typesafe.com/zinc/0.3.9/zinc-0.3.9.tgz

zinc serverを起動

cd zinc-0.3.9
./bin/zinc -nailed

起動確認

./bin/zinc -status

Nailgun server running with 1 cached compiler

Version = 0.3.9

Zinc compiler cache limit = 5
Resident scalac cache limit = 0
Analysis cache limit = 5

Compiler(Scala 2.11.8) [7728f2aa]
Setup = {
....   }
....

   java home = 
   fork java = false
   cache directory = /Users/a14350/.zinc/0.3.9
}

sparkのbuild時の確認


...
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-catalyst_2.11 ---
[INFO] Using zinc server for incremental compilation
[warn] Pruning sources from previous analysis, due to incompatible CompileSetup.

...