Building Giraph 1.1.0 For CDH 5.0.0

Instructions for Building Giraph 1.1.0 for CDH 5.0.0

For information on building giraph see https://giraph.apache.org/build.html

Building giraph for your cluster can be difficult if your configuration is not specifically supported by giraph, to help we've provided steps we had to take to build giraph on two of our cluster configurations.

Building for YARN on Hadoop 2.3.0-cdh5.0.0

Download the giraph source, and from the giraph directory run:

mvn -DskipTests -Dhadoop.version=2.3.0-cdh5.0.0 -Phadoop_yarn clean install

Building for Map Reduce v. 1 (MRv1) on Hadoop 2.3.0-cdh5.0.0

Download the giraph source and add the following to the profiles section of the main pom

    <profile>
        <id>cdh5.0.0</id>
        <properties>
            <hadoop.version>2.3.0-cdh5.0.0</hadoop.version>
            <!-- TODO: add these checks eventually -->
            <project.enforcer.skip>true</project.enforcer.skip>
            <giraph.maven.dependency.plugin.skip>true</giraph.maven.dependency.plugin.skip>
            <giraph.maven.duplicate.finder.skip>true</giraph.maven.duplicate.finder.skip>
        </properties>
        <dependencies>
            <dependency>
                <groupId>commons-net</groupId>
                <artifactId>commons-net</artifactId>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-mapreduce-client-shuffle</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-mapreduce-client-jobclient</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-mapreduce-client-hs</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-mapreduce-client-core</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-mapreduce-client-common</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-common</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-auth</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hadoop</groupId>
                <artifactId>hadoop-client</artifactId>
                <version>${hadoop.version}</version>
            </dependency>
        </dependencies>
    </profile>

Then you can run the following command.

mvn -DskipTests -Pcdh5.0.0 clean install