Apache Hadoop

Doroszlai, Attila d1bedf5448 HADOOP-19276. Create hadoop-runner based on JDK 17 7 ヶ月 前
scripts 5bb6f45034 HADOOP-19209. Update and optimize hadoop-runner 10 ヶ月 前
.dockerignore 5bb6f45034 HADOOP-19209. Update and optimize hadoop-runner 10 ヶ月 前
.gitignore 5bb6f45034 HADOOP-19209. Update and optimize hadoop-runner 10 ヶ月 前
Dockerfile d1bedf5448 HADOOP-19276. Create hadoop-runner based on JDK 17 7 ヶ月 前
LICENSE f3db8f605b HADOOP-15083. Create base image for running hadoop in docker containers. Contributed by Elek, Marton. 7 年 前
README.md a63c654761 HDDS-189. Update HDDS to start OzoneManager. Contributed by Arpit Agarwal. 6 年 前
build.sh 5bb6f45034 HADOOP-19209. Update and optimize hadoop-runner 10 ヶ月 前
krb5.conf 5bb6f45034 HADOOP-19209. Update and optimize hadoop-runner 10 ヶ月 前

README.md

Apache Hadoop base image

This is the definition of the Apache Hadoop base image. It doesn't use any Hadoop distribution just the scripts to run any Hadoop from source or from a prebuild package.

Build

To create a local version of this image use the following command:

docker build -t apache/hadoop-runner .

Usage

Do a full build on Apache Hadoop trunk with the hdds profile enabled.

mvn clean install package -DskipTests -Pdist,hdds -Dtar -Dmaven.javadoc.skip=true

Then start HDDS services with docker-compose.

cd hadoop-dist/target/compose/ozone
docker-compose up -d

Troubleshooting

If docker-compose fails to work, check that the hadoop-dist/target/compose/ozone/.env file exists and has a line like the following (the exact version number may be different):

    HDDS_VERSION=0.2.1-SNAPSHOT