This image is modified version of Knappek/docker-hadoop-secure
With bits and pieces added from Lewuathe/docker-hadoop-cluster to extend it to start a proper kerberized Hadoop cluster:
And a lot of added stuff for making this an actual, properly configured, kerberized cluster with proper user/permissions structure.
| Name | Value | Description |
|---|---|---|
KRB_REALM | EXAMPLE.COM | The Kerberos Realm, more information here |
DOMAIN_REALM | example.com | The Kerberos Domain Realm, more information here |
KERBEROS_ADMIN | admin/admin | The KDC admin user |
KERBEROS_ADMIN_PASSWORD | admin | The KDC admin password |
You can simply define these variables in the docker-compose.yml.
Clone the project and run
docker-compose up
Get the container name with docker ps and login to the container with
docker exec -it <container-name> /bin/bash
To obtain a Kerberos ticket, execute
kinit -kt /home/hadoop-user/hadoop-user.keytab hadoop-user
Afterwards you can use hdfs CLI like
hdfs dfs -ls /
docker-compose up fails for the first time with the error
Login failure for nn/hadoop.docker.com@EXAMPLE.COM from keytab /etc/security/keytabs/nn.service.keytab: javax.security.auth.login.LoginException: Unable to obtain password from user
Stop the containers with docker-compose down and start again with docker-compose up -d.
Make sure you use download a JDK version that is still available. Old versions can be deprecated by Oracle and thus the download link won't be able anymore.
Get the latest JDK8 Download URL with
curl -s https://lv.binarybabel.org/catalog-api/java/jdk8.json
If the Keystore has been expired, then create a new keystore.jks:
openssl genrsa -des3 -out server.key 1024
openssl req -new -key server.key -out server.csr`
cp server.key server.key.org openssl rsa -in server.key.org -out server.key
openssl x509 -req -days 365 -in server.csr -signkey server.key -out server.crt
keytool -import -keystore keystore.jks -alias CARoot -file server.crt`