Install CDH 5.3.2 using Cloudera Manager
Prerequesties
1. Install java
sudo apt-get update
sudo apt-get install openjdk-7-jdk
java -version
2. Install and configure ssh
sudo apt-get install ssh
ssh-keygen -t rsa -P ''
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
3. <<here ram refers the the su user or the machine name>>
su root
gedit /etc/sudoers
ram ALL =(ALL) NOPASSWD: ALL
4.
/etc/hosts to be updated as
127.0.0.1 localhost
127.0.0.1 ram
cloudera cdh manager download link
http://www.cloudera.com/content/cloudera/en/downloads/cloudera_manager/cm-5-4-3.html
steps
Pre-requisites: multiple, Internet-connected Linux machines, with SSH access, and significant free space in /var and /opt.
$ wget http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin
$ chmod u+x cloudera-manager-installer.bin
$ sudo ./cloudera-manager-installer.bin
----------------------------
error 1: failed to detect root privileges
fix:
su root
gedit /etc/sudoers
ram ALL =(ALL) NOPASSWD: ALL
error 2:
Installation failed.Failed to receive heartbeat from agent.
Ensure that the host's hostname is configured properly.
Ensure that port 7182 is accesible on the Cloudera Manager server (check firewall rules).
Ensure that ports 9000 an 9001 are free on the host being added.
fix:
/etc/hosts was looking like this when I had the problem
127.0.0.1 localhost
127.0.1.1 ubuntu
I changed it like this:
127.0.0.1 localhost
127.0.0.1 ubuntu
error 3:
Failed to perform First Run of services.
Command (22) has failed
Failed to execute command Deploy Client Configuration on service HDFS
Failed to execute command Deploy Client Configuration on service Solr
Failed to execute command Deploy Client Configuration on service HBase
fix to follow:
https://community.cloudera.com/t5/Cloudera-Manager-Installation/Error-during-service-installation/td-p/7542/page/3
error 4:
7180 port issue (connection refused)
Troubleshooting:
ps -ef | grep 7180
sudo netstat -anp | grep 7180
sudo curl localhost:7180
sudo service cloudera-scm-server restart
Fix:
ufw allow 7180
Uninstall Cloudera manager (with package and db configurations)
sudo /usr/share/cmf/uninstall-cloudera-manager.sh
rm -r /etc/cloudera-scm-server/
rm -r /etc/cloudera-scm-agent/
Prerequesties
1. Install java
sudo apt-get update
sudo apt-get install openjdk-7-jdk
java -version
2. Install and configure ssh
sudo apt-get install ssh
ssh-keygen -t rsa -P ''
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
3. <<here ram refers the the su user or the machine name>>
su root
gedit /etc/sudoers
ram ALL =(ALL) NOPASSWD: ALL
4.
/etc/hosts to be updated as
127.0.0.1 localhost
127.0.0.1 ram
cloudera cdh manager download link
http://www.cloudera.com/content/cloudera/en/downloads/cloudera_manager/cm-5-4-3.html
steps
Pre-requisites: multiple, Internet-connected Linux machines, with SSH access, and significant free space in /var and /opt.
$ wget http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin
$ chmod u+x cloudera-manager-installer.bin
$ sudo ./cloudera-manager-installer.bin
----------------------------
error 1: failed to detect root privileges
fix:
su root
gedit /etc/sudoers
ram ALL =(ALL) NOPASSWD: ALL
error 2:
Installation failed.Failed to receive heartbeat from agent.
Ensure that the host's hostname is configured properly.
Ensure that port 7182 is accesible on the Cloudera Manager server (check firewall rules).
Ensure that ports 9000 an 9001 are free on the host being added.
fix:
/etc/hosts was looking like this when I had the problem
127.0.0.1 localhost
127.0.1.1 ubuntu
I changed it like this:
127.0.0.1 localhost
127.0.0.1 ubuntu
error 3:
Failed to perform First Run of services.
Command (22) has failed
Failed to execute command Deploy Client Configuration on service HDFS
Failed to execute command Deploy Client Configuration on service Solr
Failed to execute command Deploy Client Configuration on service HBase
fix to follow:
https://community.cloudera.com/t5/Cloudera-Manager-Installation/Error-during-service-installation/td-p/7542/page/3
error 4:
7180 port issue (connection refused)
Troubleshooting:
ps -ef | grep 7180
sudo netstat -anp | grep 7180
sudo curl localhost:7180
sudo service cloudera-scm-server restart
Fix:
ufw allow 7180
Uninstall Cloudera manager (with package and db configurations)
sudo /usr/share/cmf/uninstall-cloudera-manager.sh
rm -r /etc/cloudera-scm-server/
rm -r /etc/cloudera-scm-agent/
Your comprehensive guide on installing Cloudera 5.3.2 on an Ubuntu 14.04 single node cluster is a lifesaver! The step-by-step instructions you provide, along with clear explanations, make the installation process smooth and manageable. Your attention to detail and troubleshooting tips are invaluable for anyone venturing into this setup. games of thrones so popularThanks for simplifying a potentially complex task and empowering us with the knowledge to set up Cloudera with confidence
ReplyDelete