Monday, August 3, 2015

Steps to Install Cloudera 5.3.2 on Ubuntu 14.04 single node cluster

Install CDH 5.3.2 using Cloudera Manager

Prerequesties

1. Install java

sudo apt-get update
sudo apt-get install openjdk-7-jdk
java -version


2. Install and configure ssh
sudo apt-get install ssh
ssh-keygen -t rsa -P ''
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

3.  <<here ram refers the the su user or the machine name>>

su root

gedit /etc/sudoers
ram ALL =(ALL) NOPASSWD: ALL

4.
/etc/hosts to be updated as
127.0.0.1 localhost
127.0.0.1 ram


cloudera cdh manager download link

http://www.cloudera.com/content/cloudera/en/downloads/cloudera_manager/cm-5-4-3.html

steps

Pre-requisites: multiple, Internet-connected Linux machines, with SSH access, and significant free space in /var and /opt.

    $ wget http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin
    $ chmod u+x cloudera-manager-installer.bin
    $ sudo ./cloudera-manager-installer.bin


----------------------------

error 1:  failed to detect root privileges

fix:

su root

gedit /etc/sudoers
ram ALL =(ALL) NOPASSWD: ALL

error 2:
Installation failed.Failed to receive heartbeat from agent.
Ensure that the host's hostname is configured properly.
Ensure that port 7182 is accesible on the Cloudera Manager server (check firewall rules).
Ensure that ports 9000 an 9001 are free on the host being added.

fix:

/etc/hosts was looking like this when I had the problem
127.0.0.1 localhost
127.0.1.1 ubuntu

I changed it like this:
127.0.0.1 localhost
127.0.0.1 ubuntu


error 3:

Failed to perform First Run of services.
Command (22) has failed
Failed to execute command Deploy Client Configuration on service HDFS
Failed to execute command Deploy Client Configuration on service Solr
Failed to execute command Deploy Client Configuration on service HBase

fix to follow:
https://community.cloudera.com/t5/Cloudera-Manager-Installation/Error-during-service-installation/td-p/7542/page/3

error 4:
7180 port issue (connection refused)

Troubleshooting:

ps -ef | grep 7180
sudo netstat -anp | grep 7180
sudo curl localhost:7180
sudo service cloudera-scm-server restart

Fix:
ufw allow 7180

Uninstall Cloudera manager (with package and db configurations)
sudo /usr/share/cmf/uninstall-cloudera-manager.sh
rm -r /etc/cloudera-scm-server/
rm -r /etc/cloudera-scm-agent/

1 comment:

  1. Your comprehensive guide on installing Cloudera 5.3.2 on an Ubuntu 14.04 single node cluster is a lifesaver! The step-by-step instructions you provide, along with clear explanations, make the installation process smooth and manageable. Your attention to detail and troubleshooting tips are invaluable for anyone venturing into this setup. games of thrones so popularThanks for simplifying a potentially complex task and empowering us with the knowledge to set up Cloudera with confidence

    ReplyDelete