Configuration of Hadoop

  • (4.0)
  •   |   569 Ratings

Hadoop is supported by GNU/Linux platform and its flavors. CONFIGURATIONS are specified by resources. A resource contains a set of name/value pairs as XML data. Each resource is named by either a String or by a Path. If named by a String, then the classpath is examined for a file with that name. If named by a Path, then the local filesystem is examined directly, without referring to the classpath.

Inclined to build a profession as Hadoop Developer? Then here is the blog post on Hadoop Training ONLINE.

Setting environment variables for Hadoop:-

The next step is to set up the PATH environment variables. You can set them as following:

Login as root user

   Cmd: cd/usr/lib/Hadoop-0.20/conf

   Cmd: ls


   Copy the java path as

Export JAVA-HOME=/usr/java/jdhal.6


   Login as object user

   To check the hadoop version

    Cmd: hadoop version

To start the hadoop services:-

Login as object user.

   Cmd: sudo/etc/init. d/hadoop-0.20-namenode start

   Repeat the command for all the daemon such as data node, secondary name node, job tracker, task.

Adding the host name in hadoop configuration file:-

Login as root user.

   Cmd: cd/usr/lib/hadoop-0.20/conf.

   Cmd:vi cove-site.xml

   Add your host name instead of local host in the file.


Formatting the Name Node:-



   Before formatting the Name Node, we have to assign users to the daemons in HDFS

   Cmd: export HADOOP NAME NODE-USER=hdfs

Frequently asked Hadoop Interview Questions

Cmd: export Hadoop-Secondary Name Node-user=hdfs

Cmd: export Hadoop DATA NODE hdfs JDB TRACKER hdfs=map red

Log in as object user

   Cmd: cd/usr/lib/.hadoop/bin/

   Cmd :ls

   Cmd: hadoop Name Node-format

   To format the name node

   Start all the services for hdfs

Cmd: /

   Cmd: cd/

   Cmd: hadoop fs-ls/

   Now the hadoop configuration is finished.

   Cmd: jps[To check all the daemons]

Installation of Library files:-

Log in as root user

   Cmd: yum install hadoop-0.20*

   Now, all the files and libraries which are related to hadoop [i.e. remains supported for those, which are not installed previously]

Explore Hadoop Sample Resumes! Download & Edit, Get Noticed by Top Employers!Download Now!

List of Other Big Data Courses:

 Hadoop Adminstartion  MapReduce
 Big Data On AWS  Informatica Big Data Integration
 Bigdata Greenplum DBA  Informatica Big Data Edition
 Hadoop Hive  Impala
 Hadoop Testing  Apache Mahout


Popular Courses in 2018

Get Updates on Tech posts, Interview & Certification questions and training schedules