Jirka's Public Notepad

Data Engineering | Python | SQL Server | Teradata

December 17, 2014 By Jiří Hubáček Leave a Comment

Putting your hands on Hadoop with HDP

For learning and local development purposes, there is no easier way than to download the Hortonworks Data Platform (HDP) sandbox and run in inside your favourite hypervisor.

Once you get your image started in whatever hypervisor you use, you will see a login screen with connection information.

HDP demonstration

Use your SSH client to connect to the presented IP address and login with user root and password hadoop

Once we are in, it’s time to perform first hdfs command. Switch user to hdfs and issue hdfs dfsadmin with report as a parameter. What we get is a general information about our Hadoop sandbox.

su hdfs
hdfs dfsadmin -report

hdfs dfsadmin

And that’s it!

Bottom line

If we hadn’t switched to hdfs user, we wouldn’t have seen all the information from the above screenshot. Apparently, Hortonworks made a change in the sandbox configuration for 2.2 version that root user doesn’t have a superuser privilege for hdfs anymore.

Access denied for user root. Superuser privilege is required
Access denied for user root. Superuser privilege is required

For the sake of sandbox testing purposes, one may issue a usermod command to assign root to the superuser group.

usermod -a -G hdfs root

Related

Filed Under: Big Data, Hadoop

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

  • GitHub
  • LinkedIn
  • RSS
  • Twitter
© 2022 · Jiří Hubáček, PGP