Sr Hadoop Administrator

Posted 3 years ago

Sr. Hadoop Admin
4-5+ years in Managing and Supporting large scale Production Hadoop
environments (configuration management, monitoring, and performance tuning) 
Any of theHadoop distributions (Apache, Hortonworks, Cloudera, MapR, IBM BigInsights, Pivotal HD) is a
requirement.
Experience should include Hadoop cluster architectural design, installation, configuration,
proactive monitoring, and performance tuning of any of the Hadoop distributions.
Experience in Hadoop software installation, upgrades, system maintenance, application
development troubleshooting, Linux OS and Hadoop (Apache Ranger) security design and
implementation, data management, Hadoop configuration, process scheduling, and job
execution setup and troubleshooting.
4-6+ years of experience performing administrative activities like managing HBase snapshots,
implementing hotfixes, high availability feature implementations (e.g. rack awareness, HMS HA,
etc.), and Backup, Archival and Recovery (BAR).
Must be proficient in Hadoop storage design, capacity planning, optimization, and
implementation.
4-6+ years of experience in the implementation and ongoing management of proactive
system/application monitoring solutions for any Hadoop distribution.
Strong experience in Scripting Languages (Bash, Spark, SQL, Python). Must be proficient in
Unix/Linux shell scripting.
Hands-on experience in Linux administrative activities on RHEL/CentOS.
Proficiency in setting up and integrating NiFi and Hadoop ecosystem tools – Hbase, Hive
internals (including HCatalog), Pig, Sqoop, Spark, YARN, Zookeeper, and Flume/Kafka, etc. is a
must.
Strong hands-on experience in configuring and troubleshooting Kerberos (KMS/KTS).
Automation experience in CI/CD (Continuous Integration/Deployment) Jenkins, Ansible,
Terraform, Puppet, Chef.
Implementing standards and best practices to manage and support data platforms as per
distribution.
Plan for and support hardware and software installation and upgrades.
Experience in MySQL & PostgreSQL databases.
Team player and work under minimal direction

Preferred:
 Experience with Hortonworks HDP and Cloudera CDP Hadoop distributions a plus.
 Experience with DR (Disaster Recovery) strategies and principles.
 Development or administration on NoSQL technologies like Hbase, MongoDB, Cassandra,
Accumulo, etc.
 Microsoft SQL Server database experience a plus.
 Development or administration on cloud platforms like Azure Databricks, Amazon Redshift, etc.
 Development/scripting experience on configuration management and provisioning tools (e.g.
Puppet, Chef, etc.)

 Web/Application Server & SOA administration (Tomcat, JBoss, etc.)
 Development, Implementation or deployment experience on the Hadoop ecosystem (HDFS,
MapReduce, Hive, Hbase)
 Experience on any one of the following will be an added advantage: 
Hadoop integration with large scale distributed data platforms like Teradata, Teradata
Aster, Vertica, Greenplum, Netezza, DB2, Oracle, etc.
 Proficiency with at least one of the following: Java, Python, Perl, Spark or Web-related
development
 Knowledge of Business Intelligence and/or Data Integration (ETL) operations delivery
techniques, processes, methodologies
 Exposure to tools data acquisition, transformation & integration tools like Talend, Informatica,
etc. & BI tools like Tableau, Pentaho, etc.

Job Features

Job CategoryDeveloper

Apply Online