Big Data Administrator Job in Balbhas Business Sysnomics Pvt Ltd
Big Data Administrator
- Chennai, Tamil Nadu
- Not Disclosed
- Full-time
Job Description:
Responsible for Design, Implementation and On-going Support of Big Data Platforms (Hadoop, Hbase, HIVE, Spark). Administration and periodic maintenance of multiple big data clusters set-up in AWS/Azure cloud environments. Own the platform architecture and the reliability, availability, scalability, operations automation and infrastructure optimization. Mentor Hadoop engineers and administrators, help with troubleshooting and root cause analysis Meet performance and SLA requirements of the Hadoop clusters. Design metrics and monitor real-time performance of clusters, capacity planning, performance tuning. Evaluate and recommend tools, modelling, configurations etc. for continuous improvement. Respond to outages during business and after-hours. Participates in 24x7 on-call rotation process. Develop scripts and tools to automate common Hadoop administration tasks. Develop and maintain operational best practices for smooth operation of large Hadoop clusters
Experience and Skills:
3+ Years of experience in deploying and administering secure, multi-tenant Hadoop clusters
Expertise with YARN, Spark, Kafka, Storm, Zookeeper, Hive, Hbase
Understanding of YARN and Spark, Kerberos and Sentry
Sound understanding in Hadoop ecosystem components like HDFS, map-reduce, Spark, Oozie , Zookeeper and Ambari/Cloudera manager
Experience in optimization, capacity planning & architecture of a large multi-tenant cluster Experience with AWS, Azure cloud environments, setting up secure virtual networks, LB, auto-scaling etc.
Expertise with one or more of the following languages: Python, Scala, Java, Ruby and in Shell scripting
Experience with multiple open source tool sets in the Big Data space.
Experience in tool Integration, automation, configuration management.
Excellent verbal and written communication skills, analytical and problem solving skills.
Your 4 Step Guide to Career Success
