Data Engineer(spark Developer) Job in Anblicks
Data Engineer(spark Developer)
- Hyderabad, Telangana
- Not Disclosed
- Full-time
Exp : 6+ Yrs
Location : Hyderabad
1. 6 years hands on experience on Spark Core, Spark-SQL, Python-Programming and
Streaming datasets in Big Data platform
2. Should have extensive working experience in Hive and other components of Hadoop eco
system (HBase, Zookeeper, Kafka and Flume)
3. Should be able to understand the complex transformation logic and translate them to
Spark-SQL queries.
4. Unix Shell Scripting and setting up CRON jobs
5. Should have worked on Cloudera distribution framework, Oozie Workflow (or any
Scheduler), Jenkins (or any version controller)
6. Prior experience in Consumer Banking Domain is an advantage
7. Prior experience in agile delivery method is an advantage
8. Excellent understanding of technology life cycles and the concepts and practices required
to build big data solutions
9. Familiar with Data Warehouse concepts
10. Core Java skillset is an added advantage
11. Ability to understand and build re-usable data assets or features to enable downstream
data science models to read and use
12. Good Knowledge and experience in any database (Teradata or Data Lake or Oracle or SQL
Server) is a plus
13. Bachelor of Engineering, Bachelor of Technology, MCA (or equivalent master degree)
Your 4 Step Guide to Career Success
