Data Engineer(spark Developer) Job in Anblicks

Exp : 6+ Yrs

Location : Hyderabad

1. 6 years hands on experience on Spark Core, Spark-SQL, Python-Programming and

Streaming datasets in Big Data platform

2. Should have extensive working experience in Hive and other components of Hadoop eco

system (HBase, Zookeeper, Kafka and Flume)

3. Should be able to understand the complex transformation logic and translate them to

Spark-SQL queries.

4. Unix Shell Scripting and setting up CRON jobs

5. Should have worked on Cloudera distribution framework, Oozie Workflow (or any

Scheduler), Jenkins (or any version controller)

6. Prior experience in Consumer Banking Domain is an advantage

7. Prior experience in agile delivery method is an advantage

8. Excellent understanding of technology life cycles and the concepts and practices required

to build big data solutions

9. Familiar with Data Warehouse concepts

10. Core Java skillset is an added advantage

11. Ability to understand and build re-usable data assets or features to enable downstream

data science models to read and use

12. Good Knowledge and experience in any database (Teradata or Data Lake or Oracle or SQL

Server) is a plus

13. Bachelor of Engineering, Bachelor of Technology, MCA (or equivalent master degree)