BriefCase
BriefCase

Data Engineer(spark & Scala) Job in Anblicks

Data Engineer(spark & Scala)

Anblicks 4+ weeks ago
Apply Now
Job Summary

Data Engineer


  • 5 to 9 years hands on experience on Spark Core, Spark-SQL, Scala-Programming and Streaming datasets in Big Data platform
  • Should have extensive working experience inHiveand other components of Hadoop eco system (HBase, Zookeeper, Kafka and Flume)
  • Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.
  • Unix Shell Scripting and setting up CRON jobs
  • Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller)
  • Prior experience in Consumer Banking Domain is an advantage
  • Prior experience in agile delivery method is an advantage
  • Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions
  • Familiar with Data Warehouse concepts
  • Core Java skillset is an added advantage
  • Good Knowledge and experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus
  • Spark Developer should be able to understand the Business requirements, Functional and Technical requirements and translate them effectively using the Spark Framework.
  • Should be able to understand the complex transformation logic and translate them to Hive/Spark-SQL queries. Hands on experience on dealing with live streaming datasets using Kafka/Spark Streaming.
  • Excellent oral and written communication skills, On-time delivery and good team player

    •
    Experience Required :

    5 to 9 Years

    Vacancy :

    2 - 4 Hires

    Apply Now
    Similar Jobs for you

    See more recommended jobs

    Your 4 Step Guide to Career Success

    Apply for jobs
    Create Profile
    Schedule Interview
    Get Hired