Azure Data Engineer Job in Mindteck

Must have:

Strong hands-on experience on GCP, Azure Big Data Eng stack - ADF, Azure Databricks, ADLS, Azure SQL DB, Azure Synapse

Strong hands-on experience in PySpark, Cloudera, Hive, Impala, HDFS

Strong experience in SQL

Specific focus in Azure Data Factory, Azure Databricks, PySpark, SQL

Good knowledge on Azure Streaming Technologies, Event Hub

Knowledge on Kudu and Streamsets

Added Advantages:

CI/CD, Azure DevOps experience

Migration from Cloudera platform to Azure

Role of contractor:

Designing and building pipelines to ingest data from source systems into Azure Data Lake

Designing and building data transformation using Azure Data Factory, big data, Azure Databricks, PySpark and loading into Azure SQL DB/Synapse

Owning the code release management process for all environments

Working closely with internal architects and advise on industry best practices