Data Engineer Job in Happiest Minds

Skills

Required Skills: Azure SQL, Azure Streaming analytics, Azure Cosmos DB, Azure Data Lake, ETL Framework Design

Desired Skills: Azure SQL, Azure Streaming analytics, Azure Cosmos DB, Azure Data Lake, ETL Framework Design

Roles and responsibilities

Design and build modern data pipelines and data streams

Design and build data service APIs

Expose data to end users using Power BI, Azure API Apps or other modern visualization platform or experience

Analyze current business practices, processes and procedures and identify future opportunities for leveraging Microsoft Azure data & analytics PaaS services.

Support the planning and implementation of data platform services including sizing, configuration, and needs assessment

Implement effective metrics and monitoring processes

Work as a trusted advisor to our clients

What We re Looking For

Job Description

- Should have hands on experience in Azure stack (ADLS, ASA, AALS, Azure Data Bricks, Azure Data Factory etc.. ) & Power BI

- Experience in data modeling, ETL development, Data Lake and Data Warehousing.

- Experience in data streaming, batch processing, and Microservices.

- Able to design solutions in receiving the data feed from Event Hub using stream analytics and sent to Cosmos Db for high volume and real time reporting

- Comfortable in building effective analytical tools that utilize the data pipeline to provide actionable insights into data synchronization, reporting, operational efficiency and related areas.

- Experience in building scalable data pipelines on Microsoft Azure

- Implementation experience of Big Data stack in Azure

- Expert in setting up effective pipelines to capture data from multiple sources into the enterprise centric storage.

- Good experience on CI/CD practices, iterative development on the Agile-Scrum methodology.