Data Engineer | AWS | GLUE | SPARK Job in SQUALAS

Data Engineer | AWS | GLUE | SPARK

SQUALAS 4+ weeks ago

Apply Now

Save Job

Job Summary

Mandatory skills* : Data Engineer with AWS using Glue and Spark, Apache Airflow, NiFi, S3,Lambda, MySQL + Scrum master as nice to have

Design and Implement end-to-end ETL solutions on AWS using Glue and Spark for data preparation and feature engineering of data science projects

Be comfortable to convert SQL, Pandas code that data scientists use in experiment notebooks to proper pyspark applications

Develop and maintain data orchestration pipelines using Apache Airflow and data ingestion using NiFi

Improve on existing software, enhance code quality and organize code structure

Implementation of unit and integration tests Test Driven Development

Experience Required :

1 to 7 Year

Vacancy :

5 - 10 Hires

Skills Required :

Apache Airflow, Nifi

Apply Now

Save Job

To Receive email alerts for similar jobs

Similar Jobs for you

Apply for jobs

Create Profile

Schedule Interview

Get Hired