Data Engineer Job in Kanini Software Solutions

Requirements

Experience with various data ingestion and transformation methodologies (EMR, ETL, Spark, Hadoop, etc)

Excellent communication skills to collaborate with the data engineering, analytics and science teams

Experience with the following cloud-based Big Data technologies: AWS EMR

Glue, Databricks, Spark, Jupyterhub, Hadoop, Redshift

Evaluate, configure and implement new technologies, methodologies and architecture design patterns to build data processing ETL pipeline

Data Warehousing, OLAP, SQL Queries, ETL/ELT design and development

Experience with infrastructure automation

Experience with Jenkins, GIT, and some familiarity with CI/CD

Experience with the following AWS and/or GCP Services (EKS/GKE, IAM,

KMS, VPC, EC2)

Experience working within the Agile/Scrum framework

Experience working from ticketing systems (JIRA/ServiceNow)