Data Engineer Job in Idealcrew Technology

Skill Sets Python , SQL Server and Azure Work within Program: Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform. Required Skills 50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development unless a person with app development skills is OK and would like to work as a data engineer) 25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB 25% of work: Experience with any ETL framework/tool although SSIS preferred Required but we can provide training and they can learn if lacking the experience in these areas API Development in Python Azure Data Factory (ADF) SPARK, Databricks Nice-to-have Collaborative Agile experience CI/CD skills General Traits Excellent Analytical & Communication Skills