Airflow Jobs in Ahmedabad

Job Title: Data Engineer Location: Ahmedabad, Gujarat Job Type: Full-Time About the Role We re seeking a talented Data Engineer with hands-on experience in Azure-based data solutions. If you excel at building scalable data pipelines and have a strong command of Azure Data Factory, Databricks, PySpark, and Python, we want to hear from you. Experience with Azure Synapse Analytics, Microsoft Fabric, or Power BI will be a strong advantage. What You ll Do Design and implement scalable ETL/ELT pipelines using Azure Data Factory and Databricks. Process and transform large datasets using PySpark and Python. Build and maintain data lakes and data warehouses on the Azure Cloud. Collaborate with data architects, analysts, and business stakeholders to develop effective data solutions. Ensure high standards of data quality, consistency, and reliability. Optimize pipeline performance and manage cloud costs efficiently. Apply best practices for data security, governance, and monitoring. Document workflows and contribute to architectural decisions. 3 5 years of hands-on experience in Data Engineering. Proficiency with: Azure Data Factory (ADF) Azure Databricks Azure SQL Python and PySpark Azure Storage (Blob, Data Lake Gen2) Experience with data lakehouse or modern data warehouse architecture. Familiarity with Delta Lake, MLflow, and Unity Catalog is a plus. Strong SQL skills and experience with performance tuning. Understanding of CI/CD processes in Azure. Excellent analytical and problem-solving abilities. Bonus Skills (Preferred but not required) Experience with Azure Synapse Analytics. Knowledge of Microsoft Fabric. Power BI experience for dashboards and reporting. Exposure to DevOps and Infrastructure as Code (IaC). Understanding of data governance and security frameworks. Relevant certifications (e.g., Databricks Certified Data Engineer Associate/Professional).

We are seeking a skilled AWS Redshift Developer to join our team and help us optimize our data warehousing and analytics capabilities. Roles & Responsibilities: Design, develop, and maintain data models and ETL processes in Amazon Redshift. Write complex SQL queries and optimize performance for data retrieval and reporting. Collaborate with data engineers, analysts, and other stakeholders to understand data requirements and deliver solutions. Implement best practices for data governance, security, and performance tuning in Redshift. Monitor system performance and troubleshoot any issues that arise. Create and maintain documentation for data models, ETL processes, and system architecture. Stay updated with the latest AWS services and features to enhance data management and analytics capabilities. Requirement: 3+ years of experience in data warehousing and analytics, with a strong focus on AWS Redshift. Proficient in SQL and experience with ETL tools (e.g., AWS Glue, Apache Airflow). Familiarity with data modelling concepts and methodologies. Experience with AWS services such as S3, Lambda, and EC2. Strong analytical skills and attention to detail. Excellent communication and collaboration skills. AWS certifications (e.g., AWS Certified Data Analytics - Specialty). Knowledge of other AWS data services (e.g., RDS, DynamoDB). Experience with BI tools (e.g., Tableau, Power BI) for data visualization. Qualification : 3+ years of experience in data warehousing and analytics, with a strong focus on AWS Redshift.