Airflow Jobs in Gurgaon

Job Title: Senior Data Engineer Location: Gurugram, Haryana, India Company: Builder.ai About Builder.ai At Builder.ai, we re transforming software development so that anyone regardless of technical expertise or budget can bring their software ideas to life. From startups to global enterprises like BBC, Makro, and Pepsi, we ve empowered thousands of customers around the world. With over $450M in Series D funding, including backing from Microsoft and QIA, and recognition from Fast Company as one of 2023 s Most Innovative Companies in AI, we are scaling rapidly and redefining what s possible in software and AI. Life at Builder.ai We believe in experimentation, ownership, and constant improvement. Our team of 800+ is spread across the globe but united by our shared HEARTT values: Heart, Entrepreneurship, Accountability, Respect, Trust, and Transparency. We reward your skills with: Stock options in a hyper-growth company International offsites Unlimited learning opportunities A culture that values diversity, innovation, and impact About the Role As a Senior Data Engineer, you'll be a foundational part of our growing Data & Analytics team. We're not just building pipelines we're engineering the data backbone for an entire platform that powers AI-driven software creation, operational intelligence, and customer solutions. This role will focus on building robust, scalable, and efficient data systems, and working with Data Scientists, Analysts, and Software Engineers to ensure our data infrastructure is best-in-class. What You ll Be Doing Own and operate end-to-end data pipelines across critical business domains Optimize compute, storage, and query performance using modern big data technologies Manage and evolve our CI/CD workflows and data infrastructure Improve data accuracy, integrity, and reliability for mission-critical datasets Collaborate with cross-functional teams (Analytics, AI, Product) to deliver business value Drive best practices in data engineering, architecture, and tooling Lead projects independently while clearly communicating with stakeholders on timelines and expectations Mentor junior data engineers and contribute to a strong data culture Must-Have Experience: Expert in ETL orchestration tools (e.g., Dagster, Airflow, Luigi) Proficient in SQL databases (e.g., Snowflake, PostgreSQL) Deep understanding of big data systems (e.g., Spark, Hadoop, Hive) Strong programming in Python Experience with DBT and data modeling best practices Deep experience with cloud platforms (especially Azure) Familiarity with streaming data systems (e.g., Kafka, Kinesis) Exposure to MLOps and experience delivering clean, usable datasets to AI/ML teams Experience with CI/CD and Agile environments Nice to Have: Background in ML infrastructure or knowledge graphs Experience working in product-led B2B/SaaS organizations Contributions to open-source data tools What You ll Get Quarterly discretionary performance pay Stock options in a $450M-funded scale-up 24 days annual leave + public holidays 2 Builder Family Days + Christmas/New Year break Fully covered private medical insurance Free lunch at our Gurugram HQ Referral bonus scheme Trips abroad and global collaboration Why You Should Join If you re ready to build world-class data systems that power AI at scale, and want to help shape how software will be built in the future this is your moment. Apply today and transform the way software is created one data pipeline at a time.

Position: Alpha Gen Product Engineer Job Overview: At BlackRock, we are seeking Software Engineers who thrive in innovative environments and enjoy solving complex challenges. This is an opportunity to work with cutting-edge technology and impact the financial markets through our Aladdin investment operating system, which powers decision-making for thousands of users worldwide. The Alpha Gen Technology group (AGT) is focused on enabling market-leading performance for BlackRock's investment teams. Join a team of innovators to work on next-generation technology in the quantitative and investment space. About Aladdin and Aladdin Engineering: Aladdin is BlackRock s investment operating system, used by financial institutions worldwide. It integrates sophisticated risk analytics, portfolio management, trading, and operations tools into one platform. The Aladdin Engineering group develops and maintains this platform, building tools that manage trillions in assets and support millions of financial instruments. Your Role and Impact: As an Alpha Product Engineer in the Alpha Gen Platform team, you will develop a cloud-first platform used for both quantitative research and production systems. You will be involved in the full lifecycle of the platform, from design and architecture to development, implementation, production support, and maintenance. Your Responsibilities: Build a groundbreaking, high-quality Alpha Gen platform to meet the data and quantitative needs of research and production. Prototype new alpha-enabling technology. Migrate large amounts of critical data to cloud-native data stores like Snowflake and Azure Blob Storage. Understand and address scale challenges in data access and persistence in ingestion pipelines. Work with modern data lakes, structured file formats, containers, and orchestration ecosystems. Partner with other engineering teams at BlackRock to integrate with Aladdin. Qualifications and Skills: 8+ years of proven experience in software engineering. Excellent coding skills in Python; knowledge of Scala or Java is a plus. Experience with distributed technologies like Spark, Dask, or Kubernetes. Desire to build expertise in cloud-native technologies and applications deployed to cloud infrastructure. Familiarity with agile practices, test automation, pipelines, release management, and deployment strategies. Good understanding of the modern data ecosystem Snowflake, Apache Iceberg, Parquet formats, object stores (S3, Azure Blob Storage), and orchestration systems (Airflow, Prefect). A curiosity and passion to learn new technologies. Strong interpersonal skills to work effectively in a collaborative team environment. A deep understanding of the modern data and quantitative ecosystem. How to build a platform that enables alpha generation at scale. Experience with Aladdin the investment platform used to manage over $15 trillion in global assets. How to apply enterprise integration patterns and data science technology to enable alpha generation. Our Benefits: To help you stay energized, engaged, and inspired, we offer a wide range of benefits, including: A strong retirement plan. Tuition reimbursement. Comprehensive healthcare options. Support for working parents and Flexible Time Off (FTO) to recharge. Our Hybrid Work Model: BlackRock s hybrid work model supports collaboration while offering flexibility. Employees are required to work at least 4 days in the office per week, with the option to work from home 1 day a week. Some business groups may require more time in the office. About BlackRock: BlackRock is dedicated to helping people experience financial well-being. Our clients rely on us to support their financial goals, including saving for retirement, funding education, and growing their businesses. We invest in our employees by fostering an environment where they feel welcomed, valued, and supported with networks, benefits, and development opportunities to thrive.

We are seeking a skilled and driven Senior Data DevOps Engineer with strong MLOps expertise to join our team. The ideal candidate will have a deep understanding of data engineering, automation in data pipelines, and operationalizing machine learning models. The role requires a collaborative professional capable of designing, deploying, and managing scalable data and ML pipelines that align with business goals. Responsibilities Develop, deploy, and manage CI/CD pipelines for data integration and machine learning model deployment Implement and maintain infrastructure for data processing and model training using cloud-based tools and services Automate data validation, transformation, and workflow orchestration processes Collaborate with data scientists, software engineers, and product teams to ensure seamless integration of ML models into production Optimize model serving and monitoring to enhance performance and reliability Maintain data versioning, lineage tracking, and reproducibility of ML experiments Proactively identify opportunities to improve deployment processes, scalability, and infrastructure resilience Ensure robust security measures are in place to protect data integrity and compliance with regulations Troubleshoot and resolve issues across the data and ML pipeline lifecycle Requirements Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field 4+ years of experience in Data DevOps, MLOps, or related roles Strong proficiency in cloud platforms such as Azure, AWS, or GCP Experience with Infrastructure as Code (IaC) tools like Terraform, CloudFormation, or Ansible Expertise in containerization and orchestration technologies (e.g., Docker, Kubernetes) Hands-on experience with data processing frameworks (e.g., Apache Spark, Databricks) Proficiency in programming languages such as Python, with knowledge of data manipulation and ML libraries (e.g., Pandas, TensorFlow, PyTorch) Familiarity with CI/CD tools (e.g., Jenkins, GitLab CI/CD, GitHub Actions) Experience with version control tools (e.g., Git) and MLOps platforms (e.g., MLflow, Kubeflow) Strong understanding of monitoring, logging, and alerting systems (e.g., Prometheus, Grafana) Excellent problem-solving skills and the ability to work independently and as part of a team Strong communication and documentation skills Nice to have Experience with DataOps concepts and tools (e.g., Airflow, dbt) Knowledge of data governance and tools like Collibra Familiarity with Big Data technologies (e.g., Hadoop, Hive) Certifications in cloud platforms or data engineering We offer Opportunity to work on technical challenges that may impact across geographies Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications Opportunity to share your ideas on international platforms Sponsored Tech Talks & Hackathons Unlimited access to LinkedIn learning solutions Possibility to relocate to any EPAM office for short and long-term projects Focused individual development Benefit package: Health benefits Retirement benefits Paid time off Flexible benefits Forums to explore beyond work passion (CSR, photography, painting, sports, etc.) Qualification : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field

We are seeking a highly experienced Senior Snowflake Data Engineer to join our team. The ideal candidate will be responsible for designing and implementing robust data solutions within Snowflake, ensuring they are efficient, secure, and scalable. Responsibilities Engage in Snowflake data modeling to create and maintain optimized models tailored for data ingestion and analytical needs Develop and sustain ETL pipelines to consolidate data from diverse sources into Snowflake while preserving data integrity Fine-tune the performance of Snowflake deployments, optimize storage usage, and manage data partitioning for prompt and reliable data access Establish strong data security measures, implement role-based access controls, and apply data masking techniques to uphold data governance standards Leverage tools like dbt and Apache Airflow for scheduling and automating data processes and pipeline surveillance Cooperate closely with cross-functional teams including data scientists and business analysts to solve intricate data issues and carry out effective troubleshooting Create detailed documentation and reports on data architectures, ETL processes, and system operations to facilitate clear communication and knowledge sharing across the organization Requirements 5-8 years of experience in a data engineering role Background in information warehousing with AWS or Azure, utilizing DBT, Snowflake Proficiency in Python programming, workflow management tools including Argo, Oozie, or Airflow Snowflake modeling fundamentals like roles, schema, and databases Competency in data vault modeling, designing, and developing data transformation pipelines using DBT We offer Opportunity to work on technical challenges that may impact across geographies Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications Opportunity to share your ideas on international platforms Sponsored Tech Talks & Hackathons Unlimited access to LinkedIn learning solutions Possibility to relocate to any EPAM office for short and long-term projects Focused individual development Benefit package: Health benefits Retirement benefits Paid time off Flexible benefits Forums to explore beyond work passion (CSR, photography, painting, sports, etc.) Qualification : 5-8 years of experience in a data engineering role