Airflow Pipeline Engineer Jobs in Bengaluru

Senior Data Engineer Enterprise Data Platform Location: Bengaluru Department: Business Technology Data Engineering Experience: 5+ Years Employment Type: Full-Time About Okta Okta is The World s Identity Company. We empower people to securely use any technology, anywhere, on any device. Through our Okta and Auth0 platforms, we provide secure access, authentication, and automation placing identity at the center of security and growth for thousands of organizations. We value diverse perspectives and lifelong learners. We re not looking for someone who checks every box we re looking for someone who will make us better with their unique experiences. Team: Business Technology Data Engineering The Data Engineering team at Okta supports cross-functional partners by building scalable, secure, and high-performing platforms. These platforms power decision-making and business processes across sales, marketing, engineering, finance, product, and operations. As part of this team, you ll contribute to data solutions that fuel Okta s hyper-growth. You will have the opportunity to work with cutting-edge technologies in cloud infrastructure, data lakes, automation, and CI/CD pipelines. The Role: Senior Data Engineer As a Senior Data Engineer, you will design, build, and manage modern data pipelines, infrastructure, and automation frameworks. You ll help scale our enterprise data platform using tools such as Snowflake, dbt, Airflow, Databricks, and AWS, while ensuring security, observability, and performance. You ll also contribute to CI/CD pipelines, infrastructure as code (IaC), and secure development lifecycle practices, enabling consistent, efficient, and secure delivery of data solutions. Key Responsibilities Platform Development & Infrastructure Design and maintain scalable data pipelines and platforms using Snowflake, AWS, Databricks, dbt, and Airflow. Manage infrastructure with Terraform, enabling repeatable and consistent deployments. Develop and maintain robust CI/CD pipelines using GitHub Actions, GitLab, or Jenkins. Containerize data services using Docker for better scalability and portability. Security & Compliance Implement and enforce secure development lifecycle practices, integrating tools like DAST, SAST, SCA, and Secret Scanning into pipelines. Conduct vulnerability scanning and apply patches to ensure system integrity. Ensure data security and compliance with industry standards and regulations. Collaboration & Innovation Collaborate with data engineers, data scientists, and analysts across business units to ensure data availability and integrity. Identify opportunities for automation and optimization within the data platform. Stay updated on emerging technologies and drive adoption of best practices. Must-Have Skills Bachelor s degree in Computer Science, Engineering, or a related technical field. 5+ years of experience in data engineering, including: Advanced SQL and ETL development with Airflow and dbt. Experience with data warehouses such as Snowflake, Redshift, or BigQuery. Strong hands-on experience with AWS (S3, Lambda, EC2, EMR, EKS). 2+ years of experience managing CI/CD pipelines using tools like GitHub Actions, GitLab, Jenkins, or ArgoCD. Experience with Terraform and Docker. Proficiency in backend languages such as Python, Java, or Go. Preferred Skills Experience with lakehouse architectures like Databricks, including knowledge of Delta Lake and Apache Iceberg. Background in infrastructure security, vulnerability management, and observability tooling. High Impact: Help build and scale the data platform that powers Okta s global business. Cutting-Edge Stack: Work with best-in-class technologies like AWS, Snowflake, dbt, Terraform, and Databricks. Collaborative Culture: Join a diverse, inclusive, and globally distributed team that values knowledge sharing and continuous learning. Career Growth: Shape the future of Okta s data engineering practice while expanding your technical and leadership skills. Bring your passion for data, cloud, and automation and let s shape the future of secure, scalable enterprise data platforms together. Qualification : Bachelors degree in Computer Science, Engineering, or a related technical field

Software Development Manager Experience: 8+ Years Location: Bangalore Company: Kaleidofin About Us Kaleidofin is a mission-driven fintech platform committed to delivering financial solutions for underserved communities. Our proprietary ki credit platform combines advanced credit health analytics, middleware integration, risk dashboards, and debt capital structuring empowering financial institutions to serve low-income customers, informal sector businesses, and MSMEs more effectively. Operating across India, Bangladesh, and Kenya, we ve already impacted over 6 million customers, enabling over $3 billion in debt capital for underserved communities. Backed by global investors including the Gates Foundation, Omidyar Network, and Blume Ventures, Kaleidofin is recognized as a leader in inclusive finance. Featured on Forbes Asia's "100 to Watch" Winner of RBI s Swanari TechSprint 2023 Winner of G20 TechSprint 2024 by BIS Certified as a Great Place to Work Role Overview As a Software Development Manager, you will play a key leadership role in shaping the technical roadmap and executing high-impact fintech products. You ll lead a team of engineers to build scalable, secure, and robust systems. This is a hands-on leadership role requiring active involvement in design, architecture, and code-level decisions. What You ll Do Own the product s engineering roadmap, architecture, scalability, and code quality. Guide system design decisions and lead architecture/code reviews. Collaborate closely with Product and Business teams to align on product strategy and feature development. Provide hands-on technical leadership especially in solving complex problems in fintech and lending domains. Mentor and develop engineering talent; foster a culture of ownership, innovation, and quality. Champion engineering best practices including test automation, CI/CD, and DevOps. Lead the adoption of data-driven practices including Big Data, PySpark, and data pipeline architectures. Balance short-term deliverables with long-term technical sustainability and scalability. Support team growth through career development, learning plans, and succession planning. 8+ years of software development experience, with 1 2+ years in people/team management roles. Strong fundamentals in computer science, system design, and problem-solving. Bachelor's or Master's degree in CS or related field from a top engineering institution (IITs, NITs, etc.). Proven experience building distributed, scalable, and secure systems. Strong hands-on experience with Python, Java, Spring Boot, and microservice architectures. Proficient in SQL/NoSQL, Kafka, CI/CD pipelines, and DevOps tools (Docker, Kubernetes, Jenkins, etc.). Familiarity with AI/ML model integration and credit scoring systems is a strong plus. Experience with data engineering: Big Data, Spark, Airflow, AWS stack (S3, Glue, Athena), etc. Knowledge of front-end and mobile (Android) development is a plus. Experience working in fintech, lending tech, or high-growth startup environments preferred. Excellent leadership, communication, and cross-functional collaboration skills. Be part of a high-impact team driving financial inclusion at scale. Work on cutting-edge technology in fintech and data infrastructure. Grow with a company that s winning global recognition and delivering real-world impact. Contribute to a people-first culture that values learning, innovation, and work-life balance. Qualification : Bachelor's or Master's degree in CS or related field from a top engineering institution

Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.

Position: Data Science Specialist Employment Type: Full-time Location: Bangalore, On-site Experience Required: 1 to 6 years (Mindset > Experience) About the Role: We re seeking a mission-driven, hands-on Data Analytics Specialist passionate about impact. This is not a typical analytics role you will drive key business metrics across clinical operations, stakeholder reporting, and automation. Collaborate closely with leadership, radiologists, operations, product teams, and AI engineers to ensure every decision is data-driven, actionable, and scalable. If you thrive on building dashboards, automating processes, streamlining pipelines, and driving growth through insights, this is your playground. Key Responsibilities: Own Business KPIs: Take full ownership of company-wide metrics, ensuring their accuracy, relevance, and actionability through stakeholder alignment. Data Engineering: Build and optimize ETL/ELT pipelines integrating data from Postgres, ClickHouse, and other sources. Dashboards & Reporting: Design and maintain intuitive dashboards (Metabase, Power BI, Tableau, Google Data Studio) that stakeholders actively use. Backend Data Transformation: Write clean, reusable code to convert raw data into actionable insights. API Development: Build and maintain internal APIs to serve analytics data to frontend and production systems. Email Automation: Develop real-time and scheduled email reports delivering dynamic insights to stakeholders. Spreadsheet Expertise: Automate and manipulate complex data in Excel/Google Sheets for detailed analysis and reporting. AI & Automation: Collaborate with AI teams to integrate predictive algorithms and automate analytics workflows. Business Acumen: Develop deep understanding of the teleradiology ecosystem clinical workflows, operations, financials, and tech platforms. Proactive Collaboration: Identify data gaps, flag inconsistencies, recommend improvements, and work closely with leadership. Required Skills: Strong Python skills for data analytics (Pandas, NumPy, FastAPI, Jupyter, etc.) Proficient in SQL (ClickHouse, PostgreSQL) with experience optimizing queries End-to-end dashboard ownership from data modeling to UI presentation Experience building or integrating APIs for analytics Advanced spreadsheet skills and formula-driven reporting Experience working with AI/ML models in applied settings (preferred) Hands-on backend data transformations, version control, and automation Familiarity with full-stack development frameworks (bonus) Bonus / Nice to Have: Exposure to dbt, Airflow, ChromaDB, Streamlit, Plotly Knowledge of data privacy, compliance, and healthcare analytics Experience building analytics platforms for SaaS or health-tech companies Mindset We re Looking For: 10x Hustler: Ready to learn fast and go the extra mile to solve problems. Obsessed with Accuracy: Data must be flawless before release. Extreme Ownership: Proactive in driving results without waiting for instructions. Fast Learner: Able to pick up new tools and concepts quickly. Business First, Code Later: Focused on impact, not just coding. Be part of India s fastest-growing teleradiology platform Direct access to leadership and real-world business impact Build game-changing analytics systems and influence strategy Gain exposure to AI, automation, product, and operations in one role Clear ramp-up roadmap and growth plan Expectations in First 3 Months: Build an end-to-end dashboard from scratch Clean up at least one messy data pipeline Automate a stakeholder email update Validate accuracy across critical business metrics Understand full-stack platform structure and propose an improvement

Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.

Position: Business Technology Data Engineer Location: Bengaluru, India (Hybrid 3 days onsite) Company: Samsara Technologies India Pvt. Ltd. About Samsara Samsara (NYSE: IOT) is a leader in the Connected Operations Cloud, enabling businesses across industries like transportation, logistics, manufacturing, and field services to harness IoT data for safety, efficiency, and sustainability improvements. Samsara helps organizations digitize physical operations at scale, improving outcomes that impact global infrastructure. Role Overview Samsara is seeking a Business Technology Data Engineer to join its Data & Analytics team within the Business Technology division. In this role, you will design, build, and optimize end-to-end data pipelines and infrastructure for various business-critical systems across CRM, marketing, support, and product platforms. You'll collaborate with teams across the company to build reliable and scalable data solutions that power reporting, automation, and analytics. This hybrid role requires working 3 days per week from the Bengaluru office and 2 days remotely, with working hours aligned to India Standard Time (IST). Key Responsibilities Data Engineering & Platform Development Design and maintain ETL/ELT pipelines that integrate and transform data across business systems. Build scalable data infrastructure to support advanced analytics and real-time reporting needs. Write Python and SQL scripts for data ingestion, transformation, and validation. Data Integration & Enablement Work with diverse data sources: CRM, product telemetry, marketing automation, support ticketing, and order flow systems. Develop and support data lake and data warehouse solutions using Snowflake, Redshift, Databricks, or BigQuery. Ensure interoperability between applications and data layers. Performance & Quality Monitor and optimize pipeline performance, implement observability and alerting. Improve data quality, lineage, and governance across systems. Partner with internal stakeholders (e.g., Sales Ops, Marketing Ops, Analytics) to deliver reliable data products. Minimum Qualifications Bachelor s degree in Computer Science, Data Engineering, or related field. 5+ years of professional experience in data engineering. 3+ years experience building and maintaining end-to-end pipelines in a modern data stack. Strong in SQL and Python. Hands-on experience with: ETL tools: Fivetran, dbt Cloud: AWS (preferred), GCP, or Azure Databases: MySQL, PostgreSQL, Oracle, or similar Data Warehouses: Snowflake, Redshift, BigQuery, Databricks Preferred Qualifications Familiarity with API-based ingestion, serverless architecture (Lambda, API Gateway, SQS, etc.). Experience with monitoring tools (DataDog, CloudWatch, Splunk). Comfortable engaging stakeholders to translate business needs into data solutions. Proficiency in Docker, Kubernetes, or AWS Fargate is a plus. Qualification : Bachelors degree in Computer Science, Data Engineering, or related field

Job Title: Engineering Manager Data Engineering Location: Bengaluru, Karnataka, India Department: Engineering Experience: 6 to 8 years Open Positions: 2 About the Role As an Engineering Manager - Data Engineering, you will lead a team of skilled data engineers who design, build, and maintain scalable data pipelines and infrastructure. You will collaborate with cross-functional teams and client stakeholders to deliver high-quality data systems that meet business goals. Your leadership will be pivotal in mentoring your team, driving project execution, and advancing data engineering capabilities across the organization. Key Responsibilities Lead, mentor, and develop a team of data engineers, fostering a collaborative and inclusive work environment. Conduct performance reviews, provide constructive feedback, and set clear goals for team members. Identify skill gaps and create opportunities for continuous professional growth. Plan, execute, and deliver data engineering projects on schedule and within scope. Coordinate with stakeholders to gather requirements, prioritize tasks, and define project timelines. Ensure all projects align with broader business objectives and data strategies. Oversee design, development, and maintenance of data pipelines, ETL processes, and data warehouses. Guarantee data quality, integrity, and security in all data engineering initiatives. Identify and drive process improvements to enhance efficiency and effectiveness in data operations. Manage client conversations to understand requirements and translate them into technical deliverables. Build and promote reusable frameworks to drive efficiency in data systems. Lead multiple projects involving streaming, batch, and large-scale data pipelines. Required Technical Skills Strong execution knowledge of data modeling, relational and non-relational databases (SQL and NoSQL). Expertise with ETL and orchestration tools such as IICS, Metatron, Airflow, Azure Data Factory, AWS Glue, or GCP Composer. Experience working with data warehouses like Snowflake, Redshift, Hive, or BigQuery. Proficiency in Apache Spark and optimization of Spark jobs. Strong programming skills in Python (mandatory), with knowledge of Scala, Rust, or Java as a plus. Understanding of Medallion architecture patterns. Advanced SQL skills with query optimization expertise. Experience with software development lifecycle, unit testing, and functional programming concepts. Required Non-Technical Skills Strong problem-solving skills with the ability to assess financial impacts of decisions. Excellent written and verbal communication skills, capable of engaging with mid-management client stakeholders. Ability to balance pragmatic solutions against perfect ones, driving team consensus and business value. Exceptional people management skills, including conflict resolution, empathy, negotiation, and active listening. Proven leadership and mentorship abilities, providing technical guidance to delivery teams. Self-driven, with a strong sense of ownership and accountability. Preferred Educational Qualifications Bachelor s degree in Engineering (B.E./B.Tech), MCA, or M.Sc. (Mathematics, Statistics). Lead and mentor a talented team working on cutting-edge data engineering projects. Collaborate closely with clients and cross-functional teams in a dynamic, fast-growing company. Drive innovation with scalable, high-impact data solutions. Grow your leadership and technical skills in a supportive, inclusive environment. Qualification : Bachelors degree in Engineering (B.E./B.Tech), MCA, or M.Sc. (Mathematics, Statistics).

Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field

Senior Data Engineer Location: Bengaluru Department: Global Strategic Services Data Engineering EMEA Type: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader driving industrial digital transformation. Our platforms Cognite Data Fusion and Cognite Atlas AI enable companies across Energy, Utilities, Manufacturing, and Chemicals to solve complex challenges using AI, contextual data, and automation. Cognite is backed by top-tier investors and recognized with global innovation awards. Our Values Impact: We deliver results that matter. Ownership: We take initiative, act inclusively, and embrace accountability. Relentless: We pursue excellence and innovation with resilience. About the Role As a Senior Data Engineer, you ll lead the development of scalable data solutions that empower critical industries to make informed decisions. You ll work on high-impact projects across regions, collaborating with solution architects, data scientists, and product teams. This is a growth role with room to influence product direction and mentor junior engineers. Key Responsibilities Architect and implement robust data pipelines using Cognite Data Fusion, Python, SQL, and REST APIs. Lead integrations, data modeling, and transformation tasks using cloud-native technologies. Design custom data models for discovery, mapping, and cleansing industrial data. Collaborate closely with cross-functional teams to deliver digital solutions. Conduct code reviews and champion engineering best practices. Contribute to Cognite s SDKs and internal tools. Translate customer use cases into scalable, reusable data engineering frameworks. Mentor team members and support customer onboarding when needed. What You ll Bring Bachelor s or Master s in Computer Science or related field (or equivalent experience). 5+ years in a data-intensive, customer-facing engineering role. Expertise in Python, SQL, REST APIs, and pipeline orchestration. Experience with distributed computing, Kubernetes, and cloud platforms (Azure, GCP). Familiarity with data from industrial domains like oil & gas or manufacturing is a plus. Strong DevOps mindset with hands-on experience in Git, CI/CD, and deployments. Proactive and collaborative; able to work independently and solve complex challenges. A growth mindset with willingness to ask for help and share knowledge openly. Be part of a global team spanning 70+ nationalities with strong DEI focus. Work at our Bengaluru office (Rathi Legacy, Hoodi) in a modern hybrid environment. Enjoy flat hierarchy, fast decision-making, and high ownership culture. Collaborate with world-class professionals on industry-transforming projects. Shape the future of industrial data and drive real-world impact at scale. If you re passionate about solving meaningful problems with cutting-edge data technologies, apply today. We welcome applicants from all backgrounds and experiences you might be the perfect fit, even if you don t meet every single requirement. Qualification : Bachelors or Masters in Computer Science or related field (or equivalent experience).

Engineering Leader - Machine Learning Location: Bangalore, Karnataka, India Employment Type: Full-Time | Hybrid Work Model About Eightfold.ai At Eightfold.ai, we re revolutionizing the future of employment by leveraging artificial intelligence to connect individuals to the right career opportunities based on their skills, not just their network. Our AI-powered Talent Intelligence Platform is transforming how organizations plan, hire, develop, and retain a diverse workforce. With $410M+ in funding and a $2B+ valuation, we re growing rapidly, and if you're passionate about solving one of society's most critical challenges employment then Eightfold is the place for you. Led by visionary leaders like Ashutosh Garg (former Google Search and Personalization leader) and Varun Kacholia (former Facebook and Youtube leader), we are shaping the future of AI-powered talent management. About the AI Platform Team Our AI/ML team is the heart of Eightfold, pushing the boundaries of applied machine learning. We re working with massive datasets, solving complex problems, and building cutting-edge AI models that are reshaping how companies approach talent management. Join us if you re eager to work in a team where every day presents a new challenge and opportunity. What You ll Do As the Engineering Leader - Machine Learning, you ll be responsible for leading and mentoring a high-performing team of engineers, driving the success of AI-driven products at Eightfold. Your primary responsibilities will include: Team Leadership: Coach, mentor, and manage a talented team of engineers to foster a culture of innovation, collaboration, and high performance. ML Model Ownership: Lead the development and deployment of cutting-edge deep learning models across all Eightfold products, ensuring reliability, scalability, and high-quality performance. Platform Development: Help build high-performance, flexible infrastructure that supports a variety of deep learning techniques and modeling approaches. End-to-End ML Pipeline: Oversee the end-to-end process of building and deploying machine learning models, including creating robust data pipelines that can process unstructured data. ML Framework Implementation: Design and implement an intuitive ML development framework that ensures efficiency and ease of use for data scientists and engineers. Model Fairness: Work with our internal model fairness platform to ensure that we are providing equal opportunity for everyone through responsible ML practices. Cross-Team Collaboration: Work closely with product teams to apply deep learning techniques to solve complex business problems across various domains. What You Should Already Know To be successful in this role, you should have: Strong Foundation in ML & Deep Learning: Expertise in applying Natural Language Processing (NLP) and deep learning solutions to solve real-world problems. Experience with Language Models: Familiarity with advanced language models such as BERT, GPT-3, T5, and others. Academic Background: A BS, MS, or PhD in Computer Science, Data Science, Mathematics, or related fields. Proven ML Experience: Hands-on experience building and deploying machine learning models at scale, particularly in production environments. Programming Expertise: Strong knowledge of ML languages such as Python, C++, Java, R, Scala, and experience with scientific libraries like numpy, pandas, and frameworks like TensorFlow, PyTorch, scikit-learn, etc. Strong ML Theory Knowledge: In-depth understanding of ML theory and experience working with large-scale datasets, data ingestion, and processing systems. Experience with Distributed Systems: Familiarity with distributed systems, including REST APIs, microservices, and data processing frameworks. Metrics-Focused: A passion for building high-quality models that deliver results and metrics-driven outcomes. Nice to Have Real-Time Tech Problems: Experience with real-time processing or low-latency systems. Cloud Environments: Familiarity with cloud platforms like AWS, and experience using cloud-based ML tools. MLOps Tools & Pipelines: Experience with MLflow, Metaflow, or similar tools to streamline ML workflows and operations. Advanced Tech Stack: Familiarity with tools like Spark, MLlib, Databricks, Apache Airflow, etc. Impactful Work: Join a company dedicated to solving one of society's most pressing issues employment. Your work will have a direct impact on individuals' careers around the world. Innovation at Scale: Work with cutting-edge AI and ML technologies to shape the future of talent management. Competitive Compensation: Receive an attractive salary, equity, and comprehensive benefits package (including family medical, vision, and dental coverage). Collaborative Environment: Work in a culture that values transparency, ownership, and collaboration across teams. Hybrid Work Model: Enjoy a hybrid work environment, with flexibility for remote work and in-office collaboration at our Bangalore office. Growth Opportunities: Be part of a rapidly scaling company with vast opportunities for career development and leadership roles. Equal Opportunity Employer Eightfold.ai is an Equal Opportunity Employer. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, or disability. If you are an experienced and visionary leader in Machine Learning, eager to make a lasting impact while solving one of society's most important challenges, we would love to hear from you. Qualification : BS or MS or PhD degree in Computer Science, Data Science or Mathematics

Lead Data Scientist Location: Bengaluru, India Employment Type: Full-time, Hybrid About Neuron7.ai Neuron7.ai is a rapidly growing AI-first SaaS company creating service intelligence products that are transforming industries such as high-tech devices, manufacturing, and medical devices. Backed by top Silicon Valley venture capitalists and an esteemed group of angel investors, we are recognized as a startup to watch. Our AI-driven platform helps enterprises make accurate service decisions at scale by delivering service predictions in seconds. By analyzing structured and unstructured data, alongside insights from leading experts, we empower service leaders to improve key metrics like first-call resolution, turnaround time, and service margins. At Neuron7.ai, you'll be part of a dynamic and innovative team that is redefining service intelligence. We value creativity, collaboration, and a commitment to pushing boundaries. Our goal is to lead the AI revolution in service decision-making, and we want you to be a part of that journey. About the Team As a Lead Data Scientist, you ll play a pivotal role in designing, developing, and deploying NLP-driven solutions for processing and analyzing large volumes of unstructured data. Your deep technical expertise will help launch AI products that directly impact users. You ll also mentor junior team members, ensuring technical excellence and fostering growth within the team. You'll collaborate closely with cross-functional teams and customers to solve complex challenges and create impactful AI solutions. What You ll Do: Lead NLP Development: Oversee the development and deployment of NLP-based solutions for processing and analyzing unstructured data at scale. Machine Learning Model Development: Design, train, and optimize machine learning models using popular libraries such as PyTorch, NLTK, and Scikit-learn. Cloud Deployment: Architect and deploy AI/ML products on cloud platforms such as Azure, GCP, or AWS. Collaboration: Work with data engineering teams to ensure seamless integration of AI models into production systems. Data Analytics: Perform advanced SQL analytics to extract actionable insights from structured datasets. Mentorship: Guide and mentor junior data scientists, fostering a culture of technical excellence within the team. Customer Engagement: Work closely with customers to understand their needs and translate those into technical solutions. Communicate complex technical concepts to non-technical stakeholders. Stay Current: Keep up-to-date with the latest advancements in NLP and machine learning to ensure best practices and cutting-edge solutions are applied. What We re Looking For: Experience: Minimum 10 years of experience in data science, specifically focused on NLP and unstructured data processing. Track Record: Proven experience in launching NLP-driven products to live users. Technical Expertise: Expertise in Python and libraries such as PyTorch, NLTK, and Scikit-learn. Hands-on experience with Transformer-based models (e.g., BERT, GPT). Cloud Proficiency: Strong experience with cloud platforms like Azure, GCP, or AWS for hosting and deploying AI/ML products. Data Engineering Knowledge: Familiarity with data engineering pipelines and best practices for scalable AI model deployment. SQL Proficiency: Proficient in SQL for data manipulation and advanced analytics. Problem-Solving: Excellent problem-solving skills with a strong ability to work with large-scale datasets. Leadership & Communication: Strong interpersonal and communication skills, with the ability to mentor team members and interact effectively with customers. Preferred Skills: MLOps Knowledge: Understanding of MLOps practices for model deployment, monitoring, and lifecycle management. Data Processing Tools: Familiarity with tools like Airflow, Spark, or similar frameworks for data processing. Customer-Facing Experience: Background in working with customer-facing applications and APIs to deliver AI-powered solutions. What We Do and Value: At Neuron7.ai, we prioritize integrity, innovation, and a customer-centric approach. Our mission is to enhance service decision-making using advanced AI technology, and we are committed to delivering excellence in all aspects of our work. Company Perks & Benefits: Competitive salary, equity, and spot bonuses Paid sick leave Latest MacBook Pro for your work Comprehensive health insurance Paid parental leave Hybrid work model with flexibility to work from our vibrant Bengaluru office Our Commitment to Diversity and Inclusion: Neuron7.ai is committed to fostering a diverse and inclusive workplace. We ensure equal employment opportunities without discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, marital status, or any other characteristic protected by law. If you re passionate about building innovative AI-driven solutions and want to be part of a forward-thinking team, we d love to hear from you!

Python/Apache Airflow Developer Location: Bengaluru, India Company: Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) Company Overview Wipro Limited is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For more information, visit www.wipro.com. Role Purpose The purpose of this role is to design, test, and maintain software programs for operating systems or applications to be deployed at the client end and ensure they meet 100% quality assurance parameters. Position Overview We are seeking a skilled Python and Apache Airflow Developer with a strong background in data engineering to help develop and maintain robust data pipelines and support business intelligence initiatives. Key Responsibilities Develop and maintain data pipelines using Apache Airflow and Python. Collaborate with business managers to understand data requirements. Optimize existing data workflows for performance and reliability. Manage SQL and NoSQL databases for business intelligence. Ensure data quality and security. Troubleshoot data pipeline issues and ensure smooth data flow. Required Qualifications Proven experience in Python programming and data engineering. Hands-on experience with Apache Airflow. Strong understanding of SQL and experience with SQL databases. Familiarity with NoSQL databases. Experience in data modeling and ETL processes. Must have: Python and Apache Airflow, with preferably 5+ years of experience. About Wipro Wipro is constantly evolving, and we re looking for passionate individuals who want to build a modern digital transformation partner with bold ambitions. Join Wipro, where we empower you to design your own reinvention. Realize your ambitions and take part in our global, purpose-driven business. Applications from people with disabilities are explicitly welcome.

Sr. Data Engineer - AWS - Big Data Location:Bangalore Type of Employment: Full-Time Experience Required: 7 to 10 years Job Overview: We are seeking a highly skilled Sr. Data Engineer with expertise in AWS cloud technologies and Big Data to join our Cloud Data Architect Team at Infocepts. In this critical role, you will design and implement robust data solutions using technologies like EMR, Athena, PySpark, AWS Lambda, S3, and other AWS services. The ideal candidate will have a strong foundation in database concepts and SQL and will be responsible for building scalable data pipelines to support high-performance data processing. Key Responsibilities: Technology Assessment and Design: Study the existing technology landscape and evaluate current data integration frameworks. Assist in designing complex Big Data use cases leveraging AWS services. Documentation and Stakeholder Communication: Prepare and maintain comprehensive project documentation, adhering to quality guidelines and schedules. Work closely with Architects and Project Managers to provide accurate estimations, scoping, and scheduling assistance. Clearly communicate design decisions and conduct Proof-of-Concepts to validate new solutions before implementation. Process Improvement and Automation: Identify areas for process automation to improve efficiency and team productivity. Provide expert guidance and troubleshooting support to junior Data Engineers. Training and Knowledge Sharing: Develop and deliver technology-focused training sessions for the team, ensuring continuous knowledge sharing. Share expertise through Expert Knowledge Sharing sessions with Client Stakeholders. Essential Skills: AWS Services Expertise: In-depth knowledge of S3, EC2, EMR, Athena, AWS Glue, and Lambda. Big Data Technologies: Proficiency with Apache Spark, Databricks, and Big Data table formats such as Delta Lake (open-source). Data Warehousing: Strong understanding of data warehousing concepts and architectures. Programming Skills: Advanced programming skills in Python for building data pipelines. SQL Expertise: Strong SQL skills for data transformation, aggregation, and querying large datasets. ETL Workflow Development: Expertise in creating ETL workflows with complex transformations (e.g., SCD, deduplication, aggregation). Orchestration Tools: Familiarity with orchestration tools like Apache Airflow. MPP Databases: Experience with at least one MPP database (e.g., AWS Redshift, Snowflake, SingleStore). Cloud Databases: Exposure to cloud databases like Snowflake or AWS Aurora. Desirable Skills: Cloud Databases: Familiarity with Snowflake, AWS Aurora. Big Data Technologies: Experience with Hadoop and Hive. AWS Certification: Associate or Professional Level AWS Certification. Advanced Knowledge of Big Data Solutions: Exposure to big data tools and frameworks on cloud platforms. Qualifications: Experience: 7+ years of overall IT experience, with 5+ years specifically focused on AWS-related projects. Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus). Technical Certifications: Demonstrated commitment to continuous learning through certifications or relevant training. Qualities: Strong analytical and problem-solving skills to deep dive into complex technical challenges.

Position: Cloud Data Engineer AWS Big Data Location: Bangalore, India Employment Type: Full-time Experience Required: 5 to 8 years Purpose of the Position: Join the Infocepts Cloud Data Architect Team as a Cloud Data Engineer and help design and implement cutting-edge big data solutions on AWS. You will leverage your expertise in EMR, Athena, PySpark, S3, AWS Lambda, and SQL to develop robust and scalable data platforms. Key Responsibilities: Technology Assessment and Design: Assess existing technology landscape and data integration frameworks. Design complex Big Data use cases using AWS services under guidance of the Architect. Support architectural decision-making by evaluating trade-offs in cost, performance, and durability. Recommend optimizations to existing data infrastructure. Documentation and Stakeholder Communication: Create project documentation adhering to quality and delivery standards. Collaborate closely with Architects and Project Managers for scoping, estimation, and planning. Present design decisions to technical and business stakeholders clearly. Conduct PoCs and design review sessions. Process Improvement and Automation: Identify and suggest opportunities for automation and process enhancements. Mentor junior engineers and support technical problem solving. Training and Knowledge Sharing: Prepare and deliver internal training on AWS and Big Data topics. Lead client knowledge sharing sessions and contribute to case studies. Essential Skills: In-depth experience with AWS services: S3, EC2, EMR, Athena, Glue, Lambda Familiarity with MPP databases like Redshift, Snowflake, or SingleStore Proficiency in Apache Spark and Databricks Strong programming skills in Python Experience building data pipelines using AWS and Databricks Knowledge of Big Data file formats such as Delta Lake Advanced SQL skills for large-scale data manipulation Hands-on experience with Apache Airflow or similar orchestration tools Strong understanding of ETL workflows and data warehousing concepts Desirable Skills: Cloud databases: AWS Aurora, Snowflake Experience with Hadoop and Hive AWS Certifications (Associate or Professional level) are a plus Qualifications: Bachelor s degree in Computer Science, Engineering, or related field (Master s preferred) Overall 5+ years of IT experience with at least 3 years in AWS Big Data projects Ongoing learning and technical certifications are strongly encouraged Key Qualities: Strong problem-solving and analytical thinking Self-driven with a passion for emerging data technologies Excellent communication and client presentation skills Ability to work in cross-functional, agile teams Apply now to be part of a high-impact data transformation team working on large-scale cloud data projects! Qualification : Bachelors degree in Computer Science, Engineering, or related field (Masters preferred)

Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.

Your Impact As a Data Engineer at QuantumBlack, you will collaborate with stakeholders, data scientists, and internal teams to develop and implement impactful data products and solutions. Your key responsibilities will include building and maintaining technical platforms for advanced analytics, designing scalable and reproducible data pipelines for machine learning, and ensuring information security within data environments. You will assess clients' data quality, map data fields to hypotheses, and prepare data for use in analytics models. Additionally, you will contribute to R&D projects, internal asset development, and participate in cross-functional problem-solving sessions with a variety of stakeholders, including C-level executives, to create innovative analytics solutions. You will be based in Gurugram, joining a global data engineering community, and work within cross-functional and Agile project teams alongside project managers, data scientists, machine learning engineers, other data engineers, and industry experts. You will collaborate directly with our clients, ranging from data owners and users to C-level executives. You will be aligned with one of our industry-focused practices: Pharma & Medical Products (PMP) or Global Energy & Materials (GEM). In these practices, you ll work on solving the most critical challenges for our clients in these sectors. PMP focuses on advancing the development and delivery of life-saving medicines and medical treatments, while GEM supports industries like chemicals, steel, mining, and energy to achieve operational excellence. GEMx and PMPx, the assetization arm of these practices, focus on creating reusable digital and analytics assets to support client work. As part of this team, you will help shape impactful solutions for large organizations, developing capabilities for sustained impact. Your Growth In this role, you will contribute to the frameworks and libraries that our teams of Data Scientists and Engineers use to progress from data to meaningful impact. You will have the opportunity to guide global companies through data science solutions, helping them transform and enhance performance across industries including healthcare, automotive, energy, and elite sports. Real-World Impact: You ll gain unique learning and development opportunities globally. Fusing Tech & Leadership: Work with the latest technologies and methodologies, with access to top-tier learning programs. Multidisciplinary Teamwork: Collaborate with data scientists, engineers, project managers, UX designers, and more to enhance performance. Innovative Work Culture: Creativity, passion, and wellness are central to our modern work environment, which includes insightful talks, training sessions, and a focus on work-life balance. Striving for Diversity: We celebrate diversity, with colleagues from over 40 nationalities, appreciating the value that diverse perspectives bring to the workplace. You are a highly collaborative individual who prioritizes impact over agenda. You enjoy learning from colleagues, challenging ideas thoughtfully, and working together to improve processes and solve problems. You believe in iterative change, experimenting with new approaches, and advancing quickly through constant learning and improvement. While we value using the right tech for the right task, our team often leverages technologies such as Python, PySpark, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions like AWS, GCP, and Azure. Your Role as a Data Engineer Collaboration: Work with business stakeholders, data scientists, and internal teams to create extraordinary, domain-focused data products (reusable assets) and deliver them to clients. Domain Expertise: Develop deep understanding of client industries and use creative techniques to deliver meaningful impact. Technical Platforms: Build and maintain technical platforms for advanced analytics engagements, spanning both data science and data engineering work. Data Pipelines: Design and implement robust, modular, scalable, deployable, and reproducible data pipelines for machine learning. Data Management: Ensure the security of data environments and compliance with information security standards. Data Wrangling: Assess data quality, map data fields to hypotheses, and prepare data for analytics models. Contribute to R&D: Participate in internal asset development and contribute to R&D projects to drive innovation. Cross-functional Problem Solving: Collaborate with internal teams and clients, including data owners and C-level executives, to create impactful analytics solutions. Your Qualifications and Skills Bachelor s degree in computer science or related field; Master's degree is a plus. 2-5 years of relevant work experience. Proficiency in at least one programming language such as Python, Scala, or Java. Strong experience with distributed processing frameworks (e.g., Spark, Hadoop, EMR) and SQL. Experience in commercial client-facing projects, particularly in close-knit teams. Ability to work with structured, semi-structured, and unstructured data, and identify linkages across disparate data sets. Clear communication skills to explain complex solutions effectively. Understanding of information security principles to ensure compliant handling of client data. Experience with cloud platforms (AWS, Azure, Google Cloud, Databricks) is highly desirable. Experience with CI/CD processes using GitHub Actions, CircleCI, or similar, and end-to-end pipeline development including application deployment is a plus. Qualification : Bachelors degree in computer science or related field; Master's degree is a plus.

Job Title: Senior Python Expert Experience: 3 to 8 years Overview of the Role: This role sets the benchmark for team software development processes and deployment procedures, while actively contributing to establishing best practices and methodologies within the team. Responsibilities: Develop backend services using Python Flask or similar web frameworks. Design and maintain data and pipeline management frameworks using open-source technologies such as Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud-based data engineering services like S3, Redshift, Athena, Kinesis. Design and develop efficient CRUD operations for large datasets with millions of records. Collaborate with teams to build and maintain innovative, reliable, secure, and cost-effective distributed solutions. Own and deliver complex application components within defined timelines. Ensure quality delivery using best practices in API development, performance, and scalability. Participate in customer communication, presentations, and resolution of critical issues. Contribute to architecture, feature set, and design decisions. Proactively recognize and address requirement inconsistencies and project risks. Break down work effectively and estimate accurately. Serve as a technical mentor and role model within the team. Required Skills: Strong knowledge of Python and a web framework like Flask. Experience with AWS services such as EC2, S3, Lambda, Step Functions, Glue, SNS, SQS, Secret Manager, and CodeBuild/CodePipeline. Solid understanding of SQL, including query writing, optimization, and database interaction tools. Experience with API development (RESTful services, Postman, API Gateway). Strong coding, debugging, and problem-solving skills. Understanding of architectural trade-offs and data engineering principles (data acquisition, ingestion, distributed processing, high availability). Ability to independently handle delivery of complex projects. Excellent team management and individual contributor skills. Good to Have Skills: Experience with Big Data frameworks like Hadoop and Spark. Knowledge of AWS Aurora. Familiarity with pip, setuptools, etc. Education: B.E./B.Tech, MCA, M.E./M.Tech.

Job Title: Tech Architect Experience: 7 to 10 years Education: B.E./B.Tech, MCA, M.E./M.Tech About HashedIn: We are software engineers solving business problems with a Product Mindset for leading global organizations. By combining engineering talent with business insight, we build software and products that create enterprise value. We thrive in a fast-paced learning environment, driven by extreme ownership and a fun, inclusive culture. If you are a problem solver who thrives in dynamic environments, enjoys working on cutting-edge technologies, and values collaboration and high performance, HashedIn is the place to be! Overview of the Role: As a Tech Architect, you will drive architecture and design decisions, ensuring scalability, performance, and reliability. You will play a critical role in setting up best practices, defining technical roadmaps, and ensuring high-quality delivery. This role requires hands-on technical leadership, a deep understanding of cloud platforms, architecture patterns, and modern engineering practices. Key Responsibilities: Design and deploy resilient APIs, bridging cloud infrastructure with software development. Build and manage data and pipeline management frameworks using Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud services like S3, Redshift, Athena, Kinesis, etc. Collaborate with cross-functional teams to build innovative, secure, and cost-effective distributed solutions. Design and develop big data solutions, real-time analytics, and streaming platforms using industry-standard technologies. Own delivery of complex components, ensuring adherence to technical and business requirements. Serve as a team lead or influential individual contributor, driving architecture decisions and best practices. Identify requirement inconsistencies, proactively highlight risks, and maintain clear communication with stakeholders. Create and maintain clear technical specifications, ensuring proper work breakdown and estimation. Support customer communication, handle critical issues, and contribute to client presentations. Set standards for software development processes and deployment methodologies, contributing to team-wide best practices. Desired Skills & Experience: 7-10 years of experience, including at least 4 years as an Application Architect or Data Architect. Strong expertise in Java, Python, UI Development, or Data Engineering. Hands-on experience with GCP, AWS, or Azure cloud platforms. Knowledge of Generative AI-enabled application design patterns is a plus. Strong understanding of cloud architecture, distributed applications, integration, and API design. Experience in technology stack selection and defining solution architectures for small to mid-sized cloud-hosted platforms. Strong grasp of design and architecture patterns, with experience in developing scalable architectures. Experience in setting up and governing engineering processes, tools, and standards. Proficient in effort estimation techniques, project planning, and defining test strategies. Experience responding to RFPs/RFIs and working directly with customers. Up-to-date with latest technology trends and engineering practices. Experience with PAAS and SAAS platforms hosted on cloud environments. Hands-on experience with infrastructure sizing and design for both on-premises and cloud platforms. Ability to understand business domains and translate requirements into scalable technical solutions. Excellent interpersonal skills, with the ability to engage and present to CXOs. Strong leadership, business communication, and consulting skills. Positive, service-oriented mindset. Qualification : B.E./B.Tech, MCA, M.E./M.Tech

Job Title: Sr. Engineering Manager - Data Engineering Level: L5 Experience: 13-16 years Overview We are seeking an experienced Engineering Manager with a strong background in Data Engineering, including ETL/ELT processes and cloud-based data platforms such as Snowflake. The ideal candidate will lead and mentor a team of data engineers, drive data architecture initiatives, and work closely with cross-functional stakeholders to ensure our data infrastructure supports evolving business needs. Key Responsibilities Team Leadership: Lead, mentor, and develop a high-performing data engineering team, fostering a culture of collaboration, innovation, and continuous learning. Data Pipeline Development: Oversee the design, development, and maintenance of robust ETL/ELT pipelines to ingest, transform, and process data at scale. Cloud Data Infrastructure: Drive the architecture and implementation of cloud-based data solutions, especially leveraging Snowflake, ensuring scalability, security, and reliability. Cross-Functional Collaboration: Partner with product managers, analysts, data scientists, and other business stakeholders to gather requirements and prioritize engineering efforts that deliver the most impact. Architecture and Design: Develop and enforce data architecture standards for high-performance data warehousing, ensuring seamless data integration across diverse sources. Performance Optimization: Identify and resolve performance bottlenecks, focusing on query optimization, cost management, and resource efficiency. Data Quality & Governance: Define and implement data quality frameworks and governance practices, ensuring data consistency and reliability across all pipelines. Innovation & Strategy: Stay informed on emerging data technologies and industry best practices, continuously improving processes and aligning solutions with long-term data strategies. Required Skills 8+ years of hands-on experience in data engineering, including 5+ years in a leadership role. Strong expertise in ETL/ELT processes and hands-on experience with tools like Talend, Informatica, or similar platforms. Deep proficiency in Snowflake or comparable cloud data platforms such as Redshift or BigQuery. Advanced SQL skills, including query optimization, performance tuning, data modeling, and schema design. Hands-on experience with Python or Java for data processing and automation. Knowledge of data governance, compliance standards, and data security best practices. Excellent communication and project management skills, with the ability to prioritize and manage multiple projects in parallel. Preferred Skills Exposure to Big Data technologies such as Spark, Hadoop, Databricks, Synapse, etc. Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions. Familiarity with CI/CD pipelines and DevOps practices within data engineering. Experience working with BI tools like Tableau or Power BI, and reporting integrations.

Job Title: Sr. Data Engineer Job Overview: We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in Snowflake to manage data ingestion and transformation. The ideal candidate will work with an offshore team to deliver scalable data solutions aligned with business and performance requirements. Key Responsibilities: Design, build, and maintain ELT pipelines using Snowflake. Lead offshore development teams in applying data engineering best practices. Collaborate with stakeholders to manage data integration across systems. Optimize data pipelines for performance and reliability, including query tuning and resource management. Implement data validation processes to ensure data accuracy. Document data pipelines, flow diagrams, and transformation logic. Troubleshoot pipeline failures and resolve performance issues. Ensure compliance with data governance and regulatory requirements. Required Qualifications: 5+ years of experience in data engineering with a focus on ELT development. Strong expertise in Snowflake, including data sharing, secure views, and performance optimization. Proficiency in SQL and data integration tools. Experience managing offshore development teams. Strong problem-solving and communication skills. Preferred Qualifications: Snowflake certification or relevant certifications. Experience in financial services with knowledge of data security and compliance. Familiarity with cloud platforms (AWS, Azure) and orchestration tools like Apache Airflow. Experience with Python or JavaScript for data transformation. Knowledge of data visualization tools like Tableau or Power BI.