Data Engineering Tools Jobs in Bengaluru

Data Engineering Lead Bengaluru | Engineering | Full-Time About Fam (formerly FamPay) Fam is India s first payments app designed for everyone aged 11 and above. FamApp enables seamless online and offline payments through UPI and FamCard. Our mission is to empower over **250 million young Indians** to start their financial journey early, becoming financially aware and confident. Founded in 2019 by IIT Roorkee alumni, Fam is backed by top-tier investors including Elevation Capital, Y-Combinator, Peak XV (Sequoia Capital India), Venture Highway, and angels like Kunal Shah and Amrish Rao. About the Role We re looking for a visionary **Data Engineering Lead** to take **end-to-end ownership** of Fam s data ecosystem from data ingestion and storage to processing and delivering actionable insights. You ll **define the data strategy and architecture** that supports both batch and **real-time** use cases, ensuring scalability, reliability, and governance across the organization. You will be instrumental in enabling accurate, complete, and trusted data flow that powers business intelligence, analytics, and product decision-making. This role involves **leadership, strategic thinking**, and hands-on problem solving. What You ll Do Own the full data lifecycle: ingestion, organization, storage, processing, and presentation. Define and execute **data architecture and strategy** aligned with operational and analytical goals. Build **scalable, reliable, and observable data systems** supporting batch and near real-time processing. Ensure **data quality, governance, and compliance**, proactively resolving discrepancies. Collaborate with product, engineering, and business teams to define, track, and optimize key metrics. Anticipate data-related challenges and implement preventive solutions. Lead, mentor, and grow the data engineering team, fostering innovation and accountability. Must-Haves 10+ years experience in data engineering, including proven leadership of teams or projects. Expertise designing, building, and scaling end-to-end data pipelines and systems. Deep understanding of the data lifecycle, from ingestion through business reporting. Strong communication skills and ability to collaborate across technical and business teams. Solid knowledge of **data governance, quality assurance, and compliance standards**. Experience with observability and proactive monitoring for data systems. Proficiency in Python and SQL; familiarity with Scala or Java. Hands-on experience with streaming and batch data frameworks. Experience designing large-scale data lakes and warehouses with best practices for schema evolution and partitioning. Strong background with **cloud platforms (AWS, GCP, or Azure)**. Fintech or regulated industry experience is a plus. Good to Have Fintech-specific data experience, including regulatory compliance and reporting. Deployment experience with **real-time analytics** and event-driven architectures. Familiarity with containerization and infrastructure tools like Docker, Kubernetes, Terraform. Knowledge of data observability tools (Monte Carlo, Databand, etc.). Exposure to **ML pipelines** and model deployment. Solve challenging problems at the intersection of big data, real-time processing, and fintech. Lead impactful data initiatives at a rapidly growing startup. Collaborate with a world-class team of engineers, data scientists, and product leaders. Competitive compensation, equity, and benefits. Clear career growth opportunities in leadership and innovation. Perks That Go Beyond the Paycheck Relocation assistance for a smooth move. Free office meals (lunch & dinner). Generous leave policies (birthday, period, parental support, and more). Salary advances and loan policies for financial support. Quarterly rewards, recognition, and referral incentives. Access to the latest gadgets and tools. Comprehensive health insurance with mental health support. Tax benefits like food coupons, phone allowances, and leasing options. Retirement benefits including PF contribution, leave encashment, and gratuity. About FamApp FamApp focuses on financial inclusion for the next generation by offering UPI and card payments to users aged 11+. Our flagship product, FamX, integrates UPI and card payments seamlessly, helping users manage, save, and learn about their finances effortlessly. With over **10 million users**, FamApp is revolutionizing how young Indians transact eliminating the need to carry cash and offering customizable FamX cards with personal doodles for a fun, unique payment experience. Join Our Dynamic Team At Fam, we foster a people-first culture with flexible work schedules, generous leave, comprehensive health benefits, and mental health support. You ll be part of a passionate, talented, and fun team shaping the future of fintech for India s youth.

Senior Data Engineer Enterprise Data Platform Location: Bengaluru Department: Business Technology Data Engineering Experience: 5+ Years Employment Type: Full-Time About Okta Okta is The World s Identity Company. We empower people to securely use any technology, anywhere, on any device. Through our Okta and Auth0 platforms, we provide secure access, authentication, and automation placing identity at the center of security and growth for thousands of organizations. We value diverse perspectives and lifelong learners. We re not looking for someone who checks every box we re looking for someone who will make us better with their unique experiences. Team: Business Technology Data Engineering The Data Engineering team at Okta supports cross-functional partners by building scalable, secure, and high-performing platforms. These platforms power decision-making and business processes across sales, marketing, engineering, finance, product, and operations. As part of this team, you ll contribute to data solutions that fuel Okta s hyper-growth. You will have the opportunity to work with cutting-edge technologies in cloud infrastructure, data lakes, automation, and CI/CD pipelines. The Role: Senior Data Engineer As a Senior Data Engineer, you will design, build, and manage modern data pipelines, infrastructure, and automation frameworks. You ll help scale our enterprise data platform using tools such as Snowflake, dbt, Airflow, Databricks, and AWS, while ensuring security, observability, and performance. You ll also contribute to CI/CD pipelines, infrastructure as code (IaC), and secure development lifecycle practices, enabling consistent, efficient, and secure delivery of data solutions. Key Responsibilities Platform Development & Infrastructure Design and maintain scalable data pipelines and platforms using Snowflake, AWS, Databricks, dbt, and Airflow. Manage infrastructure with Terraform, enabling repeatable and consistent deployments. Develop and maintain robust CI/CD pipelines using GitHub Actions, GitLab, or Jenkins. Containerize data services using Docker for better scalability and portability. Security & Compliance Implement and enforce secure development lifecycle practices, integrating tools like DAST, SAST, SCA, and Secret Scanning into pipelines. Conduct vulnerability scanning and apply patches to ensure system integrity. Ensure data security and compliance with industry standards and regulations. Collaboration & Innovation Collaborate with data engineers, data scientists, and analysts across business units to ensure data availability and integrity. Identify opportunities for automation and optimization within the data platform. Stay updated on emerging technologies and drive adoption of best practices. Must-Have Skills Bachelor s degree in Computer Science, Engineering, or a related technical field. 5+ years of experience in data engineering, including: Advanced SQL and ETL development with Airflow and dbt. Experience with data warehouses such as Snowflake, Redshift, or BigQuery. Strong hands-on experience with AWS (S3, Lambda, EC2, EMR, EKS). 2+ years of experience managing CI/CD pipelines using tools like GitHub Actions, GitLab, Jenkins, or ArgoCD. Experience with Terraform and Docker. Proficiency in backend languages such as Python, Java, or Go. Preferred Skills Experience with lakehouse architectures like Databricks, including knowledge of Delta Lake and Apache Iceberg. Background in infrastructure security, vulnerability management, and observability tooling. High Impact: Help build and scale the data platform that powers Okta s global business. Cutting-Edge Stack: Work with best-in-class technologies like AWS, Snowflake, dbt, Terraform, and Databricks. Collaborative Culture: Join a diverse, inclusive, and globally distributed team that values knowledge sharing and continuous learning. Career Growth: Shape the future of Okta s data engineering practice while expanding your technical and leadership skills. Bring your passion for data, cloud, and automation and let s shape the future of secure, scalable enterprise data platforms together. Qualification : Bachelors degree in Computer Science, Engineering, or a related technical field

Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field

Job Title: Senior Data Business Partner Location: Bengaluru Department: Data & Analytics Experience: Senior-level Company: OSB India (Offshore subsidiary of OSB Group) About OSB India: OSB India (OSBI) is a wholly owned offshore subsidiary of OSB Group, a leading UK financial services provider. Established in 2004, OSBI delivers exceptional customer support and operational services to the Group s UK brands. Known for driving process excellence, innovation, and functional efficiencies, OSBI is a key strategic arm supporting the Group s long-term goals. Role Overview: We are looking for a Senior Data Business Partner to bridge the gap between business and data analytics. In this role, you will collaborate with business leaders to identify analytical needs, design data-driven solutions, and drive adoption of data across the organization. This is a high-impact role requiring strong analytical acumen, stakeholder management skills, and a passion for delivering insights that support strategic decision-making. Key Responsibilities: Build trusted relationships with business stakeholders to understand their data needs and priorities. Collaborate cross-functionally to translate complex business challenges into data solutions. Lead in-depth analysis using market-standard algorithms and modelling techniques. Ensure adherence to Data Governance standards, policies, and controls. Deliver timely, accurate, and well-documented data content and insights. Advise on analytics delivery planning across projects and business functions. Enable self-service analytics by training business users on available tools and platforms. Advocate and implement innovations in AI, Machine Learning, and data analytics. Partner with Data Engineering and Architecture teams, ensuring adherence to technical standards and best practices. Present findings and strategic insights to senior management and governance forums. Mentor team members on analytical approaches and best practices. Promote a culture of continuous improvement, innovation, and high-quality data usage. Champion the use of central data repositories, relational models, and the Data Warehouse to deliver consistent and reliable BI outputs. Identify risks related to data or projects and escalate when necessary. Support internal training efforts to improve data literacy across departments. Ensure compliance with Risk Management and Data Governance policies. Stay current on industry trends, tools, and technologies to enhance analytics capability. Candidate Profile: Qualifications: Bachelor s or Master s degree in Data Science, Computer Science, Business Analytics, Statistics, or a related field. Certifications in data analytics, data science, or relevant tools/platforms are a plus. Experience: 6+ years in a business-facing data analytics role, ideally within financial services or technology. Strong experience in data analysis, modelling, and data storytelling. Proven ability to work with senior business stakeholders and executive teams. Experience in mentoring and leading analytics professionals. Demonstrated expertise in translating business needs into actionable insights. Technical Skills: Proficiency in tools such as Power BI, Tableau, SQL, Python/R, or Excel for data analysis. Familiarity with data warehousing, ETL processes, and relational databases. Understanding of data governance, risk, and compliance frameworks. Exposure to AI/ML applications in business contexts is a strong advantage. Behavioral Competencies: Excellent communication and presentation skills. Strong business acumen with the ability to drive value from data. Strategic thinking with a problem-solving mindset. Collaborative, adaptable, and proactive. At OSBI, we believe in empowering individuals to grow both personally and professionally. Whether you re early in your career or a seasoned expert, we provide an inclusive and supportive environment to help you thrive. Be a part of a connected organization where your contributions make a difference and your career is a journey, not a destination. Qualification : Bachelors or Masters degree in Data Science, Computer Science, Business Analytics, Statistics, or a related field

Product Manager Data Warehouse & Business Intelligence Location: Bangalore Company: Mahindra First Choice About Mahindra First Choice Mahindra First Choice is a pioneer in India s multi-brand used car segment. With a strong focus on innovation, data-driven decision-making, and cutting-edge technology, we are transforming the automotive ecosystem and delivering seamless customer experiences. Our commitment to excellence fuels our drive to create scalable, impactful solutions across the value chain. Role Overview We are looking for a strategic and technically strong Product Manager to lead our Data Warehouse and Business Intelligence (BI) initiatives. Based in Bangalore, this role will own the vision, development, and optimization of enterprise-wide data products. You will play a critical role in enabling data-led decisions, working closely with engineering, analytics, and business teams to drive measurable outcomes. Key Responsibilities 1. Product Strategy & Roadmap Define the vision, strategy, and long-term roadmap for Data Warehouse and BI products. Align product goals with overall business strategy through collaboration with senior leadership. Stay abreast of emerging technologies and industry trends to drive innovation in data architecture and analytics. 2. Development & Execution Partner with engineering, data science, and analytics teams to build scalable, high-performance data platforms. Prioritize product features and enhancements based on impact, feasibility, and business value. Lead cross-functional teams to ensure timely and efficient delivery of data solutions. 3. Business Intelligence & Analytics Oversee the development of interactive BI dashboards, reports, and self-service tools to empower business users. Collaborate with business stakeholders to identify critical metrics and create meaningful data visualizations. Champion data quality, consistency, governance, and accessibility across all platforms. 4. Stakeholder Management Serve as the single point of contact for data needs across Sales, Marketing, Operations, Finance, and other departments. Communicate roadmaps, progress updates, and outcomes clearly and effectively to stakeholders at all levels. Gather continuous feedback to refine products and enhance user experience. 5. Performance Monitoring & Optimization Define and track KPIs to assess product adoption, usage, and business impact. Analyze system performance and user engagement to identify areas for improvement. Drive initiatives to increase data platform efficiency and reliability. Qualifications & Skills Required Bachelor s degree in Computer Science, Engineering, Business, or a related field (Master s preferred). 7+ years of experience in product management, specifically in data warehousing, business intelligence, or analytics. Deep understanding of data architecture, ETL processes, and data modeling. Hands-on experience with BI tools like Tableau, Power BI, or Looker. Strong SQL skills and familiarity with cloud platforms (AWS, Azure, GCP). Proven track record of managing complex, cross-functional data projects in fast-paced environments. Ability to translate business needs into scalable, data-driven solutions. Preferred Experience in automotive, mobility, or e-commerce domains. Familiarity with machine learning concepts and advanced analytics techniques. Soft Skills Strong communication, presentation, and stakeholder engagement skills. Analytical mindset with a focus on delivering business value through data. Effective leadership and cross-functional collaboration. High attention to detail and ability to manage multiple priorities. At Mahindra First Choice, you ll join a fast-growing, innovation-led organization at the forefront of transforming the used car market in India. This is a unique opportunity to shape our data landscape and make a real impact on business outcomes. If you're passionate about unlocking the power of data, we d love to meet you. Qualification : Bachelors degree in Computer Science, Engineering, Business, or a related field (Masters preferred)

Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.

Position: Data Architect Location: Remote/Hybrid | Bengaluru, IND We're searching for a highly skilled and experienced Data Architect to join our team. If you have a deep understanding of big data technologies and extensive experience with Hadoop, Python, Snowflake, and Databricks, you're the ideal candidate. You'll be responsible for designing, implementing, and managing complex data architectures that support our critical business needs and objectives. What You'll Do: Design & Architecture Leadership: Design scalable and efficient data architecture solutions that meet current and future business data needs. Lead the development of data models, schemas, and databases, ensuring alignment with business requirements. Architect and implement robust data solutions on leading cloud platforms (AWS, Azure, or GCP). Data Management & Governance: Develop and maintain robust data pipelines and ETL processes using Hadoop, Databricks, and other essential tools. Oversee data integration and quality efforts to ensure consistency and reliability across the organization. Implement data governance best practices, focusing on data security, privacy, and compliance. Collaboration & Mentorship: Work closely with data engineers, data scientists, and business stakeholders to translate data requirements into effective technical solutions. Provide technical leadership and mentorship to junior data engineers and architects. Collaborate with cross-functional teams to ensure data solutions align perfectly with overall business goals. Optimization & Innovation: Optimize existing data architectures for peak performance, scalability, and cost-efficiency. Monitor and troubleshoot data systems to ensure high availability and reliability. Continuously evaluate and recommend new tools and technologies to improve our data architecture. What You'll Bring: Experience: 10+ years in data architecture, data engineering, or a related field. Big Data Expertise: Proven experience with Hadoop ecosystems (HDFS, MapReduce, Hive, HBase). Programming Prowess: Strong programming skills in Python for data processing and automation. Data Platform Mastery: Hands-on experience with Snowflake for data warehousing and Databricks for analytics. Cloud Fluency: Extensive experience with cloud platforms (AWS, Azure, GCP) and their data services. Data Modeling: Familiarity with data modeling tools and methodologies. Core Skills: Deep understanding of big data technologies and distributed computing. Strong problem-solving skills to design solutions for complex data challenges. Excellent communication skills, able to explain complex technical concepts clearly to diverse audiences. Proficient in SQL and database performance tuning. Experience with CI/CD pipelines and automation in data environments. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Advanced Degree: A Master's degree in a related field. Cloud Certifications: Certifications like AWS Certified Data Analytics, Google Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate. Additional Languages: Experience with other programming languages like Java or Scala. Machine Learning Integration: Knowledge of machine learning frameworks and their integration with data pipelines.

Position: Senior Data Scientist LLM Location: Bangalore, Karnataka, India Type: Full-Time (On-site) Experience Required: 2+ years in Deep Learning, 1+ years in LLMs Industry: Healthcare AI Company Overview: 5C Network is pioneering multi-modal AI systems for autonomous diagnosis in medical imaging. We're building next-generation models that integrate deep learning with language understanding to revolutionize clinical workflows and diagnostic accuracy. Role Summary: As a Senior Data Scientist LLM, you will lead the development and deployment of Large Language Models (LLMs) focused on enhancing medical imaging diagnostics. You ll work on cutting-edge problems such as instruction fine-tuning, prompt engineering, and Retrieval-Augmented Generation (RAG), while ensuring scalability and robustness in production environments. Key Responsibilities: LLM Development & Fine-Tuning Design and optimize prompts for diverse clinical and imaging-related use cases. Perform instruction fine-tuning of LLMs to meet task-specific requirements. Develop reasoning pipelines including Chain of Thought (CoT) techniques for complex diagnostic workflows. LLM Deployment & Optimization Self-host and deploy LLMs in secure, scalable production environments. Apply quantization and other performance optimization methods to minimize compute and memory footprint. Ensure high performance, uptime, and security in AI deployments. Retrieval-Augmented Generation (RAG) & Vector Databases Develop and implement RAG pipelines by integrating LLMs with semantic search. Work with vector databases (e.g., Qdrant) to enable fast, efficient retrieval of contextual data. Optimize data storage, indexing, and retrieval to support clinical applications. Data Engineering & Annotation Build and manage high-quality datasets tailored for CoT and multi-step reasoning tasks. Lead data annotation efforts to enhance LLM understanding of medical contexts. Collaboration & Research Collaborate with researchers, ML engineers, and domain experts to bring LLM solutions from prototype to product. Stay ahead of the curve by experimenting with novel LLM architectures and emerging techniques. Qualifications: Bachelor's or Master s degree in Computer Science, Data Science, AI, or a related field. 2+ years of hands-on experience in deep learning. Minimum 1 year of experience working with LLMs (e.g., instruction tuning, prompt engineering, RAG). Prior experience in LLM deployment (self-hosting, optimization, quantization, scaling). Proficient in Python and common ML frameworks (e.g., PyTorch, Hugging Face Transformers). Familiarity with vector databases like Qdrant or similar. Strong interest or prior exposure to healthcare/medical AI. Excellent problem-solving, communication, and team collaboration skills. Technical Stack: Languages: Python Frameworks: PyTorch, Hugging Face Technologies: LLMs (e.g., GPT, LLaMA), Vector Databases (Qdrant), RAG, Quantization Tools: Docker, Kubernetes, REST APIs, Git Work on high-impact AI solutions in the healthcare domain. Collaborate with a team at the forefront of multi-modal diagnostic technology. Access cutting-edge tools and real-world data to drive innovation. Qualification : Bachelor's or Masters degree in Computer Science, Data Science, AI, or a related field.

Position: Data Science Specialist Employment Type: Full-time Location: Bangalore, On-site Experience Required: 1 to 6 years (Mindset > Experience) About the Role: We re seeking a mission-driven, hands-on Data Analytics Specialist passionate about impact. This is not a typical analytics role you will drive key business metrics across clinical operations, stakeholder reporting, and automation. Collaborate closely with leadership, radiologists, operations, product teams, and AI engineers to ensure every decision is data-driven, actionable, and scalable. If you thrive on building dashboards, automating processes, streamlining pipelines, and driving growth through insights, this is your playground. Key Responsibilities: Own Business KPIs: Take full ownership of company-wide metrics, ensuring their accuracy, relevance, and actionability through stakeholder alignment. Data Engineering: Build and optimize ETL/ELT pipelines integrating data from Postgres, ClickHouse, and other sources. Dashboards & Reporting: Design and maintain intuitive dashboards (Metabase, Power BI, Tableau, Google Data Studio) that stakeholders actively use. Backend Data Transformation: Write clean, reusable code to convert raw data into actionable insights. API Development: Build and maintain internal APIs to serve analytics data to frontend and production systems. Email Automation: Develop real-time and scheduled email reports delivering dynamic insights to stakeholders. Spreadsheet Expertise: Automate and manipulate complex data in Excel/Google Sheets for detailed analysis and reporting. AI & Automation: Collaborate with AI teams to integrate predictive algorithms and automate analytics workflows. Business Acumen: Develop deep understanding of the teleradiology ecosystem clinical workflows, operations, financials, and tech platforms. Proactive Collaboration: Identify data gaps, flag inconsistencies, recommend improvements, and work closely with leadership. Required Skills: Strong Python skills for data analytics (Pandas, NumPy, FastAPI, Jupyter, etc.) Proficient in SQL (ClickHouse, PostgreSQL) with experience optimizing queries End-to-end dashboard ownership from data modeling to UI presentation Experience building or integrating APIs for analytics Advanced spreadsheet skills and formula-driven reporting Experience working with AI/ML models in applied settings (preferred) Hands-on backend data transformations, version control, and automation Familiarity with full-stack development frameworks (bonus) Bonus / Nice to Have: Exposure to dbt, Airflow, ChromaDB, Streamlit, Plotly Knowledge of data privacy, compliance, and healthcare analytics Experience building analytics platforms for SaaS or health-tech companies Mindset We re Looking For: 10x Hustler: Ready to learn fast and go the extra mile to solve problems. Obsessed with Accuracy: Data must be flawless before release. Extreme Ownership: Proactive in driving results without waiting for instructions. Fast Learner: Able to pick up new tools and concepts quickly. Business First, Code Later: Focused on impact, not just coding. Be part of India s fastest-growing teleradiology platform Direct access to leadership and real-world business impact Build game-changing analytics systems and influence strategy Gain exposure to AI, automation, product, and operations in one role Clear ramp-up roadmap and growth plan Expectations in First 3 Months: Build an end-to-end dashboard from scratch Clean up at least one messy data pipeline Automate a stakeholder email update Validate accuracy across critical business metrics Understand full-stack platform structure and propose an improvement

Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.

Position: Business Technology Data Engineer Location: Bengaluru, India (Hybrid 3 days onsite) Company: Samsara Technologies India Pvt. Ltd. About Samsara Samsara (NYSE: IOT) is a leader in the Connected Operations Cloud, enabling businesses across industries like transportation, logistics, manufacturing, and field services to harness IoT data for safety, efficiency, and sustainability improvements. Samsara helps organizations digitize physical operations at scale, improving outcomes that impact global infrastructure. Role Overview Samsara is seeking a Business Technology Data Engineer to join its Data & Analytics team within the Business Technology division. In this role, you will design, build, and optimize end-to-end data pipelines and infrastructure for various business-critical systems across CRM, marketing, support, and product platforms. You'll collaborate with teams across the company to build reliable and scalable data solutions that power reporting, automation, and analytics. This hybrid role requires working 3 days per week from the Bengaluru office and 2 days remotely, with working hours aligned to India Standard Time (IST). Key Responsibilities Data Engineering & Platform Development Design and maintain ETL/ELT pipelines that integrate and transform data across business systems. Build scalable data infrastructure to support advanced analytics and real-time reporting needs. Write Python and SQL scripts for data ingestion, transformation, and validation. Data Integration & Enablement Work with diverse data sources: CRM, product telemetry, marketing automation, support ticketing, and order flow systems. Develop and support data lake and data warehouse solutions using Snowflake, Redshift, Databricks, or BigQuery. Ensure interoperability between applications and data layers. Performance & Quality Monitor and optimize pipeline performance, implement observability and alerting. Improve data quality, lineage, and governance across systems. Partner with internal stakeholders (e.g., Sales Ops, Marketing Ops, Analytics) to deliver reliable data products. Minimum Qualifications Bachelor s degree in Computer Science, Data Engineering, or related field. 5+ years of professional experience in data engineering. 3+ years experience building and maintaining end-to-end pipelines in a modern data stack. Strong in SQL and Python. Hands-on experience with: ETL tools: Fivetran, dbt Cloud: AWS (preferred), GCP, or Azure Databases: MySQL, PostgreSQL, Oracle, or similar Data Warehouses: Snowflake, Redshift, BigQuery, Databricks Preferred Qualifications Familiarity with API-based ingestion, serverless architecture (Lambda, API Gateway, SQS, etc.). Experience with monitoring tools (DataDog, CloudWatch, Splunk). Comfortable engaging stakeholders to translate business needs into data solutions. Proficiency in Docker, Kubernetes, or AWS Fargate is a plus. Qualification : Bachelors degree in Computer Science, Data Engineering, or related field

Job Title: Engineering Manager Data Engineering Location: Bengaluru, Karnataka, India Department: Engineering Experience: 6 to 8 years Open Positions: 2 About the Role As an Engineering Manager - Data Engineering, you will lead a team of skilled data engineers who design, build, and maintain scalable data pipelines and infrastructure. You will collaborate with cross-functional teams and client stakeholders to deliver high-quality data systems that meet business goals. Your leadership will be pivotal in mentoring your team, driving project execution, and advancing data engineering capabilities across the organization. Key Responsibilities Lead, mentor, and develop a team of data engineers, fostering a collaborative and inclusive work environment. Conduct performance reviews, provide constructive feedback, and set clear goals for team members. Identify skill gaps and create opportunities for continuous professional growth. Plan, execute, and deliver data engineering projects on schedule and within scope. Coordinate with stakeholders to gather requirements, prioritize tasks, and define project timelines. Ensure all projects align with broader business objectives and data strategies. Oversee design, development, and maintenance of data pipelines, ETL processes, and data warehouses. Guarantee data quality, integrity, and security in all data engineering initiatives. Identify and drive process improvements to enhance efficiency and effectiveness in data operations. Manage client conversations to understand requirements and translate them into technical deliverables. Build and promote reusable frameworks to drive efficiency in data systems. Lead multiple projects involving streaming, batch, and large-scale data pipelines. Required Technical Skills Strong execution knowledge of data modeling, relational and non-relational databases (SQL and NoSQL). Expertise with ETL and orchestration tools such as IICS, Metatron, Airflow, Azure Data Factory, AWS Glue, or GCP Composer. Experience working with data warehouses like Snowflake, Redshift, Hive, or BigQuery. Proficiency in Apache Spark and optimization of Spark jobs. Strong programming skills in Python (mandatory), with knowledge of Scala, Rust, or Java as a plus. Understanding of Medallion architecture patterns. Advanced SQL skills with query optimization expertise. Experience with software development lifecycle, unit testing, and functional programming concepts. Required Non-Technical Skills Strong problem-solving skills with the ability to assess financial impacts of decisions. Excellent written and verbal communication skills, capable of engaging with mid-management client stakeholders. Ability to balance pragmatic solutions against perfect ones, driving team consensus and business value. Exceptional people management skills, including conflict resolution, empathy, negotiation, and active listening. Proven leadership and mentorship abilities, providing technical guidance to delivery teams. Self-driven, with a strong sense of ownership and accountability. Preferred Educational Qualifications Bachelor s degree in Engineering (B.E./B.Tech), MCA, or M.Sc. (Mathematics, Statistics). Lead and mentor a talented team working on cutting-edge data engineering projects. Collaborate closely with clients and cross-functional teams in a dynamic, fast-growing company. Drive innovation with scalable, high-impact data solutions. Grow your leadership and technical skills in a supportive, inclusive environment. Qualification : Bachelors degree in Engineering (B.E./B.Tech), MCA, or M.Sc. (Mathematics, Statistics).

Data Analyst Bangalore, India Location: Bangalore (Bengaluru) Experience: 2 to 8 Years Industry: IT / Data Analytics Job Summary: We are looking for a detail-oriented Data Analyst with strong skills in SQL, Python, and Excel to extract actionable insights and optimize data pipelines on popular cloud platforms. The ideal candidate will be passionate about clean, reproducible code and thrive in a collaborative team environment. Key Responsibilities: Write efficient SQL queries and develop data extraction, transformation, and loading (ETL/ELT) pipelines on cloud platforms Automate data extraction and data insertion into Management Information Systems (MIS) using Python Analyze data sets and extract actionable business insights to support decision-making Maintain high standards of data quality and ensure reproducible, clean code Collaborate effectively with cross-functional teams and communicate findings clearly Continuously learn and adapt to new analytics tools and techniques Preferred Skills & Qualifications: Strong proficiency in SQL, Python, and Excel Experience building and optimizing data pipelines on cloud platforms such as Google Cloud Platform (GCP) Familiarity with Google BigQuery, Metabase, CleverTap, Google Data Studio, Firebase, and Google Analytics Hands-on experience with data visualization tools like Tableau and Google Data Studio Knowledge of ETL/ELT pipeline development and data flow architecture Excellent attention to detail with a passion for clean and efficient coding Strong interpersonal and communication skills to work collaboratively with diverse teams Good to Have: Experience with automated reporting and dashboard creation Prior exposure to marketing analytics tools and user behavior tracking Work with cutting-edge cloud data technologies and analytics tools Opportunity to grow your skills in data engineering and visualization Collaborative work culture focused on continuous learning and innovation

Senior Data Engineer Location: Bengaluru Department: Global Strategic Services Data Engineering EMEA Type: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader driving industrial digital transformation. Our platforms Cognite Data Fusion and Cognite Atlas AI enable companies across Energy, Utilities, Manufacturing, and Chemicals to solve complex challenges using AI, contextual data, and automation. Cognite is backed by top-tier investors and recognized with global innovation awards. Our Values Impact: We deliver results that matter. Ownership: We take initiative, act inclusively, and embrace accountability. Relentless: We pursue excellence and innovation with resilience. About the Role As a Senior Data Engineer, you ll lead the development of scalable data solutions that empower critical industries to make informed decisions. You ll work on high-impact projects across regions, collaborating with solution architects, data scientists, and product teams. This is a growth role with room to influence product direction and mentor junior engineers. Key Responsibilities Architect and implement robust data pipelines using Cognite Data Fusion, Python, SQL, and REST APIs. Lead integrations, data modeling, and transformation tasks using cloud-native technologies. Design custom data models for discovery, mapping, and cleansing industrial data. Collaborate closely with cross-functional teams to deliver digital solutions. Conduct code reviews and champion engineering best practices. Contribute to Cognite s SDKs and internal tools. Translate customer use cases into scalable, reusable data engineering frameworks. Mentor team members and support customer onboarding when needed. What You ll Bring Bachelor s or Master s in Computer Science or related field (or equivalent experience). 5+ years in a data-intensive, customer-facing engineering role. Expertise in Python, SQL, REST APIs, and pipeline orchestration. Experience with distributed computing, Kubernetes, and cloud platforms (Azure, GCP). Familiarity with data from industrial domains like oil & gas or manufacturing is a plus. Strong DevOps mindset with hands-on experience in Git, CI/CD, and deployments. Proactive and collaborative; able to work independently and solve complex challenges. A growth mindset with willingness to ask for help and share knowledge openly. Be part of a global team spanning 70+ nationalities with strong DEI focus. Work at our Bengaluru office (Rathi Legacy, Hoodi) in a modern hybrid environment. Enjoy flat hierarchy, fast decision-making, and high ownership culture. Collaborate with world-class professionals on industry-transforming projects. Shape the future of industrial data and drive real-world impact at scale. If you re passionate about solving meaningful problems with cutting-edge data technologies, apply today. We welcome applicants from all backgrounds and experiences you might be the perfect fit, even if you don t meet every single requirement. Qualification : Bachelors or Masters in Computer Science or related field (or equivalent experience).

GenAI Engineer Location: Bangalore, India Office About the Team Rubrik's IT team is driving AI-powered transformation to enable smarter automation and scalable data solutions that protect and empower the company's mission. As part of the newly formed IT AI team, you'll be instrumental in developing AI agents and workflows to unlock the potential of generative AI in data engineering. About the Role We are seeking an experienced GenAI Engineer to join our Data Engineering team, focusing on building and deploying AI agents and workflows powered by large language models (LLMs). You will integrate data sources and develop MCP clients/servers to support LLM-based bots, collaborating closely with data scientists, engineers, and business teams to enhance GenAI adoption and deliver advanced data solutions. Key Responsibilities Design and develop data integrations using MCP protocols or traditional extraction methods. Build scalable data pipelines for GenAI model training and deployment using tools like Snowflake Cortex, Gemini Agentspace, and Databricks LLM (Mosaic AI, RAG, Model Serving). Ensure data quality, integrity, and scalability for AI workloads involving both structured and unstructured data. Collaborate with business teams, data engineers, and application developers to create products that streamline processes and drive growth. Integrate data pipelines with existing infrastructure to enable seamless data flow and analytics. Support the data engineering team in producing high-quality data products for AI workloads. Experience You'll Need 1+ year of experience building AI agents or using Snowflake Cortex, Gemini Agentspace, or similar open-source tools. 3+ years of experience in data engineering focused on AI/ML workloads. 5+ years of experience in data analytics with Snowflake or Databricks platforms. Strong programming skills in Python, Java, or Scala. Familiarity with data storage solutions (Snowflake, Databricks) and APIs. Experience with cloud configuration and data governance. Knowledge of large language models (transformers) and frameworks like LangChain. Strong problem-solving skills and ability to thrive in a fast-paced environment. Preferred Qualifications Experience building AI agents and agentic workflows. Knowledge of MCP and Agent2Agent protocols. Understanding of generative models and their applications in data engineering. Familiarity with data governance and security best practices for GenAI workloads. Experience with Agile methodologies and collaboration tools like Jira and GitHub. Join Us in Securing the World's Data Rubrik (NYSE: RBRK) is dedicated to securing the world's data with Zero Trust Data Security.Our platform, powered by machine learning, protects data across enterprise, cloud, and SaaS applications, helping businesses stay resilient against cyberattacks and operational disruptions.

Data Scientist Experience: 5+ Years Location: Bangalore, Karnataka, India Job Type: Full Time Job Summary We are seeking an experienced Data Scientist with over 5 years of expertise to join our innovative team in Bangalore. The ideal candidate will have hands-on experience in advanced statistical methods, machine learning, and deep learning frameworks, combined with strong skills in deploying models at scale. Key Responsibilities Apply advanced Statistics and Operations Research methods to solve complex business problems. Develop and deploy predictive and machine learning models using frameworks such as PyTorch, TensorFlow, Keras, and XGBoost. Utilize data engineering and big data tools including PySpark, Databricks, and Flask for building scalable data solutions. Implement and fine-tune NLP models like RNN, LSTM, and attention-based architectures, leveraging pre-trained models from Stanford, IBM, Azure, and OpenAI. Design and optimize efficient SQL queries to extract data from large databases. Work with visualization tools like D3.js, Dash Plotly, and deploy interactive dashboards using Streamlit. Utilize graph databases such as Neo4j for complex data relationships. Manage version control with tools like GitHub or Bitbucket. Deploy machine learning models into production environments using MLOps practices on cloud platforms such as AWS or Azure. Required Skills 5+ years of professional experience as a Data Scientist or similar role. Strong foundation in statistics, machine learning, and deep learning techniques. Proficient in Python-based data science libraries and frameworks. Hands-on experience with cloud-based MLOps and deployment. Excellent SQL skills for data extraction and manipulation. Experience with version control systems and collaborative development. Familiarity with NLP techniques and modern pre-trained language models. Strong problem-solving and communication skills. Qualifications Any graduate degree in Computer Science, Statistics, Mathematics, Engineering, or related field. Join a forward-thinking company in Bangalore, where you will work with cutting-edge technologies to create impactful data-driven solutions. Grow your career in an environment that values innovation, diversity, and continuous learning.

Senior Data Engineer Location: Bengaluru, India Employment Type: Full-time, On-site About Neuron7.ai Neuron7.ai is a rapidly growing AI-first SaaS company that is revolutionizing the world of service intelligence. Backed by leading Silicon Valley venture capitalists and a distinguished group of angel investors, we are recognized as a startup to watch. Our AI-driven platform delivers service predictions in seconds by analyzing structured and unstructured data, alongside insights from top experts. We specialize in complex service environments like high-tech devices, manufacturing, and medical devices, empowering service leaders to optimize key metrics like first-call resolution, turnaround time, and service margins. At Neuron7.ai, you will be part of a dynamic, innovative team that is pushing the boundaries of service intelligence. We value creativity, collaboration, and a relentless commitment to innovation. This is your chance to join a fast-growing startup and help redefine how AI impacts the future of service optimization. About the Role We are building a real-time analytics platform to improve uptime of connected devices and minimize maintenance costs. This involves collecting, analyzing, and leveraging large volumes of sensor data for observability and predictive analytics. As a Senior Data Engineer, you will have the opportunity to build and maintain scalable, high-performance data systems using modern data engineering tools. The ideal candidate will have hands-on experience with Python, Scala, ELT processes, Lakehouse architecture, Apache Spark, Databricks, real-time streaming systems like Kafka and Flink, and observability tools such as the ELK stack, Prometheus, and Grafana. What You ll Do: Data Model Development: Design and implement advanced data models to extract insights from complex datasets. Collaborative Problem Solving: Work with cross-functional teams to devise data-driven solutions for service optimization. Experimental Analysis: Conduct experiments and analyses to enhance service predictions and outcomes. Actionable Insights: Present findings and actionable recommendations to stakeholders, translating complex data insights into clear, understandable concepts. Mentorship: Guide and mentor junior team members, fostering a collaborative and knowledge-sharing environment. What We re Looking For: Experience: At least 4 years of hands-on experience in data engineering, with a focus on building large-scale data systems. Data Pipeline Expertise: Strong proficiency in Python and Scala for developing data pipelines. Big Data Tools: Proven experience with Apache Spark and Databricks for big data processing and analytics. Observability Tools: Hands-on experience with observability tools like Prometheus, Grafana, and the ELK stack or OpenSearch. Real-Time Data Streaming: Experience working with real-time streaming systems such as Kafka and Flink. Cloud Platforms: Familiarity with cloud platforms like Azure, GCP, or AWS. Problem-Solving Skills: Strong analytical and problem-solving abilities to work with complex data systems in fast-paced environments. Collaboration: Excellent communication and teamwork skills, with the ability to work effectively with cross-functional teams. What We Do and Value: At Neuron7.ai, we prioritize integrity, innovation, and a customer-centric approach. Our mission is to leverage advanced AI technology to enhance service decision-making and we are dedicated to delivering excellence in all aspects of our work. Company Perks & Benefits: Competitive salary, equity, and spot bonuses Paid sick leave Latest MacBook Pro for your work Comprehensive health insurance Paid parental leave Flexible work arrangements work from home or from our vibrant Bengaluru office Our Commitment to Diversity and Inclusion: Neuron7.ai is committed to fostering a diverse and inclusive workplace. We ensure equal employment opportunities without discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, marital status, or any other characteristic protected by law. If you re passionate about using data to drive service intelligence and want to be part of a forward-thinking team, we d love to hear from you!

Lead Data Engineer | ThoughtWorks | Bangalore, India Location: Bangalore, India Employment Type: Full-time, Regular Industry: Information Technology About ThoughtWorks At ThoughtWorks, we're a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. For over 30 years, we've worked alongside our clients to deliver solutions that challenge the status status quo. With a diverse and inclusive team, we empower each other to grow through shared learning, fostering an environment where innovation thrives. Our commitment to a cultivation culture is key to our success, and we re looking for a Lead Data Engineer to join our Bangalore team and lead transformative projects. Job Overview As a Lead Data Engineer at ThoughtWorks, you will be responsible for designing, developing, and operating modern data architectures that meet client business objectives. You will lead and manage data engineering projects end-to-end, from strategic planning to hands-on coding, ensuring the delivery of scalable and efficient data solutions. Working with cutting-edge technologies, you ll collaborate with stakeholders, clients, and cross-functional teams to implement data-driven strategies that address complex business challenges. Key Responsibilities Project Leadership: Lead and manage data engineering projects from inception to completion, including goal-setting, scope definition, and ensuring on-time delivery in collaboration with cross-functional teams. Data Architecture & Solution Design: Collaborate with clients to design modern data architecture and implement end-to-end solutions that meet key business objectives. Create intricate data processing pipelines to address complex business problems. Stakeholder Collaboration: Work closely with stakeholders to understand business objectives and identify opportunities to leverage data and data quality improvements. Data Modeling & Governance: Develop data models using modern modeling techniques and implement them using appropriate technologies. Ensure compliance with data governance, security, and privacy requirements. Scalable Implementations: Partner with data scientists to design scalable implementations of their models, ensuring the solutions are robust and efficient. Clean, Iterative Code: Write clean, modular code based on TDD (Test-Driven Development) and implement continuous delivery practices to support and operate data pipelines. Technology Guidance: Advise clients on distributed storage and computing technologies, selecting the best options to fit their business needs. Data Quality Strategy: Define and incorporate data quality strategies into daily work processes to ensure high standards and compliance. Job Qualifications Technical Skills: Proven experience in data engineering and system design, with a focus on building Big Data architecture and data pipelines within distributed systems. Deep knowledge of data modeling and hands-on experience with modern data engineering tools and platforms. Strong programming skills, with expertise in building scalable, high-quality data pipelines using languages like Python, Java, Scala, or others. Experience with distributed storage platforms (e.g., Hadoop, Amazon S3, etc.) and distributed processing platforms (e.g., Spark, Flink). Experience working with SQL, NoSQL, data lakes, and other data storage technologies. Familiarity with data visualization techniques and ability to communicate insights effectively across varying audiences. Professional Skills: Stakeholder Management: Strong ability to liaise between clients and other key stakeholders, ensuring trust and buy-in throughout projects. Adaptability & Resilience: Comfortable handling ambiguity and finding innovative solutions to complex challenges. Leadership & Mentorship: Experienced in coaching and mentoring team members, fostering a culture of professional growth and accountability. Risk & Conflict Management: Skilled in managing risks and resolving conflicts, driving projects forward despite challenges. Relationship Building: Natural at cultivating strong relationships with clients, stakeholders, and internal teams to create new opportunities. What You Bring to the Team Leadership: A proven track record in leading high-performance teams and supporting colleagues in their professional development. Curiosity & Innovation: A passion for data and technology and a willingness to continually learn and push the boundaries of what's possible. Collaboration: Ability to work closely with cross-functional teams and stakeholders to design and implement innovative data solutions. At ThoughtWorks, we believe in giving you the autonomy to carve out your unique career path, while providing support through development programs and a vibrant culture of learning. You ll work on exciting projects with a diverse team, solve complex challenges, and make an impact at a global scale. Join ThoughtWorks and be part of a global community of innovators. Together, we turn curiosity into action and creativity into impactful solutions.

Data Engineer (Python/Dataiku/Spark/SAS DI) Location: Bangalore Type of Employment: Full-Time Experience Required: 3 to 5 years Job Overview: We are looking for a passionate Data Engineer with expertise in Python, Dataiku, Spark, or SAS DI to join our dynamic team. In this role, you will collaborate with clients to build data pipelines that support their Data and Analytics journey. As a member of our team, you will be responsible for driving data engineering initiatives, developing and implementing ETL solutions, and optimizing data workflows for efficiency and scalability. Key Responsibilities: Data Engineering Initiatives: Collaborate with clients to define and implement data engineering initiatives based on business needs. ETL Development: Design and develop data integration solutions using tools like Python, Dataiku, Spark, and SAS DI. Develop and maintain automated data pipelines for real-time and batch data ingestions. Performance Tuning: Conduct performance tuning and optimize queries and data models to enhance performance and scalability. Database Design: Design and implement database objects such as tables, views, schemas, and stored procedures. Ensure data quality and consistency across the data warehouse. Collaboration: Work closely with cross-functional teams to translate business requirements into technical solutions and communicate effectively with clients across multiple regions. Troubleshooting: Troubleshoot and resolve data-related issues while ensuring the quality and integrity of the data. Project & Technical Leadership: Act as the technical lead or single point of contact (SPOC) for the client and internal teams, ensuring smooth project delivery. Essential Skills: Data Engineering Tools: Experience with Python, Dataiku, Spark, and SAS DI. SQL Proficiency: Strong SQL experience for extracting data from various databases and performing data analysis. ETL Development: Expertise in designing and developing ETL processes to integrate data from diverse sources into a data mart layer. Data Modeling: Understanding of data modeling concepts, including relational and dimensional modeling. BI Knowledge: Basic understanding of Business Intelligence (BI) tools and analytics needs. Communication Skills: Excellent communication skills to understand business requirements and translate them into technical solutions. Desirable Skills: Data Analysis: Strong analytical skills to perform data analysis, especially for banking products data. BI Tools: Experience with MicroStrategy or Power BI for reporting and dashboarding. Qualifications: 3+ years of experience designing and developing scalable data integration solutions. Familiarity with data analytics and reporting needs. Technical certifications that align with your continuous learning aspirations. Qualities: Strong problem-solving skills with a systematic approach to resolving issues. Ability to influence and implement change confidently. Excellent team player who works effectively in cross-functional teams. Strong communication and presentation skills, capable of interacting with clients and presenting ideas persuasively. Fluent in English, both written and spoken, for effective communication. Opportunity to work with cutting-edge data engineering tools and technologies. Be a key player in building and optimizing data pipelines for clients data and analytics needs. Competitive salary, benefits, and a dynamic, innovative work culture.

Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.