Data Ingestion Jobs in Bengaluru

1093 Jobs Found

AS

Mts - Software Development (cloud Ai Network Security Developer)

Aviatrix Systems

1-3 Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

MTS - Software Developer (Cloud AI Network Security Developer) Location: Bengaluru Company: Aviatrix Experience: 1 3 years About Aviatrix: Aviatrix is a cloud network security leader trusted by over 500 enterprises. We specialize in securing multi-cloud environments, offering runtime protection and advanced control for modern cloud infrastructures. Role Strategy & Impact In this role, you will build next-generation intelligent cloud network security solutions. You will focus on developing Python/Go microservices that fuse network visibility with LLM-driven insights to redefine cloud firewall capabilities. Technical Requirements Core Competencies: Development: Professional experience in Go (Golang) or Python. Cloud Networking: Fundamentals of Routing, NAT, VPNs, and Subnets. Security: Understanding of Firewall concepts (ACLs) and Zero Trust architecture. AI Integration: Experience using AI/LLM APIs (OpenAI, Vertex AI, etc.). Data Infrastructure: Workflows involving Kafka, data ingestion, and stream processing. Cloud Ecosystem: Hands-on familiarity with AWS, Azure, or GCP. Preferred Qualifications: Network Observability: Experience with NetFlow, IPFIX, or VPC Flow Logs. Modern DevOps: Hands-on with Kubernetes, Container Networking, and Terraform. Generative AI: Knowledge of Prompt Engineering or RAG-based systems. Key Responsibilities Control Plane Development: Build services for firewall rules and policy orchestration. AI Workflows: Integrate LLM-based assistants for anomaly detection and alert summarization. Telemetry Pipelines: Maintain high-performance data pipelines for security event metrics. Security Logic: Design logic for threat pattern recognition and posture scoring. Benefits & Why Join Us Global Benefits: Private medical, pension, and life assurance. Work-Life Balance: Generous holiday allowance and annual wellbeing stipend. Growth Mindset: We value diverse paths if you are passionate about AI and Security, we want to hear from you.

MTS Software Development Software Development Cloud
TV

Lead Software Engineer - Scale & Performance

Team Vunet Systems

6-12 Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Lead Software Engineer - Scale & Performance Location: Bengaluru Experience: 6 12 years About VuNet VuNet is a pioneer in Business Journey Observability, using Big Data and Machine Learning to revolutionize digital experiences in the financial services industry. Our platform delivers end-to-end visibility into customer journeys, helping organizations proactively resolve issues, ensure operational resilience, and deliver superior user satisfaction. With over 28 billion digital transactions monitored every month and serving more than 300 million users globally, VuNet is shaping the future of observability for some of the largest banks and financial institutions. We are Series B funded, part of NASSCOM s DeepTech Club, and recognized by global analysts such as Gartner and Omdia. Your Role: Lead Software Engineer - Scale & Performance As a Lead Software Engineer for Scale & Performance, you ll own the performance and scalability benchmarks for VuNet s observability platform. You will work with cutting-edge technologies, design robust test frameworks, and ensure that our platform scales seamlessly to meet the demands of millions of users. Roles & Responsibilities Own performance and scalability benchmarking for key platform components (ingestion pipelines, data storage, and query services). Design and execute load, stress, soak, and capacity tests across microservices, agents, and ingestion layers. Identify and resolve performance bottlenecks in both infrastructure (CPU/memory/IO) and application layers (API latency, throughput, GC behavior). Develop and maintain performance test frameworks, preferably using Kubernetes-based environments. Collaborate with DevOps and SRE teams to optimize system configurations (Kubernetes, Postgres/TimescaleDB, ClickHouse, Kafka) for scale. Implement OpenTelemetry for service instrumentation to monitor system health and latency (p50/p95/p99 metrics). Contribute to capacity planning, scaling strategies (horizontal/vertical), and resource optimization. Analyze production incidents related to scaling issues and drive permanent fixes. Work with engineering teams to design scalable architecture patterns and define SLIs/SLOs for system performance. Document performance baselines, tuning guides, and scalability best practices for internal use. What You Bring Mandatory Skills: Strong background in performance engineering for large-scale distributed systems or SaaS platforms. Expertise in Kubernetes, container runtimes (containerd/Docker), and resource profiling in containerized environments. Solid understanding of Linux internals, CPU/memory profiling, and network stack tuning. Hands-on experience with observability tools (Prometheus, Grafana, OpenTelemetry, Jaeger, Loki, Tempo, etc.). Familiarity with observability platform datastores like ClickHouse, PostgreSQL/TimescaleDB, Elasticsearch, or Cassandra. Experience with performance benchmarking tools such as k6, Locust, JMeter, or custom Golang/Python scripts. Ability to interpret system metrics (CPU usage, memory, GC, latency) and correlate across different layers. Nice-to-Have Skills: Experience with agent benchmarking (OpenTelemetry Collector, custom data shippers). Exposure to streaming systems like Kafka, NATS, or Pulsar. Familiarity with CI/CD pipelines for performance testing and regression tracking. Knowledge of cost optimization and capacity forecasting in cloud environments (AWS/GCP/Azure). Proficiency in Go, Python, or Bash scripting for automation and data analysis. Life at VuNet: At VuNet, we're building a world-class observability platform, and we re just getting started. You ll be part of a passionate, problem-solving team that embraces collaboration, fast learning, and staying ahead of emerging technologies like Gen AI. We foster a high-trust, inclusive culture where collaboration, ownership, and innovation are central to our success. If you're looking to work on cutting-edge tech, make a real impact, and grow with a supportive team you ll fit right in at VuNet. Benefits: Comprehensive health insurance coverage for you, your parents, and dependents. Mental wellness and 1:1 counseling support. A culture that promotes continuous learning, innovation, and career growth. Transparent, inclusive, and high-trust workplace. Opportunities for skill enhancement with training programs focused on new Gen AI technologies.

Lead Software Software lead Engineer Lead Engineer
FA

Data Engineering Lead

Fampay

10+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Data Engineering Lead Bengaluru | Engineering | Full-Time About Fam (formerly FamPay) Fam is India s first payments app designed for everyone aged 11 and above. FamApp enables seamless online and offline payments through UPI and FamCard. Our mission is to empower over **250 million young Indians** to start their financial journey early, becoming financially aware and confident. Founded in 2019 by IIT Roorkee alumni, Fam is backed by top-tier investors including Elevation Capital, Y-Combinator, Peak XV (Sequoia Capital India), Venture Highway, and angels like Kunal Shah and Amrish Rao. About the Role We re looking for a visionary **Data Engineering Lead** to take **end-to-end ownership** of Fam s data ecosystem from data ingestion and storage to processing and delivering actionable insights. You ll **define the data strategy and architecture** that supports both batch and **real-time** use cases, ensuring scalability, reliability, and governance across the organization. You will be instrumental in enabling accurate, complete, and trusted data flow that powers business intelligence, analytics, and product decision-making. This role involves **leadership, strategic thinking**, and hands-on problem solving. What You ll Do Own the full data lifecycle: ingestion, organization, storage, processing, and presentation. Define and execute **data architecture and strategy** aligned with operational and analytical goals. Build **scalable, reliable, and observable data systems** supporting batch and near real-time processing. Ensure **data quality, governance, and compliance**, proactively resolving discrepancies. Collaborate with product, engineering, and business teams to define, track, and optimize key metrics. Anticipate data-related challenges and implement preventive solutions. Lead, mentor, and grow the data engineering team, fostering innovation and accountability. Must-Haves 10+ years experience in data engineering, including proven leadership of teams or projects. Expertise designing, building, and scaling end-to-end data pipelines and systems. Deep understanding of the data lifecycle, from ingestion through business reporting. Strong communication skills and ability to collaborate across technical and business teams. Solid knowledge of **data governance, quality assurance, and compliance standards**. Experience with observability and proactive monitoring for data systems. Proficiency in Python and SQL; familiarity with Scala or Java. Hands-on experience with streaming and batch data frameworks. Experience designing large-scale data lakes and warehouses with best practices for schema evolution and partitioning. Strong background with **cloud platforms (AWS, GCP, or Azure)**. Fintech or regulated industry experience is a plus. Good to Have Fintech-specific data experience, including regulatory compliance and reporting. Deployment experience with **real-time analytics** and event-driven architectures. Familiarity with containerization and infrastructure tools like Docker, Kubernetes, Terraform. Knowledge of data observability tools (Monte Carlo, Databand, etc.). Exposure to **ML pipelines** and model deployment. Solve challenging problems at the intersection of big data, real-time processing, and fintech. Lead impactful data initiatives at a rapidly growing startup. Collaborate with a world-class team of engineers, data scientists, and product leaders. Competitive compensation, equity, and benefits. Clear career growth opportunities in leadership and innovation. Perks That Go Beyond the Paycheck Relocation assistance for a smooth move. Free office meals (lunch & dinner). Generous leave policies (birthday, period, parental support, and more). Salary advances and loan policies for financial support. Quarterly rewards, recognition, and referral incentives. Access to the latest gadgets and tools. Comprehensive health insurance with mental health support. Tax benefits like food coupons, phone allowances, and leasing options. Retirement benefits including PF contribution, leave encashment, and gratuity. About FamApp FamApp focuses on financial inclusion for the next generation by offering UPI and card payments to users aged 11+. Our flagship product, FamX, integrates UPI and card payments seamlessly, helping users manage, save, and learn about their finances effortlessly. With over **10 million users**, FamApp is revolutionizing how young Indians transact eliminating the need to carry cash and offering customizable FamX cards with personal doodles for a fun, unique payment experience. Join Our Dynamic Team At Fam, we foster a people-first culture with flexible work schedules, generous leave, comprehensive health benefits, and mental health support. You ll be part of a passionate, talented, and fun team shaping the future of fintech for India s youth.

Data Engineering Data Engineering Lead Data lead
GT

Snowflake Data Engineer

Growtharc Technologies

4-10 Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.

Snowflake Full-Time Virtual Warehouses Snowpipe Time Travel
CO

Platform Engineer

Colortokens

3+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Platform Engineer Location: Bengaluru, Karnataka, India Full-time partially remote About ColorTokens At ColorTokens, we empower businesses to stay operational and resilient in an increasingly complex cybersecurity landscape. Breaches happen but with our cutting-edge ColorTokens Xshield platform, companies can minimize the impact of breaches by preventing the lateral spread of ransomware and advanced malware. We enable organizations to continue operating while breaches are contained, ensuring critical assets remain protected. Our innovative platform provides unparalleled visibility into traffic patterns between workloads, OT/IoT/IoMT devices, and users, allowing businesses to enforce granular micro-perimeters, swiftly isolate key assets, and respond to breaches with agility. Recognized as a Leader in the Forrester Wave : Microsegmentation Solutions (Q3 2024), ColorTokens safeguards global enterprises and delivers significant savings by preventing costly disruptions. Our culture We foster an environment that values customer focus, innovation, collaboration, mutual respect, and informed decision-making. We believe in alignment and empowerment so you can own and drive initiatives autonomously. Self-starters and high-motivated individuals will enjoy the rewarding experience of solving complex challenges that protect some of world s impactful organizations be it a children s hospital, or a city, or the defense department of an entire country. Position Overview: Colortokens is looking for a Junior Platform Administrator to assist in managing, maintaining, and optimizing our NextGen Security Information and Event Management (SIEM) platform. The ideal candidate will support the day-to-day operations, help onboard customer log sources, troubleshoot integration issues, and provide technical assistance to the security operations team. This role is ideal for a motivated professional with 3+ years of experience in SIEM administration, security operations, or log management. Key Responsibilities: SIEM Platform Administration Assist in deploying, configuring, and maintaining the NextGen SIEM platform (e.g., Stellar Cyber, Splunk, Sentinel, QRadar, Chronicle, Exabeam). Perform basic updates and patches to ensure platform security and functionality. Monitor SIEM health, performance, and uptime under the guidance of senior administrators. Log Source Management Onboard new log sources and validate data ingestion. Help troubleshoot log ingestion, parsing, and formatting issues. Maintain log retention policies for compliance. Rule and Use Case Management Support the development and deployment of detection rules, correlation use cases, and alerts. Tune existing use cases to minimize false positives. Work closely with security analysts to refine alerting strategies. Integration and Automation Assist in integrating SIEM with other security tools (e.g., EDR, microsegmentation, vulnerability scanners). Work on basic automation tasks using scripting (Python, PowerShell) to enhance SIEM efficiency. Platform Security and Compliance Support role-based access control (RBAC) and platform security policies. Help ensure SIEM adheres to compliance standards like SOC2, ISO 27001. Participate in periodic security audits. Network Debugging & Troubleshooting Have a basic understanding of TCP/IP, networking concepts, and protocols. Assist in debugging network connectivity issues related to SIEM log ingestion. Use basic network troubleshooting tools. Collaboration and Support Work alongside SOC analysts, threat hunters, and security engineers. Provide basic technical support for SIEM users. Assist in training and documentation for security teams. Performance Monitoring and Optimization Monitor storage and indexing performance to ensure optimal operations. Report any performance issues to senior administrators. Contribute to platform health reports and alerting metrics. Incident Support Assist SOC teams in log analysis, incident response, and forensic investigations. Ensure log data is readily available for security incidents. Education and Certifications: Bachelor s degree in Computer Science, Information Security, or a related field. Certifications (Preferred but not mandatory): Splunk Certified User/Admin Microsoft Certified: Security Operations Analyst Associate QRadar Certification Any SIEM-related certification Experience: 3+ years of experience in SIEM administration, security operations, or log management. Hands-on experience with at least one SIEM platform (e.g., Stellar Cyber, Splunk, Sentinel, Chronicle, Exabeam). Basic knowledge of log ingestion, rule creation, and data parsing. Exposure to scripting (Python, PowerShell) for automation. Basic understanding of TCP/IP networking concepts and network debugging. Technical Skills: Understanding of log formats, Syslog, JSON, XML, and data pipelines. Basic knowledge of querying languages (KQL, SPL, AQL). Familiarity with SIEM integration with security tools like EDR, SOAR, NDR. Awareness of MITRE ATT&CK, NIST, or CIS security frameworks. Basic experience with network troubleshooting tools (ping, traceroute, netcat (nc)). Soft Skills: Strong problem-solving and troubleshooting abilities. Good verbal and written communication skills. Ability to work collaboratively in a security operations environment. Preferred Skills: Basic understanding of cloud-based security solutions (AWS, Azure, Google Cloud). Exposure to SOAR tools (e.g., Cortex XSOAR, Splunk Phantom). Interest in machine learning-based anomaly detection for SIEM. Key Metrics for Success: Successful onboarding of log sources. Improvement in log ingestion and parsing accuracy. Contribution to fine-tuning detection rules. Timely resolution of SIEM-related support requests. Ability to identify and troubleshoot basic network connectivity issues.

Platform Engineer Platform engineer Full-Time Platform engineering
PS

Senior Associate Data Engineering L2

Publicis Sapient

6+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.

Senior Associate Senior associate Data Data Associate
SI

Business Technology Data Engineer

Samsara Inc

5+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Position: Business Technology Data Engineer Location: Bengaluru, India (Hybrid 3 days onsite) Company: Samsara Technologies India Pvt. Ltd. About Samsara Samsara (NYSE: IOT) is a leader in the Connected Operations Cloud, enabling businesses across industries like transportation, logistics, manufacturing, and field services to harness IoT data for safety, efficiency, and sustainability improvements. Samsara helps organizations digitize physical operations at scale, improving outcomes that impact global infrastructure. Role Overview Samsara is seeking a Business Technology Data Engineer to join its Data & Analytics team within the Business Technology division. In this role, you will design, build, and optimize end-to-end data pipelines and infrastructure for various business-critical systems across CRM, marketing, support, and product platforms. You'll collaborate with teams across the company to build reliable and scalable data solutions that power reporting, automation, and analytics. This hybrid role requires working 3 days per week from the Bengaluru office and 2 days remotely, with working hours aligned to India Standard Time (IST). Key Responsibilities Data Engineering & Platform Development Design and maintain ETL/ELT pipelines that integrate and transform data across business systems. Build scalable data infrastructure to support advanced analytics and real-time reporting needs. Write Python and SQL scripts for data ingestion, transformation, and validation. Data Integration & Enablement Work with diverse data sources: CRM, product telemetry, marketing automation, support ticketing, and order flow systems. Develop and support data lake and data warehouse solutions using Snowflake, Redshift, Databricks, or BigQuery. Ensure interoperability between applications and data layers. Performance & Quality Monitor and optimize pipeline performance, implement observability and alerting. Improve data quality, lineage, and governance across systems. Partner with internal stakeholders (e.g., Sales Ops, Marketing Ops, Analytics) to deliver reliable data products. Minimum Qualifications Bachelor s degree in Computer Science, Data Engineering, or related field. 5+ years of professional experience in data engineering. 3+ years experience building and maintaining end-to-end pipelines in a modern data stack. Strong in SQL and Python. Hands-on experience with: ETL tools: Fivetran, dbt Cloud: AWS (preferred), GCP, or Azure Databases: MySQL, PostgreSQL, Oracle, or similar Data Warehouses: Snowflake, Redshift, BigQuery, Databricks Preferred Qualifications Familiarity with API-based ingestion, serverless architecture (Lambda, API Gateway, SQS, etc.). Experience with monitoring tools (DataDog, CloudWatch, Splunk). Comfortable engaging stakeholders to translate business needs into data solutions. Proficiency in Docker, Kubernetes, or AWS Fargate is a plus. Qualification : Bachelors degree in Computer Science, Data Engineering, or related field

Business Technology Data Business Data Data technology
MB

Audience Platform Lead

Merkle B2b

Fresher | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Job Title: Audience Platform Lead Insights & Analysis Location: Bangalore Employment Type: Full-Time About the Role We re seeking a strategic and technically skilled Audience Platform Lead to join our Insights & Analysis team. This role will focus on leveraging platforms like Adobe Analytics, Google Analytics, WebTrends, and various Customer Data Platforms (CDPs) to enable data-driven marketing and customer insights. As a subject matter expert in tag management, audience creation, and marketing technology integration, you will play a key role in shaping and implementing audience strategies across platforms. Key Responsibilities Lead the design, development, and implementation of solutions on Customer Data Platforms (CDPs) such as Adobe Experience Platform (AEP), Tealium, Segment, Lytics, ActionIQ, or C360. Drive data ingestion workflows via batch and real-time modes using ETL tools, APIs, and JavaScript. Build data models and define audience segments and customer journeys based on business requirements and architecture. Collaborate with internal teams and stakeholders to translate BRDs into actionable CDP use cases for marketing activation. Enable data extraction and outbound flows to reporting tools, other Adobe products, and third-party systems. Define and apply business rules and data transformations aligned with privacy and compliance standards. Guide and mentor other team members on platform capabilities, integration best practices, and scalable solutions. Ensure alignment with data privacy laws such as GDPR, CCPA, and others. Required Qualifications Proven experience in leading CDP-related development projects. Strong scripting experience with Python, Java, or Node.js. Hands-on experience with REST APIs, Open APIs, and tools like cURL. Proficiency in data analysis, data modeling, and data mapping. Experience working with unstructured data using formats such as JSON and Parquet. Preferred Qualifications: Familiarity with data privacy regulations including GDPR and CCPA. Experience in client-facing roles or stakeholder engagement. Working knowledge of reporting technologies and visualization tools. Experience with Big Data ETLs and cloud-based data platforms. Background in customer journey orchestration, audience activation, and segment development. Exposure to MLOps, data governance, or MarTech strategy is a plus. Work at the intersection of data, marketing, and technology. Lead cutting-edge customer data platform initiatives. Be part of a collaborative, innovative, and growth-driven environment. Make a measurable impact on customer engagement and digital transformation.

Platform Lead Full-Time Audience Strategy Audience Segmentation
SY

Senior Data Engineer

Synechron

8+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field

Senior Data Engineer Senior engineer Data Engineer
CO

Financial Data Analyst

Commure

3+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Financial Data Analyst Location: Bengaluru, India Employment Type: Full-time Department: Global Operations About Commure Commure develops AI-driven healthcare technology that reduces administrative burden for providers, enabling more patient-centered care. Our solutions cover clinical documentation, revenue cycle management, patient engagement, and more serving over 250,000 clinicians nationwide and rapidly scaling. Role Overview We are seeking a Financial Data Analyst to ensure the accuracy and integrity of revenue transaction data ingested from various Electronic Health Record (EHR) systems into our financial databases. This role combines quality assurance, data analysis, and a solid grasp of healthcare revenue cycles and compliance. Key Responsibilities Data Verification: Validate revenue transactions from EHR systems against ingested data. Quality Assurance: Develop and execute test plans, document discrepancies, and track defects in data ingestion processes. Mathematical Analysis: Use mathematical techniques to confirm financial data accuracy and integrity. Process Improvement: Collaborate with development teams to enhance data ingestion workflows and QA methods. Documentation: Maintain thorough records of QA tests, data mappings, and findings; prepare reports for stakeholders. Cross-Functional Collaboration: Work with IT, finance, and operations teams to ensure consistent data quality. Compliance: Adhere to HIPAA and other relevant regulatory standards, staying current with best practices in healthcare data handling. Qualifications Bachelor s degree in Information Systems, Computer Science, Mathematics, Healthcare Informatics, or related field. Minimum 3 years of experience in quality assurance or data analysis. Familiarity with healthcare revenue cycles and compliance standards. Advanced Microsoft Excel skills (VLOOKUP, pivot tables, macros), with experience in automation and data modeling preferred. Experience with data visualization tools such as Tableau or Power BI. Strong statistical, mathematical, and analytical abilities. Proficient in SQL and comfortable working with large datasets. Experience with automated QA/testing frameworks and methodologies. Clear communicator able to convey complex data insights to varied stakeholders. Willingness to work night shifts aligned with US time zones (EST to PST). Mission-Driven: Make a tangible impact by transforming healthcare through technology. Strong Investor Support: Backed by leading investors like General Catalyst, Sequoia, and Y Combinator. Rapid Growth: Both companies have achieved 500%+ YoY growth, with ongoing Series D funding. Comprehensive Benefits: Flexible PTO, health coverage, parental leave (subject to location). Qualification : Bachelors degree in Information Systems, Computer Science, Mathematics, Healthcare Informatics, or related field.

Financial Data Financial Data Analyst Financial analyst
RU

Staff Engineer - Dspm

Rubrik

13+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Staff Engineer DSPM Location: Bangalore, India About the Team Rubrik s Security Apps team focuses on securing customer data across cloud, SaaS, and on-premises environments. As data volumes grow exponentially, so do the associated cybersecurity risks. The team builds scalable and innovative solutions to protect, search, and analyze data seamlessly. Operating like a startup within a startup, they emphasize strong engineering principles, innovation, and teamwork to drive product excellence. About the Role As a Staff Engineer, you will play a critical role in Rubrik s R&D, collaborating closely with product teams to build and evolve scalable, fault-tolerant backend systems. You will lead the development of data ingestion pipelines and advanced analysis engines, shaping the technical direction of multiple projects. Additionally, you will mentor engineers, fostering leadership skills and promoting a culture of technical excellence. What You ll Do Design, develop, test, deploy, and maintain high-performance software systems. Build large-scale distributed systems and storage infrastructure. Develop backend services that ingest and process sensitive data from multiple cloud providers. Create data pipelines for classification, correlation, anomaly detection, automated issue resolution, and customer reporting. Own project priorities, deadlines, and deliverables with end-to-end accountability. Identify and resolve software bottlenecks, driving continual innovation. Provide technical leadership and mentorship to engineers, guiding their growth into leadership roles. Influence architecture and design decisions across teams and projects strategically. Propose and lead process improvements and technical initiatives to boost productivity. Collaborate rapidly with engineers, product designers, and stakeholders to solve real-world problems. Operate effectively in an agile, fast-paced environment, adapting quickly to evolving business needs. Experience & Qualifications Bachelor s or Master s degree in Computer Science or a related field. 13+ years of industry experience solving complex technical problems. Proficiency in one or more programming languages such as Go, Java, C/C++, Scala, or Python. Experience designing and architecting large-scale distributed systems. Proven ability to guide and mentor engineers in scalable software design and implementation. Strong communication and collaboration skills. Experience with public cloud platforms (GCP, AWS, Azure) is a plus. About Rubrik Rubrik is on a mission to secure the world s data with its Zero Trust Data Security platform. Using machine learning, Rubrik Security Cloud protects data across enterprises, cloud, and SaaS environments, enabling resilience against cyberattacks, insider threats, and operational disruptions while ensuring data integrity and availability. Qualification : Bachelors or Masters degree in Computer Science or a related field.

Engineer Staff Engineer Full-Time Data Security DSPM
BL

Private Markets Data Extraction, Aladdin Data, Director

Blackrock

12+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Private Markets Data Extraction, Aladdin Data Director Location: Bengaluru, Karnataka Team: Data Science Company: BlackRock About the Role We are seeking a tech-savvy leader to head our Private Markets Data Extraction team within the Aladdin Data group. This role involves driving the strategic direction of data initiatives by leveraging cutting-edge technologies like Large Language Models, AI Orchestration Frameworks (e.g., LangChain), Spring, GIT/ADO, Solr, Cassandra, and more. You will work closely with Data, Product, and Technology teams to ensure our data products exceed client expectations in quality and scope, while gaining deep exposure to finance domains such as risk management, valuations, and operations. What You ll Do Develop strategies for automated extraction of data from semi-structured and unstructured sources (e.g., regulatory documents) to build scalable, reusable pipelines. Architect and build extensible data ingestion and extraction platforms accessible to internal teams and customers. Own technical architecture, design principles, and application governance. Manage diverse, global teams of engineers, data scientists, and other tech professionals. Collaborate with cross-office and international teams. Provide expert technical guidance on software design and implementation. Mentor and support career growth for junior team members. What You Need B.S. / M.S. in Computer Science, Engineering, or related field. 12+ years of professional experience with proven leadership. Strong ability to communicate technical strategies clearly. Hands-on experience with Java and Python, object-oriented programming. Experience designing/building APIs and microservices. Expertise with open-source technologies: Spring/SpringBoot, Apache Solr, Protocol Buffers, LangChain, Docker. Experience with relational and NoSQL databases (e.g., Apache Cassandra). Agile team experience with strong problem-solving and rapid learning capabilities. Excellent interpersonal, communication, and presentation skills. Experience mentoring junior engineers. Good to Have Cloud-native development experience (Kubernetes, Docker) and Microsoft Azure. Familiarity with Apache Kafka or other pub-sub frameworks. Experience with Large Language Models (OpenAI LLMs), AI app frameworks, vector databases, NLP. Finance and financial services domain expertise. Benefits & Work Model Comprehensive benefits including retirement plans, tuition reimbursement, healthcare, family support, and Flexible Time Off (FTO). Hybrid work: typically 4 days in-office, 1 day remote with some flexibility depending on business needs. Collaborative culture fostering learning and innovation. About BlackRock BlackRock s mission is to help more people experience financial well-being globally. We invest in our employees to create a welcoming, valued, and supportive environment that encourages growth and impact. Qualification : B.S. / M.S. in Computer Science, Engineering, or related field.

Private Markets Data Extraction Data Extraction Aladdin Data
EI

Engineering Leader - Machine Learning

Eightfold

Fresher | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Engineering Leader - Machine Learning Location: Bangalore, Karnataka, India Employment Type: Full-Time | Hybrid Work Model About Eightfold.ai At Eightfold.ai, we re revolutionizing the future of employment by leveraging artificial intelligence to connect individuals to the right career opportunities based on their skills, not just their network. Our AI-powered Talent Intelligence Platform is transforming how organizations plan, hire, develop, and retain a diverse workforce. With $410M+ in funding and a $2B+ valuation, we re growing rapidly, and if you're passionate about solving one of society's most critical challenges employment then Eightfold is the place for you. Led by visionary leaders like Ashutosh Garg (former Google Search and Personalization leader) and Varun Kacholia (former Facebook and Youtube leader), we are shaping the future of AI-powered talent management. About the AI Platform Team Our AI/ML team is the heart of Eightfold, pushing the boundaries of applied machine learning. We re working with massive datasets, solving complex problems, and building cutting-edge AI models that are reshaping how companies approach talent management. Join us if you re eager to work in a team where every day presents a new challenge and opportunity. What You ll Do As the Engineering Leader - Machine Learning, you ll be responsible for leading and mentoring a high-performing team of engineers, driving the success of AI-driven products at Eightfold. Your primary responsibilities will include: Team Leadership: Coach, mentor, and manage a talented team of engineers to foster a culture of innovation, collaboration, and high performance. ML Model Ownership: Lead the development and deployment of cutting-edge deep learning models across all Eightfold products, ensuring reliability, scalability, and high-quality performance. Platform Development: Help build high-performance, flexible infrastructure that supports a variety of deep learning techniques and modeling approaches. End-to-End ML Pipeline: Oversee the end-to-end process of building and deploying machine learning models, including creating robust data pipelines that can process unstructured data. ML Framework Implementation: Design and implement an intuitive ML development framework that ensures efficiency and ease of use for data scientists and engineers. Model Fairness: Work with our internal model fairness platform to ensure that we are providing equal opportunity for everyone through responsible ML practices. Cross-Team Collaboration: Work closely with product teams to apply deep learning techniques to solve complex business problems across various domains. What You Should Already Know To be successful in this role, you should have: Strong Foundation in ML & Deep Learning: Expertise in applying Natural Language Processing (NLP) and deep learning solutions to solve real-world problems. Experience with Language Models: Familiarity with advanced language models such as BERT, GPT-3, T5, and others. Academic Background: A BS, MS, or PhD in Computer Science, Data Science, Mathematics, or related fields. Proven ML Experience: Hands-on experience building and deploying machine learning models at scale, particularly in production environments. Programming Expertise: Strong knowledge of ML languages such as Python, C++, Java, R, Scala, and experience with scientific libraries like numpy, pandas, and frameworks like TensorFlow, PyTorch, scikit-learn, etc. Strong ML Theory Knowledge: In-depth understanding of ML theory and experience working with large-scale datasets, data ingestion, and processing systems. Experience with Distributed Systems: Familiarity with distributed systems, including REST APIs, microservices, and data processing frameworks. Metrics-Focused: A passion for building high-quality models that deliver results and metrics-driven outcomes. Nice to Have Real-Time Tech Problems: Experience with real-time processing or low-latency systems. Cloud Environments: Familiarity with cloud platforms like AWS, and experience using cloud-based ML tools. MLOps Tools & Pipelines: Experience with MLflow, Metaflow, or similar tools to streamline ML workflows and operations. Advanced Tech Stack: Familiarity with tools like Spark, MLlib, Databricks, Apache Airflow, etc. Impactful Work: Join a company dedicated to solving one of society's most pressing issues employment. Your work will have a direct impact on individuals' careers around the world. Innovation at Scale: Work with cutting-edge AI and ML technologies to shape the future of talent management. Competitive Compensation: Receive an attractive salary, equity, and comprehensive benefits package (including family medical, vision, and dental coverage). Collaborative Environment: Work in a culture that values transparency, ownership, and collaboration across teams. Hybrid Work Model: Enjoy a hybrid work environment, with flexibility for remote work and in-office collaboration at our Bangalore office. Growth Opportunities: Be part of a rapidly scaling company with vast opportunities for career development and leadership roles. Equal Opportunity Employer Eightfold.ai is an Equal Opportunity Employer. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, or disability. If you are an experienced and visionary leader in Machine Learning, eager to make a lasting impact while solving one of society's most important challenges, we would love to hear from you. Qualification : BS or MS or PhD degree in Computer Science, Data Science or Mathematics

Engineering Leader Engineering Leader Machine Machine Engineering
RT

Java Developer

Raytheon Technologies Corporation

5-8 Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Java Developer Digital Engine Services Company: Pratt & Whitney Location: Bengaluru Experience: 5 8 years Job Type: Full-time About Us Pratt & Whitney, a Raytheon Technologies company, designs the world s most advanced aircraft engines. Our digital transformation efforts include connected engines and diagnostic platforms, enabling safer and smarter flight. Join our global team of innovators redefining aerospace. Role Summary We're hiring a skilled Java Developer to work on our DPHM Ground Station platform, managing engine data ingestion, transfer, and diagnostics. You will develop cloud-based microservices and automation tools to support predictive maintenance and fleet insights. Responsibilities Design and develop Java microservices for file ingestion and transfer. Work with AWS services (Lambda, S3) for cloud-native development. Manage Apache Kafka-based data pipelines. Automate alerts and monitoring systems for engine data processing. Build CI/CD pipelines and implement unit/integration testing. Define KPIs and create dashboards using data cubes and APIs. Collaborate with P&WC IT for DevSecOps and troubleshooting. Qualifications Bachelor s/Master s in Software Engineering or Computer Science. 5 8 years of experience in Java, OOP, cloud, and messaging systems. Hands-on with Kafka, AWS Lambda, CI/CD, and GitHub. Excellent English communication and teamwork skills. Preferred AWS certification IoT data pipeline experience Familiarity with C#/C++ Benefits Flexible work schedules Parental leave and childcare support Career development programs Health and savings plans Apply Now Equal Opportunity Employer All applicants are considered without regard to race, gender, disability, veteran status, or other protected attributes. RTX is an equal opportunity employer. Qualification : Bachelors/Masters in Software Engineering or Computer Science.

Digital Engine Services Digital services Java
IB

Data Engineer

International Business Machines

7+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Azure Data Engineer IBM Consulting Client Innovation Center Location: Bengaluru, India Experience: 7+ Years (Minimum 4+ Years in Azure Technologies) Job Type: Full-Time Education Required: Bachelor s Degree (Master s preferred) Introduction: Join IBM Consulting at our Client Innovation Center in Bengaluru, where we deliver deep technical and industry expertise to a wide range of public and private sector clients. Our delivery centers focus on innovation, agility, and adoption of next-gen technologies to transform businesses locally and globally. Your Role & Responsibilities: Design and develop scalable data engineering solutions on Microsoft Azure. Build, optimize, and manage data pipelines and ETL workflows using tools like Azure Data Factory, ADLS, and Databricks. Write clean, efficient code using PySpark, PL/SQL, and Spark SQL. Integrate and manage data from various sources, both structured and unstructured. Work with SQL, Postgres, Cassandra, and Cosmos DB. Utilize Azure services such as Stream Analytics, SQL DW, Azure Functions, ARM Templates, and Analysis Services. Implement and maintain serverless architectures for modern data solutions. Ensure high-quality data delivery, security, and compliance across systems. Collaborate across teams and contribute to solution design, code reviews, and documentation. Required Skills & Experience: Bachelor s degree in Computer Science, Information Systems, or related technical field. 7+ years total experience in Data Engineering, with 4+ years in Azure-based data projects. Strong hands-on experience with: Azure Data Factory, Data Lake (ADLS), Databricks Programming: Python, PySpark, PL/SQL, Spark SQL Databases: SQL, Postgres, Cassandra, Cosmos DB Solid grasp of data warehousing, relational databases, and cloud-based architectures. Familiarity with version control tools like Git and CI/CD pipelines. Preferred Skills & Qualifications: Master s Degree in a relevant field. Experience with: ARM Templates, Azure Functions, Serverless Architectures Object-oriented scripting languages (Python, Scala, etc.) Excellent problem-solving and communication skills. Ability to work in a fast-paced environment and collaborate effectively with teams and stakeholders. What You ll Get: Work on high-impact, global projects with cutting-edge Azure technologies. Be part of a collaborative and forward-thinking IBM team. Opportunities for professional growth, upskilling, and certifications. A dynamic work culture focused on innovation, agility, and client success. Join us in Bengaluru and be part of IBM s journey in shaping the future of data engineering. Qualification : Bachelors degree in Computer Science, Information Systems, or related technical field.

Data Engineer Data Engineer Platforms Data Platforms
M&

Data Engineer - Platform Generative Ai

Mckinsey & Company

3+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Your Impact We are seeking a passionate Data Engineer with expertise in Python development who is excited about cloud-based data engineering using AWS services. You will be an integral part of a dynamic, multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers, and other stakeholders. As a key member of a global team working on our generative AI initiative, you will be based in one of our European offices. McKinsey s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm s internal use, and your role will be crucial in driving the development of data solutions to support generative AI applications. You will work with a team of data engineers to develop robust data ingestion pipelines and enhance data processing capabilities that integrate data into systems used by AI applications. Your responsibilities will include writing Python code, creating tests, developing and maintaining GitHub Action CICD pipelines, and managing AWS-based infrastructure and Docker containers. Your Growth As a member of the global team working on our generative AI initiative, you will play a key role in shaping and accelerating the delivery of McKinsey's target state data platform, which will enable AI use-cases. You will be part of our cloud-first approach, transforming data platforms and analytical applications across the firm. Working closely with multidisciplinary teams, you will contribute to building cutting-edge data solutions in a fast-paced, innovative environment. McKinsey s Tech Ecosystem function is responsible for developing all technology solutions for the firm s internal needs, and you ll have the opportunity to shape how these solutions evolve. Your Qualifications and Skills 3+ years of professional experience as a Data Engineer, with a focus on cloud-based data engineering using AWS services Expertise in Python development and a strong understanding of clean code, modularity, error handling, and test automation Extensive experience with relational databases and data pipeline performance Hands-on experience with Docker and CI/CD pipelines (e.g., GitHub Actions) Strong execution focus, with the ability to work independently in complex, fast-paced environments and deliver results Demonstrable experience in solving data pipeline performance issues and diagnostics Interest in generative AI and machine learning topics Experience with Kedro framework is a plus Opinionated and confident in sharing ideas, willing to speak up at all levels Familiarity with Agile principles and product development methodologies Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams

Data Engineer Data Engineer Platform Data platform
IN

Staff Data Engineer

Intuit

12+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Intuit is a global leader in financial technology, dedicated to helping individuals and businesses thrive. Our suite of products, including TurboTax, Credit Karma, QuickBooks, and Mailchimp, serves approximately 100 million customers worldwide. At Intuit, we believe in providing everyone with the tools and resources they need to achieve financial success. We are constantly innovating to make financial empowerment a reality for all. Job Overview Join the Intuit Data Platform (IDP) team as a Staff Engineer and help us transform the way we handle big data! The IDP team is responsible for the Intuit Analytics Platform, which powers real-time data ingestion, cataloging, analytics, and machine learning across the entire organization. As Intuit s customer base grows, so does the volume of data we process. Our engineering excellence ensures that we can scale and leverage this data to drive machine learning and product innovations. We re in the process of building the next-generation real-time and batch ingestion engine, capable of indexing, cataloging, and organizing data and metadata. We are passionate about using open-source technologies to solve challenges and contributing back to the community. If you're excited about building a platform that will directly impact data scientists and analysts and have a desire to shape the future of data at Intuit, then come join us! Key Responsibilities Architect & Design: Build fault-tolerant and scalable big-data platforms using open-source technologies to handle massive datasets. Data Solutions: Create architecture solutions that address complex use cases like data normalization, lineage, governance, ontology, and discoverability. Cross-Team Collaboration: Work with analysts and data scientists to understand data requirements for building operational propensity models and gaining deep customer insights. Hands-On Coding: Lead development efforts within the Hadoop ecosystem using technologies such as Java MapReduce, Spark, Scala, HBase, and Hive to build and optimize data pipelines for both real-time and batch applications. Database Management: Work with NoSQL, SQL, and in-memory databases to design high-performance data systems. Code Reviews: Ensure code quality, consistency, and adherence to best practices through regular code reviews. Architectural Alignment: Ensure alignment between enterprise architecture and business requirements. Prove Feasibility: Conduct proof-of-concept (POC) experiments for new technologies or approaches and drive them to production. Collaboration with Data Cataloging Team: Work closely with data catalog teams and architects to index and catalog all data sources at Intuit. Agile Leadership: Lead fast-paced development teams using agile methodologies and promote best practices in software development, testing, and incident response. Design & Model: Build dimension models suited for customer business use cases and ensure seamless integration of business and technical requirements. Qualifications Experience: 12+ years of relevant experience, with at least 5+ years specializing in the big data domain. Big Data Architecture: Proven experience in architecting end-to-end ecosystems for big data and analytics platforms. Expert Knowledge: Deep expertise in building fault-tolerant, scalable big data solutions, especially using the Hadoop ecosystem (Hive, HBase, Spark, Kafka, MapReduce, etc.). Programming Expertise: Mastery of Java and Scala, with a focus on building high-throughput data services. Machine Learning: Knowledge of machine learning principles and AI applications in big data. Big-Data Technologies: Familiarity with tools such as HDFS, Storm, Zookeeper, Cassandra, Redshift, GraphDB, and others. Understanding both real-time and batch processing in the Hadoop ecosystem. Communication: Strong communication skills, with an ability to explain complex technical topics to both technical and non-technical audiences. Programming Skills: Intermediate experience in Python or R for data processing. Education: BE/BTech/MS in Computer Science or a related field (or equivalent experience). Collaboration: Demonstrated ability to work cross-functionally and lead change through influence and example. At Intuit, you ll be part of a talented, passionate team working on innovative solutions that shape the future of data analytics and machine learning. As a Staff Engineer, you ll have the chance to work with cutting-edge technologies, build scalable systems, and help revolutionize how Intuit leverages data to drive product innovation. If you're looking for a dynamic environment where you can have a meaningful impact, come join us at Intuit! Qualification : BE/BTech/MS in Computer Science (or equivalent)

Data Engineer Staff Engineer Data Engineer Full-Time
HT

Senior Python Expert

Hashedin Technologies Pvt. Ltd.

3-8 Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Job Title: Senior Python Expert Experience: 3 to 8 years Overview of the Role: This role sets the benchmark for team software development processes and deployment procedures, while actively contributing to establishing best practices and methodologies within the team. Responsibilities: Develop backend services using Python Flask or similar web frameworks. Design and maintain data and pipeline management frameworks using open-source technologies such as Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud-based data engineering services like S3, Redshift, Athena, Kinesis. Design and develop efficient CRUD operations for large datasets with millions of records. Collaborate with teams to build and maintain innovative, reliable, secure, and cost-effective distributed solutions. Own and deliver complex application components within defined timelines. Ensure quality delivery using best practices in API development, performance, and scalability. Participate in customer communication, presentations, and resolution of critical issues. Contribute to architecture, feature set, and design decisions. Proactively recognize and address requirement inconsistencies and project risks. Break down work effectively and estimate accurately. Serve as a technical mentor and role model within the team. Required Skills: Strong knowledge of Python and a web framework like Flask. Experience with AWS services such as EC2, S3, Lambda, Step Functions, Glue, SNS, SQS, Secret Manager, and CodeBuild/CodePipeline. Solid understanding of SQL, including query writing, optimization, and database interaction tools. Experience with API development (RESTful services, Postman, API Gateway). Strong coding, debugging, and problem-solving skills. Understanding of architectural trade-offs and data engineering principles (data acquisition, ingestion, distributed processing, high availability). Ability to independently handle delivery of complex projects. Excellent team management and individual contributor skills. Good to Have Skills: Experience with Big Data frameworks like Hadoop and Spark. Knowledge of AWS Aurora. Familiarity with pip, setuptools, etc. Education: B.E./B.Tech, MCA, M.E./M.Tech.

Python Expert Full-Time Python Expert Python developer
ND

Sr. Data Engineer

Ness Digital Engineering

5+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Job Title: Sr. Data Engineer Job Overview: We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in Snowflake to manage data ingestion and transformation. The ideal candidate will work with an offshore team to deliver scalable data solutions aligned with business and performance requirements. Key Responsibilities: Design, build, and maintain ELT pipelines using Snowflake. Lead offshore development teams in applying data engineering best practices. Collaborate with stakeholders to manage data integration across systems. Optimize data pipelines for performance and reliability, including query tuning and resource management. Implement data validation processes to ensure data accuracy. Document data pipelines, flow diagrams, and transformation logic. Troubleshoot pipeline failures and resolve performance issues. Ensure compliance with data governance and regulatory requirements. Required Qualifications: 5+ years of experience in data engineering with a focus on ELT development. Strong expertise in Snowflake, including data sharing, secure views, and performance optimization. Proficiency in SQL and data integration tools. Experience managing offshore development teams. Strong problem-solving and communication skills. Preferred Qualifications: Snowflake certification or relevant certifications. Experience in financial services with knowledge of data security and compliance. Familiarity with cloud platforms (AWS, Azure) and orchestration tools like Apache Airflow. Experience with Python or JavaScript for data transformation. Knowledge of data visualization tools like Tableau or Power BI.

Sr. Data Engineer Sr. engineer Data Engineer
CO

Data Engineer

Couchbase

5+ Years | Not Disclosed | Bengaluru, Karnataka, India | Full-time

Job Title: Data Engineer Location: Bengaluru (Hybrid) About Couchbase: As industries race to embrace AI, traditional database solutions fall short of rising demands for versatility, performance, and affordability. Couchbase is leading the way with Capella, the developer data platform for critical applications in our AI world. By uniting transactional, analytical, mobile, and AI workloads into a seamless, fully managed solution, Couchbase empowers developers and enterprises to build and scale applications with unmatched flexibility, performance, and cost-efficiency from cloud to edge. Trusted by over 30% of the Fortune 100, Couchbase is unlocking innovation, accelerating AI transformation, and redefining customer experiences. Come join our mission! Position Overview: We are seeking a highly skilled Data Engineer with a strong background in data warehousing, advanced analytics, and AI integration. The ideal candidate will have 5+ years of experience designing and implementing data pipelines, building robust analytics platforms, and working with modern data technologies like Snowflake, Google Cloud, Databricks, Looker, PowerBI, and Tableau. As part of our Delorean team, you will play a pivotal role in driving innovation and ensuring our data infrastructure supports strategic decision-making. Key Responsibilities: Data Infrastructure Development: Design, develop, and maintain scalable data pipelines and ETL processes to support data ingestion, transformation, and storage across multiple platforms. Experience with Cloud Data Platforms: Expertise in implementing and optimizing solutions using industry-leading tools such as Snowflake, Databricks, and Google Cloud Platform. Demonstrated ability to ensure high performance, scalability, and cost-effectiveness in data infrastructure and workflows. Analytics & Visualization: Build and maintain interactive dashboards and reports using Looker, PowerBI, and Tableau to provide actionable insights to business stakeholders. AI & Advanced Analytics: Collaborate with Data Science teams to integrate AI models and machine learning workflows into data pipelines for predictive analytics and automation. Data Governance: Ensure data quality, security, and compliance with industry best practices and regulatory requirements. Collaboration: Partner with cross-functional teams, including Product, Engineering, and Business Operations, to understand data requirements and deliver tailored solutions. Continuous Improvement: Identify opportunities to improve data workflows, adopt new technologies, and drive operational efficiency. Qualifications: Education: Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field. Experience: 5+ years of hands-on experience in data engineering, data warehousing, or related fields. Technical Skills: Expertise in Snowflake, Databricks, and Google Cloud Platform (Mandatory experience in at least one tool). Proficiency in ETL/ELT processes and data pipeline tools (e.g., Apache Airflow, dbt). Experience with data visualization tools like Looker, Power BI, and Tableau. Strong SQL skills and familiarity with Python or Scala for data processing. Knowledge of AI/ML concepts and frameworks for integrating predictive models. Soft Skills: Excellent problem-solving skills with a proactive mindset. Strong communication and collaboration skills to work effectively with technical and non-technical teams. Ability to manage multiple priorities in a fast-paced environment. Modern customer experiences need a flexible cloud database platform that can power applications spanning from cloud to edge and everything in between. Couchbase s mission is to simplify how developers and architects develop, deploy, and consume modern applications. With Capella, our flexible, affordable cloud platform, we empower organizations to quickly build and deliver premium customer experiences with unmatched price-performance. More than 30% of the Fortune 100 trust Couchbase to power their modern applications. Benefits at Couchbase: Generous Time Off Program: Flexibility to care for yourself and your family. Wellness Benefits: Comprehensive medical plans, dental, vision, life insurance, and employee assistance programs. Financial Planning: RSU equity program, ESPP, retirement planning, and business travel insurance. Career Growth: A Be valued, Create value approach to your career development. Fun Perks: Ergonomic office setup, food & snacks for in-office employees, and more! Qualification : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.

Data Engineer Data Engineer Full-Time Data Engineering

1 - 20 of 0 jobs

* No exact matches found. Showing closest results instead
Sort by:

No results found

Modify search criteria or create an alert to get relevant jobs as soon as they’re posted

Create an alert

Continue to Save

Please login to your jobseeker account, or create a new one to save this job.

Feedback

Share Feedback