Data Performance Optimization Jobs in Bengaluru
1331 Jobs Found
Data Engineer
Capital One
Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field
Principal Associate - Full Stack Engineering
Capital One
Principal Associate Full Stack Engineering (GenAI Observability) Location: Bangalore Company: Capital One India About Us At Capital One India, we re tackling some of the most complex problems in financial services using machine learning, advanced analytics, and cloud-first engineering. Our mission is to build cutting-edge, patentable solutions that transform customer experiences, enhance operational efficiency, and ensure robust risk and compliance standards. We re a team of makers, breakers, doers, and disruptors obsessed with turning data into real-world impact at scale. About the Team Machine Learning Experiences (MLX) The MLX team is pioneering the future of model governance, ML observability, and Generative AI infrastructure at Capital One. We re enabling teams to seamlessly deploy ML and GenAI models at scale, with full visibility into performance, health, compliance, and ethical usage. This is the platform powering the next generation of AI-driven financial products across the company. About the Role We re looking for a Principal Associate Full Stack Engineer to lead the development of observability platforms for Generative AI systems. You ll be part of a cross-functional team focused on governance automation, LLM monitoring, and intelligent diagnostics using telemetry data, metadata, and advanced analytics. You ll design systems to collect, analyze, and visualize performance data from our large-scale GenAI infrastructure, helping data scientists and engineers make faster, safer decisions. What You ll Do Lead architecture and development of observability tools and dashboards for monitoring GenAI models and platform health. Design and build core APIs and SDKs to instrument large language models (LLMs) and foundational models (training, fine-tuning, prompting stages). Integrate Generative AI to enable observability features like anomaly detection, predictive analytics, and copilot-assisted troubleshooting. Partner with platform, MLOps, and governance teams to ingest and analyze telemetry, metadata, and runtime metrics at scale. Drive development of tools to ensure compliance with AI ethics, data governance, and industry regulations. Collaborate with product, design, and research to turn complex requirements into scalable, cloud-native software solutions. Lead proof-of-concept initiatives to test and showcase how GenAI can improve platform observability and decision-making. Contribute to the open-source community and stay at the forefront of GenAI and ML infrastructure evolution. Basic Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or related field 4+ years of experience building distributed, data-intensive systems using microservices architecture 4+ years of experience in backend development with Python, Go, or Java 4+ years of expertise with observability stacks (Prometheus, Grafana, ELK) and adapting them for AI systems Strong knowledge of OpenTelemetry, and experience building custom SDKs and APIs 5+ years of hands-on experience with Generative AI models, especially applied to observability, governance, or compliance 2+ years of experience with cloud platforms such as AWS, Azure, or GCP Preferred Qualifications 4+ years building and optimizing ML systems in production environments 3+ years of experience with MLOps tools like MLflow, Kubeflow, or commercial platforms Experience with GenAI frameworks and libraries like LangChain, Haystack, and vector databases (FAISS, Chroma, OpenSearch) Familiarity with emerging observability tools for LLMs such as Langfuse, Phoenix, Helicone, or OpenInference Contributor to open-source GenAI or ML infrastructure projects Author or co-author of published work in AI/ML observability, governance, or performance monitoring Experience with PyTorch, TensorFlow, Spark, or Dask Knowledge of NVIDIA GPU telemetry, CUDA programming, and performance optimization for AI workloads Understanding of AI ethics, data governance, and regulatory frameworks for machine learning systems Why Join Capital One India Work at the intersection of technology, AI, and compliance helping shape the future of responsible AI Join a team driving enterprise-wide adoption of Generative AI Collaborate with world-class engineers, data scientists, and product leaders Enjoy a high-performance culture that encourages innovation, learning, and mentorship Access to cutting-edge tools, open-source contributions, and cloud-native infrastructure Qualification : Bachelors or Masters degree in Computer Science, Engineering, or related field
Manager FMRTS CT
Shadowfax Technologies
Position: Manager FMRTS CT Location: Bengaluru Experience Required: 5 10 years Department: Operations About the Role: We are seeking a highly analytical and results-driven Manager FMRTS CT to lead key operational excellence initiatives across sort centers in the West region. This role focuses on improving throughput, optimizing workflows, and ensuring process adherence across the end-to-end supply chain. The ideal candidate should possess strong cross-functional leadership, data-driven decision-making, and project management skills. Key Responsibilities: Increase core Throughput Per Hour (TPH) in sort centers through layout standardization and implementation of Zone-Based Palletization (ZBP). Develop and apply mathematical models to optimize load balancing across belts, reducing defects and improving productivity. Own and drive compliance programs such as signage standardization, WIKI documentation, Guard Shack (GS) protocols, and Grace Time Truck Departure (GTTD). Analyze and improve sort center quality metrics; conduct deep dives for underperforming sites and collaborate with cross-functional teams (Operations, Linehaul, Analytics, Safety & Loss Prevention) to meet performance targets. Build and maintain a sortation path planning tool to ensure Long-Term Planning (LTP) is adhered to at the site level. Conduct Time & Motion studies to identify and eliminate non-value-adding activities, improving overall package throughput time. Partner with teams across Category Sourcing, Logistics, Warehousing, Last Mile, Finance, Tech, Warranty, and After-Sales (AFS) to ensure seamless process execution from procurement through to delivery. Address daily operational challenges and strategic issues by working closely with leadership teams across business functions. Lead and manage cross-functional project teams, set milestones, and ensure timely execution of Supply Chain Excellence initiatives. Establish data-driven process controls, tooling requirements, and audit mechanisms to ensure consistent process adherence. Drive adoption of new tools and operational playbooks, ensuring governance, compliance, and best practice implementation. Assess business and technical risks, manage escalations, and maintain a balance between operational needs and technical constraints. Investigate complex sourcing and supply chain challenges, design scalable solutions, and collaborate with engineering and stakeholder teams for implementation. Leverage analytics and technology to lead cross-functional coordination, resolve operational bottlenecks, and drive continuous improvement. What You Bring: 5 10 years of experience in operations, supply chain, or logistics, preferably within e-commerce or high-volume distribution environments. Proven experience in process optimization, data modeling, and performance analysis. Strong knowledge of warehouse/sort center operations and tooling systems. Demonstrated ability to manage cross-functional teams and deliver complex projects end-to-end. Excellent problem-solving, communication, and stakeholder management skills. Proficiency in data analysis tools and methodologies is a strong plus.
Data Architect
Growtharc Technologies
Position: Data Architect Location: Remote/Hybrid | Bengaluru, IND We're searching for a highly skilled and experienced Data Architect to join our team. If you have a deep understanding of big data technologies and extensive experience with Hadoop, Python, Snowflake, and Databricks, you're the ideal candidate. You'll be responsible for designing, implementing, and managing complex data architectures that support our critical business needs and objectives. What You'll Do: Design & Architecture Leadership: Design scalable and efficient data architecture solutions that meet current and future business data needs. Lead the development of data models, schemas, and databases, ensuring alignment with business requirements. Architect and implement robust data solutions on leading cloud platforms (AWS, Azure, or GCP). Data Management & Governance: Develop and maintain robust data pipelines and ETL processes using Hadoop, Databricks, and other essential tools. Oversee data integration and quality efforts to ensure consistency and reliability across the organization. Implement data governance best practices, focusing on data security, privacy, and compliance. Collaboration & Mentorship: Work closely with data engineers, data scientists, and business stakeholders to translate data requirements into effective technical solutions. Provide technical leadership and mentorship to junior data engineers and architects. Collaborate with cross-functional teams to ensure data solutions align perfectly with overall business goals. Optimization & Innovation: Optimize existing data architectures for peak performance, scalability, and cost-efficiency. Monitor and troubleshoot data systems to ensure high availability and reliability. Continuously evaluate and recommend new tools and technologies to improve our data architecture. What You'll Bring: Experience: 10+ years in data architecture, data engineering, or a related field. Big Data Expertise: Proven experience with Hadoop ecosystems (HDFS, MapReduce, Hive, HBase). Programming Prowess: Strong programming skills in Python for data processing and automation. Data Platform Mastery: Hands-on experience with Snowflake for data warehousing and Databricks for analytics. Cloud Fluency: Extensive experience with cloud platforms (AWS, Azure, GCP) and their data services. Data Modeling: Familiarity with data modeling tools and methodologies. Core Skills: Deep understanding of big data technologies and distributed computing. Strong problem-solving skills to design solutions for complex data challenges. Excellent communication skills, able to explain complex technical concepts clearly to diverse audiences. Proficient in SQL and database performance tuning. Experience with CI/CD pipelines and automation in data environments. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Advanced Degree: A Master's degree in a related field. Cloud Certifications: Certifications like AWS Certified Data Analytics, Google Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate. Additional Languages: Experience with other programming languages like Java or Scala. Machine Learning Integration: Knowledge of machine learning frameworks and their integration with data pipelines.
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Senior Machine Learning Engineer
Chevron Corporation
Senior Machine Learning Engineer Location: Bengaluru, India Company: Chevron Experience Required: 5 10 Years Department: AI/ML Engineering Work Mode: Hybrid / Global Operations Support About the Role Chevron is actively seeking a Senior Machine Learning Engineer to join our cutting-edge AI team. You will be responsible for designing, building, and optimizing advanced machine learning systems that power transformative applications in artificial intelligence. In this role, you will develop self-learning applications and refine AI systems using robust engineering, statistics, and software design practices. Key Responsibilities Study and transform data science prototypes into production-ready systems Design scalable and robust machine learning systems Research and implement modern ML algorithms and tools Develop ML applications based on business and technical requirements Select appropriate datasets, data pipelines, and data representation techniques Run experiments and evaluate results to fine-tune models Perform statistical analysis and ML performance optimization Train and retrain models as new data becomes available Extend and customize existing ML libraries and frameworks Stay up to date with the latest ML research and trends Required Qualifications 5 10 years of proven experience as a Machine Learning Engineer or in a similar role Hands-on experience with Azure Machine Learning and MLOps Strong skills in data structures, data modeling, and software architecture Deep knowledge of math, probability, statistics, and algorithm design Proficient in programming languages: Python, R Familiarity with ML frameworks and libraries such as Keras, PyTorch, scikit-learn Excellent analytical and problem-solving skills Strong communication and teamwork abilities Working Hours Chevron supports international teams. Work hours are scheduled to align with global collaboration: Work Days: Monday to Friday Shift Options: 8:00 AM 5:00 PM or 1:30 PM 10:30 PM IST Opportunity to work on impactful ML/AI solutions at enterprise scale Flexible work culture with global exposure Advanced tools, infrastructure, and data at your fingertips Professional growth in a forward-thinking, innovation-driven environment Equal Opportunity Statement Chevron is an equal opportunity employer and adheres to inclusive hiring practices. All qualified candidates will receive consideration without regard to race, gender, age, religion, nationality, sexual orientation, disability, or any other protected status. Chevron also participates in E-Verify as required by law in applicable jurisdictions. Apply Today
Analytics Lead/architect
Oracle India
Analytics Lead/Architect Location: Bengaluru, Karnataka, India Job Category: Consulting Job Type: Regular Employee Role: Individual Contributor Job Description: As a BI Architect, you will work on both offshore and onsite client projects. Your responsibilities will involve working with Oracle BI Applications, OAC (Oracle Analytics Cloud), and ODI (Oracle Data Integrator) implementations. You will engage with clients to understand their requirements, lead technical designs, and oversee system and integration testing using Oracle methodologies. You will also contribute to PreSales, the creation of Go-to-Market (GTM) strategies, and take the lead in developing IP/solution accelerators. Additionally, you will be responsible for owning the technical delivery of large, complex projects. Responsibilities: Lead Oracle BI Applications, OAC, and ODI implementations. Interact with clients to understand and gather business requirements. Oversee technical design, development, and system/integration testing. Contribute to PreSales activities and the creation of Go-to-Market (GTM) strategies. Lead the development of IP/solution accelerators. Own the technical delivery of large and complex projects. Required Skills: BI (Business Intelligence) expertise. Experience with Oracle Data Integrator (ODI). This position offers the opportunity to work on cutting-edge analytics technologies and deliver impactful solutions in a collaborative and dynamic environment. If you have significant experience in Oracle BI and ODI implementations, and enjoy leading large, complex projects, we would love to hear from you.
Data Integration Developer- Talend
Infocepts
Position: Data Integration Developer Talend Location: Bangalore Employment Type: Full-time Experience Required: 4 to 7 years Overview: We are seeking a Data Integration Developer with strong expertise in Talend to join our growing data engineering team. This role is ideal for professionals who are passionate about designing and building robust, scalable ETL/ELT pipelines and integrating enterprise data across cloud and on-premise platforms. You will work closely with data architects, business analysts, and reporting teams to support data transformation, integration, and analytics efforts. Key Responsibilities: ETL/ELT Solutions Development: Design, develop, and deploy scalable ETL/ELT processes using Talend Data Integration (on-prem and cloud). Data Transformation & Integration: Implement data transformation using stored procedures and other data processing techniques. Report Development Support: Collaborate with reporting teams to support dashboard/report creation using tools like MicroStrategy and Power BI. Documentation & Data Governance: Create detailed pipeline documentation, configurations, and data workflows. Performance Optimization: Monitor pipeline performance, identify bottlenecks, and troubleshoot data integration issues. Essential Skills: Hands-on experience with Talend Suite (Talend Data Integration, Talend Cloud) Experience with Snowflake and writing Stored Procedures Knowledge of ETL/ELT design, data warehousing, and data modeling Familiarity with JSON, XML, CSV data formats Experience with data quality frameworks and job monitoring/scheduling tools Proficiency in Agile methodology and tools like JIRA Desirable Skills: Experience with reporting tools such as MicroStrategy and Power BI Skills in scripting languages: Python, Java, or Shell Understanding of cloud platforms (AWS, GCP, Azure) and related data services Qualifications: Bachelor s or Master s degree in Computer Science, Engineering, or a related field Minimum of 3+ years of Talend development experience Qualities We Value: Strong verbal and written communication skills Experience in Agile and cross-functional team environments Problem-solving mindset and ability to work under minimal supervision Quick learner with a passion for data and process improvement Work with modern cloud data integration and enterprise tools Collaborate with global clients and expert teams Be part of cutting-edge data platform transformation initiatives Apply today and be part of our mission to deliver next-gen, data-driven insights. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field
Cloud Data Engineer - AWS Big Data
Infocepts
Position: Cloud Data Engineer AWS Big Data Location: Bangalore, India Employment Type: Full-time Experience Required: 5 to 8 years Purpose of the Position: Join the Infocepts Cloud Data Architect Team as a Cloud Data Engineer and help design and implement cutting-edge big data solutions on AWS. You will leverage your expertise in EMR, Athena, PySpark, S3, AWS Lambda, and SQL to develop robust and scalable data platforms. Key Responsibilities: Technology Assessment and Design: Assess existing technology landscape and data integration frameworks. Design complex Big Data use cases using AWS services under guidance of the Architect. Support architectural decision-making by evaluating trade-offs in cost, performance, and durability. Recommend optimizations to existing data infrastructure. Documentation and Stakeholder Communication: Create project documentation adhering to quality and delivery standards. Collaborate closely with Architects and Project Managers for scoping, estimation, and planning. Present design decisions to technical and business stakeholders clearly. Conduct PoCs and design review sessions. Process Improvement and Automation: Identify and suggest opportunities for automation and process enhancements. Mentor junior engineers and support technical problem solving. Training and Knowledge Sharing: Prepare and deliver internal training on AWS and Big Data topics. Lead client knowledge sharing sessions and contribute to case studies. Essential Skills: In-depth experience with AWS services: S3, EC2, EMR, Athena, Glue, Lambda Familiarity with MPP databases like Redshift, Snowflake, or SingleStore Proficiency in Apache Spark and Databricks Strong programming skills in Python Experience building data pipelines using AWS and Databricks Knowledge of Big Data file formats such as Delta Lake Advanced SQL skills for large-scale data manipulation Hands-on experience with Apache Airflow or similar orchestration tools Strong understanding of ETL workflows and data warehousing concepts Desirable Skills: Cloud databases: AWS Aurora, Snowflake Experience with Hadoop and Hive AWS Certifications (Associate or Professional level) are a plus Qualifications: Bachelor s degree in Computer Science, Engineering, or related field (Master s preferred) Overall 5+ years of IT experience with at least 3 years in AWS Big Data projects Ongoing learning and technical certifications are strongly encouraged Key Qualities: Strong problem-solving and analytical thinking Self-driven with a passion for emerging data technologies Excellent communication and client presentation skills Ability to work in cross-functional, agile teams Apply now to be part of a high-impact data transformation team working on large-scale cloud data projects! Qualification : Bachelors degree in Computer Science, Engineering, or related field (Masters preferred)
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Senior Engineer - Kernel & Driver - Linux
Sasken Technologies
Job Title: Senior Engineer - Kernel & Driver - Linux Job Summary The Senior Engineer for Kernel & Driver Development in Linux will be responsible for designing, developing, and maintaining embedded Linux systems and drivers. This role involves working on the kernel, device drivers, and board bring-up for various embedded platforms. The engineer will also work closely with cross-functional teams, analyze complex problems, and contribute to the continuous improvement of Linux-based systems. This position requires an individual with strong technical expertise in Linux, kernel development, and embedded systems. Key Responsibilities Kernel and Driver Development: Design, develop, and optimize embedded Linux kernel and device drivers, including board bring-up and device tree configuration. Customize, debug, and fix kernel and driver issues to enhance system performance and reliability. Collaboration and Support: Collaborate with internal teams and customers to resolve technical issues, provide solutions, and ensure system stability. Interact with project managers and team leads to ensure project milestones are met and quality standards are adhered to. System Integration and Testing: Perform system integration and testing to ensure compatibility and proper functioning of kernel and drivers across different platforms. Develop and execute test plans, debug kernel crashes, and perform root cause analysis. Continuous Improvement: Identify opportunities to optimize system performance and enhance the functionality of embedded Linux systems. Provide technical guidance and mentorship to junior engineers and contribute to best practices. Documentation and Reporting: Maintain accurate documentation for kernel configurations, driver designs, and bug fixes. Regularly update project progress, report risks, and participate in code reviews. Education and Experience Required Education: Bachelor's or Master's degree in Computer Science, Electronics, or a related field. Experience: 5+ years of experience in embedded Linux kernel and driver development, with strong expertise in debugging and system optimization. Technical Competencies Linux Kernel & Driver Development: Extensive experience with embedded Linux kernel, device tree, and driver development (customization, bug fixing, and optimization). In-depth knowledge of Linux kernel internals and system architecture. Platforms: Experience with ARM, x86/Intel Atom, or other embedded Linux platforms. Tools: Proficiency with tools such as Lauterbach, Makefile (build systems), Git, and Gerrit. Programming Languages: Strong proficiency in C programming language. Specialization Areas: Power Management Peripherals Media, Display, and Connectivity Data Protocols Security Performance Optimization Android (Optional) Carrier-grade Platforms Additional Competencies Problem-Solving: Ability to troubleshoot complex system issues and provide innovative solutions. Communication Skills: Strong written and verbal communication skills for technical documentation and customer interaction. Team Collaboration: Ability to work effectively with cross-functional teams, including hardware, software, and testing teams. Attention to Detail: Detail-oriented approach to design, debugging, and testing to ensure high-quality system performance. This position is ideal for an experienced engineer with a deep understanding of Linux kernel and driver development who is looking to contribute to cutting-edge embedded systems and gain exposure to new technologies in a fast-paced environment. Qualification : Bachelor's or Master's degree in Computer Science, Electronics, or a related field.
Sr. Engineering Manager
Ness Digital Engineering
Job Title: Sr. Engineering Manager - Data Engineering Level: L5 Experience: 13-16 years Overview We are seeking an experienced Engineering Manager with a strong background in Data Engineering, including ETL/ELT processes and cloud-based data platforms such as Snowflake. The ideal candidate will lead and mentor a team of data engineers, drive data architecture initiatives, and work closely with cross-functional stakeholders to ensure our data infrastructure supports evolving business needs. Key Responsibilities Team Leadership: Lead, mentor, and develop a high-performing data engineering team, fostering a culture of collaboration, innovation, and continuous learning. Data Pipeline Development: Oversee the design, development, and maintenance of robust ETL/ELT pipelines to ingest, transform, and process data at scale. Cloud Data Infrastructure: Drive the architecture and implementation of cloud-based data solutions, especially leveraging Snowflake, ensuring scalability, security, and reliability. Cross-Functional Collaboration: Partner with product managers, analysts, data scientists, and other business stakeholders to gather requirements and prioritize engineering efforts that deliver the most impact. Architecture and Design: Develop and enforce data architecture standards for high-performance data warehousing, ensuring seamless data integration across diverse sources. Performance Optimization: Identify and resolve performance bottlenecks, focusing on query optimization, cost management, and resource efficiency. Data Quality & Governance: Define and implement data quality frameworks and governance practices, ensuring data consistency and reliability across all pipelines. Innovation & Strategy: Stay informed on emerging data technologies and industry best practices, continuously improving processes and aligning solutions with long-term data strategies. Required Skills 8+ years of hands-on experience in data engineering, including 5+ years in a leadership role. Strong expertise in ETL/ELT processes and hands-on experience with tools like Talend, Informatica, or similar platforms. Deep proficiency in Snowflake or comparable cloud data platforms such as Redshift or BigQuery. Advanced SQL skills, including query optimization, performance tuning, data modeling, and schema design. Hands-on experience with Python or Java for data processing and automation. Knowledge of data governance, compliance standards, and data security best practices. Excellent communication and project management skills, with the ability to prioritize and manage multiple projects in parallel. Preferred Skills Exposure to Big Data technologies such as Spark, Hadoop, Databricks, Synapse, etc. Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions. Familiarity with CI/CD pipelines and DevOps practices within data engineering. Experience working with BI tools like Tableau or Power BI, and reporting integrations.
SAP HANA DBA/Developer
Ness Digital Engineering
Job Title: SAP HANA DBA/Developer Experience: 4+ years (including 2+ years specifically on SAP HANA Cloud/On-Prem) Why Ness At Ness, we recognize that our people are our greatest asset. Our success as one of the world s leading technology companies is driven by our employees professionalism, innovation, teamwork, and dedication to excellence. As part of the Ness team, you will have the opportunity to work on cutting-edge products and platforms for some of the most innovative software companies globally. Ness offers exciting and challenging projects across diverse industries and a collaborative work environment with forward-thinking professionals. Our core values rigor, innovation, and partnership guide our day-to-day operations and customer interactions. Skill Set & Key Requirements 4+ years of overall experience, with at least 2 years focused on SAP HANA (Cloud/On-Prem) as a DBA or Developer. Expert knowledge of HANA database architecture, including SDI/SDA (Smart Data Integration/Smart Data Access). Strong experience in scripting languages, data modeling, and automation tools. Proven expertise in SQL performance optimization and database tuning. Hands-on experience in User & Role management for HANA (or other SAP products). Experience working in multi-layer environments and strong understanding of transport mechanisms (Code lifecycle management). Flexibility and willingness to work across multiple technologies and platforms. Preferred (Good to Have) Experience with ETL tools/technologies and ETL administration. Basic understanding of SAP BTP (Business Technology Platform). Strong analytical and debugging skills for complex issues. Ability to document processes clearly and effectively. Proactive approach with a mindset to own topics and share knowledge within the team.
Sr. Data Engineer
Ness Digital Engineering
Job Title: Sr. Data Engineer Job Overview: We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in Snowflake to manage data ingestion and transformation. The ideal candidate will work with an offshore team to deliver scalable data solutions aligned with business and performance requirements. Key Responsibilities: Design, build, and maintain ELT pipelines using Snowflake. Lead offshore development teams in applying data engineering best practices. Collaborate with stakeholders to manage data integration across systems. Optimize data pipelines for performance and reliability, including query tuning and resource management. Implement data validation processes to ensure data accuracy. Document data pipelines, flow diagrams, and transformation logic. Troubleshoot pipeline failures and resolve performance issues. Ensure compliance with data governance and regulatory requirements. Required Qualifications: 5+ years of experience in data engineering with a focus on ELT development. Strong expertise in Snowflake, including data sharing, secure views, and performance optimization. Proficiency in SQL and data integration tools. Experience managing offshore development teams. Strong problem-solving and communication skills. Preferred Qualifications: Snowflake certification or relevant certifications. Experience in financial services with knowledge of data security and compliance. Familiarity with cloud platforms (AWS, Azure) and orchestration tools like Apache Airflow. Experience with Python or JavaScript for data transformation. Knowledge of data visualization tools like Tableau or Power BI.
Senior Cloud Data Engineer
Capgemini Invent
Job Title: Senior Cloud Data Engineer Experience: 10+ Years Location: Bengaluru About Capgemini Invent: Capgemini Invent is the digital innovation, consulting, and transformation brand of the Capgemini Group. It brings together leading expertise in strategy, technology, data science, and creative design to help CxOs reimagine their businesses. We are a global business line dedicated to helping organizations envision and build what s next. Your Role: As a Senior Cloud Data Engineer at Capgemini Invent, you will design, develop, and maintain scalable data pipelines using advanced cloud technologies to ensure smooth data integration and efficient workflows. You will collaborate with cross-functional teams to deliver robust and optimized data solutions while ensuring compliance and security throughout the process. Key Responsibilities: Design, develop, and maintain scalable data pipelines using AWS services. Optimize data storage and retrieval processes to ensure efficiency and accessibility. Ensure data security and compliance with industry standards, including data privacy laws. Manage large volumes of data, focusing on accuracy, integrity, and secure accessibility. Develop and refine data processes for data modeling, mining, and production. Implement quality checks, data validation, and monitoring of data flows. Collaborate with data scientists, analysts, and IT teams to meet data requirements. Work closely with data architects and modelers on project objectives and solutions. Troubleshoot and resolve issues in data pipelines, ensuring performance tuning and optimization. Develop and implement disaster recovery procedures to safeguard data. Ensure seamless integration of HR and other business data into cloud-based environments. Research new opportunities for data acquisition and discover additional uses for existing data. Stay up-to-date with the latest cloud technologies, data management practices, and trends, including Generative AI. Recommend and implement improvements to enhance data reliability, efficiency, and quality. Your Profile: 10+ years of experience in cloud data engineering. Proficiency with cloud platforms such as AWS, Azure, or Google Cloud. Experience with data pipeline tools like Apache Spark, AWS Glue, or similar technologies. Strong programming skills in Python, SQL, Java, or Scala. Familiarity with Snowflake, Informatica, or similar tools is an advantage. In-depth knowledge of data privacy laws, security best practices, and data governance. Expertise in analyzing and interpreting complex datasets to derive actionable insights. Strong communication, collaboration, and problem-solving skills. Knowledge of database technologies, including SQL, Big Data, and Cloud-based systems. Passion for learning and keeping up with emerging technologies, particularly in Generative AI. Experience working in an Agile framework and managing multiple projects simultaneously. Ability to adapt to evolving priorities and business needs. What You Will Love About Working Here: Flexibility: Enjoy flexible work arrangements such as remote work or flexible hours, ensuring a healthy work-life balance. Career Growth: We offer numerous opportunities for career advancement and personal development, helping you explore diverse paths and expand your skills. Certifications & Learning: Gain valuable certifications in cutting-edge technologies, including Generative AI, to stay ahead of the curve. About Capgemini: Capgemini is a global business and technology transformation partner that helps organizations accelerate their dual transition to a digital and sustainable world. With a team of 340,000 professionals in over 50 countries, we are dedicated to making a tangible impact on enterprises and society. Trusted by clients for over 55 years, Capgemini uses its deep industry expertise and cutting-edge technologies such as AI, cloud, and data to unlock the full potential of businesses worldwide. In 2023, the group reported global revenues of 22.5 billion.
Senior Technical Lead Software Engineering
Qualcomm
Job Title: Senior Technical Lead Software Engineering General Summary: Qualcomm Technologies Inc., a global leader in Snapdragon SoCs, is the largest provider of chipset solutions for Microsoft Windows on Snapdragon products. As part of our commitment to developing next-generation solutions, we seek a highly skilled Senior Technical Lead Software Engineering to drive innovation and excellence in our compute platform solutions. The ideal candidate is a self-motivated leader with excellent verbal and written communication skills and a proven ability to collaborate with engineers, partners, and customers across geographies. This role requires experience working with senior management in a corporate environment and the ability to take a hands-on technical leadership approach, diving into technical details and problem-solving as needed. Key Responsibilities: Software Development & Validation: Lead driver development and validation for compute platforms consisting of ARM cores, GPUs, and DSPs. Perform smoke testing, test scenario development, and issue troubleshooting to ensure product reliability and quality. Provide technical guidance and mentorship to software engineering teams. Collaboration & Stakeholder Engagement: Interface with cross-functional development and test teams, ensuring effective communication and seamless execution. Collaborate with OEMs for feature updates, over-the-air (OTA) updates, and test plan development. Drive large-scale software validation efforts across Windows, Linux, Android, and Integrity platforms. Data Analysis & Performance Optimization: Utilize big data tools and platforms to manage and analyze large datasets for software performance improvement. Optimize and validate multimedia drivers across audio, video, camera, display, and graphics components. Technical Expertise & Innovation: Demonstrate strong familiarity with ARM architecture and a solid understanding of CPU, GPU, and NPU architectures. Develop and optimize software using C, C++, Python, and other programming languages. Leverage tools like Power BI for data-driven decision-making. Minimum Qualifications: Bachelor s degree in Engineering, Information Systems, Computer Science, or a related field with 18+ years of Software Engineering experience. OR Master s degree with 15+ years of experience. OR PhD with 12+ years of experience. 2+ years of experience with programming languages such as C, C++, Java, Python, etc. Preferred Qualifications: 9-12 years of experience in driver development, validation, and compute platform software engineering. Proven experience in leading large teams responsible for software validation and development. Hands-on experience with multimedia/embedded applications and driver validation on Windows, Linux, Android, or Integrity platforms. Experience managing and analyzing large datasets using big data tools and platforms. Familiarity with ARM architectures, CPU/GPU/NPU architecture. Strong analytical, debugging, and troubleshooting skills for large-scale software systems. Be part of a pioneering team that develops cutting-edge solutions for Windows on Snapdragon. Work in a collaborative and innovation-driven environment with top industry professionals. Enjoy competitive compensation, career growth opportunities, and access to cutting-edge technologies.
Senior Technical Lead FAW, Data Modelling, & OBIEE
Speridian Technologies
Senior Technical Lead FAW, Data Modelling, & OBIEE Location: Remote / Bangalore, India Experience: 7-12 Years About the Role We are seeking a Senior Technical Lead with deep expertise in Fusion Analytics Warehouse (FAW), Data Modelling, and OBIEE to design and implement cutting-edge enterprise analytics solutions. This role requires hands-on experience in FAW customization, OBIEE development, data integration, and ETL/ELT processes. As a key technical leader, you will work closely with internal teams and stakeholders to develop scalable, high-performance analytics solutions, ensuring alignment with business goals. Key Responsibilities FAW & OBIEE Development Lead the design, development, and deployment of enterprise analytics solutions using Fusion Analytics Warehouse (FAW) and OBIEE. Implement and manage FAW solutions, ensuring alignment with business requirements. Customize FAW dashboards and reports to meet specific organizational needs. Data Modelling & Integration Design, develop, and maintain robust data models, including dimensional modelling and star schema design. Provide expertise in ETL/ELT processes and data integration to support seamless data flow. Work with Oracle, SQL Server, and other database management systems to optimize data performance. OBIEE Development & Optimization Develop and maintain OBIEE reports, dashboards, and metadata repository (RPD). Troubleshoot and optimize OBIEE performance, ensuring scalability and reliability. Ensure data security and compliance across FAW, OBIEE, and related analytics platforms. Collaboration & Stakeholder Engagement Provide technical expertise in data integration, reporting, and visualization to internal teams and stakeholders. Effectively communicate complex technical concepts to non-technical stakeholders. Collaborate with cross-functional teams to ensure timely and successful project delivery. Required Qualifications & Skills Education & Experience Graduate degree in Computer Science, Information Technology, or a related field. 7-12 years of experience in enterprise analytics and business intelligence. Technical Expertise Fusion Analytics Warehouse (FAW): Hands-on experience in customization and deployment. Data Modelling: Strong knowledge of dimensional modelling and star schema design. OBIEE: Expertise in RPD development, dashboard/report creation, and performance tuning. ETL/ELT: Strong understanding of data integration processes and tools. SQL & Databases: Proficiency in Oracle, SQL Server, and other database management systems. Cloud Analytics: Familiarity with Oracle Cloud Infrastructure (OCI) and Oracle Analytics Cloud (OAC). Soft Skills Strong problem-solving and analytical skills. Excellent communication and collaboration skills. Ability to work independently and in a team-oriented environment. Lead Cutting-Edge Analytics Initiatives Work with FAW, OBIEE, and cloud-based analytics platforms. Career Growth Opportunities for learning, upskilling, and career advancement. Collaborative Environment Work alongside industry experts in a dynamic, innovative culture. Comprehensive Benefits Competitive salary, remote work flexibility, and a supportive work environment. Join Our Team & Shape the Future of Enterprise Analytics! If you are passionate about data analytics, FAW, and OBIEE, we encourage you to apply! Apply Now! Qualification : Graduate degree in Computer Science, Information Technology, or a related field.
Data Engineer
Indium Software
Data Engineer Role Overview We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs. This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows. Key Responsibilities Data Pipeline Development & Optimization Design and build scalable ETL/ELT processes for structured and unstructured data. Develop and maintain data ingestion frameworks to handle large datasets efficiently. Ensure data integrity, consistency, and security across multiple sources. Database & Data Warehouse Management Develop, optimize, and maintain relational and NoSQL databases. Implement data modeling best practices for performance and scalability. Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery). Big Data & Cloud Technologies Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing. Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions. Develop real-time and batch processing workflows. Collaboration & Documentation Work closely with data scientists, engineers, and business teams to understand data requirements. Document data pipelines, architecture, and workflows for scalability and maintenance. Required Qualifications & Skills Technical Expertise: Strong experience with SQL and Python for data processing. Proficiency in ETL/ELT frameworks and data integration techniques. Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka). Cloud & Database Management: Expertise in cloud data platforms (Azure, AWS, GCP). Experience with data warehousing solutions (Snowflake, Redshift, BigQuery). Understanding of data governance, security, and compliance. Performance Optimization & Troubleshooting: Ability to optimize SQL queries and improve data processing efficiency. Experience troubleshooting complex data pipeline issues. Apply Now & Be Part of an Innovative Data Team!
Generative Ai Engineer
Gramener
About the Job Join us as a Generative AI Engineer, where you ll design and develop cutting-edge AI-powered solutions that redefine creativity and innovation. Your work will push the boundaries of what s possible in content generation, from text and images to audio and beyond. In this job, you will: Research & Development: Stay up-to-date with the latest advancements in generative AI and deep learning. Contribute to the development of novel models, exploring innovative algorithms and methodologies. Model Architecture: Design custom generative models using neural network architectures like GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and others tailored for specific applications. Data Processing: Prepare and preprocess large-scale datasets for model training. Apply techniques like data augmentation, normalization, and transformation to improve performance. Training & Optimization: Train generative models using frameworks like TensorFlow and PyTorch, optimizing for efficiency, speed, and quality. Hyperparameter Tuning: Fine-tune models for optimal performance, balancing convergence speed, stability, and output diversity. Evaluation Metrics: Develop metrics to assess the quality, diversity, and novelty of generated content. Continuously iterate and improve models based on these metrics. Deployment: Work with software engineers to integrate generative models into production systems, ensuring scalability, reliability, and performance. Collaboration: Partner with data scientists, machine learning engineers, designers, and product managers to translate business requirements into generative AI solutions. Documentation: Document research, experiments, and codebase thoroughly for internal use and external stakeholders. Continuous Learning: Stay informed on emerging technologies, attend industry events, and contribute to ongoing innovation. Qualifications Bachelor s, Master s, or Ph.D. in Computer Science, Engineering, or related fields. Strong foundation in machine learning, deep learning, and neural networks. Proficiency in Python and relevant AI libraries (e.g., TensorFlow, PyTorch). Hands-on experience with generative models like GANs, VAEs, and their practical applications. Solid understanding of data preprocessing, feature extraction, and model evaluation. Experience training and optimizing neural networks on large-scale datasets. Familiarity with cloud computing and distributed systems (AWS, Azure, GCP) is a plus. Strong problem-solving skills and a creative mindset. Excellent communication and teamwork abilities. A portfolio of generative AI projects or publications is a strong advantage. About Gramener We create software that tells data stories. For example: We advised a global computer manufacturer to focus on order delivery time, increasing NPS by 18% and generating incremental revenue of >$50M. We helped a foundation predict mosquito release points, reducing the process time from 3 weeks to 2 hours in their mission to protect 100M lives from malaria over 5 years. We re good at what we do, which is why we re growing 40% year-over-year. We re looking for passionate innovators to help us scale further. First-hand experience with C-suite-focused business advisory in data & analytics. Opportunities to collaborate with data science experts, domain champions, and client teams, being part of transformative change. A chance to experiment, take risks, and solve meaningful problems. Supportive colleagues and a dynamic environment you ll love working in. Key Metrics for Success Solution quality and business value delivered to clients. Successful project deliveries. Customer satisfaction on engagements. Qualification : Bachelors, Masters, or Ph.D. in Computer Science, Engineering, or related fields.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted