Data Platforms Jobs in Bengaluru
1348 Jobs Found
Senior Data Engineer
Okta
Senior Data Engineer Enterprise Data Platform Location: Bengaluru Department: Business Technology Data Engineering Experience: 5+ Years Employment Type: Full-Time About Okta Okta is The World s Identity Company. We empower people to securely use any technology, anywhere, on any device. Through our Okta and Auth0 platforms, we provide secure access, authentication, and automation placing identity at the center of security and growth for thousands of organizations. We value diverse perspectives and lifelong learners. We re not looking for someone who checks every box we re looking for someone who will make us better with their unique experiences. Team: Business Technology Data Engineering The Data Engineering team at Okta supports cross-functional partners by building scalable, secure, and high-performing platforms. These platforms power decision-making and business processes across sales, marketing, engineering, finance, product, and operations. As part of this team, you ll contribute to data solutions that fuel Okta s hyper-growth. You will have the opportunity to work with cutting-edge technologies in cloud infrastructure, data lakes, automation, and CI/CD pipelines. The Role: Senior Data Engineer As a Senior Data Engineer, you will design, build, and manage modern data pipelines, infrastructure, and automation frameworks. You ll help scale our enterprise data platform using tools such as Snowflake, dbt, Airflow, Databricks, and AWS, while ensuring security, observability, and performance. You ll also contribute to CI/CD pipelines, infrastructure as code (IaC), and secure development lifecycle practices, enabling consistent, efficient, and secure delivery of data solutions. Key Responsibilities Platform Development & Infrastructure Design and maintain scalable data pipelines and platforms using Snowflake, AWS, Databricks, dbt, and Airflow. Manage infrastructure with Terraform, enabling repeatable and consistent deployments. Develop and maintain robust CI/CD pipelines using GitHub Actions, GitLab, or Jenkins. Containerize data services using Docker for better scalability and portability. Security & Compliance Implement and enforce secure development lifecycle practices, integrating tools like DAST, SAST, SCA, and Secret Scanning into pipelines. Conduct vulnerability scanning and apply patches to ensure system integrity. Ensure data security and compliance with industry standards and regulations. Collaboration & Innovation Collaborate with data engineers, data scientists, and analysts across business units to ensure data availability and integrity. Identify opportunities for automation and optimization within the data platform. Stay updated on emerging technologies and drive adoption of best practices. Must-Have Skills Bachelor s degree in Computer Science, Engineering, or a related technical field. 5+ years of experience in data engineering, including: Advanced SQL and ETL development with Airflow and dbt. Experience with data warehouses such as Snowflake, Redshift, or BigQuery. Strong hands-on experience with AWS (S3, Lambda, EC2, EMR, EKS). 2+ years of experience managing CI/CD pipelines using tools like GitHub Actions, GitLab, Jenkins, or ArgoCD. Experience with Terraform and Docker. Proficiency in backend languages such as Python, Java, or Go. Preferred Skills Experience with lakehouse architectures like Databricks, including knowledge of Delta Lake and Apache Iceberg. Background in infrastructure security, vulnerability management, and observability tooling. High Impact: Help build and scale the data platform that powers Okta s global business. Cutting-Edge Stack: Work with best-in-class technologies like AWS, Snowflake, dbt, Terraform, and Databricks. Collaborative Culture: Join a diverse, inclusive, and globally distributed team that values knowledge sharing and continuous learning. Career Growth: Shape the future of Okta s data engineering practice while expanding your technical and leadership skills. Bring your passion for data, cloud, and automation and let s shape the future of secure, scalable enterprise data platforms together. Qualification : Bachelors degree in Computer Science, Engineering, or a related technical field
Data Engineer
Capital One
Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field
Manager - Data Analytics, Credit Card Portfolios
Zeta
Job Title: Manager - Data Analytics, Credit Card Portfolios Location: Bangalore Employment Type: Full-time About Zeta: Zeta is a next-gen banking technology company empowering banks and fintechs to build the future of financial products. Founded in 2015 by Bhavin Turakhia and Ramki Gaddipati, Zeta s flagship platform Zeta Tachyon is a cloud-native, fully API-enabled banking stack powering issuance, processing, lending, core banking, fraud & risk, and more. Over 20 million cards have been issued globally through our platform. With 1,700+ employees across the US, EMEA, and Asia and 70%+ in R&D, Zeta is backed by SoftBank, Mastercard, and others, having raised $330M at a $2B valuation in 2025. We work with leading banks and fintechs worldwide to transform multi-million card portfolios. Role Overview: We are looking for a strategic and experienced Manager - Data Analytics to lead business intelligence and enterprise reporting for global fintech portfolios including Credit Cards, Deposits, and other financial products. This role involves managing a team of analysts, leveraging multiple data lakes and warehouses, and building a scalable, comprehensive reporting framework for diverse markets including the US, UK, and India. Key Responsibilities: Enterprise Reporting & Data Architecture: Design and maintain end-to-end reporting across the customer lifecycle: acquisition, activation, usage, delinquency, collections, retention, operations, and support. Deliver accurate analysis of key financial KPIs: revenue, profitability, credit risk, defaults, acquisition cost. Build dashboards, self-service BI tools, and automated pipelines using Apache Superset, Metabase, Tableau. Optimize data storage and reporting for scalability and cost-efficiency. Data Integration & Analytics Execution: Collaborate with vendors and internal engineering to integrate data from credit bureaus, open banking, core banking, card and payment processors, loan origination, CCaaS, and aggregators into a centralized Data Lake. Business Intelligence & Growth: Lead analytics projects to uncover user behavior, optimize acquisition channels, underwriting, and portfolio performance via segmentation, cohort, and funnel analyses. Partner with Product and Marketing teams to evaluate experiments (A/B testing) and guide roadmap decisions. Leadership: Build, mentor, and lead a high-performing team of BI analysts and data visualization experts. Data Governance: Establish and enforce data governance best practices, ensuring compliance and data security. Skills & Experience: Expert in BI tools such as Apache Superset, Metabase, Tableau; strong SQL skills. Familiarity with cloud data platforms like Snowflake, Redshift, BigQuery. Deep knowledge of credit and fintech KPIs: acquisition, credit decisioning, delinquency, repayment, charge-offs, profitability, RoA, CLTV, etc. Proven leadership experience managing analytics teams and scaling reporting infrastructures. Excellent communication skills with the ability to translate complex data into business strategies. Knowledge of data governance, privacy, and security in financial services. Qualifications: 10+ years in Business Intelligence/Analytics with 3+ years in the credit card industry. 3+ years managing teams of analysts or data professionals. Bachelor s degree in Computer Science, Engineering, Statistics, or a related field. Equal Opportunity: Zeta celebrates diversity and is an equal opportunity employer. We are committed to fostering an inclusive environment and encourage candidates from all backgrounds to apply. Qualification : Bachelors degree in Computer Science, Engineering, Statistics, or a related field
Data Architect
Acqueon
Position Title: Data Architect Department: R&D Engineering Location: Bangalore Experience: 15+ Years Industry: SaaS / Conversational Engagement / Customer Experience Technology About Acqueon: Acqueon is a leading provider of conversational engagement software that enables customer-centric enterprises to proactively engage with their customers across voice, messaging, and email channels. By leveraging a powerful data platform, predictive models, and intelligent workflows, we help brands enhance customer experience, improve collections, and drive revenue growth. With over 200 global clients, Acqueon is at the forefront of AI-powered customer engagement. Role Overview: We are seeking a visionary and technically hands-on Data Architect to lead the development of enterprise-scale data platforms and engineering solutions. You will work closely with Product Owners, Engineering Leadership, and cross-functional teams to define and execute a strategic technology roadmap aligned with Acqueon s business goals. As a key member of our R&D team, you ll lead the design and development of highly scalable, low-latency, fault-tolerant data systems, while mentoring top-tier engineering talent and driving high-impact product features. Key Responsibilities: Architect & Lead: Design and lead development of scalable data architectures and solutions supporting real-time and batch processing, analytics, and enterprise applications. Strategic Ownership: Define and implement the data strategy, technology roadmap, and long-term architecture vision for Acqueon s platforms. Leadership: Manage and mentor a team of senior developers and engineers, fostering innovation, ownership, and delivery excellence. Cross-functional Collaboration: Work with Product, Sales, Engineering, and Customer teams to align on feature development and delivery strategy. Project Management: Oversee the end-to-end delivery of complex features, ensuring adherence to timelines, scalability, and quality standards. System Design: Review architecture and design for robustness, performance, and fault tolerance, including multi-region, high-availability setups. R&D Enablement: Collaborate with international R&D teams and align development efforts across global product initiatives. Innovation & Optimization: Drive architectural decisions, recommend performance improvements, and ensure best practices for enterprise-scale data solutions. Required Skills & Experience: Education: Bachelor s or Master s in Computer Science, IT, or related field. Experience: 15+ years in software development and data architecture, with leadership experience in managing engineering teams. Architecture Expertise: Proven experience in designing scalable, concurrent, distributed, and highly available data systems. Database Proficiency: Strong in SQL/NoSQL databases Experience with MS SQL, Aerospike, DynamoDB, Snowflake In-depth knowledge of micro-partitions, cluster keys, warehouse cloning, time travel in Snowflake Strong in writing and tuning complex stored procedures ETL & Pipelines: Experience in building ETL pipelines and integrating data from S3, Kinesis Streams, APIs Cloud & DevOps: Strong understanding of Docker, AWS, and cloud-native deployment architectures Setting up multi-region resilience, disaster recovery strategies Technologies: Elasticsearch, AWS data services, container orchestration Big Data & Analytics: Exposure to analytical processing and statistical modeling is a plus Leadership: Strong project management skills, stakeholder engagement, and team mentoring experience Preferred Qualifications: Background in customer engagement, VDI, Cybersecurity, or Secure Access technologies Previous experience working with distributed R&D and product teams Knowledge of Acqueon, Citrix, VMware, Omnissa platforms is a plus Certifications in AWS, Snowflake, or similar technologies are an advantage Soft Skills & Behavioral Traits: Strong verbal and written communication skills Strategic thinking with hands-on execution ability High accountability and ownership mindset Ability to work in a fast-paced, dynamic, startup-like environment Comfortable with ambiguity and context-switching Team player with the ability to lead by influence and collaboration Be a part of a fast-growing, AI-driven SaaS company disrupting the customer engagement space Work on cutting-edge technologies with global product teams Ownership of end-to-end solutions and ability to shape the data platform of the future A culture that promotes innovation, agility, and career growth
Product Manager Data Warehouse & Business Intelligence
Mahindra First Choice
Product Manager Data Warehouse & Business Intelligence Location: Bangalore Company: Mahindra First Choice About Mahindra First Choice Mahindra First Choice is a pioneer in India s multi-brand used car segment. With a strong focus on innovation, data-driven decision-making, and cutting-edge technology, we are transforming the automotive ecosystem and delivering seamless customer experiences. Our commitment to excellence fuels our drive to create scalable, impactful solutions across the value chain. Role Overview We are looking for a strategic and technically strong Product Manager to lead our Data Warehouse and Business Intelligence (BI) initiatives. Based in Bangalore, this role will own the vision, development, and optimization of enterprise-wide data products. You will play a critical role in enabling data-led decisions, working closely with engineering, analytics, and business teams to drive measurable outcomes. Key Responsibilities 1. Product Strategy & Roadmap Define the vision, strategy, and long-term roadmap for Data Warehouse and BI products. Align product goals with overall business strategy through collaboration with senior leadership. Stay abreast of emerging technologies and industry trends to drive innovation in data architecture and analytics. 2. Development & Execution Partner with engineering, data science, and analytics teams to build scalable, high-performance data platforms. Prioritize product features and enhancements based on impact, feasibility, and business value. Lead cross-functional teams to ensure timely and efficient delivery of data solutions. 3. Business Intelligence & Analytics Oversee the development of interactive BI dashboards, reports, and self-service tools to empower business users. Collaborate with business stakeholders to identify critical metrics and create meaningful data visualizations. Champion data quality, consistency, governance, and accessibility across all platforms. 4. Stakeholder Management Serve as the single point of contact for data needs across Sales, Marketing, Operations, Finance, and other departments. Communicate roadmaps, progress updates, and outcomes clearly and effectively to stakeholders at all levels. Gather continuous feedback to refine products and enhance user experience. 5. Performance Monitoring & Optimization Define and track KPIs to assess product adoption, usage, and business impact. Analyze system performance and user engagement to identify areas for improvement. Drive initiatives to increase data platform efficiency and reliability. Qualifications & Skills Required Bachelor s degree in Computer Science, Engineering, Business, or a related field (Master s preferred). 7+ years of experience in product management, specifically in data warehousing, business intelligence, or analytics. Deep understanding of data architecture, ETL processes, and data modeling. Hands-on experience with BI tools like Tableau, Power BI, or Looker. Strong SQL skills and familiarity with cloud platforms (AWS, Azure, GCP). Proven track record of managing complex, cross-functional data projects in fast-paced environments. Ability to translate business needs into scalable, data-driven solutions. Preferred Experience in automotive, mobility, or e-commerce domains. Familiarity with machine learning concepts and advanced analytics techniques. Soft Skills Strong communication, presentation, and stakeholder engagement skills. Analytical mindset with a focus on delivering business value through data. Effective leadership and cross-functional collaboration. High attention to detail and ability to manage multiple priorities. At Mahindra First Choice, you ll join a fast-growing, innovation-led organization at the forefront of transforming the used car market in India. This is a unique opportunity to shape our data landscape and make a real impact on business outcomes. If you're passionate about unlocking the power of data, we d love to meet you. Qualification : Bachelors degree in Computer Science, Engineering, Business, or a related field (Masters preferred)
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Audience Platform Lead
Merkle B2b
Job Title: Audience Platform Lead Insights & Analysis Location: Bangalore Employment Type: Full-Time About the Role We re seeking a strategic and technically skilled Audience Platform Lead to join our Insights & Analysis team. This role will focus on leveraging platforms like Adobe Analytics, Google Analytics, WebTrends, and various Customer Data Platforms (CDPs) to enable data-driven marketing and customer insights. As a subject matter expert in tag management, audience creation, and marketing technology integration, you will play a key role in shaping and implementing audience strategies across platforms. Key Responsibilities Lead the design, development, and implementation of solutions on Customer Data Platforms (CDPs) such as Adobe Experience Platform (AEP), Tealium, Segment, Lytics, ActionIQ, or C360. Drive data ingestion workflows via batch and real-time modes using ETL tools, APIs, and JavaScript. Build data models and define audience segments and customer journeys based on business requirements and architecture. Collaborate with internal teams and stakeholders to translate BRDs into actionable CDP use cases for marketing activation. Enable data extraction and outbound flows to reporting tools, other Adobe products, and third-party systems. Define and apply business rules and data transformations aligned with privacy and compliance standards. Guide and mentor other team members on platform capabilities, integration best practices, and scalable solutions. Ensure alignment with data privacy laws such as GDPR, CCPA, and others. Required Qualifications Proven experience in leading CDP-related development projects. Strong scripting experience with Python, Java, or Node.js. Hands-on experience with REST APIs, Open APIs, and tools like cURL. Proficiency in data analysis, data modeling, and data mapping. Experience working with unstructured data using formats such as JSON and Parquet. Preferred Qualifications: Familiarity with data privacy regulations including GDPR and CCPA. Experience in client-facing roles or stakeholder engagement. Working knowledge of reporting technologies and visualization tools. Experience with Big Data ETLs and cloud-based data platforms. Background in customer journey orchestration, audience activation, and segment development. Exposure to MLOps, data governance, or MarTech strategy is a plus. Work at the intersection of data, marketing, and technology. Lead cutting-edge customer data platform initiatives. Be part of a collaborative, innovative, and growth-driven environment. Make a measurable impact on customer engagement and digital transformation.
Senior Manager Data Science, Data Modelling & Analytics
Merkle B2b
Job Title: Senior Manager Data Science, Data Modelling & Analytics Location: Bengaluru Department: Insights & Analysis About the Role: As a Senior Manager, you will lead a team of data scientists and analysts, driving the development and deployment of advanced analytics solutions that enable data-driven decision-making. This role blends strategic leadership with hands-on technical expertise, playing a critical part in delivering impactful insights and analytics across the organization. Key Responsibilities: Hands-On Technical Contribution: Design, develop, and deploy advanced machine learning models and statistical analyses to address complex business challenges. Utilize Python, R, SQL, and other tools to manipulate data and build predictive models. Manage end-to-end data pipelines including collection, cleaning, transformation, and visualization. Collaborate with IT and data engineering teams to integrate analytics solutions into production environments. Provide thought leadership on analytics solutions and metrics aligned with business needs. Team Leadership & Development: Lead, mentor, and manage a team of data scientists and analysts, fostering collaboration and innovation. Guide career development, conduct performance evaluations, and promote skill enhancement. Encourage continuous learning and adoption of best practices in data science methodologies. Strategic Planning & Execution: Collaborate with senior leadership to define and execute data science strategy aligned with business goals. Identify and prioritize high-impact analytics projects that deliver business value. Ensure timely and quality delivery of analytics solutions balancing scope and resources. Client Engagement & Stakeholder Management: Act as primary point of contact for clients, translating business challenges into data science solutions. Lead client presentations, workshops, and discussions, effectively communicating complex analytical concepts. Build and maintain strong client relationships, managing expectations and deliverables. Deliver regular reports and dashboards to senior management and stakeholders. Bridge communication between technical teams and business units to align analytics initiatives with organizational objectives. Cross-Functional Collaboration: Work closely with Business Intelligence, Market Analytics, and Data Engineering teams to integrate analytics into business processes. Translate complex insights into actionable recommendations for non-technical stakeholders. Facilitate data-driven workshops and presentations across the organization. Collaborate with support functions to provide timely leadership updates on operational metrics. Governance & Compliance: Ensure compliance with data governance policies and data privacy regulations (e.g., GDPR, PDPA). Implement best practices for data quality, security, and ethical analytics use. Stay abreast of industry trends and regulatory changes affecting data analytics. Qualifications: Education: Bachelor s or Master s degree in Data Science, Computer Science, Statistics, Mathematics, or related field. Experience: 12+ years in advanced analytics, data science, data modelling, machine learning, or related fields. 5+ years in leadership roles managing analytics teams and projects. Experience in BFSI, Hi-Tech, Retail, or Healthcare industries preferred. Experience with media data is a plus. Technical Skills: Proficiency in Python, R, SQL. Experience with data visualization tools like Tableau, Power BI. Familiarity with big data platforms (Hadoop, Spark) and cloud services (AWS, GCP, Azure). Strong knowledge of machine learning frameworks and libraries. Soft Skills: Excellent analytical and problem-solving skills. Strong communication and interpersonal abilities. Ability to influence and drive organizational change. Strategic thinker focused on business outcomes. Desirable Expertise: Advanced Analytics Techniques: Descriptive Analytics: Statistical analysis, data visualization. Predictive Analytics: Regression, time series forecasting, classification, market mix modelling. Prescriptive Analytics: Optimization, simulation modelling. Text Analytics: NLP, sentiment analysis. Machine Learning Techniques: Supervised Learning: Linear/logistic regression, decision trees, random forests, gradient boosting, SVMs. Unsupervised Learning: Clustering, PCA, anomaly detection. Reinforcement Learning: Q-learning, deep Q-networks. Generative AI & Large Language Models (Good to Have): Experience with GPT, Gemini, LLAMA, etc. for text generation, summarization, conversational agents. Hyperparameter tuning, prompt engineering, embeddings, fine-tuning. Additional Skills: Proficiency with Tableau or Power BI (advanced visualization). Strong data management, structuring, and harmonization skills.
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Data Architect
Camsdata Technologies India Pvt. Ltd.
Data Architect Bangalore, India Location: Bangalore (Bengaluru) Experience: 10 to 15 Years Industry: IT & Data Systems Job Summary: We are seeking an experienced Data Architect with a strong background in designing and implementing enterprise-scale data solutions. The ideal candidate will have expertise in building data lakes, warehouses, and pipelines, with deep knowledge of cloud platforms, data management, and industry best practices. Key Responsibilities: Design, develop, and maintain complex data architectures including data lakes, data warehouses, data marts, and efficient schema design Build and optimize scalable data pipelines for extraction, transformation, and loading (ETL/ELT) processes Apply Agile methodologies in project delivery and collaborate within cross-functional teams Perform data profiling, cleansing, conversion, and ensure high-quality data management for both structured and unstructured data Implement CI/CD and Infrastructure as Code (IaC) practices using tools like GitHub, Jenkins, CloudFormation, and Azure Resource Manager Manage database systems and tools such as PostgreSQL, Oracle, Snowflake, Teradata, MongoDB, Hadoop, and others Utilize data modeling tools like Erwin, Power Designer, and Toad for effective data architecture design Leverage cloud platforms including AWS and Microsoft Azure, with hands-on experience in services like AWS Glue, DMS, Lambda, Azure Data Factory, Synapse, and Data Lake Storage Work with programming and scripting languages including SQL, PL/SQL, Python, Spark, YAML, and JSON Use containerization and automation tools such as Docker, Ansible, and NodeJS for efficient deployment Ensure compliance with cybersecurity principles and frameworks such as NIST Lead data governance initiatives and enforce best practices in data quality and security Preferred Qualifications: ITIL certification and experience with Agile methodology Knowledge of code review and version control best practices, especially in GitHub Familiarity with data science tools and AI/ML frameworks like R, Keras, or TensorFlow Experience with natural language processing (NLP) and machine learning concepts Background in regulated industries, with pharma manufacturing experience highly preferred Exposure to multi-site, global IT projects and manufacturing operations Lead innovative data architecture projects within a dynamic and fast-paced environment Work with cutting-edge cloud technologies and big data ecosystems Collaborate with global teams on impactful enterprise solutions Access to professional growth opportunities in data governance, AI, and cloud technologies
Director - Data Management
Maxval Group
Director Data Management (Data Migration & Automation) Location: Bangalore, India About MaxVal Founded in 2004, MaxVal is a pioneer in IP services focused on efficiency, cost-effectiveness, and continuous improvement driven by metrics-based processes. Our technology-driven IP solutions serve over 600 clients globally. With a talented team of 725+ IP and tech experts, MaxVal continuously innovates to deliver exceptional customer and employee success. Job Summary MaxVal is looking for an experienced and visionary Director of Data Migration and Automation to lead our data migration initiatives. You will oversee migrating data from various IP solutions to our software platform, ensuring accuracy, integrity, and efficiency through automation. This leadership role requires strategic thinking, strong domain expertise in Intellectual Property, and the ability to inspire and guide a team of specialists. Key Responsibilities Team Leadership & Management Lead, mentor, and empower a team of Data Migration specialists, ensuring resources and guidance for successful project delivery. Cultivate a collaborative, client-centric culture within the team. Data Mapping & Transformation Design comprehensive data mapping and transformation plans aligning external IP data with MaxVal s platform. Maintain data integrity and consistency throughout migration. Competitor Data Analysis Analyze competitor IP data structures and models to inform effective migration strategies. Automation System Development Architect and develop automation solutions to streamline migration workflows, including data mapping and transformation. Create processes and scripts to automate repetitive tasks and enhance efficiency. IP Domain Expertise Utilize deep knowledge of IP data types (patents, trademarks, copyrights, legal entities). Collaborate with legal experts to ensure precise migration of IP information. Technical Integration & Customization Partner with technical teams to embed automation into migration workflows. Customize automation tools to accommodate unique IP and legacy system requirements. Quality Assurance & Testing Define QA protocols specific to IP data migration. Conduct thorough testing to validate data accuracy and completeness. Stakeholder Engagement Interface with clients to understand migration needs and challenges. Offer expert recommendations to achieve successful migration aligned with client goals. Continuous Learning & Innovation Stay abreast of industry trends, best practices, and emerging technologies in data migration and automation. Drive continuous improvements in automation and migration efficiency. Cross-Functional Collaboration Work closely with product, engineering, and client-facing teams to ensure migration success and contribute to product enhancements. Documentation & Knowledge Sharing Maintain detailed documentation of migration processes and automation workflows. Lead workshops and training to disseminate best practices internally and to clients. Requirements Experience: 15+ years leading data migration projects in software implementations. 10+ years in leadership roles managing and mentoring teams. Expertise: Strong knowledge of data migration methodologies, tools, and best practices. Familiarity with automation tools, database management, and data integration platforms. Deep understanding of the Intellectual Property domain is highly preferred. Skills: Strategic leadership with excellent communication and stakeholder management skills. Ability to drive innovation and build scalable automation solutions.
Global Lead Sales Data Operations
Rubrik
Lead Sales Data Operations Location: Bangalore, India (On-site) About Rubrik Rubrik is the fastest-growing enterprise startup in Silicon Valley, revolutionizing cloud data management. Following our IPO in April 2024, we reached $1B ARR with 38% YoY growth as of Q3 2025. Leveraging AI and cutting-edge technology, we solve complex challenges to drive innovation and efficiency across sales and beyond. About the Role Rubrik is seeking a proactive and detail-oriented Sales Data Operations Lead to oversee and elevate data management practices within our Bangalore office. This leadership role will involve managing a team of Data Operations Analysts, driving data governance initiatives, and exploring AI-powered solutions to enhance data quality and operational efficiency. If you thrive in a fast-paced environment and are passionate about maintaining clean, accurate sales data, this role offers a unique opportunity to impact the future of data-driven sales operations. Key Responsibilities Leadership & Team Management Lead, mentor, and support a team of 2-3 Data Operations Analysts. Foster a high-performing, collaborative team environment. Delegate tasks effectively and provide performance feedback to meet goals. Data Quality & Maintenance Oversee CRM data entry and ensure accuracy and timeliness of account records. Utilize enrichment tools like D&B Hoovers and ZoomInfo for data validation. Regularly clean duplicate records, merge accounts, and update outdated information. Manage data change request queues while adhering to SLAs. Conduct audits to detect and resolve data inconsistencies. Cross-Functional Collaboration Work closely with Marketing, Customer Support, and IT teams to align on data governance policies. Lead monthly Data Operations status meetings with key stakeholders. Actively gather and incorporate feedback to improve data processes. Data Governance & Continuous Improvement Analyze root causes of data quality issues and implement corrective measures. Innovate and implement solutions for improved data management. Reporting & Documentation Maintain records of data maintenance activities and audit results. Prepare regular reports on data quality and operational metrics for senior leadership. Document processes clearly to support audits and team training. Required Qualifications 5+ years experience with Salesforce Sales Cloud and sales data operations. Minimum 3 years managing small teams (2-5 analysts). Strong expertise in data governance and quality tools such as ZoomInfo and D&B Hoovers. Detail-oriented with exceptional organizational and time management skills. Experience with CRMFusion DemandTools is a plus. Excellent collaboration, analytical, and problem-solving skills. Strong written and verbal communication skills in English. Proactive, innovative approach to process improvement. Bachelor s degree or equivalent experience. Reporting This role reports to the Director of Sales Process & Systems based at Rubrik s US headquarters. Rubrik (NYSE: RBRK) is on a mission to secure the world s data. Through Zero Trust Data Security , we enable organizations to build resilience against cyberattacks, insider threats, and operational disruptions. Powered by machine learning, Rubrik Security Cloud protects data across enterprise, cloud, and SaaS applications ensuring data integrity, availability, and rapid recovery in any scenario.
Pipeline And Gtm Senior Data Analyst
Rubrik
Pipeline and GTM Senior Data Analyst Location: Bangalore, India About the Role Rubrik s Pipeline & GTM Strategy and Analytics team seeks a Senior Pipeline and GTM Data Analyst to ensure high-quality data for pipeline development, measurement, and operational efficiency. Reporting to the Senior Manager of Pipeline & GTM Strategy and Analytics, you will play a key role in pipeline analytics, dashboard creation, and providing operational support for the Sales Development Representative (SDR) team. Your analytical expertise will empower data-driven decisions to accelerate growth. Key Responsibilities SDR Operations Support: Support territory and quota planning to grow the Inside Sales organization and drive revenue. Analyze strategic funnel metrics and measure sales performance. Administer and optimize sales tools like Salesforce (SFDC), Outreach, ZoomInfo, LinkedIn Sales Navigator, and more. Enhance lead routing and customer-facing messaging processes. Collaborate with Sales, Marketing, and IT teams to improve lead qualification and pipeline growth. Use data-driven insights to improve Inside Sales functions, incorporating input from cross-functional teams such as Marketing and Finance. Analytics & Reporting: Build, prepare, and analyze reports to support pipeline analytics and special projects that drive pipeline growth (PG) attainment. Create and maintain real-time dashboards for actionable insights. Validate and ensure data quality for SDR and pipeline dashboards. Continuous Improvement & Innovation: Enhance data management processes for improved efficiency and accuracy. Stay current with industry best practices in data analytics and management. Implement new tools and techniques for better data preparation and validation. Cross-Functional Collaboration: Facilitate smooth communication between SDR Operations and Analytics teams. Provide accurate, timely data to all relevant teams for informed decision-making. Participate in team meetings, offering data-driven recommendations. Required Skills and Experience 5+ years in Sales Operations, Strategy, or a related analytical role. Bachelor s degree or equivalent practical experience. Strong communication skills (written and oral). Self-starter with the ability to work independently and collaborate across all business levels. Salesforce (SFDC) administration experience. Advanced proficiency in Microsoft Excel or Google Sheets, including complex modeling and robust analysis. Experience with Microsoft Office suite (Word, Excel, PowerPoint, Outlook). Skilled in data visualization tools such as Tableau, PowerBI, or similar. Comfortable managing and analyzing large datasets. Preferred: Experience with SQL and/or Python for data querying and automation. Rubrik (NYSE: RBRK) is on a mission to secure the world s data. With Zero Trust Data Security , we help organizations build resilience against cyberattacks, insider threats, and operational disruptions. Our AI-powered Rubrik Security Cloud protects data across enterprise, cloud, and SaaS applications, ensuring integrity, availability, and rapid business recovery.
Engineering Manager- Data
Meesho
Engineering Manager Data Location: Bangalore, Karnataka | Department: Tech About the Team At Meesho, we power millions of orders daily with zero downtime thanks to our cutting-edge data and backend systems. Our engineering culture is built on speed, ownership, and a growth mindset. We embrace failures as learning opportunities and foster a 'Founder s Mindset' across all engineering teams. We're passionate technologists, team players, and storytellers just as comfortable building robust data platforms as we are bonding over books, games, or chai. If you're ready to lead a team building high-impact, real-time data systems that touch millions of users, come join us. About the Role We are seeking an experienced Engineering Manager Data to lead our data engineering initiatives. You ll be responsible for building scalable data platforms, managing distributed systems, and ensuring data accuracy, accessibility, and real-time analytics capabilities. This role combines technical depth, strategic thinking, and team leadership to build next-gen data systems powering Meesho s mission. What You Will Do Design and allocate technical tasks based on Meesho s data engineering standards and architecture. Lead and mentor a team of data engineers; conduct regular performance reviews and provide growth feedback. Oversee development of scalable, distributed data systems across streaming and batch pipelines. Collaborate with Product, Design, and Sales teams to create innovative data-driven products and features. Monitor project progress, drive sprint planning, and report on key metrics using OKRs. Promote engineering best practices, data quality standards, and cloud-native development. What You Will Need Bachelor s or Master s in Computer Science or a related field. 8+ years of overall experience, with 4+ years managing software/data engineering teams. Hands-on expertise in Java, Python, or Go and multithreading. Experience with distributed data systems, including Apache Spark, Kafka, and streaming architectures. Deep understanding of relational and NoSQL databases. Proficient in cloud platforms (preferably AWS) and containerized deployments. Experience in data modeling, pipeline architecture, and data quality frameworks. Familiarity with BI tools like Tableau, Metabase, or Superset. Good to have: Knowledge of Trino, Flink, Presto, Druid, Pinot, and real-time analytics platforms. Strong project and stakeholder management; ability to lead cross-functional teams. About Us Meesho is India s fastest-growing e-commerce platform on a mission to democratize internet commerce for every Indian. With 1.75M+ sellers and millions of active customers, we offer zero commission, the lowest shipping costs, and unparalleled reach across every serviceable pincode in India. We're building Meesho to be Meri Shop for the next billion users empowering small businesses and first-time entrepreneurs to sell and thrive online. Our Culture & Total Rewards Our culture is rooted in impact, innovation, and inclusivity. Guided by 11 core principles or "Mantras", we empower our teams to think big, move fast, and grow constantly. Daily rituals like Reflections and Listen or Die ensure everyone has a voice and a growth path. What We Offer: Competitive Compensation including salary, performance bonuses, and equity. Wellness & Insurance via our MeeCare program, with extensive coverage for employees and families, plus mental health and wellness initiatives. Work-Life Balance with flexible work hours, generous leave policies, and parental support. Learning & Development with courses, mentorship, and career mobility through our Internal Mobility Program. Perks & Benefits including salary advances, relocation support, recreational discounts, and employee gifts. Join us to lead the data transformation at Meesho and help shape the future of commerce for India s next billion users. Apply now to make your mark! Qualification : Bachelors or Masters in Computer Science or a related field.
Analytics Lead/architect
Oracle India
Analytics Lead/Architect Location: Bengaluru, Karnataka, India Job Category: Consulting Job Type: Regular Employee Role: Individual Contributor Job Description: As a BI Architect, you will work on both offshore and onsite client projects. Your responsibilities will involve working with Oracle BI Applications, OAC (Oracle Analytics Cloud), and ODI (Oracle Data Integrator) implementations. You will engage with clients to understand their requirements, lead technical designs, and oversee system and integration testing using Oracle methodologies. You will also contribute to PreSales, the creation of Go-to-Market (GTM) strategies, and take the lead in developing IP/solution accelerators. Additionally, you will be responsible for owning the technical delivery of large, complex projects. Responsibilities: Lead Oracle BI Applications, OAC, and ODI implementations. Interact with clients to understand and gather business requirements. Oversee technical design, development, and system/integration testing. Contribute to PreSales activities and the creation of Go-to-Market (GTM) strategies. Lead the development of IP/solution accelerators. Own the technical delivery of large and complex projects. Required Skills: BI (Business Intelligence) expertise. Experience with Oracle Data Integrator (ODI). This position offers the opportunity to work on cutting-edge analytics technologies and deliver impactful solutions in a collaborative and dynamic environment. If you have significant experience in Oracle BI and ODI implementations, and enjoy leading large, complex projects, we would love to hear from you.
Cloud Data Engineer - AWS Big Data
Infocepts
Position: Cloud Data Engineer AWS Big Data Location: Bangalore, India Employment Type: Full-time Experience Required: 5 to 8 years Purpose of the Position: Join the Infocepts Cloud Data Architect Team as a Cloud Data Engineer and help design and implement cutting-edge big data solutions on AWS. You will leverage your expertise in EMR, Athena, PySpark, S3, AWS Lambda, and SQL to develop robust and scalable data platforms. Key Responsibilities: Technology Assessment and Design: Assess existing technology landscape and data integration frameworks. Design complex Big Data use cases using AWS services under guidance of the Architect. Support architectural decision-making by evaluating trade-offs in cost, performance, and durability. Recommend optimizations to existing data infrastructure. Documentation and Stakeholder Communication: Create project documentation adhering to quality and delivery standards. Collaborate closely with Architects and Project Managers for scoping, estimation, and planning. Present design decisions to technical and business stakeholders clearly. Conduct PoCs and design review sessions. Process Improvement and Automation: Identify and suggest opportunities for automation and process enhancements. Mentor junior engineers and support technical problem solving. Training and Knowledge Sharing: Prepare and deliver internal training on AWS and Big Data topics. Lead client knowledge sharing sessions and contribute to case studies. Essential Skills: In-depth experience with AWS services: S3, EC2, EMR, Athena, Glue, Lambda Familiarity with MPP databases like Redshift, Snowflake, or SingleStore Proficiency in Apache Spark and Databricks Strong programming skills in Python Experience building data pipelines using AWS and Databricks Knowledge of Big Data file formats such as Delta Lake Advanced SQL skills for large-scale data manipulation Hands-on experience with Apache Airflow or similar orchestration tools Strong understanding of ETL workflows and data warehousing concepts Desirable Skills: Cloud databases: AWS Aurora, Snowflake Experience with Hadoop and Hive AWS Certifications (Associate or Professional level) are a plus Qualifications: Bachelor s degree in Computer Science, Engineering, or related field (Master s preferred) Overall 5+ years of IT experience with at least 3 years in AWS Big Data projects Ongoing learning and technical certifications are strongly encouraged Key Qualities: Strong problem-solving and analytical thinking Self-driven with a passion for emerging data technologies Excellent communication and client presentation skills Ability to work in cross-functional, agile teams Apply now to be part of a high-impact data transformation team working on large-scale cloud data projects! Qualification : Bachelors degree in Computer Science, Engineering, or related field (Masters preferred)
Data Engineer
International Business Machines
Azure Data Engineer IBM Consulting Client Innovation Center Location: Bengaluru, India Experience: 7+ Years (Minimum 4+ Years in Azure Technologies) Job Type: Full-Time Education Required: Bachelor s Degree (Master s preferred) Introduction: Join IBM Consulting at our Client Innovation Center in Bengaluru, where we deliver deep technical and industry expertise to a wide range of public and private sector clients. Our delivery centers focus on innovation, agility, and adoption of next-gen technologies to transform businesses locally and globally. Your Role & Responsibilities: Design and develop scalable data engineering solutions on Microsoft Azure. Build, optimize, and manage data pipelines and ETL workflows using tools like Azure Data Factory, ADLS, and Databricks. Write clean, efficient code using PySpark, PL/SQL, and Spark SQL. Integrate and manage data from various sources, both structured and unstructured. Work with SQL, Postgres, Cassandra, and Cosmos DB. Utilize Azure services such as Stream Analytics, SQL DW, Azure Functions, ARM Templates, and Analysis Services. Implement and maintain serverless architectures for modern data solutions. Ensure high-quality data delivery, security, and compliance across systems. Collaborate across teams and contribute to solution design, code reviews, and documentation. Required Skills & Experience: Bachelor s degree in Computer Science, Information Systems, or related technical field. 7+ years total experience in Data Engineering, with 4+ years in Azure-based data projects. Strong hands-on experience with: Azure Data Factory, Data Lake (ADLS), Databricks Programming: Python, PySpark, PL/SQL, Spark SQL Databases: SQL, Postgres, Cassandra, Cosmos DB Solid grasp of data warehousing, relational databases, and cloud-based architectures. Familiarity with version control tools like Git and CI/CD pipelines. Preferred Skills & Qualifications: Master s Degree in a relevant field. Experience with: ARM Templates, Azure Functions, Serverless Architectures Object-oriented scripting languages (Python, Scala, etc.) Excellent problem-solving and communication skills. Ability to work in a fast-paced environment and collaborate effectively with teams and stakeholders. What You ll Get: Work on high-impact, global projects with cutting-edge Azure technologies. Be part of a collaborative and forward-thinking IBM team. Opportunities for professional growth, upskilling, and certifications. A dynamic work culture focused on innovation, agility, and client success. Join us in Bengaluru and be part of IBM s journey in shaping the future of data engineering. Qualification : Bachelors degree in Computer Science, Information Systems, or related technical field.
Chief Analytics Office (cao) - Data Scientist
International Business Machines
Chief Analytics Office (CAO) - Data Scientist Location: Bangalore, Karnataka, India Job Type: Full-Time Experience Level: 2-4 years Company: IBM Chief Analytics Office (CAO) Introduction: At IBM, we believe in the power of AI and data science to transform enterprises. In the Chief Analytics Office (CAO), we work on the front lines of AI-driven enterprise transformations. By joining our team, you will collaborate with innovative leaders and contribute to solving complex problems using the latest AI and machine learning technologies. Here, your skills will not only be valued but nurtured in a dynamic, collaborative environment designed for growth and impact. Role Overview: As a Data Scientist within IBM's Chief Analytics Office, you will play a critical role in driving AI and data science initiatives across the enterprise. You will use your technical expertise to develop and deploy machine learning models and data analytics solutions that align with business objectives. This role is focused on translating data insights into actionable recommendations and leading data science projects from concept to execution. Key Responsibilities: Technical Execution and Leadership: Develop and deploy AI models and data analytics solutions. Assist in the implementation and optimization of AI-driven strategies aligned with business stakeholder requirements. Refine data-driven methodologies for enterprise transformation projects. Data Science and AI: Design, implement, and optimize machine learning solutions and statistical models. Perform end-to-end data analysis, from problem formulation through to deployment. Ensure the scalability of AI solutions by leveraging cloud platforms. Apply IBM s data science standards and reusable assets to ensure quality and consistency. Project Support: Lead and contribute across various stages of AI and data science projects, from data exploration to model development and deployment. Monitor project timelines and assist in resolving any technical challenges. Design and implement measurement frameworks to assess the business impact of AI solutions using KPIs. Collaboration: Work closely with stakeholders to ensure alignment with strategic goals. Collaborate with data engineers, software developers, and other team members to integrate AI solutions into existing systems. Provide technical expertise to cross-functional teams, fostering a collaborative environment. Required Education and Experience: Education: Bachelor s or Master s degree in Computer Science, Data Science, Statistics, or a related field. An advanced degree is strongly preferred. Experience: 2-4 years of experience in data science, AI, or analytics, with a focus on implementing data-driven solutions. Experience with data cleaning, data analysis, A/B testing, and data visualization. Hands-on experience with AI technologies through coursework or projects. Required Technical Skills: Programming and Data Analysis: Proficiency in SQL and Python for data analysis and developing machine learning models. Familiarity with machine learning algorithms such as linear regression, decision trees, random forests, gradient boosting (e.g., XGBoost, LightGBM), neural networks, and deep learning frameworks (e.g., TensorFlow, PyTorch). Cloud Platforms & Data Processing: Experience with cloud-based platforms (e.g., AWS, Azure, IBM Cloud) and data processing frameworks. Specialized Knowledge: Knowledge of large language models (LLMs) and familiarity with IBM s WatsonX product suite. Familiarity with object-oriented programming (OOP) principles. Analytical and Soft Skills: Problem-Solving: Strong analytical skills with the ability to solve complex problems and derive actionable insights from datasets. Communication: Excellent communication skills to explain technical concepts clearly to stakeholders at various levels. Project Management: Ability to handle multiple initiatives simultaneously, prioritize effectively, and meet deadlines in a fast-paced environment. Preferred Experience: Advanced Degree: A Master s degree in a related field is strongly preferred. Impact: Work on innovative projects that directly impact enterprise transformation using the latest AI and data science techniques. Collaboration: Be part of a collaborative environment with a global team of AI experts. Growth: Develop professionally with continuous learning opportunities in the ever-evolving AI field. Work-Life Balance: IBM offers a dynamic work environment with flexibility and career growth opportunities. Apply now and join IBM's Chief Analytics Office as a Data Scientist and be part of the next generation of data-driven innovations. Qualification : A Masters degree in a related field is strongly preferred.
Data Engineer - Platform Generative Ai
Mckinsey & Company
Your Impact We are seeking a passionate Data Engineer with expertise in Python development who is excited about cloud-based data engineering using AWS services. You will be an integral part of a dynamic, multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers, and other stakeholders. As a key member of a global team working on our generative AI initiative, you will be based in one of our European offices. McKinsey s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm s internal use, and your role will be crucial in driving the development of data solutions to support generative AI applications. You will work with a team of data engineers to develop robust data ingestion pipelines and enhance data processing capabilities that integrate data into systems used by AI applications. Your responsibilities will include writing Python code, creating tests, developing and maintaining GitHub Action CICD pipelines, and managing AWS-based infrastructure and Docker containers. Your Growth As a member of the global team working on our generative AI initiative, you will play a key role in shaping and accelerating the delivery of McKinsey's target state data platform, which will enable AI use-cases. You will be part of our cloud-first approach, transforming data platforms and analytical applications across the firm. Working closely with multidisciplinary teams, you will contribute to building cutting-edge data solutions in a fast-paced, innovative environment. McKinsey s Tech Ecosystem function is responsible for developing all technology solutions for the firm s internal needs, and you ll have the opportunity to shape how these solutions evolve. Your Qualifications and Skills 3+ years of professional experience as a Data Engineer, with a focus on cloud-based data engineering using AWS services Expertise in Python development and a strong understanding of clean code, modularity, error handling, and test automation Extensive experience with relational databases and data pipeline performance Hands-on experience with Docker and CI/CD pipelines (e.g., GitHub Actions) Strong execution focus, with the ability to work independently in complex, fast-paced environments and deliver results Demonstrable experience in solving data pipeline performance issues and diagnostics Interest in generative AI and machine learning topics Experience with Kedro framework is a plus Opinionated and confident in sharing ideas, willing to speak up at all levels Familiarity with Agile principles and product development methodologies Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams
Staff Data Engineer
Intuit
Intuit is a global leader in financial technology, dedicated to helping individuals and businesses thrive. Our suite of products, including TurboTax, Credit Karma, QuickBooks, and Mailchimp, serves approximately 100 million customers worldwide. At Intuit, we believe in providing everyone with the tools and resources they need to achieve financial success. We are constantly innovating to make financial empowerment a reality for all. Job Overview Join the Intuit Data Platform (IDP) team as a Staff Engineer and help us transform the way we handle big data! The IDP team is responsible for the Intuit Analytics Platform, which powers real-time data ingestion, cataloging, analytics, and machine learning across the entire organization. As Intuit s customer base grows, so does the volume of data we process. Our engineering excellence ensures that we can scale and leverage this data to drive machine learning and product innovations. We re in the process of building the next-generation real-time and batch ingestion engine, capable of indexing, cataloging, and organizing data and metadata. We are passionate about using open-source technologies to solve challenges and contributing back to the community. If you're excited about building a platform that will directly impact data scientists and analysts and have a desire to shape the future of data at Intuit, then come join us! Key Responsibilities Architect & Design: Build fault-tolerant and scalable big-data platforms using open-source technologies to handle massive datasets. Data Solutions: Create architecture solutions that address complex use cases like data normalization, lineage, governance, ontology, and discoverability. Cross-Team Collaboration: Work with analysts and data scientists to understand data requirements for building operational propensity models and gaining deep customer insights. Hands-On Coding: Lead development efforts within the Hadoop ecosystem using technologies such as Java MapReduce, Spark, Scala, HBase, and Hive to build and optimize data pipelines for both real-time and batch applications. Database Management: Work with NoSQL, SQL, and in-memory databases to design high-performance data systems. Code Reviews: Ensure code quality, consistency, and adherence to best practices through regular code reviews. Architectural Alignment: Ensure alignment between enterprise architecture and business requirements. Prove Feasibility: Conduct proof-of-concept (POC) experiments for new technologies or approaches and drive them to production. Collaboration with Data Cataloging Team: Work closely with data catalog teams and architects to index and catalog all data sources at Intuit. Agile Leadership: Lead fast-paced development teams using agile methodologies and promote best practices in software development, testing, and incident response. Design & Model: Build dimension models suited for customer business use cases and ensure seamless integration of business and technical requirements. Qualifications Experience: 12+ years of relevant experience, with at least 5+ years specializing in the big data domain. Big Data Architecture: Proven experience in architecting end-to-end ecosystems for big data and analytics platforms. Expert Knowledge: Deep expertise in building fault-tolerant, scalable big data solutions, especially using the Hadoop ecosystem (Hive, HBase, Spark, Kafka, MapReduce, etc.). Programming Expertise: Mastery of Java and Scala, with a focus on building high-throughput data services. Machine Learning: Knowledge of machine learning principles and AI applications in big data. Big-Data Technologies: Familiarity with tools such as HDFS, Storm, Zookeeper, Cassandra, Redshift, GraphDB, and others. Understanding both real-time and batch processing in the Hadoop ecosystem. Communication: Strong communication skills, with an ability to explain complex technical topics to both technical and non-technical audiences. Programming Skills: Intermediate experience in Python or R for data processing. Education: BE/BTech/MS in Computer Science or a related field (or equivalent experience). Collaboration: Demonstrated ability to work cross-functionally and lead change through influence and example. At Intuit, you ll be part of a talented, passionate team working on innovative solutions that shape the future of data analytics and machine learning. As a Staff Engineer, you ll have the chance to work with cutting-edge technologies, build scalable systems, and help revolutionize how Intuit leverages data to drive product innovation. If you're looking for a dynamic environment where you can have a meaningful impact, come join us at Intuit! Qualification : BE/BTech/MS in Computer Science (or equivalent)
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted