Azure Data Lake Storage Adls Jobs in Bengaluru

Position: Technical Support Engineer - L2 Job Type: Full-Time Location: Bangalore Department: Technical Support About BlueOptima: At BlueOptima, our mission is to be the global leader in optimizing the performance of software engineers across all industries. Through our cutting-edge metrics in software development, we empower large organizations to build better software, faster and at lower costs. Our innovative technology pushes the boundaries of what s possible, making a real difference in software delivery. With a global presence including offices in London, India, Mexico, the US, and Japan we are a diverse team of 120 people from over 20 countries. We foster a collaborative, open-minded environment where every individual can create their own success story in a high-performance setting. Job Description: As a Technical Support Engineer - L2, you will play a critical role as the senior technical leader between customer-facing teams, Product Management, and Engineering. You will provide deep technical expertise, troubleshooting complex issues, contributing to product development, and ensuring the smooth success of customer engagements. This role is highly dynamic and involves working closely with multiple teams, managing escalated support cases, coordinating new features and fixes, and creating internal best practices. Key Responsibilities: Customer Success Support: Act as a technical lead for pre-sales, deployment, and support teams. Troubleshoot escalated support issues, replicate environments, and collaborate with engineering to resolve problems quickly and efficiently. Product Feedback & Roadmap Alignment: Actively participate in "road-testing" pre-release software, providing crucial feedback to Product Management, and helping ensure customer requirements are aligned with the product roadmap. Technical Exploration & Research: Lead deep technical investigations, such as benchmarking custom use cases, and prototype new features to improve the overall customer experience. Enablement & Knowledge Sharing: Contribute to internal documentation, including product capabilities and best practices, and deliver regular training sessions to technical teams to promote continuous learning. Qualifications: Core Technical Skills: Advanced Systems Administration: Expertise in Linux and Windows, including performance tuning, kernel parameters, and filesystem management. Scripting Skills: Strong proficiency in Bash, Python, or similar languages to automate complex tasks and gather detailed debugging data. Enterprise Storage: Experience with SAN, NAS, and related enterprise storage technologies and architectures. Disaster Recovery: Hands-on experience with data copy, replication, and disaster recovery solutions. Cloud Storage: Experience working with Cloud Object Stores like AWS S3, Azure, or Google Cloud. Virtualization & Containerization: Knowledge of Docker, IaaS, and PaaS technologies. Additional Technical Skills: In-depth knowledge of version control systems (Git, Subversion). Familiarity with security concepts (Kerberos, SSL/TLS, LDAP). Advanced networking knowledge, including packet tracing and tuning. Understanding of Java concepts and integrations. Experience & Education: 10-15 years of experience in IT, with a focus on Linux-based systems and enterprise environments. Bachelor s degree in Computer Science or a related field. Soft Skills: Communication: Ability to explain complex technical concepts to both technical and non-technical audiences. Problem-Solving: Strong methodical troubleshooting skills and the ability to think critically in high-pressure situations. Customer-Facing Experience: Previous experience in customer-facing roles, with the ability to manage expectations and deliver results. Calm Under Pressure: A composed, professional demeanor even in high-stakes situations. Continuous Learning: Enthusiasm and curiosity to stay ahead of new technologies and industry trends. At BlueOptima, you ll be part of a pioneering company with a mission to transform the way software performance is optimized. We value innovation, collaboration, and individual growth, offering a dynamic and high-performance environment where your contributions truly make an impact. If you re looking to advance your career while working with cutting-edge technology, BlueOptima is the place to be. Qualification : Bachelors degree in Computer Science or a related field

Data Engineering Lead Bengaluru | Engineering | Full-Time About Fam (formerly FamPay) Fam is India s first payments app designed for everyone aged 11 and above. FamApp enables seamless online and offline payments through UPI and FamCard. Our mission is to empower over **250 million young Indians** to start their financial journey early, becoming financially aware and confident. Founded in 2019 by IIT Roorkee alumni, Fam is backed by top-tier investors including Elevation Capital, Y-Combinator, Peak XV (Sequoia Capital India), Venture Highway, and angels like Kunal Shah and Amrish Rao. About the Role We re looking for a visionary **Data Engineering Lead** to take **end-to-end ownership** of Fam s data ecosystem from data ingestion and storage to processing and delivering actionable insights. You ll **define the data strategy and architecture** that supports both batch and **real-time** use cases, ensuring scalability, reliability, and governance across the organization. You will be instrumental in enabling accurate, complete, and trusted data flow that powers business intelligence, analytics, and product decision-making. This role involves **leadership, strategic thinking**, and hands-on problem solving. What You ll Do Own the full data lifecycle: ingestion, organization, storage, processing, and presentation. Define and execute **data architecture and strategy** aligned with operational and analytical goals. Build **scalable, reliable, and observable data systems** supporting batch and near real-time processing. Ensure **data quality, governance, and compliance**, proactively resolving discrepancies. Collaborate with product, engineering, and business teams to define, track, and optimize key metrics. Anticipate data-related challenges and implement preventive solutions. Lead, mentor, and grow the data engineering team, fostering innovation and accountability. Must-Haves 10+ years experience in data engineering, including proven leadership of teams or projects. Expertise designing, building, and scaling end-to-end data pipelines and systems. Deep understanding of the data lifecycle, from ingestion through business reporting. Strong communication skills and ability to collaborate across technical and business teams. Solid knowledge of **data governance, quality assurance, and compliance standards**. Experience with observability and proactive monitoring for data systems. Proficiency in Python and SQL; familiarity with Scala or Java. Hands-on experience with streaming and batch data frameworks. Experience designing large-scale data lakes and warehouses with best practices for schema evolution and partitioning. Strong background with **cloud platforms (AWS, GCP, or Azure)**. Fintech or regulated industry experience is a plus. Good to Have Fintech-specific data experience, including regulatory compliance and reporting. Deployment experience with **real-time analytics** and event-driven architectures. Familiarity with containerization and infrastructure tools like Docker, Kubernetes, Terraform. Knowledge of data observability tools (Monte Carlo, Databand, etc.). Exposure to **ML pipelines** and model deployment. Solve challenging problems at the intersection of big data, real-time processing, and fintech. Lead impactful data initiatives at a rapidly growing startup. Collaborate with a world-class team of engineers, data scientists, and product leaders. Competitive compensation, equity, and benefits. Clear career growth opportunities in leadership and innovation. Perks That Go Beyond the Paycheck Relocation assistance for a smooth move. Free office meals (lunch & dinner). Generous leave policies (birthday, period, parental support, and more). Salary advances and loan policies for financial support. Quarterly rewards, recognition, and referral incentives. Access to the latest gadgets and tools. Comprehensive health insurance with mental health support. Tax benefits like food coupons, phone allowances, and leasing options. Retirement benefits including PF contribution, leave encashment, and gratuity. About FamApp FamApp focuses on financial inclusion for the next generation by offering UPI and card payments to users aged 11+. Our flagship product, FamX, integrates UPI and card payments seamlessly, helping users manage, save, and learn about their finances effortlessly. With over **10 million users**, FamApp is revolutionizing how young Indians transact eliminating the need to carry cash and offering customizable FamX cards with personal doodles for a fun, unique payment experience. Join Our Dynamic Team At Fam, we foster a people-first culture with flexible work schedules, generous leave, comprehensive health benefits, and mental health support. You ll be part of a passionate, talented, and fun team shaping the future of fintech for India s youth.

Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.

Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.

Job Title: Enterprise Infrastructure Automation Architect Location: Bengaluru, India Experience: 16 20 Years Service Line: Cloud & Infrastructure Services Educational Qualifications: B.E., B.Tech, M.Tech, BCA, MCA, MBA Role Overview: We are looking for a seasoned Enterprise Infrastructure Automation Architect to lead the design and implementation of automation strategies across our global IT infrastructure. This role is pivotal in driving enterprise-wide automation initiatives, streamlining operations, and enabling digital transformation through scalable and secure infrastructure automation solutions. Key Responsibilities: Infrastructure Automation Strategy & Roadmap Define and maintain the enterprise automation strategy aligned with organizational goals and IT objectives. Identify automation opportunities across compute, storage, network, virtualization, cloud, and data center domains. Establish automation goals, KPIs, and success metrics for continuous improvement. Evaluate and recommend emerging automation technologies and frameworks. Solution Design & Architecture Design scalable, secure, and maintainable automation architectures for enterprise infrastructure. Define enterprise-wide automation standards and best practices (e.g., IaC, scripting, orchestration). Select and standardize tools such as Ansible, Terraform, Python, PowerShell, and cloud-native automation services. Build reusable automation frameworks, templates, and modules to ensure consistency. Implementation & Governance Provide architectural oversight and support during implementation and deployment phases. Ensure compliance with automation standards and governance throughout the lifecycle. Participate in project reviews to ensure strategic alignment with enterprise automation goals. Establish governance processes for managing scripts, workflows, and infrastructure-as-code artifacts. Additional Responsibilities: Proven experience in IT Service Management and remote delivery automation environments. Ability to articulate the business value and operational impact of automation initiatives. Self-motivated, creative thinker with excellent problem-solving abilities. Excellent communication skills, both verbal and written. Technical & Professional Requirements: In-depth knowledge of enterprise architecture frameworks (e.g., TOGAF, Zachman). Expertise in infrastructure domains including compute, storage, middleware, backup (on-prem & cloud). Experience with public cloud platforms (AWS, Azure, GCP) and hybrid cloud architectures. Proficiency in security standards and best practices across global IT environments. Hands-on experience with monitoring and orchestration tools. Skilled in creating architecture diagrams and workflow visualizations using tools like MS Visio, Lucidchart, etc.

Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field

Java Full Stack Developer Bangalore Location: Bangalore (Bengaluru), India Experience: 2 to 12 Years Industry: IT Software Software Development Education: BE / BTech / MCA preferred Employment Type: Full-time Role Category: Software Development Role: Java Full Stack Developer Job Overview: We are looking for a skilled Java Full Stack Developer to join our dynamic team in Bangalore. The ideal candidate will have hands-on experience in developing web and enterprise applications using Java, AngularJS or React, and microservices architecture. You will be involved in full-cycle development including UI/UX, backend logic, databases, and deployment on cloud platforms. Key Responsibilities: Design and develop scalable, secure, and high-performance software applications Translate UX designs into responsive and intuitive UI components Implement business logic and application workflows using Java/J2EE and Spring Boot Develop and integrate APIs and microservices Work with NoSQL/SQL databases for data modeling and storage Deploy applications on AWS, Azure, or Google Cloud Platform (GCP) Conduct code reviews and perform unit, integration, and functional testing Maintain CI/CD pipelines and version control tools (e.g., Git, Jenkins) Create and maintain technical documentation and coding guidelines Collaborate with cross-functional teams in an agile environment Preferred Skills & Technologies: Strong programming skills in Java/J2EE, Spring Boot, and RESTful APIs Proficiency in front-end frameworks: AngularJS, React.js, or similar Experience in building microservices-based architecture Working knowledge of NoSQL databases like MongoDB or Cassandra Experience with DevOps tools and cloud platforms (AWS/Azure/GCP) Familiarity with mobile app development (iOS/Android) is a plus Exposure to Machine Learning, Cognitive Services, or Predictive Analytics is a strong advantage Soft Skills: Strong communication and collaboration skills Ability to work independently and in a team Eagerness to learn and adopt new technologies Comfortable in a fast-paced, startup-like environment Opportunity to work on cutting-edge technologies Be part of a passionate and innovative development team Flexible and collaborative work culture Growth-oriented role with leadership opportunities

Cloud Architect Bangalore, India Location: Bangalore (Bengaluru) Experience: 8 to 15 Years Industry: IT Software / Cloud Computing Job Summary: We are seeking a seasoned Cloud Architect with deep expertise in designing and implementing secure, scalable cloud solutions across public and private cloud platforms. The ideal candidate will have strong knowledge of enterprise application and integration patterns, cloud-native microservices, and security architecture. Key Responsibilities: Architect and design cloud solutions leveraging AWS, Microsoft Azure, and Google Cloud Platform (GCP) Develop microservices-based applications using Docker and Kubernetes, and deploy them on cloud platforms Define security architectural requirements, including threat modeling, identity and access management, PKI, and secrets management Ensure cloud environments adhere to security protocols, compliance standards, and best practices for authentication and authorization Work with a wide range of cloud services including storage, networking, and security components Apply knowledge of Big Data ecosystems such as Hadoop and NoSQL databases to design scalable data processing architectures Deploy and manage cloud infrastructure using Terraform for infrastructure as code (IaC) Utilize configuration management tools like Puppet, Chef, and continuous integration tools such as Git and Jenkins Collaborate within Agile teams to deliver cloud architecture solutions efficiently Stay updated on emerging open-source technologies and integrate them into cloud architectures when applicable Required Skills & Qualifications: Extensive experience with both public and private cloud technologies Strong understanding of Enterprise Application Patterns and Integration Patterns Hands-on experience with containerization, microservices, and orchestration tools (Docker, Kubernetes) In-depth knowledge of cloud security, including threat modeling and compliance requirements Proficiency in managing cloud infrastructure on AWS, Azure, and/or GCP Familiarity with Big Data platforms and NoSQL databases Skilled in Infrastructure as Code (IaC) tools, especially Terraform Experience with automation and configuration management tools like Puppet, Chef, Git, and Jenkins Comfortable working in Agile development environments Preferred Qualifications: Bachelor s or Master s degree in Computer Science, Information Technology, or related field Relevant cloud certifications such as AWS Certified Solutions Architect, Azure Solutions Architect Expert, or Google Cloud Professional Architect Strong communication skills to articulate complex cloud architectures to diverse stakeholders Lead the design of innovative, secure, and scalable cloud architectures Work with cutting-edge cloud and container technologies in a dynamic environment Opportunity to grow professionally with access to training and certifications Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or related field

Data Architect Bangalore, India Location: Bangalore (Bengaluru) Experience: 10 to 15 Years Industry: IT & Data Systems Job Summary: We are seeking an experienced Data Architect with a strong background in designing and implementing enterprise-scale data solutions. The ideal candidate will have expertise in building data lakes, warehouses, and pipelines, with deep knowledge of cloud platforms, data management, and industry best practices. Key Responsibilities: Design, develop, and maintain complex data architectures including data lakes, data warehouses, data marts, and efficient schema design Build and optimize scalable data pipelines for extraction, transformation, and loading (ETL/ELT) processes Apply Agile methodologies in project delivery and collaborate within cross-functional teams Perform data profiling, cleansing, conversion, and ensure high-quality data management for both structured and unstructured data Implement CI/CD and Infrastructure as Code (IaC) practices using tools like GitHub, Jenkins, CloudFormation, and Azure Resource Manager Manage database systems and tools such as PostgreSQL, Oracle, Snowflake, Teradata, MongoDB, Hadoop, and others Utilize data modeling tools like Erwin, Power Designer, and Toad for effective data architecture design Leverage cloud platforms including AWS and Microsoft Azure, with hands-on experience in services like AWS Glue, DMS, Lambda, Azure Data Factory, Synapse, and Data Lake Storage Work with programming and scripting languages including SQL, PL/SQL, Python, Spark, YAML, and JSON Use containerization and automation tools such as Docker, Ansible, and NodeJS for efficient deployment Ensure compliance with cybersecurity principles and frameworks such as NIST Lead data governance initiatives and enforce best practices in data quality and security Preferred Qualifications: ITIL certification and experience with Agile methodology Knowledge of code review and version control best practices, especially in GitHub Familiarity with data science tools and AI/ML frameworks like R, Keras, or TensorFlow Experience with natural language processing (NLP) and machine learning concepts Background in regulated industries, with pharma manufacturing experience highly preferred Exposure to multi-site, global IT projects and manufacturing operations Lead innovative data architecture projects within a dynamic and fast-paced environment Work with cutting-edge cloud technologies and big data ecosystems Collaborate with global teams on impactful enterprise solutions Access to professional growth opportunities in data governance, AI, and cloud technologies

Customer Success Engineer II Technical Support | Cloud & SaaS Location: Bangalore, India Job Type: Full-Time | Customer Success | Cloud Technology | Technical Support About Rubrik s Customer Support & Success Team Rubrik s Global Customer Support and Success Organization is committed to delivering an outstanding post-purchase experience. Our team of seasoned experts ensures smooth deployment, adoption, and continued usage of Rubrik s cloud data management and Zero Trust Data Security solutions. We handle complex technical support cases, guide customers through SaaS product adoption, and provide strategic consultation across a wide range of cloud platforms, data security tools, and enterprise IT ecosystems. Our engineers work closely with cross-functional teams, acting as trusted advisors and primary technical contacts, to maintain high standards of data protection, incident resolution, and customer success. About the Role We are looking for a highly skilled Customer Success Engineer II to join our fast-paced support team. In this role, you will provide enterprise-level technical support for Rubrik s data security solutions via phone, web, chat, and email. You will troubleshoot complex technical issues, support diverse cloud deployments, and deliver excellent service across hybrid infrastructure environments. Key Responsibilities Handle technical support tickets ranging from basic queries to advanced troubleshooting across cloud platforms and virtualized environments. Independently diagnose and resolve customer issues involving snapshots, replication, backup and recovery, data management, and infrastructure. Utilize cloud infrastructure knowledge to provide guidance and recommend best practices (AWS, Azure, GCP). Collaborate with internal teams such as Engineering and Escalations to resolve critical incidents. Deliver high-quality customer communication, ensuring transparency and issue resolution from start to finish. Author and contribute to technical documentation, including knowledge base articles, FAQs, and deployment guides. Continuously improve case resolution processes and provide insights into recurring issues. Analyze and report root causes; work with developers to file bugs and enhance product reliability. Share feedback and insights with product teams to drive platform improvements and enhance customer satisfaction. Support automation, DevOps, and microservices architecture as part of troubleshooting modern enterprise stacks. Required Skills & Experience 3+ years in a technical support, DevOps, or cloud infrastructure role supporting enterprise environments. Strong knowledge of VMware, Linux, Kubernetes, and cloud platforms like AWS, Azure, and Google Cloud Platform (GCP). Hands-on experience with Office 365 APIs, Microsoft SQL databases, scripting languages such as Python or Perl, and automation tools. Deep understanding of SaaS systems, cloud deployment models, and data protection principles. Demonstrated problem-solving skills with a passion for learning and adapting to new technologies. Ability to write clear technical documentation and communicate complex concepts to diverse audiences. Bachelor's degree in Computer Science, Information Technology, or related technical field. Preferred Qualifications Experience in supporting data backup and recovery, storage solutions, or cybersecurity tools. Exposure to Zero Trust Security models, data compliance standards, or incident management workflows. Strong collaboration skills with internal development, QA, and customer success teams. Previous experience contributing to internal knowledge systems or customer-facing documentation. At Rubrik, we are redefining data security and resilience. Our award-winning platform, Rubrik Security Cloud, powered by machine learning, protects enterprise, cloud, and SaaS environments from ransomware, cyber threats, and downtime. You ll work with passionate professionals who are dedicated to helping businesses secure their critical data and recover quickly in times of crisis.

Staff Engineer DSPM Location: Bangalore, India About the Team Rubrik s Security Apps team focuses on securing customer data across cloud, SaaS, and on-premises environments. As data volumes grow exponentially, so do the associated cybersecurity risks. The team builds scalable and innovative solutions to protect, search, and analyze data seamlessly. Operating like a startup within a startup, they emphasize strong engineering principles, innovation, and teamwork to drive product excellence. About the Role As a Staff Engineer, you will play a critical role in Rubrik s R&D, collaborating closely with product teams to build and evolve scalable, fault-tolerant backend systems. You will lead the development of data ingestion pipelines and advanced analysis engines, shaping the technical direction of multiple projects. Additionally, you will mentor engineers, fostering leadership skills and promoting a culture of technical excellence. What You ll Do Design, develop, test, deploy, and maintain high-performance software systems. Build large-scale distributed systems and storage infrastructure. Develop backend services that ingest and process sensitive data from multiple cloud providers. Create data pipelines for classification, correlation, anomaly detection, automated issue resolution, and customer reporting. Own project priorities, deadlines, and deliverables with end-to-end accountability. Identify and resolve software bottlenecks, driving continual innovation. Provide technical leadership and mentorship to engineers, guiding their growth into leadership roles. Influence architecture and design decisions across teams and projects strategically. Propose and lead process improvements and technical initiatives to boost productivity. Collaborate rapidly with engineers, product designers, and stakeholders to solve real-world problems. Operate effectively in an agile, fast-paced environment, adapting quickly to evolving business needs. Experience & Qualifications Bachelor s or Master s degree in Computer Science or a related field. 13+ years of industry experience solving complex technical problems. Proficiency in one or more programming languages such as Go, Java, C/C++, Scala, or Python. Experience designing and architecting large-scale distributed systems. Proven ability to guide and mentor engineers in scalable software design and implementation. Strong communication and collaboration skills. Experience with public cloud platforms (GCP, AWS, Azure) is a plus. About Rubrik Rubrik is on a mission to secure the world s data with its Zero Trust Data Security platform. Using machine learning, Rubrik Security Cloud protects data across enterprises, cloud, and SaaS environments, enabling resilience against cyberattacks, insider threats, and operational disruptions while ensuring data integrity and availability. Qualification : Bachelors or Masters degree in Computer Science or a related field.

Staff Software Engineer Databases Location: Bengaluru, India Company: Databricks About Databricks Databricks is a leading data and AI company powering over 10,000 organizations globally, including half of the Fortune 500. Founded by the original creators of Apache Spark , Delta Lake, and MLflow, Databricks offers a unified platform for data, analytics, and AI, enabling enterprises to innovate with confidence. With its global presence and a growing Bengaluru team, Databricks is rapidly expanding. Role Overview As a Staff Software Engineer in Bengaluru, you ll work within Backend or Distributed Data Systems (DDS) teams to build scalable, reliable, and high-performance services powering Databricks data and AI platform. You will tackle challenges ranging from distributed systems and cloud storage to service architecture, workflow orchestration, and developer experience. Key Responsibilities Develop large-scale distributed backend services, including managing cloud storage backends like AWS S3 or Azure Blob Store. Build and maintain infrastructure that supports millions of cluster-hours per day. Contribute to key DDS projects such as Apache Spark , Delta Lake, and performance engineering. Design and implement high-performance, reliable, and scalable systems and client libraries. Collaborate cross-functionally to drive innovation in cloud-native data processing and storage. Qualifications BS or higher in Computer Science or related field. 10+ years of production software engineering experience in Python, Java, Scala, C++, or similar. Proven experience developing large-scale distributed systems from the ground up. Experience with SaaS platforms or Service-Oriented Architectures. Benefits & Culture Competitive benefits tailored to employees needs. Committed to fostering a diverse, inclusive, and equitable work environment. Diversity & Inclusion Statement Databricks ensures equal employment opportunities regardless of age, race, gender, ethnicity, disability, sexual orientation, veteran status, or other protected characteristics, striving for a welcoming and inclusive workplace. Qualification : BS or higher in Computer Science or related field.

Job Title: Azure Infrastructure Architect Location: Bengaluru, Karnataka, India Department: Engineering About CloudSEK CloudSEK is one of India s leading cybersecurity product companies, focused on leveraging Artificial Intelligence and Machine Learning to identify and resolve digital threats in real-time. With a strong portfolio of products like CloudSEK XVigil, BeVigil, and SVigil, we provide advanced solutions for attack surface monitoring, cybersecurity risk management, and software supply chain protection. We are headquartered in Singapore and have expanded rapidly across India, Southeast Asia, and the Americas. At CloudSEK, we prioritize innovation, agility, and building impactful products that keep our customers ahead of emerging cybersecurity threats. About the Role: Azure Infrastructure Architect CloudSEK is looking for an Azure Infrastructure Architect to design, implement, and optimize cloud infrastructure solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure services, infrastructure automation, and security best practices, with a strong background in cloud architecture patterns. You will work closely with various stakeholders to align cloud strategies with business objectives, ensuring high availability, security, and scalability of enterprise applications. Key Responsibilities Cloud Architecture & Design: Design and implement highly scalable, resilient, and secure cloud infrastructure solutions on Microsoft Azure. Develop cloud adoption strategies, migration plans, and hybrid cloud architectures to meet business needs. Create architecture blueprints, reference architectures, and best practices tailored to Azure environments. Ensure compliance with the Azure Well-Architected Framework and other industry standards. Infrastructure & Automation: Architect and automate Infrastructure as Code (IaC) using tools like Terraform, ARM templates, Bicep, and Ansible. Implement CI/CD pipelines for infrastructure deployment using Azure DevOps, GitHub Actions, or Jenkins. Automate cloud operations, monitoring, and governance using Azure Automation, PowerShell, and Python. Security & Compliance: Design and enforce Azure security best practices including Azure Policy, RBAC, NSGs, Key Vault, Defender for Cloud, and Sentinel. Ensure adherence to regulatory frameworks like ISO 27001, SOC 2, GDPR, and HIPAA. Perform threat modeling, risk assessments, and define zero-trust architectures. Networking & Hybrid Cloud: Design and optimize Azure Virtual Networks (VNet), ExpressRoute, VPN Gateway, and Load Balancers for seamless operations. Implement hybrid cloud architectures, integrating on-premises data centers with Azure via Azure Arc. Optimize network performance, DNS, CDN, and traffic routing in cloud-native environments. Performance Optimization & Cost Management: Leverage Azure Cost Management to implement cost-effective cloud solutions and manage reserved instances. Optimize cloud resource utilization using Autoscaling, VM sizing, and Serverless computing models. Define and implement cloud governance policies to control costs and improve operational efficiency. Collaboration & Stakeholder Engagement: Collaborate with DevOps, Security, and Application teams to align infrastructure solutions with business needs. Provide technical leadership and guidance to engineering teams, ensuring alignment with industry trends and best practices. Act as a trusted advisor to leadership on cloud strategies, emerging technologies, and technical decision-making. Required Skills & Qualifications Technical Expertise: Azure Services: Experience with Azure Virtual Machines, Azure Kubernetes Service (AKS), Azure Functions, Azure Storage, Azure SQL, CosmosDB, and Azure Networking (VNet, NSG, VPN, ExpressRoute). Automation & IaC: Expertise in Terraform, ARM Templates, Bicep, Ansible, PowerShell, Python. DevOps & CI/CD: Knowledge of Azure DevOps, GitHub Actions, Jenkins, Kubernetes, Docker. Security & Compliance: Familiarity with Azure Security Center, Azure AD, Key Vault, Microsoft Defender for Cloud, Sentinel, and Zero Trust Model. Networking & Hybrid Cloud: Experience with ExpressRoute, Load Balancers, Private Link, Virtual WAN, Azure Arc. Monitoring & Logging: Proficiency with Azure Monitor, Log Analytics, Prometheus, and Grafana. Cloud Migration: Hands-on experience in cloud migrations using Azure Migrate, including planning and execution. Soft Skills: Strong problem-solving and analytical abilities. Excellent communication and stakeholder management skills. Ability to work in agile environments and across cross-functional teams. A passion for continuous learning and staying updated with the latest Azure technologies. Preferred Qualifications: Azure Certifications such as Azure Solutions Architect Expert (AZ-305), Azure Security Engineer (AZ-500), or Azure DevOps Engineer (AZ-400). Experience with multi-cloud environments (AWS, GCP). Familiarity with database technologies (SQL, NoSQL, PostgreSQL, MySQL). Location Bengaluru, Karnataka, India Education/Qualification Bachelor s degree in Engineering or Technology (B.Tech/BE). Years of Experience 10 to 15 years of professional experience in cloud infrastructure and architecture design. Be part of a fast-growing startup where you can make a direct impact. Competitive salary and a comprehensive benefits package. Access to cutting-edge technologies and continuous learning opportunities. Flexible working hours and a collaborative work culture focused on innovation and growth. If you're an experienced Azure Infrastructure Architect passionate about designing and optimizing cloud solutions with Microsoft Azure, we would love to hear from you! Join CloudSEK and be part of a forward-thinking team revolutionizing the cybersecurity landscape. Qualification : Bachelors degree in Engineering or Technology (B.Tech/BE).

Lead Data Engineer | ThoughtWorks | Bangalore, India Location: Bangalore, India Employment Type: Full-time, Regular Industry: Information Technology About ThoughtWorks At ThoughtWorks, we're a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. For over 30 years, we've worked alongside our clients to deliver solutions that challenge the status status quo. With a diverse and inclusive team, we empower each other to grow through shared learning, fostering an environment where innovation thrives. Our commitment to a cultivation culture is key to our success, and we re looking for a Lead Data Engineer to join our Bangalore team and lead transformative projects. Job Overview As a Lead Data Engineer at ThoughtWorks, you will be responsible for designing, developing, and operating modern data architectures that meet client business objectives. You will lead and manage data engineering projects end-to-end, from strategic planning to hands-on coding, ensuring the delivery of scalable and efficient data solutions. Working with cutting-edge technologies, you ll collaborate with stakeholders, clients, and cross-functional teams to implement data-driven strategies that address complex business challenges. Key Responsibilities Project Leadership: Lead and manage data engineering projects from inception to completion, including goal-setting, scope definition, and ensuring on-time delivery in collaboration with cross-functional teams. Data Architecture & Solution Design: Collaborate with clients to design modern data architecture and implement end-to-end solutions that meet key business objectives. Create intricate data processing pipelines to address complex business problems. Stakeholder Collaboration: Work closely with stakeholders to understand business objectives and identify opportunities to leverage data and data quality improvements. Data Modeling & Governance: Develop data models using modern modeling techniques and implement them using appropriate technologies. Ensure compliance with data governance, security, and privacy requirements. Scalable Implementations: Partner with data scientists to design scalable implementations of their models, ensuring the solutions are robust and efficient. Clean, Iterative Code: Write clean, modular code based on TDD (Test-Driven Development) and implement continuous delivery practices to support and operate data pipelines. Technology Guidance: Advise clients on distributed storage and computing technologies, selecting the best options to fit their business needs. Data Quality Strategy: Define and incorporate data quality strategies into daily work processes to ensure high standards and compliance. Job Qualifications Technical Skills: Proven experience in data engineering and system design, with a focus on building Big Data architecture and data pipelines within distributed systems. Deep knowledge of data modeling and hands-on experience with modern data engineering tools and platforms. Strong programming skills, with expertise in building scalable, high-quality data pipelines using languages like Python, Java, Scala, or others. Experience with distributed storage platforms (e.g., Hadoop, Amazon S3, etc.) and distributed processing platforms (e.g., Spark, Flink). Experience working with SQL, NoSQL, data lakes, and other data storage technologies. Familiarity with data visualization techniques and ability to communicate insights effectively across varying audiences. Professional Skills: Stakeholder Management: Strong ability to liaise between clients and other key stakeholders, ensuring trust and buy-in throughout projects. Adaptability & Resilience: Comfortable handling ambiguity and finding innovative solutions to complex challenges. Leadership & Mentorship: Experienced in coaching and mentoring team members, fostering a culture of professional growth and accountability. Risk & Conflict Management: Skilled in managing risks and resolving conflicts, driving projects forward despite challenges. Relationship Building: Natural at cultivating strong relationships with clients, stakeholders, and internal teams to create new opportunities. What You Bring to the Team Leadership: A proven track record in leading high-performance teams and supporting colleagues in their professional development. Curiosity & Innovation: A passion for data and technology and a willingness to continually learn and push the boundaries of what's possible. Collaboration: Ability to work closely with cross-functional teams and stakeholders to design and implement innovative data solutions. At ThoughtWorks, we believe in giving you the autonomy to carve out your unique career path, while providing support through development programs and a vibrant culture of learning. You ll work on exciting projects with a diverse team, solve complex challenges, and make an impact at a global scale. Join ThoughtWorks and be part of a global community of innovators. Together, we turn curiosity into action and creativity into impactful solutions.

Azure Data Engineer IBM Consulting Client Innovation Center Location: Bengaluru, India Experience: 7+ Years (Minimum 4+ Years in Azure Technologies) Job Type: Full-Time Education Required: Bachelor s Degree (Master s preferred) Introduction: Join IBM Consulting at our Client Innovation Center in Bengaluru, where we deliver deep technical and industry expertise to a wide range of public and private sector clients. Our delivery centers focus on innovation, agility, and adoption of next-gen technologies to transform businesses locally and globally. Your Role & Responsibilities: Design and develop scalable data engineering solutions on Microsoft Azure. Build, optimize, and manage data pipelines and ETL workflows using tools like Azure Data Factory, ADLS, and Databricks. Write clean, efficient code using PySpark, PL/SQL, and Spark SQL. Integrate and manage data from various sources, both structured and unstructured. Work with SQL, Postgres, Cassandra, and Cosmos DB. Utilize Azure services such as Stream Analytics, SQL DW, Azure Functions, ARM Templates, and Analysis Services. Implement and maintain serverless architectures for modern data solutions. Ensure high-quality data delivery, security, and compliance across systems. Collaborate across teams and contribute to solution design, code reviews, and documentation. Required Skills & Experience: Bachelor s degree in Computer Science, Information Systems, or related technical field. 7+ years total experience in Data Engineering, with 4+ years in Azure-based data projects. Strong hands-on experience with: Azure Data Factory, Data Lake (ADLS), Databricks Programming: Python, PySpark, PL/SQL, Spark SQL Databases: SQL, Postgres, Cassandra, Cosmos DB Solid grasp of data warehousing, relational databases, and cloud-based architectures. Familiarity with version control tools like Git and CI/CD pipelines. Preferred Skills & Qualifications: Master s Degree in a relevant field. Experience with: ARM Templates, Azure Functions, Serverless Architectures Object-oriented scripting languages (Python, Scala, etc.) Excellent problem-solving and communication skills. Ability to work in a fast-paced environment and collaborate effectively with teams and stakeholders. What You ll Get: Work on high-impact, global projects with cutting-edge Azure technologies. Be part of a collaborative and forward-thinking IBM team. Opportunities for professional growth, upskilling, and certifications. A dynamic work culture focused on innovation, agility, and client success. Join us in Bengaluru and be part of IBM s journey in shaping the future of data engineering. Qualification : Bachelors degree in Computer Science, Information Systems, or related technical field.

Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.

Join Us in Revolutionizing the Data Storage Industry We're leading an exciting transformation in the data storage industry. By joining us, you will have the opportunity to make a significant impact, grow alongside a brilliant team, and be at the forefront of cutting-edge technology. If you re passionate about reshaping the future of tech, this is your chance to leave your mark. The Challenge: As a DevOps Engineer, you will be responsible for managing, automating, and optimizing our VMware, cloud, and on-prem Kubernetes infrastructure. Your role will be critical in ensuring the high availability, performance, and scalability of our services. You will work closely with cross-functional teams to architect solutions that improve our engineering operations and align with business needs. Key Responsibilities: Infrastructure Design & Management: Design, deploy, and maintain scalable VMware, Cloud (AWS, GCP, Azure, IBM), and Kubernetes environments. Custom Solutions Development: Develop and implement tailored OpenStack/VMware/Kubernetes solutions based on organizational needs. Automation & CI/CD: Build automation tools and frameworks (CI/CD pipelines) to streamline infrastructure operations and manage workloads (VMs/Pods) lifecycles. Observability & Best Practices: Implement observability best practices for OpenStack/VMware/Kubernetes environments, ensuring reliability and performance. Continuous Improvement: Provide expertise in DevOps methodologies to support continuous improvement and optimize infrastructure efficiency. Troubleshooting & Support: Assist with deployment, configuration, troubleshooting, and provide infrastructure support for AWS/Azure environments. Documentation & Knowledge Sharing: Create and maintain documentation for OpenStack/VMware/Kubernetes architecture and stay current with emerging technologies and industry best practices. On-Call Support: Participate in the follow-the-sun on-call rotation for infrastructure support. What You ll Need to Bring: Education: Bachelor s degree in Computer Science, Information Technology, or a related field. Experience: 5+ years of experience managing and automating large-scale VMware, OpenStack, or Kubernetes environments. Programming Skills: Proficiency in Python, Java, or Go for scripting and automation. DevOps Knowledge: Strong understanding of DevOps principles with hands-on experience using tools like Ansible, Terraform, or Puppet. Observability Expertise: Experience implementing observability solutions with tools like Prometheus, Grafana, Logstash, Elastic, Fluent-bit, or Fluentd. Linux & Networking: Familiarity with Linux, TCP/IP, DNS, DHCP, and related networking concepts. OpenStack/Vmware/Kubernetes: Proven experience working with OpenStack (e.g., OpenStack Yoga), VMware, or Kubernetes (particularly enterprise Kubernetes clusters on bare metal). Virtualization & Containerization: Expertise in virtualization technologies (KVM, VMware, KubeVirt) and container technologies (Docker, Kubernetes). Cloud Experience: Experience with infrastructure support and automation for AWS, Azure, or GCP. Problem-Solving Skills: Excellent troubleshooting abilities with great attention to detail. Communication & Collaboration: Strong interpersonal skills and the ability to collaborate across teams. Preferred Qualifications: Experience with PureStorage products such as FlashArray, FlashBlade, or Portworx. Certifications in Kubernetes (CKA, CKAD), VMware (VCP), or OpenStack (COA). Experience running production VMs in KubeVirt. Familiarity with agile environments and project management tools. What You Can Expect from Us: Pure Innovation: We celebrate critical thinkers, challenges, and trailblazers who strive to innovate. Pure Growth: We support your growth and provide the space for you to contribute meaningfully. We're proud to be named in Fortune's Best Workplaces and certified as a Great Place to Work. Pure Team: We focus on collaboration and teamwork, setting aside ego for the greater good. Qualification : Bachelors degree in Computer Science, Information Technology, or related field.

Job/Position Summary: Data Engineer Responsibilities: Implement data pipelines that meet design and are efficient, scalable, and maintainable. Implement best practices including proper use of source control, participation in code reviews, data validation and testing. Timely deliveries while working on projects. Act as advisor/mentor and helps junior data engineers in their deliverables. Must Have Skills: Should have experience of at least 4+ years with Data Engineering. Strong experience of design, implementation and fine-tuning big data processing pipelines in production environment. Experience with big tools like Hadoop, Spark, Kafka, Hive, Databricks. Experience in programming at least one of with Python, Java, Scala, Shell Script. Experience with relational SQL and NO SQL databases like PostgresSQL, MYSQL, Cassandra etc. Experience with any data visualization tool (Plotly, Tableau, Power BI, Google Data Studio, Quick sight etc.). Good To Have Skills: Should have Basic Knowledge of CI/CD Pipeline. Experience in working on at least one Cloud (AWS or Azure or GCP). For AWS: - Experience with AWS Cloud services like EC2, S3, EMR, RDS, Athena, Glue, Lambda, EMR. For Azure: -Experience with Azure Cloud services like Azure Blob/Data Lake GEN2, Delta Lake, Databricks, Azure SQL, Azure DevOps, Azure Data Factory, Power BI. For GCP: - Experience with GCP Cloud services Big Query, Cloud Storage bucket, DataProc, Dataflow, Pub Sub, Cloud Function, Data Studio. Sound familiarity in Versioning tools (Git, SVN etc.). Experience Mentoring students is desirable. Knowledge of latest developments in Machine Learning, Deep Learning, Optimization in Automotive domain. Open minded approach to explore multiple algorithms to design optimal solution. History of contribution to articles/blogs/whitepapers etc. in Analytics. History of contribution to Open Source. Requirement: ESSENTIAL SKILLS /COMPETENCIES Data Engineering Hadoop Kafka CI/CD Cloud

Your Impact As a Data Engineer at QuantumBlack, you will collaborate with stakeholders, data scientists, and internal teams to develop and implement impactful data products and solutions. Your key responsibilities will include building and maintaining technical platforms for advanced analytics, designing scalable and reproducible data pipelines for machine learning, and ensuring information security within data environments. You will assess clients' data quality, map data fields to hypotheses, and prepare data for use in analytics models. Additionally, you will contribute to R&D projects, internal asset development, and participate in cross-functional problem-solving sessions with a variety of stakeholders, including C-level executives, to create innovative analytics solutions. You will be based in Gurugram, joining a global data engineering community, and work within cross-functional and Agile project teams alongside project managers, data scientists, machine learning engineers, other data engineers, and industry experts. You will collaborate directly with our clients, ranging from data owners and users to C-level executives. You will be aligned with one of our industry-focused practices: Pharma & Medical Products (PMP) or Global Energy & Materials (GEM). In these practices, you ll work on solving the most critical challenges for our clients in these sectors. PMP focuses on advancing the development and delivery of life-saving medicines and medical treatments, while GEM supports industries like chemicals, steel, mining, and energy to achieve operational excellence. GEMx and PMPx, the assetization arm of these practices, focus on creating reusable digital and analytics assets to support client work. As part of this team, you will help shape impactful solutions for large organizations, developing capabilities for sustained impact. Your Growth In this role, you will contribute to the frameworks and libraries that our teams of Data Scientists and Engineers use to progress from data to meaningful impact. You will have the opportunity to guide global companies through data science solutions, helping them transform and enhance performance across industries including healthcare, automotive, energy, and elite sports. Real-World Impact: You ll gain unique learning and development opportunities globally. Fusing Tech & Leadership: Work with the latest technologies and methodologies, with access to top-tier learning programs. Multidisciplinary Teamwork: Collaborate with data scientists, engineers, project managers, UX designers, and more to enhance performance. Innovative Work Culture: Creativity, passion, and wellness are central to our modern work environment, which includes insightful talks, training sessions, and a focus on work-life balance. Striving for Diversity: We celebrate diversity, with colleagues from over 40 nationalities, appreciating the value that diverse perspectives bring to the workplace. You are a highly collaborative individual who prioritizes impact over agenda. You enjoy learning from colleagues, challenging ideas thoughtfully, and working together to improve processes and solve problems. You believe in iterative change, experimenting with new approaches, and advancing quickly through constant learning and improvement. While we value using the right tech for the right task, our team often leverages technologies such as Python, PySpark, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions like AWS, GCP, and Azure. Your Role as a Data Engineer Collaboration: Work with business stakeholders, data scientists, and internal teams to create extraordinary, domain-focused data products (reusable assets) and deliver them to clients. Domain Expertise: Develop deep understanding of client industries and use creative techniques to deliver meaningful impact. Technical Platforms: Build and maintain technical platforms for advanced analytics engagements, spanning both data science and data engineering work. Data Pipelines: Design and implement robust, modular, scalable, deployable, and reproducible data pipelines for machine learning. Data Management: Ensure the security of data environments and compliance with information security standards. Data Wrangling: Assess data quality, map data fields to hypotheses, and prepare data for analytics models. Contribute to R&D: Participate in internal asset development and contribute to R&D projects to drive innovation. Cross-functional Problem Solving: Collaborate with internal teams and clients, including data owners and C-level executives, to create impactful analytics solutions. Your Qualifications and Skills Bachelor s degree in computer science or related field; Master's degree is a plus. 2-5 years of relevant work experience. Proficiency in at least one programming language such as Python, Scala, or Java. Strong experience with distributed processing frameworks (e.g., Spark, Hadoop, EMR) and SQL. Experience in commercial client-facing projects, particularly in close-knit teams. Ability to work with structured, semi-structured, and unstructured data, and identify linkages across disparate data sets. Clear communication skills to explain complex solutions effectively. Understanding of information security principles to ensure compliant handling of client data. Experience with cloud platforms (AWS, Azure, Google Cloud, Databricks) is highly desirable. Experience with CI/CD processes using GitHub Actions, CircleCI, or similar, and end-to-end pipeline development including application deployment is a plus. Qualification : Bachelors degree in computer science or related field; Master's degree is a plus.

Job Title: Senior Cloud Data Engineer Experience: 10+ Years Location: Bengaluru About Capgemini Invent: Capgemini Invent is the digital innovation, consulting, and transformation brand of the Capgemini Group. It brings together leading expertise in strategy, technology, data science, and creative design to help CxOs reimagine their businesses. We are a global business line dedicated to helping organizations envision and build what s next. Your Role: As a Senior Cloud Data Engineer at Capgemini Invent, you will design, develop, and maintain scalable data pipelines using advanced cloud technologies to ensure smooth data integration and efficient workflows. You will collaborate with cross-functional teams to deliver robust and optimized data solutions while ensuring compliance and security throughout the process. Key Responsibilities: Design, develop, and maintain scalable data pipelines using AWS services. Optimize data storage and retrieval processes to ensure efficiency and accessibility. Ensure data security and compliance with industry standards, including data privacy laws. Manage large volumes of data, focusing on accuracy, integrity, and secure accessibility. Develop and refine data processes for data modeling, mining, and production. Implement quality checks, data validation, and monitoring of data flows. Collaborate with data scientists, analysts, and IT teams to meet data requirements. Work closely with data architects and modelers on project objectives and solutions. Troubleshoot and resolve issues in data pipelines, ensuring performance tuning and optimization. Develop and implement disaster recovery procedures to safeguard data. Ensure seamless integration of HR and other business data into cloud-based environments. Research new opportunities for data acquisition and discover additional uses for existing data. Stay up-to-date with the latest cloud technologies, data management practices, and trends, including Generative AI. Recommend and implement improvements to enhance data reliability, efficiency, and quality. Your Profile: 10+ years of experience in cloud data engineering. Proficiency with cloud platforms such as AWS, Azure, or Google Cloud. Experience with data pipeline tools like Apache Spark, AWS Glue, or similar technologies. Strong programming skills in Python, SQL, Java, or Scala. Familiarity with Snowflake, Informatica, or similar tools is an advantage. In-depth knowledge of data privacy laws, security best practices, and data governance. Expertise in analyzing and interpreting complex datasets to derive actionable insights. Strong communication, collaboration, and problem-solving skills. Knowledge of database technologies, including SQL, Big Data, and Cloud-based systems. Passion for learning and keeping up with emerging technologies, particularly in Generative AI. Experience working in an Agile framework and managing multiple projects simultaneously. Ability to adapt to evolving priorities and business needs. What You Will Love About Working Here: Flexibility: Enjoy flexible work arrangements such as remote work or flexible hours, ensuring a healthy work-life balance. Career Growth: We offer numerous opportunities for career advancement and personal development, helping you explore diverse paths and expand your skills. Certifications & Learning: Gain valuable certifications in cutting-edge technologies, including Generative AI, to stay ahead of the curve. About Capgemini: Capgemini is a global business and technology transformation partner that helps organizations accelerate their dual transition to a digital and sustainable world. With a team of 340,000 professionals in over 50 countries, we are dedicated to making a tangible impact on enterprises and society. Trusted by clients for over 55 years, Capgemini uses its deep industry expertise and cutting-edge technologies such as AI, cloud, and data to unlock the full potential of businesses worldwide. In 2023, the group reported global revenues of 22.5 billion.