Cloud Data Storage Jobs in Bengaluru
809 Jobs Found
Lead Software Engineer - Scale & Performance
Team Vunet Systems
Lead Software Engineer - Scale & Performance Location: Bengaluru Experience: 6 12 years About VuNet VuNet is a pioneer in Business Journey Observability, using Big Data and Machine Learning to revolutionize digital experiences in the financial services industry. Our platform delivers end-to-end visibility into customer journeys, helping organizations proactively resolve issues, ensure operational resilience, and deliver superior user satisfaction. With over 28 billion digital transactions monitored every month and serving more than 300 million users globally, VuNet is shaping the future of observability for some of the largest banks and financial institutions. We are Series B funded, part of NASSCOM s DeepTech Club, and recognized by global analysts such as Gartner and Omdia. Your Role: Lead Software Engineer - Scale & Performance As a Lead Software Engineer for Scale & Performance, you ll own the performance and scalability benchmarks for VuNet s observability platform. You will work with cutting-edge technologies, design robust test frameworks, and ensure that our platform scales seamlessly to meet the demands of millions of users. Roles & Responsibilities Own performance and scalability benchmarking for key platform components (ingestion pipelines, data storage, and query services). Design and execute load, stress, soak, and capacity tests across microservices, agents, and ingestion layers. Identify and resolve performance bottlenecks in both infrastructure (CPU/memory/IO) and application layers (API latency, throughput, GC behavior). Develop and maintain performance test frameworks, preferably using Kubernetes-based environments. Collaborate with DevOps and SRE teams to optimize system configurations (Kubernetes, Postgres/TimescaleDB, ClickHouse, Kafka) for scale. Implement OpenTelemetry for service instrumentation to monitor system health and latency (p50/p95/p99 metrics). Contribute to capacity planning, scaling strategies (horizontal/vertical), and resource optimization. Analyze production incidents related to scaling issues and drive permanent fixes. Work with engineering teams to design scalable architecture patterns and define SLIs/SLOs for system performance. Document performance baselines, tuning guides, and scalability best practices for internal use. What You Bring Mandatory Skills: Strong background in performance engineering for large-scale distributed systems or SaaS platforms. Expertise in Kubernetes, container runtimes (containerd/Docker), and resource profiling in containerized environments. Solid understanding of Linux internals, CPU/memory profiling, and network stack tuning. Hands-on experience with observability tools (Prometheus, Grafana, OpenTelemetry, Jaeger, Loki, Tempo, etc.). Familiarity with observability platform datastores like ClickHouse, PostgreSQL/TimescaleDB, Elasticsearch, or Cassandra. Experience with performance benchmarking tools such as k6, Locust, JMeter, or custom Golang/Python scripts. Ability to interpret system metrics (CPU usage, memory, GC, latency) and correlate across different layers. Nice-to-Have Skills: Experience with agent benchmarking (OpenTelemetry Collector, custom data shippers). Exposure to streaming systems like Kafka, NATS, or Pulsar. Familiarity with CI/CD pipelines for performance testing and regression tracking. Knowledge of cost optimization and capacity forecasting in cloud environments (AWS/GCP/Azure). Proficiency in Go, Python, or Bash scripting for automation and data analysis. Life at VuNet: At VuNet, we're building a world-class observability platform, and we re just getting started. You ll be part of a passionate, problem-solving team that embraces collaboration, fast learning, and staying ahead of emerging technologies like Gen AI. We foster a high-trust, inclusive culture where collaboration, ownership, and innovation are central to our success. If you're looking to work on cutting-edge tech, make a real impact, and grow with a supportive team you ll fit right in at VuNet. Benefits: Comprehensive health insurance coverage for you, your parents, and dependents. Mental wellness and 1:1 counseling support. A culture that promotes continuous learning, innovation, and career growth. Transparent, inclusive, and high-trust workplace. Opportunities for skill enhancement with training programs focused on new Gen AI technologies.
Technical Support Engineer - L2
Blueoptima
Position: Technical Support Engineer - L2 Job Type: Full-Time Location: Bangalore Department: Technical Support About BlueOptima: At BlueOptima, our mission is to be the global leader in optimizing the performance of software engineers across all industries. Through our cutting-edge metrics in software development, we empower large organizations to build better software, faster and at lower costs. Our innovative technology pushes the boundaries of what s possible, making a real difference in software delivery. With a global presence including offices in London, India, Mexico, the US, and Japan we are a diverse team of 120 people from over 20 countries. We foster a collaborative, open-minded environment where every individual can create their own success story in a high-performance setting. Job Description: As a Technical Support Engineer - L2, you will play a critical role as the senior technical leader between customer-facing teams, Product Management, and Engineering. You will provide deep technical expertise, troubleshooting complex issues, contributing to product development, and ensuring the smooth success of customer engagements. This role is highly dynamic and involves working closely with multiple teams, managing escalated support cases, coordinating new features and fixes, and creating internal best practices. Key Responsibilities: Customer Success Support: Act as a technical lead for pre-sales, deployment, and support teams. Troubleshoot escalated support issues, replicate environments, and collaborate with engineering to resolve problems quickly and efficiently. Product Feedback & Roadmap Alignment: Actively participate in "road-testing" pre-release software, providing crucial feedback to Product Management, and helping ensure customer requirements are aligned with the product roadmap. Technical Exploration & Research: Lead deep technical investigations, such as benchmarking custom use cases, and prototype new features to improve the overall customer experience. Enablement & Knowledge Sharing: Contribute to internal documentation, including product capabilities and best practices, and deliver regular training sessions to technical teams to promote continuous learning. Qualifications: Core Technical Skills: Advanced Systems Administration: Expertise in Linux and Windows, including performance tuning, kernel parameters, and filesystem management. Scripting Skills: Strong proficiency in Bash, Python, or similar languages to automate complex tasks and gather detailed debugging data. Enterprise Storage: Experience with SAN, NAS, and related enterprise storage technologies and architectures. Disaster Recovery: Hands-on experience with data copy, replication, and disaster recovery solutions. Cloud Storage: Experience working with Cloud Object Stores like AWS S3, Azure, or Google Cloud. Virtualization & Containerization: Knowledge of Docker, IaaS, and PaaS technologies. Additional Technical Skills: In-depth knowledge of version control systems (Git, Subversion). Familiarity with security concepts (Kerberos, SSL/TLS, LDAP). Advanced networking knowledge, including packet tracing and tuning. Understanding of Java concepts and integrations. Experience & Education: 10-15 years of experience in IT, with a focus on Linux-based systems and enterprise environments. Bachelor s degree in Computer Science or a related field. Soft Skills: Communication: Ability to explain complex technical concepts to both technical and non-technical audiences. Problem-Solving: Strong methodical troubleshooting skills and the ability to think critically in high-pressure situations. Customer-Facing Experience: Previous experience in customer-facing roles, with the ability to manage expectations and deliver results. Calm Under Pressure: A composed, professional demeanor even in high-stakes situations. Continuous Learning: Enthusiasm and curiosity to stay ahead of new technologies and industry trends. At BlueOptima, you ll be part of a pioneering company with a mission to transform the way software performance is optimized. We value innovation, collaboration, and individual growth, offering a dynamic and high-performance environment where your contributions truly make an impact. If you re looking to advance your career while working with cutting-edge technology, BlueOptima is the place to be. Qualification : Bachelors degree in Computer Science or a related field
Manager - Data Analytics, Credit Card Portfolios
Zeta
Job Title: Manager - Data Analytics, Credit Card Portfolios Location: Bangalore Employment Type: Full-time About Zeta: Zeta is a next-gen banking technology company empowering banks and fintechs to build the future of financial products. Founded in 2015 by Bhavin Turakhia and Ramki Gaddipati, Zeta s flagship platform Zeta Tachyon is a cloud-native, fully API-enabled banking stack powering issuance, processing, lending, core banking, fraud & risk, and more. Over 20 million cards have been issued globally through our platform. With 1,700+ employees across the US, EMEA, and Asia and 70%+ in R&D, Zeta is backed by SoftBank, Mastercard, and others, having raised $330M at a $2B valuation in 2025. We work with leading banks and fintechs worldwide to transform multi-million card portfolios. Role Overview: We are looking for a strategic and experienced Manager - Data Analytics to lead business intelligence and enterprise reporting for global fintech portfolios including Credit Cards, Deposits, and other financial products. This role involves managing a team of analysts, leveraging multiple data lakes and warehouses, and building a scalable, comprehensive reporting framework for diverse markets including the US, UK, and India. Key Responsibilities: Enterprise Reporting & Data Architecture: Design and maintain end-to-end reporting across the customer lifecycle: acquisition, activation, usage, delinquency, collections, retention, operations, and support. Deliver accurate analysis of key financial KPIs: revenue, profitability, credit risk, defaults, acquisition cost. Build dashboards, self-service BI tools, and automated pipelines using Apache Superset, Metabase, Tableau. Optimize data storage and reporting for scalability and cost-efficiency. Data Integration & Analytics Execution: Collaborate with vendors and internal engineering to integrate data from credit bureaus, open banking, core banking, card and payment processors, loan origination, CCaaS, and aggregators into a centralized Data Lake. Business Intelligence & Growth: Lead analytics projects to uncover user behavior, optimize acquisition channels, underwriting, and portfolio performance via segmentation, cohort, and funnel analyses. Partner with Product and Marketing teams to evaluate experiments (A/B testing) and guide roadmap decisions. Leadership: Build, mentor, and lead a high-performing team of BI analysts and data visualization experts. Data Governance: Establish and enforce data governance best practices, ensuring compliance and data security. Skills & Experience: Expert in BI tools such as Apache Superset, Metabase, Tableau; strong SQL skills. Familiarity with cloud data platforms like Snowflake, Redshift, BigQuery. Deep knowledge of credit and fintech KPIs: acquisition, credit decisioning, delinquency, repayment, charge-offs, profitability, RoA, CLTV, etc. Proven leadership experience managing analytics teams and scaling reporting infrastructures. Excellent communication skills with the ability to translate complex data into business strategies. Knowledge of data governance, privacy, and security in financial services. Qualifications: 10+ years in Business Intelligence/Analytics with 3+ years in the credit card industry. 3+ years managing teams of analysts or data professionals. Bachelor s degree in Computer Science, Engineering, Statistics, or a related field. Equal Opportunity: Zeta celebrates diversity and is an equal opportunity employer. We are committed to fostering an inclusive environment and encourage candidates from all backgrounds to apply. Qualification : Bachelors degree in Computer Science, Engineering, Statistics, or a related field
Snowflake Data Engineer
Growtharc Technologies
Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.
Enterprise Infra Automation Architect
Infosys
Job Title: Enterprise Infrastructure Automation Architect Location: Bengaluru, India Experience: 16 20 Years Service Line: Cloud & Infrastructure Services Educational Qualifications: B.E., B.Tech, M.Tech, BCA, MCA, MBA Role Overview: We are looking for a seasoned Enterprise Infrastructure Automation Architect to lead the design and implementation of automation strategies across our global IT infrastructure. This role is pivotal in driving enterprise-wide automation initiatives, streamlining operations, and enabling digital transformation through scalable and secure infrastructure automation solutions. Key Responsibilities: Infrastructure Automation Strategy & Roadmap Define and maintain the enterprise automation strategy aligned with organizational goals and IT objectives. Identify automation opportunities across compute, storage, network, virtualization, cloud, and data center domains. Establish automation goals, KPIs, and success metrics for continuous improvement. Evaluate and recommend emerging automation technologies and frameworks. Solution Design & Architecture Design scalable, secure, and maintainable automation architectures for enterprise infrastructure. Define enterprise-wide automation standards and best practices (e.g., IaC, scripting, orchestration). Select and standardize tools such as Ansible, Terraform, Python, PowerShell, and cloud-native automation services. Build reusable automation frameworks, templates, and modules to ensure consistency. Implementation & Governance Provide architectural oversight and support during implementation and deployment phases. Ensure compliance with automation standards and governance throughout the lifecycle. Participate in project reviews to ensure strategic alignment with enterprise automation goals. Establish governance processes for managing scripts, workflows, and infrastructure-as-code artifacts. Additional Responsibilities: Proven experience in IT Service Management and remote delivery automation environments. Ability to articulate the business value and operational impact of automation initiatives. Self-motivated, creative thinker with excellent problem-solving abilities. Excellent communication skills, both verbal and written. Technical & Professional Requirements: In-depth knowledge of enterprise architecture frameworks (e.g., TOGAF, Zachman). Expertise in infrastructure domains including compute, storage, middleware, backup (on-prem & cloud). Experience with public cloud platforms (AWS, Azure, GCP) and hybrid cloud architectures. Proficiency in security standards and best practices across global IT environments. Hands-on experience with monitoring and orchestration tools. Skilled in creating architecture diagrams and workflow visualizations using tools like MS Visio, Lucidchart, etc.
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Customer Experience Manager Ii
Rubrik
Customer Experience Manager II (EST Shift Bangalore, India) Location: Bangalore, India Work Shift: EST (5:30 PM IST 2:30 AM IST) Job Type: Full-Time | Customer Support | Cloud Technology Job Overview We are looking for a highly motivated and experienced Customer Experience Manager II to join our dynamic Customer Support team. In this role, you will be responsible for managing strategic enterprise accounts, ensuring superior customer satisfaction, and driving proactive customer success strategies. You will serve as the primary point of contact (POC) for customer escalations, technical issues, and account health, while ensuring Rubrik delivers a world-class customer experience in the cloud data management space. Key Responsibilities Build strong relationships with key customer stakeholders and deliver a seamless support experience. Act as the escalation owner and trusted advisor for complex technical and service-related issues. Train customers on how to engage with Rubrik s support portal, submit tickets, and track issues effectively. Utilize Salesforce CRM to monitor account health and detect patterns that may lead to service disruptions. Proactively identify risks and initiate actions to drive customer retention and account stability. Collaborate with cross-functional teams including Engineering, Technical Support, and Sales Engineering. Create and deliver Root Cause Analysis (RCA) documentation and customer-facing status updates. Work closely with internal teams to ensure timely issue resolution and a proactive support approach. Lead project management activities during critical incidents and escalations. Deliver weekly performance and progress reports to internal stakeholders and customer teams. Qualifications and Skills Minimum 8 years of experience in customer experience management, technical support leadership, or enterprise account management roles. Proficiency with CRM platforms, especially Salesforce. Strong communication skills with the ability to deliver clear written documentation and customer updates. Hands-on technical knowledge in: Networking protocols Data storage systems Backup and disaster recovery solutions Cloud platforms (e.g., AWS S3, Microsoft Azure) Hypervisors (VMware, Hyper-V) Experience managing virtual cross-functional teams in a high-pressure environment. Proven ability to handle customer escalations and implement preventive measures. Familiarity with storage vendor ecosystems and best practices in enterprise IT environments. Bachelor s degree in Computer Science, IT, Business, or related field (Advanced degree is a plus). Willingness to travel for client engagements and team collaboration as needed. Preferred Competencies Background in cloud computing, SaaS support, or data protection technologies. Certifications in project management or cloud platforms (e.g., AWS, Azure). Ability to lead with a customer-first mindset and ensure customer loyalty through proactive engagement. Join Rubrik and be part of a company at the forefront of cloud data security, backup solutions, and customer-centric innovation. You ll work with leading technologies, support high-value enterprise clients, and help shape the future of data management in the cloud.
Competitive Technical Research Analyst
Rubrik
Competitive Technical Research Analyst Location: Bangalore, India Job Summary Rubrik is seeking a Competitive Technical Research Analyst to empower our sales teams with strategic competitive intelligence. You will be instrumental in maintaining internal collateral, developing battle cards, presentations, and delivering impactful sales training that highlights Rubrik s strengths against competitors. You will collaborate closely with sales, product marketing, and product management teams to provide up-to-date market insights and help Rubrik stay ahead in the data protection and cybersecurity space. Key Responsibilities Collaborate with Sales Enablement to develop sales tools such as cheat sheets, presentations, and training materials. Work alongside Field Enablement and Field Success teams to integrate competitive strategies into sales plays. Develop defensible, data-backed competitive analyses showcasing Rubrik s advantages over competitors. Provide quarterly competitive landscape reports through detailed data analysis and feedback. Deliver day-zero competitive intelligence support on new Rubrik product features and competitive feature sets. Produce in-depth documentation comparing Rubrik solutions with competing products for internal teams. Partner with Product Management and Marketing to create collateral supporting demand generation efforts. Required Qualifications 5+ years in a sales engineer, solution architect, or quota-carrying role within a field sales team. Experience with data protection solutions such as Cohesity DataProtect, Veeam Backup & Recovery, Dell EMC IDPA/DataProtect, Veritas NetBackup, or Commvault. Familiarity with protecting unstructured data from On-Prem NAS and Cloud Object Storage. Experience crafting technical presentations for sales and customer education. Solid understanding of cloud computing architectures and SaaS application protection focused on cyber resilience. Strong knowledge of customer pain points around data protection and cyber resilience. Excellent collaboration skills to drive projects across teams. Ability to analyze competitor products, strategies, and messaging effectively. Skill in translating technical features into compelling business value propositions. High energy and a speed of sales mindset to act with urgency and curiosity. Rubrik (NYSE: RBRK) is on a mission to secure the world s data. With Zero Trust Data Security , we help organizations build resilience against cyberattacks, insider threats, and operational disruptions. Our Security Cloud, powered by machine learning, protects data across enterprise, cloud, and SaaS applications ensuring data integrity, availability, and rapid recovery.
Genai Engineer
Rubrik
GenAI Engineer Location: Bangalore, India About the Team Rubrik s IT team is at the forefront of AI-powered transformation, focused on building intelligent automation and scalable data solutions to support the company s mission. As part of the newly established IT AI team, you ll help develop AI agents and workflows to unlock the full potential of generative AI in data engineering. About the Role We re seeking a GenAI Engineer to join our Data Engineering team, specializing in the development and deployment of AI agents and workflows powered by large language models (LLMs). You ll be responsible for integrating data sources, developing MCP clients/servers, and collaborating with cross-functional teams to drive GenAI adoption across the organization. Key Responsibilities Design and implement data integrations using MCP protocols or traditional data extraction methods Build scalable data pipelines for GenAI model training and deployment using tools like Snowflake Cortex, Gemini Agentspace, and Databricks LLM (Mosaic AI, RAG, Model Serving) Ensure high standards of data quality, integrity, and scalability for both structured and unstructured AI workloads Collaborate with business, data engineering, and application development teams to create AI-enabled products Integrate pipelines into existing infrastructure for seamless data flow and analytics Support high-quality data products tailored for AI and machine learning workflows Required Experience 1+ years building AI Agents or working with platforms like Snowflake Cortex, Gemini Agentspace, or similar open-source frameworks 3+ years in data engineering with a focus on AI/ML workloads 5+ years in data analytics using Snowflake or Databricks Strong programming skills in Python, Java, or Scala Familiarity with data storage, APIs, and cloud configurations Experience with data governance and scalable system design Solid understanding of LLMs, transformers, and frameworks such as LangChain Strong analytical and problem-solving skills in a dynamic environment Preferred Qualifications Proven experience building AI Agents and agentic workflows Understanding of MCP and Agent2Agent protocols Knowledge of generative model architectures and applications in data engineering Familiarity with data security and governance best practices in GenAI Experience with Agile methodologies and tools such as Jira and GitHub Join Us in Securing the World s Data Rubrik (NYSE: RBRK) is committed to delivering Zero Trust Data Security. Our ML-powered platform protects data across enterprise, cloud, and SaaS applications, helping organizations stay resilient against cyberattacks and disruptions.
GenAI Engineer
Rubrik
GenAI Engineer Location: Bangalore, India Office About the Team Rubrik's IT team is driving AI-powered transformation to enable smarter automation and scalable data solutions that protect and empower the company's mission. As part of the newly formed IT AI team, you'll be instrumental in developing AI agents and workflows to unlock the potential of generative AI in data engineering. About the Role We are seeking an experienced GenAI Engineer to join our Data Engineering team, focusing on building and deploying AI agents and workflows powered by large language models (LLMs). You will integrate data sources and develop MCP clients/servers to support LLM-based bots, collaborating closely with data scientists, engineers, and business teams to enhance GenAI adoption and deliver advanced data solutions. Key Responsibilities Design and develop data integrations using MCP protocols or traditional extraction methods. Build scalable data pipelines for GenAI model training and deployment using tools like Snowflake Cortex, Gemini Agentspace, and Databricks LLM (Mosaic AI, RAG, Model Serving). Ensure data quality, integrity, and scalability for AI workloads involving both structured and unstructured data. Collaborate with business teams, data engineers, and application developers to create products that streamline processes and drive growth. Integrate data pipelines with existing infrastructure to enable seamless data flow and analytics. Support the data engineering team in producing high-quality data products for AI workloads. Experience You'll Need 1+ year of experience building AI agents or using Snowflake Cortex, Gemini Agentspace, or similar open-source tools. 3+ years of experience in data engineering focused on AI/ML workloads. 5+ years of experience in data analytics with Snowflake or Databricks platforms. Strong programming skills in Python, Java, or Scala. Familiarity with data storage solutions (Snowflake, Databricks) and APIs. Experience with cloud configuration and data governance. Knowledge of large language models (transformers) and frameworks like LangChain. Strong problem-solving skills and ability to thrive in a fast-paced environment. Preferred Qualifications Experience building AI agents and agentic workflows. Knowledge of MCP and Agent2Agent protocols. Understanding of generative models and their applications in data engineering. Familiarity with data governance and security best practices for GenAI workloads. Experience with Agile methodologies and collaboration tools like Jira and GitHub. Join Us in Securing the World's Data Rubrik (NYSE: RBRK) is dedicated to securing the world's data with Zero Trust Data Security.Our platform, powered by machine learning, protects data across enterprise, cloud, and SaaS applications, helping businesses stay resilient against cyberattacks and operational disruptions.
Principal Engineer, Google Cloud VMware Engine
Google Careers
Principal Engineer, Google Cloud VMware Engine Google - Bengaluru, Karnataka, India Join Google Cloud in Bengaluru, Karnataka, India and play a pivotal role in the Google Cloud VMware Engine (GCVE) team! Our mission is to empower customers to seamlessly move their VMware-based applications to Google Cloud without altering their existing apps, tools, or processes. As a Principal Engineer, you will spearhead the technical strategy for GCVE, driving the development of highly performant and scalable infrastructure with fully redundant and dedicated networking. You will ensure the availability necessary for demanding enterprise workloads and pioneer innovative solutions to dramatically reduce cloud migration timelines. In this critical role, you will lead the execution and delivery of the overall GCVE Systems Design. This includes influencing compute server design, platform architecture, network fabric, large cluster level Service Level Objectives (SLOs), reliability, observability, and alerting. You will also be instrumental in how these systems integrate with the broader Google Cloud Infrastructure and Services. Collaboration with external partners, particularly VMware, to co-create groundbreaking solutions will be a key aspect of this role. Leveraging your deep understanding of emerging cloud technologies, you will address the unique cloud requirements of VMware workloads. Your technical expertise will be crucial in bringing innovative software solutions to market, understanding enterprise workload requirements, and utilizing open source technologies. Google Cloud is dedicated to accelerating every organization's digital transformation. We provide enterprise-grade solutions leveraging Google s cutting-edge technology and developer-friendly tools. Join us as a trusted partner for customers in over 200 countries and territories, enabling their growth and solving their most critical business challenges. Responsibilities: Develop a forward-thinking technical roadmap for the Google Cloud VMware Engine organization, fostering continuous innovation and the implementation of novel systems solutions. Design, build, and deploy highly scalable solutions leveraging Google compute platforms, robust hardware, advanced networking, and sophisticated software infrastructure to deliver exceptional systems for VMware workloads at scale. Collaborate effectively across engineering teams involved in the build, design, and implementation of hardware and software spanning infrastructure domains such as platforms, server architecture, compute, storage, networking, and data analytics. Influence and establish best engineering practices for managing robust and scalable systems to proactively address exponential market demand. Provide technical leadership for cloud developer technology within Google and manage collaborations with cross-functional Engineering teams to optimize the adoption of Google Cloud Platform capabilities, both internally and for the broader cloud industry. Minimum Qualifications: Bachelor's degree in Computer Science, Electrical Engineering, or equivalent practical experience. 15 years of experience in hardware and software design, data structures, and algorithms. Preferred Qualifications: Master's degree. Proven experience in delivering successfully within stipulated timelines. Demonstrated experience in successfully building software and large-scale distributed systems. Comprehensive understanding of private and public cloud design considerations and limitations in virtualization, global infrastructure, hypervisor technologies, networking, data storage, and security. Exceptional ability to work cross-functionally, partnering effectively with groups such as Sales, Engineering, Product Management, Product Marketing, UX, and UI, skillfully brokering trade-offs with stakeholders and understanding their diverse needs. Excellent narrative and storytelling skills with a proven ability to drive usage, adoption, and market momentum. Qualification : Bachelor's degree in Computer Science, Electrical Engineering, or equivalent practical experience.
Software Engineer Iii, Google Cloud
Google Careers
Job Title: Software Engineer Location: Bengaluru, India Company: Google Minimum Qualifications: Bachelor's degree or equivalent practical experience. 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree. 2 years of experience with data structures or algorithms. Preferred Qualifications: Master's degree or PhD in Computer Science or related technical fields. Experience developing accessible technologies that meet diverse user needs. About the Job: Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design, and mobile; the list goes on and continues to grow every day. As a software engineer, you will work on a specific project critical to Google s needs, with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, to display leadership qualities, and to be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Google Cloud Overview: Google Cloud accelerates every organization s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google s cutting-edge technology and tools to help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. Responsibilities: Write product or system development code, focusing on building scalable and efficient systems. Participate in, or lead design reviews with peers and stakeholders to decide on the most appropriate technologies for the task. Review code developed by other developers and provide feedback to ensure best practices, such as: Style guidelines Code accuracy Testability Efficiency Contribute to existing documentation or educational content, and adapt it based on product or program updates and user feedback. Triage product or system issues and debug/track/resolve them by analyzing the sources of issues and understanding their impact on hardware, network, or service operations and quality. Qualification : Master's degree or PhD in Computer Science or related technical fields.
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Sap Cpi Developer
Pure Storage
Join Us in Reshaping the Data Storage Industry We re in an unbelievably exciting area of tech, fundamentally reshaping the data storage industry. At Pure Storage, you ll have the chance to lead with innovative thinking, grow alongside us, and collaborate with the smartest team in the industry. If you're ready to make a lasting impact and seize boundless opportunities, come join us! Position Overview: Join our growing SAP team as an experienced SAP Cloud Platform Integration (CPI) Developer. In this role, you'll specialize in designing and implementing scalable integration solutions. You will be a key player in building and optimizing SAP CPI processes to support our expanding business operations. If you're excited about working with a dynamic, innovative team and creating impactful solutions, this is the perfect opportunity for you to grow your career. Responsibilities: Design, develop, and deploy integration flows using SAP CPI between SAP and non-SAP systems. Collaborate with business stakeholders and functional teams to confirm integration requirements and create technical specifications. Monitor, troubleshoot, and resolve integration-related issues. Ensure compliance with security and governance standards during integration design and development. Qualifications: Bachelor's degree in Information Technology, Computer Science, or a related field. 4 to 6 years of experience in IT with a focus on SAP integration development, specifically on SAP CPI. Knowledge of integration patterns and techniques, as well as experience with API management. Experience implementing security protocols such as OAuth, HTTPS, and SSL/TLS. SAP CPI certification is preferred. This is a primarily in-office role, so you will be expected to work in our Bangalore office in compliance with Pure's policies, unless on PTO, work travel, or other approved leave. What You Can Expect from Us: Pure Innovation: We celebrate those who think critically, embrace challenges, and aspire to be trailblazers. Pure Growth: We provide the space and support for you to grow alongside us and contribute meaningfully. Pure Storage has been named one of Fortune's Best Large Workplaces in the Bay Area, Fortune s Best Workplaces for Millennials, and certified as a Great Place to Work. Pure Team: We build each other up, setting aside egos for the greater good. We understand the value of bringing your full and best self to work. That's why we offer a variety of perks to help you maintain a healthy balance, including flexible time off, wellness resources, and company-sponsored team events. For more details, visit purebenefits.com. Qualification : Bachelors degree in Information Technology, Computer Science or related field.
Devops Engineer
Pure Storage
Join Us in Revolutionizing the Data Storage Industry We're leading an exciting transformation in the data storage industry. By joining us, you will have the opportunity to make a significant impact, grow alongside a brilliant team, and be at the forefront of cutting-edge technology. If you re passionate about reshaping the future of tech, this is your chance to leave your mark. The Challenge: As a DevOps Engineer, you will be responsible for managing, automating, and optimizing our VMware, cloud, and on-prem Kubernetes infrastructure. Your role will be critical in ensuring the high availability, performance, and scalability of our services. You will work closely with cross-functional teams to architect solutions that improve our engineering operations and align with business needs. Key Responsibilities: Infrastructure Design & Management: Design, deploy, and maintain scalable VMware, Cloud (AWS, GCP, Azure, IBM), and Kubernetes environments. Custom Solutions Development: Develop and implement tailored OpenStack/VMware/Kubernetes solutions based on organizational needs. Automation & CI/CD: Build automation tools and frameworks (CI/CD pipelines) to streamline infrastructure operations and manage workloads (VMs/Pods) lifecycles. Observability & Best Practices: Implement observability best practices for OpenStack/VMware/Kubernetes environments, ensuring reliability and performance. Continuous Improvement: Provide expertise in DevOps methodologies to support continuous improvement and optimize infrastructure efficiency. Troubleshooting & Support: Assist with deployment, configuration, troubleshooting, and provide infrastructure support for AWS/Azure environments. Documentation & Knowledge Sharing: Create and maintain documentation for OpenStack/VMware/Kubernetes architecture and stay current with emerging technologies and industry best practices. On-Call Support: Participate in the follow-the-sun on-call rotation for infrastructure support. What You ll Need to Bring: Education: Bachelor s degree in Computer Science, Information Technology, or a related field. Experience: 5+ years of experience managing and automating large-scale VMware, OpenStack, or Kubernetes environments. Programming Skills: Proficiency in Python, Java, or Go for scripting and automation. DevOps Knowledge: Strong understanding of DevOps principles with hands-on experience using tools like Ansible, Terraform, or Puppet. Observability Expertise: Experience implementing observability solutions with tools like Prometheus, Grafana, Logstash, Elastic, Fluent-bit, or Fluentd. Linux & Networking: Familiarity with Linux, TCP/IP, DNS, DHCP, and related networking concepts. OpenStack/Vmware/Kubernetes: Proven experience working with OpenStack (e.g., OpenStack Yoga), VMware, or Kubernetes (particularly enterprise Kubernetes clusters on bare metal). Virtualization & Containerization: Expertise in virtualization technologies (KVM, VMware, KubeVirt) and container technologies (Docker, Kubernetes). Cloud Experience: Experience with infrastructure support and automation for AWS, Azure, or GCP. Problem-Solving Skills: Excellent troubleshooting abilities with great attention to detail. Communication & Collaboration: Strong interpersonal skills and the ability to collaborate across teams. Preferred Qualifications: Experience with PureStorage products such as FlashArray, FlashBlade, or Portworx. Certifications in Kubernetes (CKA, CKAD), VMware (VCP), or OpenStack (COA). Experience running production VMs in KubeVirt. Familiarity with agile environments and project management tools. What You Can Expect from Us: Pure Innovation: We celebrate critical thinkers, challenges, and trailblazers who strive to innovate. Pure Growth: We support your growth and provide the space for you to contribute meaningfully. We're proud to be named in Fortune's Best Workplaces and certified as a Great Place to Work. Pure Team: We focus on collaboration and teamwork, setting aside ego for the greater good. Qualification : Bachelors degree in Computer Science, Information Technology, or related field.
Data Engineer
Kpit Technologies
Job/Position Summary: Data Engineer Responsibilities: Implement data pipelines that meet design and are efficient, scalable, and maintainable. Implement best practices including proper use of source control, participation in code reviews, data validation and testing. Timely deliveries while working on projects. Act as advisor/mentor and helps junior data engineers in their deliverables. Must Have Skills: Should have experience of at least 4+ years with Data Engineering. Strong experience of design, implementation and fine-tuning big data processing pipelines in production environment. Experience with big tools like Hadoop, Spark, Kafka, Hive, Databricks. Experience in programming at least one of with Python, Java, Scala, Shell Script. Experience with relational SQL and NO SQL databases like PostgresSQL, MYSQL, Cassandra etc. Experience with any data visualization tool (Plotly, Tableau, Power BI, Google Data Studio, Quick sight etc.). Good To Have Skills: Should have Basic Knowledge of CI/CD Pipeline. Experience in working on at least one Cloud (AWS or Azure or GCP). For AWS: - Experience with AWS Cloud services like EC2, S3, EMR, RDS, Athena, Glue, Lambda, EMR. For Azure: -Experience with Azure Cloud services like Azure Blob/Data Lake GEN2, Delta Lake, Databricks, Azure SQL, Azure DevOps, Azure Data Factory, Power BI. For GCP: - Experience with GCP Cloud services Big Query, Cloud Storage bucket, DataProc, Dataflow, Pub Sub, Cloud Function, Data Studio. Sound familiarity in Versioning tools (Git, SVN etc.). Experience Mentoring students is desirable. Knowledge of latest developments in Machine Learning, Deep Learning, Optimization in Automotive domain. Open minded approach to explore multiple algorithms to design optimal solution. History of contribution to articles/blogs/whitepapers etc. in Analytics. History of contribution to Open Source. Requirement: ESSENTIAL SKILLS /COMPETENCIES Data Engineering Hadoop Kafka CI/CD Cloud
Data Engineer
Couchbase
Job Title: Data Engineer Location: Bengaluru (Hybrid) About Couchbase: As industries race to embrace AI, traditional database solutions fall short of rising demands for versatility, performance, and affordability. Couchbase is leading the way with Capella, the developer data platform for critical applications in our AI world. By uniting transactional, analytical, mobile, and AI workloads into a seamless, fully managed solution, Couchbase empowers developers and enterprises to build and scale applications with unmatched flexibility, performance, and cost-efficiency from cloud to edge. Trusted by over 30% of the Fortune 100, Couchbase is unlocking innovation, accelerating AI transformation, and redefining customer experiences. Come join our mission! Position Overview: We are seeking a highly skilled Data Engineer with a strong background in data warehousing, advanced analytics, and AI integration. The ideal candidate will have 5+ years of experience designing and implementing data pipelines, building robust analytics platforms, and working with modern data technologies like Snowflake, Google Cloud, Databricks, Looker, PowerBI, and Tableau. As part of our Delorean team, you will play a pivotal role in driving innovation and ensuring our data infrastructure supports strategic decision-making. Key Responsibilities: Data Infrastructure Development: Design, develop, and maintain scalable data pipelines and ETL processes to support data ingestion, transformation, and storage across multiple platforms. Experience with Cloud Data Platforms: Expertise in implementing and optimizing solutions using industry-leading tools such as Snowflake, Databricks, and Google Cloud Platform. Demonstrated ability to ensure high performance, scalability, and cost-effectiveness in data infrastructure and workflows. Analytics & Visualization: Build and maintain interactive dashboards and reports using Looker, PowerBI, and Tableau to provide actionable insights to business stakeholders. AI & Advanced Analytics: Collaborate with Data Science teams to integrate AI models and machine learning workflows into data pipelines for predictive analytics and automation. Data Governance: Ensure data quality, security, and compliance with industry best practices and regulatory requirements. Collaboration: Partner with cross-functional teams, including Product, Engineering, and Business Operations, to understand data requirements and deliver tailored solutions. Continuous Improvement: Identify opportunities to improve data workflows, adopt new technologies, and drive operational efficiency. Qualifications: Education: Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field. Experience: 5+ years of hands-on experience in data engineering, data warehousing, or related fields. Technical Skills: Expertise in Snowflake, Databricks, and Google Cloud Platform (Mandatory experience in at least one tool). Proficiency in ETL/ELT processes and data pipeline tools (e.g., Apache Airflow, dbt). Experience with data visualization tools like Looker, Power BI, and Tableau. Strong SQL skills and familiarity with Python or Scala for data processing. Knowledge of AI/ML concepts and frameworks for integrating predictive models. Soft Skills: Excellent problem-solving skills with a proactive mindset. Strong communication and collaboration skills to work effectively with technical and non-technical teams. Ability to manage multiple priorities in a fast-paced environment. Modern customer experiences need a flexible cloud database platform that can power applications spanning from cloud to edge and everything in between. Couchbase s mission is to simplify how developers and architects develop, deploy, and consume modern applications. With Capella, our flexible, affordable cloud platform, we empower organizations to quickly build and deliver premium customer experiences with unmatched price-performance. More than 30% of the Fortune 100 trust Couchbase to power their modern applications. Benefits at Couchbase: Generous Time Off Program: Flexibility to care for yourself and your family. Wellness Benefits: Comprehensive medical plans, dental, vision, life insurance, and employee assistance programs. Financial Planning: RSU equity program, ESPP, retirement planning, and business travel insurance. Career Growth: A Be valued, Create value approach to your career development. Fun Perks: Ergonomic office setup, food & snacks for in-office employees, and more! Qualification : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
Senior Cloud Data Engineer
Capgemini Invent
Job Title: Senior Cloud Data Engineer Experience: 10+ Years Location: Bengaluru About Capgemini Invent: Capgemini Invent is the digital innovation, consulting, and transformation brand of the Capgemini Group. It brings together leading expertise in strategy, technology, data science, and creative design to help CxOs reimagine their businesses. We are a global business line dedicated to helping organizations envision and build what s next. Your Role: As a Senior Cloud Data Engineer at Capgemini Invent, you will design, develop, and maintain scalable data pipelines using advanced cloud technologies to ensure smooth data integration and efficient workflows. You will collaborate with cross-functional teams to deliver robust and optimized data solutions while ensuring compliance and security throughout the process. Key Responsibilities: Design, develop, and maintain scalable data pipelines using AWS services. Optimize data storage and retrieval processes to ensure efficiency and accessibility. Ensure data security and compliance with industry standards, including data privacy laws. Manage large volumes of data, focusing on accuracy, integrity, and secure accessibility. Develop and refine data processes for data modeling, mining, and production. Implement quality checks, data validation, and monitoring of data flows. Collaborate with data scientists, analysts, and IT teams to meet data requirements. Work closely with data architects and modelers on project objectives and solutions. Troubleshoot and resolve issues in data pipelines, ensuring performance tuning and optimization. Develop and implement disaster recovery procedures to safeguard data. Ensure seamless integration of HR and other business data into cloud-based environments. Research new opportunities for data acquisition and discover additional uses for existing data. Stay up-to-date with the latest cloud technologies, data management practices, and trends, including Generative AI. Recommend and implement improvements to enhance data reliability, efficiency, and quality. Your Profile: 10+ years of experience in cloud data engineering. Proficiency with cloud platforms such as AWS, Azure, or Google Cloud. Experience with data pipeline tools like Apache Spark, AWS Glue, or similar technologies. Strong programming skills in Python, SQL, Java, or Scala. Familiarity with Snowflake, Informatica, or similar tools is an advantage. In-depth knowledge of data privacy laws, security best practices, and data governance. Expertise in analyzing and interpreting complex datasets to derive actionable insights. Strong communication, collaboration, and problem-solving skills. Knowledge of database technologies, including SQL, Big Data, and Cloud-based systems. Passion for learning and keeping up with emerging technologies, particularly in Generative AI. Experience working in an Agile framework and managing multiple projects simultaneously. Ability to adapt to evolving priorities and business needs. What You Will Love About Working Here: Flexibility: Enjoy flexible work arrangements such as remote work or flexible hours, ensuring a healthy work-life balance. Career Growth: We offer numerous opportunities for career advancement and personal development, helping you explore diverse paths and expand your skills. Certifications & Learning: Gain valuable certifications in cutting-edge technologies, including Generative AI, to stay ahead of the curve. About Capgemini: Capgemini is a global business and technology transformation partner that helps organizations accelerate their dual transition to a digital and sustainable world. With a team of 340,000 professionals in over 50 countries, we are dedicated to making a tangible impact on enterprises and society. Trusted by clients for over 55 years, Capgemini uses its deep industry expertise and cutting-edge technologies such as AI, cloud, and data to unlock the full potential of businesses worldwide. In 2023, the group reported global revenues of 22.5 billion.
Data Engineer
Indium Software
Data Engineer Role Overview We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs. This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows. Key Responsibilities Data Pipeline Development & Optimization Design and build scalable ETL/ELT processes for structured and unstructured data. Develop and maintain data ingestion frameworks to handle large datasets efficiently. Ensure data integrity, consistency, and security across multiple sources. Database & Data Warehouse Management Develop, optimize, and maintain relational and NoSQL databases. Implement data modeling best practices for performance and scalability. Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery). Big Data & Cloud Technologies Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing. Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions. Develop real-time and batch processing workflows. Collaboration & Documentation Work closely with data scientists, engineers, and business teams to understand data requirements. Document data pipelines, architecture, and workflows for scalability and maintenance. Required Qualifications & Skills Technical Expertise: Strong experience with SQL and Python for data processing. Proficiency in ETL/ELT frameworks and data integration techniques. Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka). Cloud & Database Management: Expertise in cloud data platforms (Azure, AWS, GCP). Experience with data warehousing solutions (Snowflake, Redshift, BigQuery). Understanding of data governance, security, and compliance. Performance Optimization & Troubleshooting: Ability to optimize SQL queries and improve data processing efficiency. Experience troubleshooting complex data pipeline issues. Apply Now & Be Part of an Innovative Data Team!
Senior Software Engineer - Data Platform
Databricks
About Databricks At Databricks, we are passionate about enabling data teams to solve the world s toughest challenges from creating the next mode of transportation to accelerating the development of medical breakthroughs. We build and run the world s best data and AI infrastructure platform, empowering our customers to use deep data insights to transform their businesses. Databricks Mosaic AI offers a data-centric approach to building enterprise-quality Machine Learning (ML) and Generative AI solutions, enabling organizations to securely and cost-effectively own and host ML and Generative AI models, trained and augmented with their enterprise data. We re only getting started in Bengaluru, India, where we are currently setting up 10 new engineering teams from scratch! The Opportunity Senior Software Engineer As a Senior Software Engineer at Databricks India, you ll have the opportunity to work on a variety of challenging projects across multiple domains: Backend Engineering Distributed Data Systems (DDS) Full-Stack Development The Impact You ll Have 1. Backend Engineering Join our Backend teams and tackle challenges that range from product to infrastructure: Solve complex problems in distributed systems, large-scale service architecture, monitoring, workflow orchestration, and developer experience. Build reliable, high-performance services and client libraries for managing massive amounts of data on cloud storage backends like AWS S3 and Azure Blob Store. Work on scalable services (e.g., Scala, Kubernetes) and data pipelines (e.g., Apache Spark, Databricks) that support our pricing infrastructure, processing millions of cluster-hours per day. 2. Distributed Data Systems (DDS) Work across a range of exciting DDS projects: Apache Spark Data Plane Storage Delta Lake Delta Pipelines Performance Engineering 3. Full-Stack Engineering As a Full-Stack Software Engineer, collaborate closely with your team and product managers to create intuitive user experiences that delight our customers. What We Look For BS or higher in Computer Science or a related field. 7+ years of production-level experience in one or more of the following languages: Python, Java, Scala, C++, or similar. Proven experience developing large-scale distributed systems from scratch. Experience working on a SaaS platform or with Service-Oriented Architectures (SOA). About Databricks Databricks is the data and AI company trusted by over 10,000 organizations worldwide, including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500. We help unify and democratize data, analytics, and AI through the Databricks Data Intelligence Platform. Headquartered in San Francisco, Databricks was founded by the original creators of Apache Spark, Delta Lake, MLflow, and the Lakehouse architecture, with offices around the globe. Qualification : BS (or higher) in Computer Science, or a related field.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted