Spark Developer Jobs in Bengaluru

Position: Mechatronics & Big Data Scientist Developer Department: Research & Development Reporting To: General Manager Location: Bengaluru Key Responsibilities Machine Learning: Select features, build, and optimize classifiers using advanced machine learning techniques. Data Mining: Perform data mining using state-of-the-art methods to extract valuable insights from large datasets. Data Enhancement: Extend the company s datasets with third-party data sources when necessary to improve model accuracy and relevance. Data Collection & Processing: Improve data collection procedures to include all necessary information for building analytic systems. Data Cleansing & Integrity: Process, cleanse, and verify the integrity of data used for analysis to ensure reliable results. Ad-hoc Analysis: Perform ad-hoc analysis as needed, presenting the results in a clear, actionable manner. Anomaly Detection: Design and implement automated anomaly detection systems, tracking their performance over time to ensure accuracy. Behavioral Competencies Data-Driven: Strong inclination toward working with data and applying analytical thinking to solve complex problems. Detail-Oriented: Meticulous in data analysis and system development to ensure quality and precision in results. Skills and Expertise Machine Learning Algorithms Strong understanding of machine learning techniques and algorithms such as k-NN, Naive Bayes, SVM, Decision Forests, etc. Data Science Tools Experience with common data science toolkits like R, Weka, NumPy, and MatLab. Proficiency in at least one (preferably NumPy or R) is highly desirable. Data Visualization Skilled in data visualization tools such as D3.js, GGplot, or similar. Database Management Experience with query languages such as SQL, Hive, Pig, NiFi, or others depending on the company s stack. Familiarity with NoSQL databases like InfluxDB, MongoDB, Cassandra, HBase. Statistical Analysis Strong applied statistics skills, including distributions, statistical testing, and regression analysis. Programming Skills Good scripting and programming skills in languages like PHP, Slim, SQL, and Laravel. Big Data Technologies Knowledge of Hadoop, HDFS, NiFi, and other big data platforms and technologies. Qualifications Essential: MTech, MS, or equivalent in Mechatronics, Computer Science, or a related field. Experience: Minimum 2 years of hands-on experience in developing SDKs and working with Big Data platforms. Proven track record in machine learning, data mining, and data science projects. Qualification : MTech, MS, or equivalent in Mechatronics, Computer Science, or a related field

Java Developer Software Engineer Experience: 3 6 years Location: Bengaluru Department: Product Development Join VuNet Build the Future of Digital Observability VuNet is pioneering a new category in Business Journey Observability, combining Big Data and Machine Learning to transform digital experiences in financial services. We monitor over 28 billion transactions monthly, supporting 300+ million users across major banks and financial institutions (e.g., UPI, real-time payment systems). VuNet is Series B funded, part of NASSCOM DeepTech Club, and recognized by Forbes, Gartner, and others for its innovation in AI and observability. About the Role We are looking for a Java Developer to join our Product Development Team, focused on building lightweight, high-performance Java agents that collect observability data from real-world production systems. Your work will directly contribute to improving digital journeys for millions of users. If you thrive in a fast-paced environment, enjoy solving complex problems, and want to be part of a cutting-edge platform built in India for the world this is your opportunity. Your Responsibilities Design and develop scalable Java-based agents to collect data from JVMs and other systems in production environments. Integrate with various systems using protocols like TCP, HTTP, and REST APIs. Maintain and enhance existing agents: debug, analyze root causes, and collaborate with customer-facing teams for fixes. Ensure clean, efficient code through unit testing, design documentation, coding standards, and peer reviews. Take full ownership of the development lifecycle from requirement analysis to production deployment. Collaborate with Product, Platform, and Support teams to build robust, real-world-ready solutions. Contribute to broader Java development efforts (e.g., platform modules, service components, custom adapters) as needed. What You Bring Must-Have Skills 3 6 years of hands-on Java development experience. Strong understanding of multithreading, file handling, and socket programming. Experience working with Java Management Extensions (JMX). Proficiency in consuming REST APIs with Java. Strong debugging skills and ability to resolve complex production issues. Excellent communication and documentation skills. Self-motivated, detail-oriented, and collaborative mindset. A growth-driven mindset with curiosity to learn new technologies and domains. Nice-to-Have Skills Experience with Java application servers like Tomcat, JBoss, or Jetty. Familiarity with Apache Kafka and event-driven architectures. Exposure to distributed systems or big data tools: Spark, Redis, Cassandra, Hadoop, MySQL. Life at VuNet We re not just building technology we re building the future of digital experiences. At VuNet, you ll be part of a collaborative, innovation-driven team where curiosity, ownership, and continuous learning are core to our culture. Whether you re exploring Generative AI, solving high-scale data challenges, or working alongside some of the sharpest minds in deep tech VuNet is where you can grow, build, and make a real-world impact. Your Benefits Health insurance for you, your dependents, and parents. Mental wellness support with 1:1 counseling. Transparent and inclusive workplace culture. Access to emerging tech (including Gen AI) and cutting-edge tools. Career development and technical learning programs. Opportunity to shape a globally recognized, Made-in-India deep tech product.

Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field

Principal Associate Full Stack Engineering (GenAI Observability) Location: Bangalore Company: Capital One India About Us At Capital One India, we re tackling some of the most complex problems in financial services using machine learning, advanced analytics, and cloud-first engineering. Our mission is to build cutting-edge, patentable solutions that transform customer experiences, enhance operational efficiency, and ensure robust risk and compliance standards. We re a team of makers, breakers, doers, and disruptors obsessed with turning data into real-world impact at scale. About the Team Machine Learning Experiences (MLX) The MLX team is pioneering the future of model governance, ML observability, and Generative AI infrastructure at Capital One. We re enabling teams to seamlessly deploy ML and GenAI models at scale, with full visibility into performance, health, compliance, and ethical usage. This is the platform powering the next generation of AI-driven financial products across the company. About the Role We re looking for a Principal Associate Full Stack Engineer to lead the development of observability platforms for Generative AI systems. You ll be part of a cross-functional team focused on governance automation, LLM monitoring, and intelligent diagnostics using telemetry data, metadata, and advanced analytics. You ll design systems to collect, analyze, and visualize performance data from our large-scale GenAI infrastructure, helping data scientists and engineers make faster, safer decisions. What You ll Do Lead architecture and development of observability tools and dashboards for monitoring GenAI models and platform health. Design and build core APIs and SDKs to instrument large language models (LLMs) and foundational models (training, fine-tuning, prompting stages). Integrate Generative AI to enable observability features like anomaly detection, predictive analytics, and copilot-assisted troubleshooting. Partner with platform, MLOps, and governance teams to ingest and analyze telemetry, metadata, and runtime metrics at scale. Drive development of tools to ensure compliance with AI ethics, data governance, and industry regulations. Collaborate with product, design, and research to turn complex requirements into scalable, cloud-native software solutions. Lead proof-of-concept initiatives to test and showcase how GenAI can improve platform observability and decision-making. Contribute to the open-source community and stay at the forefront of GenAI and ML infrastructure evolution. Basic Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or related field 4+ years of experience building distributed, data-intensive systems using microservices architecture 4+ years of experience in backend development with Python, Go, or Java 4+ years of expertise with observability stacks (Prometheus, Grafana, ELK) and adapting them for AI systems Strong knowledge of OpenTelemetry, and experience building custom SDKs and APIs 5+ years of hands-on experience with Generative AI models, especially applied to observability, governance, or compliance 2+ years of experience with cloud platforms such as AWS, Azure, or GCP Preferred Qualifications 4+ years building and optimizing ML systems in production environments 3+ years of experience with MLOps tools like MLflow, Kubeflow, or commercial platforms Experience with GenAI frameworks and libraries like LangChain, Haystack, and vector databases (FAISS, Chroma, OpenSearch) Familiarity with emerging observability tools for LLMs such as Langfuse, Phoenix, Helicone, or OpenInference Contributor to open-source GenAI or ML infrastructure projects Author or co-author of published work in AI/ML observability, governance, or performance monitoring Experience with PyTorch, TensorFlow, Spark, or Dask Knowledge of NVIDIA GPU telemetry, CUDA programming, and performance optimization for AI workloads Understanding of AI ethics, data governance, and regulatory frameworks for machine learning systems Why Join Capital One India Work at the intersection of technology, AI, and compliance helping shape the future of responsible AI Join a team driving enterprise-wide adoption of Generative AI Collaborate with world-class engineers, data scientists, and product leaders Enjoy a high-performance culture that encourages innovation, learning, and mentorship Access to cutting-edge tools, open-source contributions, and cloud-native infrastructure Qualification : Bachelors or Masters degree in Computer Science, Engineering, or related field

Job Title: Lead / Senior Software Engineer (Microservices, IoT, Kafka, AWS) Location: Bengaluru Experience Required: 5 8 years Industry: Automotive (Electric Mobility) Employment Type: Full-time About Ultraviolette Join the Charge. Create the Future. At Ultraviolette, we re not just building electric vehicles we re redefining what mobility looks and feels like. From creating India s fastest electric motorcycle to designing the world s most advanced electric scooter, we're on a mission to engineer machines that are not only sustainable, but also exhilarating. Our team is a diverse mix of engineers, designers, dreamers, and doers, united by a bold vision to accelerate the global shift to electric mobility. If you're driven by innovation and looking to work on cutting-edge products that challenge the status quo, this is your platform to make a real impact. About the Role We are looking for a Senior/Lead Software Engineer who thrives in designing scalable, high-performance, and cloud-native microservices. This role is ideal for someone with hands-on experience in Java, Spring Boot, Kafka, and AWS, and a keen interest in IoT and real-time data architectures. You will work at the intersection of hardware and software helping us bring our vision of connected, intelligent, and high-performance electric vehicles to life. Key Responsibilities Design, develop, and deploy Java-based microservices using Spring Boot and related technologies. Architect and implement event-driven systems using Apache Kafka for real-time IoT data streaming. Build and manage RESTful APIs with AWS API Gateway for seamless service integration. Leverage AWS services such as Lambda, DynamoDB, and MemoryDB to build scalable, serverless solutions. Collaborate with cross-functional teams front-end developers, DevOps, and product managers to convert ideas into working features. Optimize application performance, troubleshoot issues, and ensure high reliability and availability. Mentor junior engineers, conduct code reviews, and enforce clean coding practices. Contribute to architecture decisions, technical roadmaps, and innovation initiatives. Stay on top of emerging technologies in cloud, microservices, and IoT ecosystems. Participate actively in Agile processes including sprint planning, stand-ups, and retrospectives. Required Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or a related field. 5+ years of hands-on experience in Java development, with a strong foundation in Spring Boot. Proven experience designing and deploying microservices architectures. Strong knowledge of Kafka and real-time streaming/data pipeline architectures. Hands-on experience with Docker and Kubernetes for containerization and orchestration. Understanding of IoT protocols such as MQTT or CoAP and device connectivity. Proficiency with version control (Git) and Agile methodologies. Excellent problem-solving, communication, and collaboration skills. Nice to Have AWS Certifications (e.g., AWS Certified Developer or Solutions Architect). Experience with additional languages like Python or Rust. Familiarity with NoSQL databases such as MongoDB or Cassandra. Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure as Code (e.g., Terraform). Exposure to stream processing frameworks (e.g., Apache Flink, Spark Streaming). Experience in edge computing and distributed systems. Strong understanding of cloud security best practices. Work on India s most futuristic electric vehicles at the intersection of technology, performance, and sustainability. Be part of a mission-driven company shaping the future of mobility. Collaborate with some of the most talented engineers and designers in the industry. A fast-paced environment that celebrates innovation, learning, and growth. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field

Backend Developer Location: Bengaluru, India Experience: 2 - 5 Years Job Type: Full-time About VuNet VuNet is pioneering Business Observability by combining big data and machine learning to revolutionize customer journey monitoring and enhance digital payment experiences for leading financial institutions. We foster financial inclusion nationwide by delivering innovative, scalable solutions in a collaborative, high-impact environment. Role Overview: Backend Developer Join VuNet s Platform Core OS team to build highly scalable backend systems powering critical products. As a Backend Developer, you ll have significant ownership and influence in shaping the architecture, collaborating across teams, and delivering world-class software solutions that impact millions of users. Key Responsibilities Own backend development and work closely with product, design, and business teams to architect and deliver scalable solutions Deliver major initiatives independently and on time Follow best development practices including design specs, coding standards, unit testing, and code reviews Solve complex service scalability problems with creativity and technical expertise Take complete ownership of your solutions and drive their success Communicate effectively across multidisciplinary teams Skills & Experience 2+ years of strong programming experience in Python Experience with asyncio and the Django framework Hands-on with web application development and working knowledge of SQL/NoSQL databases Experience with third-party integrations Strong communication and teamwork skills Detail-oriented with good analytical and problem-identification abilities Proven success as an individual contributor Bonus Skills: Elasticsearch, Kafka, Apache Spark, Redis, Cassandra, Hadoop Eagerness to learn new technologies and domains 100% health insurance coverage for you and your family, including parents Financial protection with disability, life, and accidental death insurance Mental wellness programs and one-on-one counseling A culture focused on delivering excellence and fostering career growth Transparent, inclusive, and collaborative work environment Continuous learning and development opportunities Apply now and be part of our trailblazing team!

Backend Engineer Location: Bengaluru (Hoodi, Rathi Legacy, Rohan Tech Park) Team: Product Engineering Employment: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader leveraging AI and data to solve complex industrial challenges in Oil & Gas, Chemicals, Pharma, Manufacturing, and Energy. Our flagship products include Cognite Atlas AI and Cognite Data Fusion (CDF). We have been recognized as a 2022 Technology Innovation Leader and 2024 Microsoft Energy & Resources Partner of the Year, driving the future of industrial digital transformation. Our Values Impact: Deliver meaningful, measurable results. Ownership: Take responsibility beyond your comfort zone and foster inclusivity. Relentless: Innovate with determination and resilience. Role & Responsibilities Design and develop scalable, high-performance backend services and APIs using Java, Kotlin, or Python for Cognite Data Fusion. Work with advanced database technologies like PostgreSQL and Elasticsearch to enhance our industrial knowledge graph. Collaborate with application teams to create user-centric solutions addressing complex industrial problems. Build resilient, scalable infrastructure using modern open-source tools and Cognite s data platform. Influence critical product and technical decisions by partnering closely with stakeholders and domain experts. 5+ years of backend engineering experience, primarily using Java, Kotlin, or Python in SaaS/product companies at scale. Flexibility with tech stacks: Java/Kotlin experience is a plus for Python developers and vice versa. Experience with Spark is highly valued. Strong background in modern databases (PostgreSQL, Elasticsearch), graph processing, distributed systems, and performance tuning. Commitment to clean, maintainable code and best practices through continuous code review and improvement. DevOps experience: CI/CD, Infrastructure as Code, Kubernetes multi-cloud deployments (AWS, GCP, Azure). Skilled in observability and diagnostics with tools like Prometheus, Grafana, and expertise in troubleshooting complex system issues. Comfortable contributing to and learning from the open-source community. Excellent communication skills to collaborate effectively across diverse, global teams. Be part of a diverse global team representing 70+ nationalities, committed to DEI. Work in a modern, vibrant office environment at Rathi Legacy, Hoodi, Bengaluru with hybrid flexibility. Flat hierarchy with direct access to leadership and minimal bureaucracy. Collaborate with world-class talent on ambitious, high-impact projects across multiple industries. Engage in Cognite s HUB community for direct interaction with colleagues and partners. Make Your Impact Join Cognite and help revolutionize industrial digital transformation with strong DataOps, enabling better decisions and sustainability for global clients. We encourage applications from all backgrounds and identities. If you re passionate about shaping the future of industrial SaaS, apply today!

Senior Full-stack Developer (Frontend Focus) Location: Bengaluru (Rathi Legacy, Rohan Tech Park, Hoodi) Team: Global Strategic Services Industry Innovation and Solutions Employment: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader pioneering AI and data-driven industrial digital transformation, recognized as a top innovator and Microsoft Energy & Resources Partner of the Year. Our flagship products, Cognite Data Fusion and Cognite Atlas AI, empower industries like Oil & Gas, Chemicals, Pharma, and Manufacturing. The Role & Team Join Cognite s Industry and Innovation Team to build impactful, repeatable full-stack solutions for key clients. As a senior developer, you ll design end-to-end systems, mentor peers, and troubleshoot technical challenges. Collaborate closely with designers, architects, and product managers while working with the latest web technologies. Key Responsibilities Develop full-stack applications with a frontend focus using ReactJS. Collaborate with cross-functional teams to deliver customer-centric solutions. Coach and support other developers on the team. Maintain high code quality through well-structured, efficient, and maintainable code. Understand and apply web security best practices to protect applications. Utilize backend skills in Python (FastAPI), Java, or Kotlin to build backend services/APIs. Work with cloud platforms (GCP, Azure, AWS), Kubernetes, Docker, and distributed systems like Kafka, PostgreSQL, Elasticsearch. Apply pragmatic testing approaches including unit, integration, and end-to-end testing. Engage in design activities using tools like Figma. What You Bring 5+ years of full-stack development experience with React as your main frontend framework. Experience with backend languages/frameworks: Python (FastAPI), Java, Kotlin preferred. Familiarity with cloud infrastructure and container orchestration technologies. Hands-on experience with distributed open-source software like Kubernetes, Kafka, PostgreSQL, Elasticsearch. Good understanding of web security concepts and browser restrictions. Bachelor s degree or higher in Computer Science, Engineering, or equivalent experience. Passion for emerging web technologies and continuous learning. Work in a diverse, inclusive environment with 70+ nationalities. Modern hybrid work setting with flat structure and direct decision-maker access. Collaborate on ambitious projects with global impact. Engage with a vibrant community of experts and industry leaders. Enjoy learning opportunities and a culture that values ownership, impact, and relentless innovation.

Data Engineer Experience: 5+ Years Location: Bangalore, Karnataka, India Job Type: Full Time Job Summary We are looking for a talented Data Engineer with over 5 years of experience and a strong foundation in machine learning development to join our team in Bangalore. The ideal candidate will have hands-on expertise in Python programming, machine learning basics, and computer vision techniques like custom object detection and OCR. Key Responsibilities Develop and maintain data pipelines supporting machine learning models and data analytics. Implement custom object detection algorithms and OCR solutions using computer vision techniques. Utilize Python ML libraries such as OpenCV, SciPy, NumPy, Matplotlib, Pandas, Scikit-learn, Keras, PyTorch, and TensorFlow. Collaborate with data scientists and software engineers to optimize data workflows and ML model deployment. Ensure data quality, integrity, and scalability within data infrastructure. Troubleshoot and improve existing machine learning systems and pipelines. Required Skills Minimum of 5 years of experience in data engineering or related roles. At least 2 years of hands-on experience as a Machine Learning developer. Strong programming skills in Python. Solid understanding of machine learning fundamentals. Practical experience with custom object detection and OCR applications. Proficiency in key Python libraries for machine learning and data processing. Ability to work collaboratively in cross-functional teams. Qualifications Any graduate degree from a recognized university. Work with cutting-edge machine learning technologies in a supportive, innovative environment in Bangalore. Grow your career by solving complex problems and building impactful data solutions with a passionate team. Qualification : Any graduate degree from a recognized university.

Staff Software Engineer Databases Location: Bengaluru, India Company: Databricks About Databricks Databricks is a leading data and AI company powering over 10,000 organizations globally, including half of the Fortune 500. Founded by the original creators of Apache Spark , Delta Lake, and MLflow, Databricks offers a unified platform for data, analytics, and AI, enabling enterprises to innovate with confidence. With its global presence and a growing Bengaluru team, Databricks is rapidly expanding. Role Overview As a Staff Software Engineer in Bengaluru, you ll work within Backend or Distributed Data Systems (DDS) teams to build scalable, reliable, and high-performance services powering Databricks data and AI platform. You will tackle challenges ranging from distributed systems and cloud storage to service architecture, workflow orchestration, and developer experience. Key Responsibilities Develop large-scale distributed backend services, including managing cloud storage backends like AWS S3 or Azure Blob Store. Build and maintain infrastructure that supports millions of cluster-hours per day. Contribute to key DDS projects such as Apache Spark , Delta Lake, and performance engineering. Design and implement high-performance, reliable, and scalable systems and client libraries. Collaborate cross-functionally to drive innovation in cloud-native data processing and storage. Qualifications BS or higher in Computer Science or related field. 10+ years of production software engineering experience in Python, Java, Scala, C++, or similar. Proven experience developing large-scale distributed systems from the ground up. Experience with SaaS platforms or Service-Oriented Architectures. Benefits & Culture Competitive benefits tailored to employees needs. Committed to fostering a diverse, inclusive, and equitable work environment. Diversity & Inclusion Statement Databricks ensures equal employment opportunities regardless of age, race, gender, ethnicity, disability, sexual orientation, veteran status, or other protected characteristics, striving for a welcoming and inclusive workplace. Qualification : BS or higher in Computer Science or related field.

Database Engineer II Location: Bangalore, Karnataka | Department: Tech About the Team At Meesho, 5% of Indian households shop with us and to manage millions of orders every day, we ve built resilient systems that operate with zero downtime! Our engineering muscle is a key driver behind Meesho s growth as an e-commerce giant. We value speed over perfection and view failures as opportunities for growth. As a Database Engineer II, you ll be part of a team that thrives on collaboration, constructive feedback, and innovation. If you enjoy solving complex technical problems while working with a fun, dynamic team, Meesho is the place for you! About the Role As a Database Engineer II at Meesho, you'll implement best practices for NoSQL Database Engineering, working with a variety of NoSQL technologies at a large scale. You ll collaborate closely with engineering teams to optimize and streamline systems and processes. Being proficient in emerging technologies and working effectively with cross-functional teams will be key to your success in this role. What You Will Do Manage, maintain, and monitor relational and NoSQL database clusters to meet SLAs. Oversee both in-house and SaaS solutions in the public cloud or 3rd party environments. Diagnose and communicate database issues to relevant stakeholders and implement solutions. Design and implement best practices for provisioning, tuning, upgrading, and decommissioning database clusters. Cost optimization: Implement mechanisms for cost control and continuous improvement. Collaborate with teams to automate approaches for scalability, reliability, and performance. Participate in R&D: Research new database features and innovative solutions. Be part of the on-call rotation to ensure smooth database operations. What You Will Need 5+ years of experience in provisioning and managing relational/NoSQL databases. Proficiency in two or more of the following: MySQL, PostgreSQL, BigTable, Elasticsearch, MongoDB, Redis, ScyllaDB. Strong Python programming skills. Experience with deployment orchestration, automation, and security management using tools like Jenkins, Terraform, and Ansible. Experience with cloud platforms like AWS or GCP. Comfortable working in Linux/Unix environments. Knowledge of TCP/IP stack, load balancers, and networking concepts. Proven ability to drive projects to completion in a timely manner. A degree in Computer Science, Software Engineering, IT, or a related field is a plus. About Us Welcome to Meesho, where every story starts with a spark of inspiration and entrepreneurial spirit. We're not just an e-commerce platform; we're your partner in making dreams come true. Curious about life at Meesho? Our employees rave about our culture and environment and we re proud to be one of the top-rated e-commerce workplaces on Glassdoor! Our Mission Meesho s mission is to democratize internet commerce for everyone. We started with a single goal: to become the e-commerce destination for the next billion Indian consumers and enable 100 million small businesses to succeed online. With over 1.75 million sellers, we provide industry-first benefits like zero commission and the lowest shipping costs. Meesho is empowering small businesses by connecting them with a massive customer base through cutting-edge tech infrastructure and logistics. Culture & Total Rewards At Meesho, we foster a dynamic, high-impact workplace where performance excellence is key. Our people-centric culture is built on our 11 guiding principles (or "Mantras"), which influence everything from recognition and growth discussions to team collaboration. What We Offer: Competitive compensation: Market-leading cash and equity-based rewards tailored to each role and experience. Holistic wellness support: Our MeeCare Program includes benefits covering physical, mental, financial, and social wellness. Medical insurance: Extensive medical coverage for employees and their families, along with wellness services like telehealth and gym discounts. Work-life balance: Generous leave policies, parental support, retirement benefits, and continuous learning support. Employee recognition: Personalized gifts, team engagement, and a culture of appreciation. Additional benefits including salary advance, relocation assistance, and flexible benefits plans. Qualification : A degree in Computer Science, Software Engineering, IT, or a related field is a plus.

Android Developer - I Location: Bangalore, Karnataka | Tech About the Team When 5% of Indian households shop with us, it s important to build resilient systems to manage millions of orders every day. We ve done this with zero downtime! Sounds impossible? Well, that s the kind of Engineering muscle that has helped Meesho become the e-commerce giant that it is today. We value speed over perfection, and see failures as opportunities to become better. We ve taken steps to inculcate a strong Founder s Mindset across our engineering teams, making us grow and move fast. We place special emphasis on the continuous growth of each team member - and we do this with regular 1-1s and open communication. Software Development Engineer - I Android, you will be part of self-starters who thrive on teamwork and constructive feedback. We know how to party as hard as we work! If we aren t building unparalleled tech solutions, you can find us debating the plot points of our favorite books and games or even gossiping over chai. So, if a day filled with building impactful solutions with a fun team sounds appealing to you, join us. About the Role We are seeking problem solvers to join our team of Android Developers. We want candidates with experience in programming, user interfaces, and/or tools supporting applications on Android using the Android SDK. As SDE I - Android, you will gain experience in building maintainable and testable code bases, including API design and unit testing techniques. If you are interested in joining a world-class team of passionate engineers who work hard and play hard, we look forward to hearing from you. What you will do: Perform code reviews, write unit tests, and contribute to architectural planning and refactoring. Work on bug-fixing and improving application performance. Design and build new features and improvements for the Android platform. Mentor interns and support team members. Collaborate closely with QA, Engineers, Product Managers, and Designers across the company. Collaborate with cross-functional teams to define, design, and ship new features. What you will need: BE/BTech/BCA/BSc in any discipline. 1+ years experience in a relevant role. Experience having worked on two or more Android apps in the past. Familiarity with Java, Kotlin, Android SDK, and the ecosystem. Familiarity with Material Design guidelines, common mobile UX patterns, and anti-patterns. Experience with common Android libraries like Retrofit, OkHttp, Picasso, RxJava, Gson Arch-components etc. Experience with different programming paradigms, esp. functional and reactive programming. Familiarity with consuming REST APIs, and what makes them RESTful. Familiarity with Git and continuous integration. Proficiency at object-oriented programming and multi-threading. Understanding of advanced Android concepts like Custom Views, Accessibility Services, background processing APIs. Understanding of different architectural patterns (esp. MVVM) and their testability. Proficiency at debugging, including identifying memory leaks, performance bottlenecks and using tools like ADB, Proguard, etc. Ability to tell good design from bad design. Ability to write clean, maintainable code which others can work on. Apps published to Play Store are a plus. About Us Welcome to Meesho, where every story begins with a spark of inspiration and a dash of entrepreneurial spirit. We're not just a platform; we're your partner in turning dreams into realities. Curious about life at Meesho? Our people have a lot to say and they've made us the top-rated e-commerce workplace on Glassdoor. Our Mission Democratising internet commerce for everyone- Meesho (Meri shop) started with a single idea in mind -to be an e-commerce destination for the next billion Indian consumers and enable 100 million small businesses to succeed online. We provide sellers with a range of industry-first benefits such as zero commission and the lowest shipping cost. Over 1.75 million sellers are registered on Meesho, growing their business by tapping the company s massive customer base, state-of-the-art tech infrastructure, pan-India logistics at the lowest cost through third-party logistics providers in an 'Everyday Lowest Cost' channel for sellers. Affordable, relatable merchandise mirroring local markets has helped us make inroads with first-time internet users in the country. We cater to an underserved and unique customer base and cover every serviceable pincode in the country. Our unique business model and continuous innovation has enabled us to become the first Indian horizontal E-commerce company. Culture and Total Rewards Our focus is on cultivating a dynamic workplace characterized by high impact and performance excellence. We prioritize a people-centric culture, dedicated to hiring and developing exceptional talent. Total rewards at Meesho comprises of a comprehensive set of elements - monetary, non-monetary, tangible, and intangible in nature. Our 11 guiding principles, or "Mantras," are the backbone of how we operate - influencing everything from recognition and evaluation to growth discussions. Daily rituals & processes like Reflections , Listen or Die , Internal Mobility Program, Talent Reviews, Continuous Performance Management - all embody these principles. We provide market leading compensation - both cash and equity-based - specific to job roles, individual experience and skill along with our employee centric benefits and work environment. We focus extensively on holistic wellness - through our MeeCare Program - encompassing benefits and policies across physical, mental, financial, and social wellness aspects. This includes extensive medical insurance benefits for employees and their families, wellness initiatives like telehealth, wellness events, and gym & recreational discounts etc. To support work-life balance, we provide generous leave policies, parental support benefits, retirement benefits, and learning and development assistance. Through gratitude...

Job Title: Application Developer - ETL and Data Management Introduction: In this role, you ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we provide deep technical and industry expertise to a wide range of public and private sector clients globally. Our delivery centers leverage locally-based skills to help clients drive innovation and the adoption of new technologies. A career in IBM Consulting is built on long-term relationships and close collaboration with clients across the world. You will work with leaders across industries to improve the hybrid cloud and AI journeys for some of the most innovative and valuable companies worldwide. Your ability to make a meaningful impact for clients is enabled by our strategic partner ecosystem and robust technology platforms, including Software and Red Hat. Curiosity and a constant quest for knowledge are key to success in IBM Consulting. In your role, you ll be encouraged to challenge the norm, explore new ideas, and come up with creative solutions that result in groundbreaking impact for a wide network of clients. Our culture is built on evolution and empathy, focusing on long-term career growth and development in an environment that values your unique skills and experience. Your Role and Responsibilities: ETL Workflow Development: Develop and implement ETL workflows by creating ETL jobs, and data models in datamarts using technologies such as Snowflake, DBT, Unix, and SQL. Batch Processing Redesign: Redesign Control M Batch processing for ETL job builds to run efficiently in a production environment. System Evaluation and Improvement: Study the existing system to evaluate its effectiveness and design new systems to improve workflow efficiency. Business Program Analysis & Support: Perform requirements identification, business program analysis, testing, and system enhancements while providing production support. Agile Environment: Work effectively in an Agile environment and gain familiarity with tools such as JIRA and SharePoint. Client Interaction: Good written and verbal communication skills are essential as you will interact directly with client counterparts to understand requirements and provide solutions. Required Technical and Professional Expertise: Experience: A minimum of 3 years of experience in developing ETL applications, implementing workflows, and creating data models using Snowflake, DBT, Unix, and SQL technologies. Agile Environment: Strong understanding of working in an Agile environment and proficiency in tools like JIRA and SharePoint. Problem-Solving Skills: Ability to manage change and proven time management skills. Strong interpersonal skills to contribute effectively to team efforts. Continuous Learning: Stay up-to-date with technical knowledge by attending educational workshops and reviewing relevant publications. Preferred Technical and Professional Expertise: ETL Development: Experience in developing triggers, functions, and stored procedures to support ETL workflows. Impact Analysis: Assist with impact analysis of changing upstream processes on the Data Warehouse and reporting systems. ETL & Reporting Support: Participate in the design, testing, support, and debugging of new and existing ETL and reporting processes. Data Profiling & Troubleshooting: Perform data profiling and analysis using a variety of tools, troubleshoot and support production processes, and maintain documentation. Innovation: Be part of a team that drives global change and leverages cutting-edge technologies to solve complex problems. Growth: Gain access to continuous learning and career development opportunities to further your expertise in data management and cloud technologies. Collaboration: Work with a diverse team in a collaborative environment that values new ideas and creative solutions. Global Impact: Your work will contribute to improving business operations and technological advancements for clients around the world. If you're passionate about driving innovative solutions, working with a variety of clients, and continuously evolving your skills, IBM Consulting is the perfect place for you to advance your career.

Job Title: Senior Python Expert Experience: 3 to 8 years Overview of the Role: This role sets the benchmark for team software development processes and deployment procedures, while actively contributing to establishing best practices and methodologies within the team. Responsibilities: Develop backend services using Python Flask or similar web frameworks. Design and maintain data and pipeline management frameworks using open-source technologies such as Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud-based data engineering services like S3, Redshift, Athena, Kinesis. Design and develop efficient CRUD operations for large datasets with millions of records. Collaborate with teams to build and maintain innovative, reliable, secure, and cost-effective distributed solutions. Own and deliver complex application components within defined timelines. Ensure quality delivery using best practices in API development, performance, and scalability. Participate in customer communication, presentations, and resolution of critical issues. Contribute to architecture, feature set, and design decisions. Proactively recognize and address requirement inconsistencies and project risks. Break down work effectively and estimate accurately. Serve as a technical mentor and role model within the team. Required Skills: Strong knowledge of Python and a web framework like Flask. Experience with AWS services such as EC2, S3, Lambda, Step Functions, Glue, SNS, SQS, Secret Manager, and CodeBuild/CodePipeline. Solid understanding of SQL, including query writing, optimization, and database interaction tools. Experience with API development (RESTful services, Postman, API Gateway). Strong coding, debugging, and problem-solving skills. Understanding of architectural trade-offs and data engineering principles (data acquisition, ingestion, distributed processing, high availability). Ability to independently handle delivery of complex projects. Excellent team management and individual contributor skills. Good to Have Skills: Experience with Big Data frameworks like Hadoop and Spark. Knowledge of AWS Aurora. Familiarity with pip, setuptools, etc. Education: B.E./B.Tech, MCA, M.E./M.Tech.

Job Title: Sr. Data Engineer Job Overview: We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in Snowflake to manage data ingestion and transformation. The ideal candidate will work with an offshore team to deliver scalable data solutions aligned with business and performance requirements. Key Responsibilities: Design, build, and maintain ELT pipelines using Snowflake. Lead offshore development teams in applying data engineering best practices. Collaborate with stakeholders to manage data integration across systems. Optimize data pipelines for performance and reliability, including query tuning and resource management. Implement data validation processes to ensure data accuracy. Document data pipelines, flow diagrams, and transformation logic. Troubleshoot pipeline failures and resolve performance issues. Ensure compliance with data governance and regulatory requirements. Required Qualifications: 5+ years of experience in data engineering with a focus on ELT development. Strong expertise in Snowflake, including data sharing, secure views, and performance optimization. Proficiency in SQL and data integration tools. Experience managing offshore development teams. Strong problem-solving and communication skills. Preferred Qualifications: Snowflake certification or relevant certifications. Experience in financial services with knowledge of data security and compliance. Familiarity with cloud platforms (AWS, Azure) and orchestration tools like Apache Airflow. Experience with Python or JavaScript for data transformation. Knowledge of data visualization tools like Tableau or Power BI.

Database Engineer About the Role: We are seeking a skilled Database Engineer with a strong focus on SQL/PLSQL development and performance tuning. This role requires expertise in designing, developing, and optimizing database solutions within an Oracle Database 19c environment. The ideal candidate will have a deep understanding of SQL processing, PL/SQL development, and performance tuning methodologies. Responsibilities: Develop complex SQL queries, including subqueries, correlated subqueries, and dynamic SQL. Create SQL scripts for data migration and ETL processes. Utilize SQL*Loader for data loading from flat files and spreadsheets. Design and develop database objects (tables, views, indexes, constraints, synonyms, database links). Develop stored procedures, functions, and complex PL/SQL packages. Work with collections in PL/SQL. Apply knowledge of Oracle Database 19c features and awareness of Oracle 23c AI database. Understand Oracle architecture, data dictionary views, and catalog views. Identify and resolve performance bottlenecks affecting SQL queries and the database. Utilize performance monitoring and reporting utilities (STATSPACK, AWR, ADDM, SQL Monitoring). Perform SQL tuning, PL/SQL tuning, and application tuning using tools like TKPROF, Explain Plan, and SQL Monitoring. Optimize SQL queries using indexes, table partitioning, and partition swapping. Optimize database performance by analyzing database objects, creating indexes, and materialized views. Apply bucketing concepts. Schedule and troubleshoot jobs in Oracle Database. Migrate data between database environments using Import/Export. Qualifications: Demonstrated expertise in developing complex SQL queries, including subqueries, correlated subqueries, and dynamic SQL. Proficiency in PL/SQL development, including stored procedures, functions, packages, and collections. Experience with data migration and ETL processes. Hands-on experience with SQL*Loader. Strong understanding of Oracle Database architecture and performance tuning methodologies. Familiarity with performance monitoring and reporting tools (STATSPACK, AWR, ADDM, SQL Monitoring). Experience with SQL and PL/SQL tuning techniques. Knowledge of Oracle Database 19c features and awareness of Oracle 23c AI database. Experience with job scheduling and troubleshooting. Proficiency in data migration using Import/Export. Experience with bucketing.

About MongoDB MongoDB empowers innovators to create, transform, and revolutionize industries by harnessing the power of software and data. We enable organizations of all sizes to build, scale, and manage modern applications by modernizing legacy systems, fostering innovation, and integrating AI. Our industry-leading developer data platform, MongoDB Atlas, is the only globally distributed, multi-cloud database available in over 115 regions across AWS, Google Cloud, and Microsoft Azure. With Atlas, customers can build anywhere on the edge, on-premises, or across multiple cloud providers. With a global presence and over 175,000 developers joining MongoDB monthly, industry leaders such as Samsung and Toyota rely on us to develop next-generation, AI-driven applications. Role Overview We are seeking passionate and skilled technologists to join our Pre-Sales organization, ensuring that our growth is strategically aligned with our platform s capabilities and our customers needs. As a Pre-Sales Solution Architect, you will guide customers in designing and implementing reliable, scalable systems using MongoDB s data platform. Our team consists of experienced software architects, entrepreneurs, and developers who take direct responsibility for customer success from software design to deployment and operations. You will collaborate closely with our sales team, playing a key role in securing deals and driving business growth. As a trusted advisor, you will work with a diverse range of clients, from startups to large enterprise IT organizations. If you d like to learn more about the role, explore the experiences of Veronica Tudor, Matt Kalan, and Winston Vargo on our Life at MongoDB blog. This role is based in our Bengaluru office as part of our hybrid working model. Ideal Candidate Profile Required Qualifications: 10+ years of professional experience, including a strong background in software development. 3+ years of pre-sales experience with enterprise software solutions. Proficiency in at least two modern scripting or programming languages (e.g., Python, Node.js, SQL, C/C++, Java, C#). Hands-on experience with scalable and highly available distributed systems. Willingness to travel within the region, including international travel as needed. Preferred Qualifications: Experience selling databases or deploying applications with major cloud providers (AWS, Google Cloud, Azure). Familiarity with database programming and data modeling best practices. Key Responsibilities Design systems, applications, and infrastructure to support large-scale software development projects using MongoDB. Provide technical guidance on architectures, patterns, and best practices for leveraging MongoDB effectively. Support the sales team with technical discovery, demonstrations, proof of value, presentations, system sizing, and documentation of technical decision criteria. Translate technical concepts into business value for stakeholders, including executives and decision-makers. Act as a liaison between customers and MongoDB s Product Management team, providing field insights and feedback. Represent MongoDB at industry events, trade shows, and account-based marketing initiatives to drive demand. Mentor and support other pre-sales team members, sharing knowledge and best practices. Demonstrate situational awareness and adaptability in dynamic team environments. Learning & Development Opportunities Gain in-depth knowledge of MongoDB s rapidly evolving product suite, including: Core Database Server Atlas (fully managed cloud database service) Atlas Data Lake, Atlas Full-Text Search, Realm (Mobile Database), Charts Developer Tools & Connectors (Ops/Cloud Manager, Compass, Connector for BI, Connector for Spark) Expand expertise in complementary technologies such as Apache Kafka and Kubernetes. Learn and apply modern architecture methodologies, including microservices, event-driven architectures, DevOps, and cloud security. Develop and refine sales techniques, including presentations, demonstrations, whiteboarding, discovery, and objection handling. Gain exposure to a diverse range of industries and real-world use cases. Culture & Benefits At MongoDB, we prioritize the personal and professional growth of our employees by fostering a supportive and enriching work environment. From employee affinity groups and fertility assistance to a generous parental leave policy, we are committed to the well-being of our team members at every stage of their journey. Learn more about life at MongoDB and join us in making a meaningful impact on the world. MongoDB is an equal-opportunity employer committed to diversity and inclusion. We provide accommodations for individuals with disabilities throughout the application and interview process. If you require accommodations, please inform your recruiter.

As a Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical solution engineers and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products. The impact you will have: As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year Be a hands on manager to assist the team members in resolving issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools/automation initiatives Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc What we look for: Min 10-12 years of experience in designing, building, testing, and maintaining Python/Java/Scala/Spark based applications in a typical project delivery and consulting environments with 4+ years working as a Manager 5+ years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark,Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Spark experience is mandatory Hands on experience in the performance tuning/troubleshooting of Hive and Spark based applications at production scale. Real time experience in JVM and Memory Management techniques such as Garbage collections, Heap/Thread Dump Analysis is preferred Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred Hands-on experience with AWS or Azure or GCP is preferred Experience in implementing CI/CD, Monitoring/alerting for Production Systems Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable Experience in leading and managing end-to-end projects and have reported and escalated to top levels Experience in managing and leading teams in an organisation involving multiple reporting lines Strong written and verbal communication skills; very good analytical, organisational, multi-tasking skills About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

As a Senior Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical Solution Engineers (Spark) and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products. The impact you will have: As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year Be a hands on manager to assist the team members in resolving issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools/automation initiatives Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc What we look for: Min 10-12 years of experience in designing, building, testing, and maintaining Python/Java/Scala/Spark based applications in a typical project delivery and consulting environments with 4+ years working as a Manager 5+ years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark,Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Big Data / Spark hands on-experience is mandatory Hands on experience in the performance tuning/troubleshooting of Hive and Spark based applications at production scale. Real time experience in JVM and Memory Management techniques such as Garbage collections, Heap/Thread Dump Analysis is preferred Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred Hands-on experience with AWS or Azure or GCP is preferred Experience in implementing CI/CD, Monitoring/alerting for Production Systems Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable Experience in leading and managing end-to-end projects and have reported and escalated to top levels Experience in managing and leading teams in an organisation involving multiple reporting lines About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Mission As a Spark Backline Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before it reaches the engineering team. You will report to the Senior Backline Manager of the Backline Escalations Team. Outcomes Troubleshoot, resolve and suggest deep code-level analysis of Spark to address complex customer issues related to Spark core internals, Spark SQL, Structured Streaming and Databricks Delta. Provide best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers. Help the support team with detailed troubleshooting guides and runbooks. Contribute to automation and tooling programs to make daily troubleshooting efficient. Work with the Spark Engineering Team and spread awareness of upcoming features and releases. Identify Spark bugs and suggest possible workarounds. Demonstrate ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests Participate in weekend and weekday on call rotation. Competencies Minimum 5 years' experience developing, testing, and sustaining Python or Java or Scala-based applications. Comfortable with compiling, building and navigating the Apache Spark source code. Comfortable with identifying and applying patches/bug fixes to the Apache Spark source code. Experience in Big Data/Hadoop/Spark/Kafka/Elasticsearch data pipelines. Hands-on experience with SQL-based database systems. Experience in JVM, GC, Thread dump-based troubleshooting is required. Experience with AWS or Azure related services. Bachelor's degree in Computer Science or a related field is required. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone. Qualification : Bachelor's degree in Computer Science or a related field is required.