Staff Software Engineer , Machine Learning (search) Job in Databricks

Staff Software Engineer, Machine Learning (Search)

Location: Bengaluru, India
Company: Databricks

Role Overview

Join Databricks Applied AI team as a Staff Engineer to lead advancements in Search Quality. This role focuses on improving search ranking, query understanding, and building scalable evaluation frameworks to enhance discovery across millions of data assets on the platform.

Key Responsibilities

• Lead development and deployment of ML/NLP-based search relevance models integrated with Databricks products.
• Design and build automated ML pipelines for data preprocessing, query understanding/rewrite, ranking, retrieval, and evaluation.
• Collaborate with product managers and cross-functional teams to drive strategic search product innovations.
• Develop robust frameworks for offline and online evaluation of search ranking improvements.

What We re Looking For

• BS or higher (MS/PhD preferred) in Computer Science or related fields.
• 10+ years experience building search relevance systems at scale in production or research environments.
• Experience applying Large Language Models (LLMs) to search relevance problems.
• Expertise in query understanding, NLP, text mining, recommendations, personalization, discovery, or conversational AI.
• Strong computer science fundamentals.
• Contributions to popular open-source projects is a plus.

Why Join Databricks?

Work at the forefront of AI-driven data products, collaborate with top AI/ML experts, and influence how thousands of organizations discover and interact with data. Databricks offers a cutting-edge platform and a collaborative, innovative culture.