Principal Ai Engineer - Mlops Job in Rapid7

Principal AI Engineer - MLOps

Location: Pune

Overview

Rapid7 is seeking a **Principal AI Engineer - MLOps** to drive the development and deployment of **scalable, production-grade AI/ML systems** in the field of cybersecurity. This role is within the **AI Center of Excellence team** and involves managing the **end-to-end design of ML production systems** from scoping and data requirements to continuous deployment and monitoring. You will play a pivotal role in mentoring junior engineers and shaping the **MLOps culture**.

Key Technologies Used

• **Cloud/Infrastructure:** AWS (research environments, data hosting), **EKS** (Kubernetes), **Terraform** (Infrastructure as Code).
• **Modeling/Data:** **Python** (numpy, pandas, scikit-learn), Jupyter notebooks, Anomaly detection methods.

Key Responsibilities

• End-to-End ML Production System Design:
  • **Architect and manage the design and deployment** of ML systems from inception to production.
  • Define project scopes, data requirements, modeling strategies, and **deployment pipelines** for AI/ML systems.
  • Ensure **seamless integration** of models and AI components into the production environment, focusing on **scalability, reliability, and security**.
• Data Pipeline Management:
  • **Develop and maintain data pipelines**, ensuring data consistency, integrity, and accessibility throughout the ML lifecycle.
  • Oversee the data lifecycle, including **data preprocessing, feature engineering**, and storage.
• ML Guardrails & Monitoring:
  • Implement **robust ML guardrails** to ensure model performance, fairness, and compliance.
  • Manage the **monitoring and observability** of deployed models, ensuring timely and accurate tracking of model performance.
• Deployment & Service Monitoring:
  • Develop and deploy accessible endpoints, including **web applications and REST APIs**, adhering to security best practices.
  • Continuously monitor models and data to detect issues such as **drift, anomalies, or performance degradation**.
• Collaboration & Mentorship:
  • Collaborate closely with engineering, data science, and product teams to ensure alignment on goals.
  • **Mentor and guide junior engineers**, share knowledge, and promote best practices in MLOps.
• Agile Development & Iteration:
  • Embrace **agile practices**, focusing on continuous iteration and solving complex challenges.

Skills & Experience

Core Technical Expertise

• **Extensive Software Engineering Experience:** 15+ years as a software engineer, with at least **3-5 years of expertise in MLOps** in AWS environments.
• **MLOps & DevOps:** Proven experience deploying **scalable AI/ML systems**, managing **CI/CD pipelines**, and utilizing cloud AI resources.
• Expertise with **Docker, Kubernetes, and cloud-based AI infrastructure management**.
• **Programming:** Strong proficiency in **Python** (Flask or FastAPI) and experience building APIs.

Data & Modeling Skills

• Experience in designing **data pipelines** and performing **feature engineering**.
• Familiarity with **model risk management** strategies, including **concept drift monitoring** and hyperparameter tuning.

Leadership & Communication

• Demonstrated ability to **collaborate across engineering, data science, and product teams**.
• Proven track record of **mentoring and guiding junior engineers**.
• Strong communication skills for conveying complex technical concepts and creating detailed system architecture documentation.

Nice to Have

• Experience deploying resources that enable data scientists to fine-tune and experiment with **LLMs (Large Language Models)**.
• Understanding of AI/ML operational frameworks and associated challenges.

Why Join Rapid7?

• Be a part of **cutting-edge AI/ML efforts** to strengthen cybersecurity.
• Mentor and grow the next generation of engineers in an inclusive, fast-paced environment.
• Tackle some of the most challenging security problems with a passionate and creative team.