BriefCase
BriefCase

Senior Data Engineer + Ai Job in Pratham Software Private Limited

Senior Data Engineer + Ai

Pratham Software Private Limited 4+ weeks ago
Apply Now
Job Summary

Position: Senior Data Engineer + AI

Experience: 2 5 years

Location: Jaipur

Category: Careers / Data & AI

About the Role

We re seeking a dynamic Senior Data Engineer with a strong foundation in PySpark, Apache Spark, and Databricks, who is also enthusiastic about working with Generative AI and Agentic AI technologies. This is an opportunity to work at the intersection of data engineering, AI innovation, and business insights delivering impactful solutions for high-value clients.

Key Responsibilities

  • Design and develop scalable data pipelines for batch and real-time processing using PySpark, Spark, and Databricks.
  • Enable AI-driven solutions, including Retrieval-Augmented Generation (RAG), embedding models, and LLM integration.
  • Build and maintain BI dashboards and reports using Power BI, Tableau, or Looker.
  • Perform in-depth data analysis to support data-driven strategies and insights.
  • Architect and manage data warehouses and data lakehouse environments with Snowflake, PostgreSQL, etc.
  • Support the integration and orchestration of LLM agent frameworks (LangChain, Haystack, CrewAI, etc.).
  • Ensure pipeline performance, cost-efficiency, and monitoring in cloud platforms (Azure, AWS, or GCP).
  • Collaborate across teams AI researchers, analysts, and business stakeholders to drive end-to-end solutions.
  • Uphold best practices in data governance, metadata management, and compliance using tools like DataHub or Azure Purview.

Required Skills & Experience

  • Advanced skills in PySpark, Apache Spark, and Databricks.
  • Proficient in SQL for data modeling and transformation.
  • Hands-on experience with data visualization tools (Power BI, Tableau, Looker).
  • Solid understanding of relational databases, data warehousing, and data lake architectures.
  • Exposure to Generative AI, RAG pipelines, vector databases (FAISS, Pinecone, ChromaDB).
  • Familiarity with Agentic AI tools such as LangChain, Haystack, CrewAI.
  • Cloud experience with Azure, AWS, or Google Cloud.
  • Strong communication and problem-solving skills with the ability to translate business needs into data solutions.

Preferred Qualifications

  • Experience with Databricks-native tools: MLflow, Delta Live Tables.
  • Knowledge of prompt engineering, LLM deployment, and orchestration.
  • Familiarity with CI/CD, Docker, Git, and DevOps practices.
  • Understanding of Responsible AI, privacy regulations, and data ethics.
  • Background in consulting, enterprise AI/ML, or product development.

This role is ideal for engineers passionate about building robust data systems while exploring the potential of AI in real-world use cases.

Apply Now to join a team where data meets intelligence.
Experience Required :

2 to 5 Years

Vacancy :

2 - 4 Hires

Apply Now
Similar Jobs for you