Data Pipeline Engineer Jobs in Pune

428 Jobs Found

RS

Ai/ml Engineer

Roxiler Systems

2-3 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

AI/ML Engineer Experience: 2 3 Years Education: BBA, BSc, BTech/BE, MSc, MTech, MCA Location: Pune About the Role We are seeking a passionate AI/ML Engineer to design, build, and scale production-grade AI systems that power our platform. You will work on real-world AI problems such as document intelligence, real-time voice AI, and intelligent job-to-candidate matching systems. This role requires strong hands-on experience in LLM engineering, backend development, and AI system productionization. Required Skills Python (FastAPI) LangChain, LlamaIndex OpenAI API, Anthropic Good to Have Postgres (Pgvector), Supabase Redis Docker LangSmith GitHub Actions Roles & Responsibilities Build Agentic Workflows: Design and deploy AI agents capable of reasoning and decision-making using LangChain or LlamaIndex. Develop Voice AI Systems: Build low-latency, real-time conversational voice bots for candidate outreach using WebSockets, STT, and TTS, ensuring effective context retention and state management. Engineer Data Pipelines: Create robust parsing systems that enforce strict JSON outputs from LLMs for resume data extraction, along with data cleaning pipelines for unstructured formats (PDF/DOCX). Implement Advanced RAG Systems: Develop retrieval pipelines using Pgvector or Pinecone with hybrid search (semantic + keyword) for accurate job-to-candidate matching. Productionize & Monitor AI Systems: Set up tracing and observability using LangSmith to debug chains, monitor token usage, and optimize performance and cost. Backend Integration: Package AI logic into scalable, asynchronous microservices using FastAPI and Docker. Technical Requirements 1. Generative AI & LLM Engineering Experience enforcing structured JSON outputs using function calling. Strong prompt engineering skills (Chain-of-Thought, Few-Shot). Hands-on experience orchestrating complex AI pipelines using LangChain or LlamaIndex. 2. Voice AI & Real-Time Processing Experience with STT/TTS APIs (e.g., Whisper, Deepgram). Strong understanding of WebSockets and async programming for real-time audio streaming. Ability to design conversation managers with memory and context handling. 3. Search & Data (RAG) Experience with vector databases such as Pgvector, Pinecone, or Qdrant. Expertise in chunking, cleaning, and ingesting unstructured data. 4. MLOps & Production Engineering Observability and tracing using LangSmith. Writing automated AI evaluation scripts to test prompts before deployment. Experience optimizing cost by balancing model performance and token usage. 5. Core Backend Engineering Strong Python skills with FastAPI. Proficiency in async/await patterns for concurrent processing. Experience with Docker and relational databases (SQL). 6. Machine Learning & Algorithms Understanding of recommendation systems (Collaborative Filtering, Two-Tower models). Experience with ranking and re-ranking techniques (LTR, Cross-Encoders). Familiarity with traditional ML models using Scikit-learn or XGBoost. The Applied Mindset We Value Model Strategy: Ability to choose the right model based on cost, latency, and intelligence requirements. Security First: Awareness of prompt injection and jailbreaking risks and strategies to mitigate them. Hallucination Control: Strong grounding techniques to ensure factual and reliable AI outputs. Tech Stack Overview Languages: Python (FastAPI) AI & Orchestration: LangChain, LlamaIndex, OpenAI API, Anthropic Voice AI: Deepgram, Twilio Databases: Postgres (Pgvector), Supabase, Redis DevOps & MLOps: Docker, LangSmith, GitHub Actions Qualification : BBA, BSc, BTech/BE, MSc, MTech, MCA

Ai Ai ml Engineer Ai engineer Ml engineer
RA

Principal Ai Engineer - Mlops

Rapid7

15+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Principal AI Engineer - MLOps Location: Pune Overview Rapid7 is seeking a **Principal AI Engineer - MLOps** to drive the development and deployment of **scalable, production-grade AI/ML systems** in the field of cybersecurity. This role is within the **AI Center of Excellence team** and involves managing the **end-to-end design of ML production systems** from scoping and data requirements to continuous deployment and monitoring. You will play a pivotal role in mentoring junior engineers and shaping the **MLOps culture**. Key Technologies Used **Cloud/Infrastructure:** AWS (research environments, data hosting), **EKS** (Kubernetes), **Terraform** (Infrastructure as Code). **Modeling/Data:** **Python** (numpy, pandas, scikit-learn), Jupyter notebooks, Anomaly detection methods. Key Responsibilities End-to-End ML Production System Design: **Architect and manage the design and deployment** of ML systems from inception to production. Define project scopes, data requirements, modeling strategies, and **deployment pipelines** for AI/ML systems. Ensure **seamless integration** of models and AI components into the production environment, focusing on **scalability, reliability, and security**. Data Pipeline Management: **Develop and maintain data pipelines**, ensuring data consistency, integrity, and accessibility throughout the ML lifecycle. Oversee the data lifecycle, including **data preprocessing, feature engineering**, and storage. ML Guardrails & Monitoring: Implement **robust ML guardrails** to ensure model performance, fairness, and compliance. Manage the **monitoring and observability** of deployed models, ensuring timely and accurate tracking of model performance. Deployment & Service Monitoring: Develop and deploy accessible endpoints, including **web applications and REST APIs**, adhering to security best practices. Continuously monitor models and data to detect issues such as **drift, anomalies, or performance degradation**. Collaboration & Mentorship: Collaborate closely with engineering, data science, and product teams to ensure alignment on goals. **Mentor and guide junior engineers**, share knowledge, and promote best practices in MLOps. Agile Development & Iteration: Embrace **agile practices**, focusing on continuous iteration and solving complex challenges. Skills & Experience Core Technical Expertise **Extensive Software Engineering Experience:** 15+ years as a software engineer, with at least **3-5 years of expertise in MLOps** in AWS environments. **MLOps & DevOps:** Proven experience deploying **scalable AI/ML systems**, managing **CI/CD pipelines**, and utilizing cloud AI resources. Expertise with **Docker, Kubernetes, and cloud-based AI infrastructure management**. **Programming:** Strong proficiency in **Python** (Flask or FastAPI) and experience building APIs. Data & Modeling Skills Experience in designing **data pipelines** and performing **feature engineering**. Familiarity with **model risk management** strategies, including **concept drift monitoring** and hyperparameter tuning. Leadership & Communication Demonstrated ability to **collaborate across engineering, data science, and product teams**. Proven track record of **mentoring and guiding junior engineers**. Strong communication skills for conveying complex technical concepts and creating detailed system architecture documentation. Nice to Have Experience deploying resources that enable data scientists to fine-tune and experiment with **LLMs (Large Language Models)**. Understanding of AI/ML operational frameworks and associated challenges. Be a part of **cutting-edge AI/ML efforts** to strengthen cybersecurity. Mentor and grow the next generation of engineers in an inclusive, fast-paced environment. Tackle some of the most challenging security problems with a passionate and creative team.

Principal Ai Engineer Principal engineer Ai engineer
CT

Technical Project Manager-II

Calfus Technologies India

6+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Technical Project Manager-II Location: Pune Employment Type: Full-Time About Calfus At Calfus, we deliver innovative AI agents and enterprise solutions that transform businesses in unimaginable ways. Our software engineering and ERP teams empower startups and enterprises to harness AI s full potential, automate complex workflows, and drive revenue growth. We pride ourselves on a culture of innovation, speed, and collaboration. As one of the fastest-growing companies in the AI space, we seek talented professionals who are passionate, driven, and ready to make an impact. About the Role As a Technical Project Manager-II, you will lead the successful delivery of complex technical projects from conception through deployment. Your role includes managing cross-functional teams, defining project scopes, creating timelines, allocating resources, and ensuring projects meet customer requirements on time and within budget. You will bridge communication between technical teams and stakeholders, proactively resolving issues to keep projects on track. Key Responsibilities Lead end-to-end delivery of GenAI/LLM-based software solutions across diverse business functions. Understand customer needs, translate them into technical requirements, and negotiate priorities. Build and nurture a strong engineering culture focused on respect, empathy, and best practices. Collaborate with principal engineers across Calfus locations to develop best-in-class products. Manage project scope, timelines, resources, and risks to ensure timely delivery. Facilitate communication between stakeholders and technical teams. Support engineering teams by addressing challenges and helping unblock technical issues. Apply Agile, Scrum, or other development methodologies effectively. Utilize project management and development tools (Jira, Git, Jenkins, Docker, etc.). Leverage cloud technologies (AWS, Azure) and understand system architectures. What We Expect From You 6+ years of relevant project management experience, with 5+ years in technical or IT environments. Proven success managing complex, multi-team software projects, especially involving AI/ML or GenAI/LLM solutions. Strong programming knowledge in one or more: Node.js, Java, Python, React.js, Angular. Deep understanding of software development life cycles and methodologies (Agile, Scrum, Waterfall). Experience with cloud architectures and deployment pipelines (DevOps, CI/CD). Excellent communication skills to engage technical and non-technical stakeholders. Ability to drive decision-making based on data and insights. Proficient with project management tools like Jira, MS Project, Asana, etc. Bonus Skills Certifications such as PMP, ScrumMaster or equivalent. Hands-on experience with DevOps and continuous integration/deployment practices. Familiarity with data pipelines from ingestion to dashboards is a plus. Benefits Comprehensive medical, group, and parental insurance. Gratuity and provident fund contributions. Wellness programs and birthday leave. Inclusive, fast-paced culture that values innovation and diversity. Equal Opportunity Statement Calfus Inc. is committed to creating an inclusive workplace where everyone regardless of background, identity, or experience has the opportunity to thrive. We celebrate diversity and encourage all qualified candidates to apply.

Technical Project Technical project Manager Technical manager
CT

Data Engineer

Calfus Technologies India

3-4 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Data Engineer BI Analytics & DWH Location: Pune About Calfus At Calfus, we develop cutting-edge AI agents and software products that enable businesses to unlock the full potential of AI transforming operations, boosting revenue, and driving innovation. From startups to global enterprises, our clients trust us to deliver engineering excellence. Our teams have built ERP and cloud solutions that integrate seamlessly with core business systems, streamlining manual processes and empowering teams to focus on high-impact work. As one of the fastest-growing companies in our sector, we thrive on collaboration, speed, and innovation. If you re driven by impact and love working in fast-paced environments, we want to hear from you. About the Role We re looking for a Data Engineer with 3 4 years of experience to join our Business Intelligence & Data Warehouse team. In this role, you'll be responsible for building robust data pipelines, designing scalable data models, and supporting analytics and reporting capabilities. You will work with modern tools like Azure Data Factory, Databricks, and Snowflake, and help deliver reliable, performant data infrastructure for internal and client-facing initiatives. What You ll Do ETL/ELT Development Build and maintain efficient ETL/ELT pipelines using Azure Data Factory, Databricks, or equivalent. Ingest and consolidate data from multiple sources into data warehouses or data lakes. Data Modeling & Warehousing Design and implement relational and dimensional models suited for business reporting. Work with databases such as Snowflake, Redshift, Postgres, or SQL Server. SQL & Database Engineering Write performant SQL queries, stored procedures, and scripts for data transformation. Implement complex joins and aggregations for analytical workloads. BI & Visualization Support Collaborate with business users to support reporting in Power BI or Tableau. Enable data-driven decisions through accessible and accurate data models. Performance & Data Quality Monitor pipeline jobs for failures, performance issues, and delays. Apply data validation checks to ensure the integrity and accuracy of data. Bachelor s degree in Computer Science, Data Engineering, Information Systems, or related field. 3 4 years of hands-on experience in data engineering, with strong skills in ETL/ELT, SQL, and data modeling. Experience with cloud platforms (Azure, AWS) and tools like: Azure Data Factory Databricks SQL Server, Postgres, Redshift, or Snowflake Basic understanding of Python for scripting and automation. Familiarity with file formats like JSON, Parquet, and CSV. Exposure to BI tools such as Tableau or Power BI (nice to have). Benefits @ Calfus Medical, group, and parental insurance Provident fund & gratuity Birthday leave and wellness support High-growth, high-impact environment Diversity & Inclusion Calfus is proud to be an Equal Opportunity Employer. We believe that diversity drives innovation, and we are committed to fostering an inclusive, supportive, and respectful environment for all. Qualification : Bachelors degree in Computer Science, Data Engineering, Information Systems, or related field

Data Engineer Data Engineer Full-Time Data Engineering
CT

Data Engineering Lead

Calfus Technologies India

6-12 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Data Engineering Lead BI Analytics & DWH Location: Pune About Calfus At Calfus, we build groundbreaking AI agents and enterprise software that are redefining what s possible for businesses. Whether it's automating workflows, integrating ERP systems, or deploying AI-powered solutions, we help companies scale smarter and faster. Our engineering and data teams are at the core of this innovation designing and delivering high-performance solutions that unlock massive business value. As we grow rapidly, we re looking for driven individuals ready to make a meaningful impact. About the Role We re hiring a Data Engineering Lead to own and drive our BI Analytics & Data Warehousing strategy. You'll lead the architecture, development, and optimization of data pipelines, models, and interactive dashboards that power strategic insights across the business. You ll work hands-on with ETL tools, SQL, Power BI, Tableau, Python, and cloud platforms like Azure and AWS while mentoring junior engineers and collaborating with cross-functional stakeholders. What You ll Do Data Architecture & Modeling Design and implement scalable data models that support self-service BI and analytical reporting. Manage data modeling across structured, semi-structured, and cloud-native data sources. ETL/ELT & Integration Oversee ETL processes using SSIS, Airflow, or equivalent tools for seamless data movement. Handle complex data transformation using SQL Server, Postgres, Snowflake, and Redshift. Visualization & Reporting Develop and lead dashboard/report design using Power BI, Tableau, QuickSight, Plotly, or Dash. Drive best practices in dashboard performance, UX, and storytelling with data. Advanced Data Engineering Use Python, PySpark, NumPy, and Pandas for data wrangling and exploratory analysis. Work with Azure Databricks, MongoDB, and cloud storage (S3, Azure Blob) to build robust pipelines. Automation & DevOps Orchestrate pipelines using Apache Airflow, and implement CI/CD for data engineering workflows. Manage version control and code quality across projects using Git-based workflows. Stakeholder Collaboration Partner with business leaders and analysts to translate requirements into scalable data solutions. Align technical delivery with strategic business goals and drive cross-functional data initiatives. Leadership & Mentorship Guide and mentor junior team members across data and BI functions. Foster a culture of innovation, ownership, and continuous learning. What You Bring Bachelor s in Computer Science, Information Systems, Data Engineering, or related field. 6 12 years of experience in BI architecture, data engineering, and analytics. Deep expertise in: ETL tools: SSIS, Airflow Databases: SQL Server, Snowflake, Postgres, Redshift, MongoDB BI Tools: Power BI, Tableau, QuickSight, Plotly/Dash Python for data analysis, automation, and pipeline development Cloud Platforms: Azure, AWS (S3, Lambda, Databricks) Strong SQL and data modeling skills (relational and dimensional). Familiarity with CRISP-DM, data governance practices, and performance tuning. Bonus Points If You Have Experience working with Azure SDK. Ability to work with REST APIs and perform web scraping. BI architecture design and deployment at scale. Growth-driven culture with clear career paths. Work on industry-defining AI and enterprise products. Exposure to diverse clients, industries, and technologies. Strong focus on wellness, flexibility, and learning. Benefits Medical, group, and parental insurance Provident fund & gratuity Birthday leave & employee wellness programs Highly collaborative and innovative work environment Diversity & Inclusion Calfus is an Equal Opportunity Employer. We believe that diversity fuels innovation. We re committed to creating a welcoming and inclusive workplace for everyone regardless of race, gender, age, background, or identity. Lead the future of data at Calfus. Apply now and help power decision-making through scalable, smart, and stunning data engineering solutions. Qualification : Bachelors in Computer Science Information Systems, Data Engineering, or related field

Data Engineering Data Engineering Lead Data lead
CO

Senior/lead Java Developer

Cognologix

6-8 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Position: Senior / Lead Java Developer Location: Pune Work Type: Full Time Minimum Experience: 6 8 Years Top Skills: Core Java, Spring Boot, Cloud-Native Microservices About the Role At Cognologix, we empower data-driven enterprises to harness the full potential of their data. From scalable analytics to machine learning platforms, we help clients navigate their digital transformation journeys. As a Senior/Lead Java Developer, you will work with modern cloud-native technologies to build distributed systems that process terabytes of data efficiently and intelligently. Key Responsibilities Collaborate with Data Scientists, Engineers, and Product Managers to transform complex data into actionable insights. Design and develop high-performance, low-latency Java-based microservices. Own the end-to-end architecture, implementation, and maintenance of backend systems. Design and implement REST APIs and contribute to living documentation and test specifications. Write clean, scalable, and testable code following best development practices. Build and maintain data pipelines using Apache Spark, Google Data Pipelines, or similar tools. Mentor junior developers and actively contribute to team growth and knowledge sharing. Continuously optimize and enhance the software development lifecycle. What You Bring (Must-Have Skills) 5+ years of hands-on experience building scalable cloud-native applications. Proficient in Java, Spring, Spring Boot, and Spring Security frameworks. Experience with Groovy, SQL, or NoSQL databases. Familiarity with distributed event-driven architectures using Kafka, GCP Pub/Sub, etc. Solid understanding of RESTful API design principles and performance optimization. Experience in working with Google Cloud Platform (GCP) and BigQuery is a plus. Nice to Have (Preferred Skills) Exposure to containerized environments and tools such as Docker, Istio, and Kubernetes. Experience with big data technologies like Apache Spark, Flink, or similar platforms. Understanding of CI/CD pipelines, DevOps practices, and cloud infrastructure automation. Full-stack development experience or a willingness to contribute beyond backend responsibilities. High autonomy, fast-paced environment, and flat hierarchy Work on emerging technologies and solve meaningful problems at scale Remote work options available for experienced professionals Competitive compensation and family-friendly benefits Clear path for performance-based career growth About Cognologix Cognologix helps companies disrupt and innovate by reimagining their business models. We specialize in building modern, scalable, cloud-native products with a focus on data engineering, analytics, and automation. Our agile teams deliver high-quality, tech-driven outcomes across industries and geographies.

Senior Lead Senior lead Java Lead java
CO

Associate Data Science Engineer

Cognologix

1-2 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Position: Associate Data Science Engineer Location: Pune, Maharashtra Work Type: Full Time Minimum Experience: 1 2 Years Top Skills: AI Applications, Python, Machine Learning, Deep Learning, NLP/NLG, Image Processing About the Role We are looking for a self-driven Associate Data Science Engineer to join our fast-growing Data & AI Practice. You will work on cutting-edge AI technologies and cloud-native solutions, helping build intelligent, high-impact products for our global clients. If you're passionate about AI/ML, Computer Vision, NLP, Generative AI, and developing scalable AI applications, this role is for you. What You Will Work On Contribute to the design, development, and deployment of AI-powered features and solutions. Collaborate with Product Management to translate business problems into AI/ML use cases. Build applications leveraging Computer Vision, NLP, Deep Learning, and Gen AI technologies. Develop and present functional prototypes, demos, and POCs. Stay current with the latest tools, frameworks, and research in ML, DL, and Gen AI. Participate in end-to-end project lifecycles from analysis to monitoring. What You Bring (Must-Have Skills) 1+ years of experience delivering AI/ML solutions through complete project lifecycle. Strong grasp of Linear Algebra, Statistics, and Probability. Proficiency in Python and data science libraries such as Pandas, NumPy, SciPy, scikit-learn, NLTK. Hands-on experience with ML/DL/NLP frameworks: TensorFlow, Keras, PyTorch, HuggingFace, spaCy, CoreNLP. Experience with Deep Learning models for Computer Vision and Object Detection. Solid knowledge of Generative AI, LLMs, and tools such as LangChain, LlamaIndex, Prompt Engineering. Strong analytical thinking, problem-solving ability, and effective communication. Great If You Also Know Experience with RAG frameworks, Function Calling, Agentic Frameworks, or Vector Search. Familiarity with cloud services: AWS (preferred), Azure, or Google Cloud Platform. Building APIs using FastAPI, async programming, and REST principles. Understanding of CI/CD, Docker/Kubernetes, and cloud-native deployment pipelines. Exposure to MLOps / LLMOps: versioning, tuning, deployment, and monitoring of models. Comfort with data visualization tools and practices. Agile development experience (Scrum, Kanban, etc.). Startup culture, small teams, and a high degree of autonomy. Work on next-gen technologies in AI, ML, GenAI, and cloud computing. Remote working options based on experience and maturity. Competitive salary and family-friendly benefits. Clear, performance-based career growth path. About Cognologix Cognologix helps businesses reimagine and innovate through modern data and cloud-native solutions. With a strong focus on data science, automation, and intelligent applications, we partner with organizations to deliver cutting-edge products in the most efficient and scalable ways. We thrive in a fast-paced, tech-first environment where innovation meets execution.

Associate Data Data Associate Science Data Science
VE

Key Account Manager

Varroc Engineering Ltd

10-12 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Key Account Manager Regional Support (West Region) Location: Pune Experience Required: 10 12 Years Department: Sales & Business Development Industry: Automotive / Engineering / Manufacturing Educational Qualification: Minimum: BE/B.Tech Preferred: MBA in Marketing / Automotive Domain Role Summary: The Key Account Manager Support (Regional) plays a crucial role in driving sales growth, increasing share of business (SOB), and enhancing customer satisfaction by supporting both existing and new business development activities. This role bridges customers, internal business units, finance, and production teams to ensure efficient commercial and operational execution. Key Responsibilities: Customer Relationship & Account Management: Maintain and regularly update customer database (SOB, price history, contacts, etc.). Build and sustain long-term relationships with key OEM clients, including Yamaha, TVSM, and new 2W-EV customers (e.g., eBSA, E-Motorad, KINETIC). Handle export customer accounts, ensuring timely communication, coordination, and query resolution. Act as the primary point of contact for assigned customer accounts, ensuring prompt responses to all routine and strategic requirements. Business Development & Lead Generation: Generate new business opportunities through cold calls, networking, RFP responses, and market intelligence. Support the creation of business proposals, quotations, and commercial documentation. Identify cross-selling and up-selling opportunities within existing accounts to increase SOB. Commercial Support & Coordination: Collaborate with BUs/plants for timely invoice generation, PO compliance, and price amendments (BOPs/raw material). Coordinate with Finance and AR teams to manage receivables and ensure zero outstanding payments. Follow up with customers for invoice realization and help streamline processes related to accounts receivable. Work with internal stakeholders on part price amendments based on raw material cost fluctuations and commercial agreements. Project Execution & Internal Collaboration: Ensure smooth execution of new product development activities with cross-functional teams (Sales, R&D, SCM, Quality). Track development timelines and report status to internal and external stakeholders. Facilitate customer visits, audits, and reviews as required. Market & Competitor Insights: Monitor industry trends, competitor activity, and emerging customer requirements. Attend industry events, conferences, and customer forums to gather market intelligence and build a professional network. Required Skills & Competencies: Strong customer relationship management and negotiation skills. Good understanding of automotive components, raw materials, and BOP pricing. Excellent communication and presentation skills. Sound commercial acumen with ability to analyze market trends and financial data. Hands-on experience in sales pipeline management, lead conversion, and proposal drafting. Proficiency in MS Office Suite (Excel, Word, PowerPoint), ERP tools preferred. Key Accounts to Manage: Metallic Business Accounts Yamaha / TVSM Export Customers All regions New EV Two-Wheeler OEMs Western Region (e.g., eBSA, E-Motorad, KINETIC, etc.) Work with top automotive and EV OEMs in a fast-growing, innovation-driven company. Opportunity to lead key customer accounts and directly contribute to business growth. Collaborate with cross-functional leaders and gain exposure to global markets. Qualification : MBA in Marketing / Automotive Domain

Key Account Key account Manager Key manager
VP

Sr Data Engineer

Vconstruct Private Limited

7-10 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Position: Senior Data Engineer Location: Pune Employment Type: Full-Time Company: vConstruct (Construction Technology Company) About vConstruct vConstruct is a Pune-based construction technology company focused on leveraging data science and analytics to transform the construction industry. Our Data Science and Analytics team is a close-knit group dedicated to supporting the business with robust data infrastructure and insightful analysis. Role Overview We are seeking a highly experienced Senior Data Engineer to lead the design, development, and maintenance of scalable data pipelines and infrastructure. This role involves working closely with cross-functional teams to manage diverse data sources, ensure data integrity, and support data-driven business initiatives. Key Responsibilities Lead the design and development of scalable, high-performance data pipelines and ETL/ELT frameworks following modern data engineering best practices. Architect complex data integration workflows that unify structured, semi-structured, and unstructured data from cloud and on-premise sources. Develop robust real-time, batch, and on-demand data pipelines equipped with monitoring, alerting, and automated error handling. Collaborate with analysts, data scientists, and business leaders to create reliable data models, quality frameworks, and SLAs. Ensure optimal pipeline performance, throughput, and proactive issue resolution. Work with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows aligned with enterprise standards. Enforce best practices in source control, code reviews, testing automation, and continuous delivery. Lead root cause analysis and preventive maintenance to minimize business impact from data failures. Establish standards for data modeling, transformation logic, and governance. Design and execute comprehensive testing strategies to ensure data reliability and pipeline resilience. Optimize pipeline and query performance for scalability, reliability, and cost-efficiency. Maintain detailed technical documentation including architecture diagrams, process flows, and integration specs. Facilitate discussions with business and operational teams to prioritize data initiatives and drive strategy. Qualifications 7-10 years of hands-on experience in data engineering with a track record of building scalable and secure data platforms. 5+ years of scripting experience in Python for data processing, automation, and ETL development. 4+ years experience with Snowflake, including performance tuning, security, and advanced SQL. 5+ years experience with data integration tools like Azure Data Factory, Fivetran, or Matillion. 5+ years writing complex, optimized SQL queries on large datasets. Proven experience integrating APIs, JSON, XML, and webhooks for data acquisition. Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools such as Apache Airflow. Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git). Familiarity with dbt or similar transformation tools and modular development practices. Experience with data visualization tools like Power BI is a plus. Strong interpersonal and communication skills to lead cross-functional technical discussions. Education Bachelor s or Master s degree in Computer Science, Information Technology, or a related field. Equivalent academic and professional experience will also be considered. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or a related field

Sr Data Engineer Sr engineer Data Engineer
BS

Assembler Sustaining Engineer

Bmc Software

5+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Assembler Sustaining Engineer Location: Pune, Maharashtra, India Travel: Occasional business travel may be required About BMC At BMC, trust is more than a value it s how we operate. We are an award-winning, inclusive workplace that celebrates diversity, innovation, and the passion to give back. We believe in work-life balance, empowering individuals, and creating an environment where you feel inspired and supported every day. Your wins will be celebrated, your growth championed, and your contributions deeply valued. We enable our customers to become Autonomous Digital Enterprises ready to take on the future with confidence. The Opportunity: Join the team behind Control-M, BMC s powerful orchestration and automation platform used by the world s top organizations to automate business-critical processes from data pipelines to financial transactions. As a z/OS Assembler Specialist in our Product R&D Support team, you'll work on sustaining engineering and APAR (Authorized Program Analysis Reports) development for mainframe systems. If you're driven by solving complex challenges, collaborating globally, and making a direct impact on product stability and customer satisfaction, this role is for you. Key Responsibilities: Join a dedicated team responsible for product support and APARs development for BMC s mission-critical Mainframe (z/OS) products. Develop and maintain diagnostic tools and solutions to improve the supportability and performance of the product. Contribute to APAR development cycles with a focus on timely delivery and quality. Take ownership of technical issues and work them through to resolution. Collaborate with global teams across functions to ensure product quality meets enterprise-level expectations. Share knowledge, best practices, and mentor others to elevate team capabilities. Qualifications: Bachelor s degree in Computer Science, Engineering, or a related field. 5+ years of experience in an engineering role within a Mainframe z/OS environment. Strong programming experience in Assembler language. Proficiency with z/OS internals, including JCL, JES2/3, SMS. Ability to analyze system dumps using IPCS. Hands-on experience with SMP/E for software maintenance. Strong analytical and troubleshooting skills with customer-focused problem-solving ability. Excellent communication and collaboration skills; capable of working both independently and as part of a team. Nice to Have: Experience with Java, C, or C++ Familiarity with UNIX System Services and Language Environment on z/OS Background in an enterprise product-based company Over 6,000 employees globally, united by innovation and collaboration A culture that recognizes and celebrates your individuality Continuous learning opportunities and exposure to cutting-edge technologies A commitment to creating an inclusive and empowering workplace That s okay. We value diverse backgrounds and perspectives. If you're excited about this role and BMC, we still encourage you to apply. BMC is proud to be an equal opportunity employer. Qualification : Bachelors degree in Computer Science, Engineering, or a related field.

Assembler Sustaining Engineer Full-Time Sustaining engineering
AS

Senior Etl Engineer

Accelirate Softech

5+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Senior ETL Engineer Location: Pune Role Overview: We are seeking a Senior ETL Engineer to design, develop, and optimize our end-to-end data infrastructure, including ETL pipelines, data lakes, and data warehouses. This role is instrumental in enabling reliable, scalable, and high-performance data operations while aligning with data governance best practices. You will be an integral part of a collaborative data team, working closely with Data Engineers, Architects, Analysts, Scientists, and other stakeholders to modernize and migrate our data systems to the cloud. Key Responsibilities: Convert SSIS stored procedures into Matillion mappings, and develop associated job schedules and audit frameworks. Design, build, and maintain efficient ETL pipelines to extract, transform, and load data from multiple sources into the data lake and data warehouse. Implement both full and incremental loads using SCD (Slowly Changing Dimensions) and CDC (Change Data Capture) methodologies for real-time and batch data processing. Develop and maintain robust error handling, job monitoring, and job audit mechanisms. Conduct data profiling, data cleansing, and root cause analysis to resolve data inconsistencies and improve data quality. Optimize data pipelines for performance, scalability, and data quality, using benchmarking and tuning techniques. Build dashboards or reports for ETL job monitoring, performance tracking, and system health checks. Support data governance practices, ensuring accuracy, availability, and security of production data. Contribute to cloud migration initiatives, transitioning data workloads from on-premise systems to modern cloud data platforms. Required Skills & Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 5+ years of experience as an ETL Engineer, Data Engineer, or in a similar data engineering role. Experience with cloud-based data platforms such as AWS, Azure, or GCP. Proficiency with data warehousing technologies like Snowflake, Redshift, Azure Synapse, or Databricks. Hands-on experience with ETL tools such as Matillion, SSIS, Informatica, AWS Glue, Azure Data Factory, StreamSets, STRiim, Oracle ODI, Coalesce, or Talend. Solid understanding of data modeling principles (E/R and Dimensional Modeling) and tools like ER/Studio or ERwin. Proficiency with SQL and programming/scripting languages such as Python, Scala, or Java. Experience with database tools such as Microsoft SSMS or Oracle Developer. Strong analytical, problem-solving, and data troubleshooting skills. Excellent communication and collaboration abilities. Ability to work efficiently in a fast-paced, agile, and dynamic environment. Qualification : Bachelor's degree in Computer Science, Engineering, or a related field.

Senior ETL Engineer Senior engineer ETL Engineer
OT

Senior Python Engineer

Opcito Technologies Private Limited

8+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Senior Python Engineer (Cloud & Backend) Pune, Maharashtra | 8 12 Years Experience | Full-time | Tech Stack: Python, AWS, FastAPI, Docker, Kubernetes, PostgreSQL, MongoDB We re hunting for a backend boss who lives and breathes Python and knows how to scale systems like a pro. If you re into building high-performance microservices, playing with cloud infra, and turning chaos into clean code let s talk. What you ll be doing: Design and build Python-based microservices for data ingestion, processing, and querying Craft clean, scalable REST APIs and data models Write unit tests that don t break when someone sneezes Work hand-in-hand with cross-functional teams to ship solid software on time, every time Optimize performance, reliability, and scalability like a true backend engineer Contribute to smart CI/CD pipelines and continuous improvement What you bring: 8 12 years of solid backend dev experience Strong Python skills, especially with Asyncio and FastAPI Deep experience with AWS, REST, and cloud-native architecture Fluent in PostgreSQL & MongoDB Comfortable with Docker, Kubernetes, and identity protocols (SSO, SAML) Familiar with CI/CD, testing frameworks, and performance tuning Bonus if you're curious about GenAI, vector databases, or ML We re not just tech nerds we re transformation partners. At Opcito, you ll get the chance to work on real impact projects using the best tools and practices out there (hello, DevOps, cloud-native, containers, and serverless). Perks & Culture: Growth-first mindset + learning budgets Pay that matches your skill & experience A friendly, no-BS, collaborative team Flexible schedules we trust you to get it done Social & corporate events you ll actually enjoy Recognition game strong: Great Place to Work (2021 24) Top 50 IT Workplaces India Best for Millennials 2023 GPTW ISO/IEC 27001:2013 Certified Top Developers India Clutch Hit Apply and let's build cool stuff together.

Senior Python Senior python Engineer Senior engineer
DR

Senior Staff Software Engineer (foundation)

Druva

5+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Senior Staff Software Engineer (Foundation) Company: Druva Location: Pune, India About Druva: Druva empowers organizations with cyber, data, and operational resilience through the Data Resiliency Cloud the industry s first and only SaaS solution at scale. Our platform simplifies data protection, streamlines governance, and provides unparalleled data visibility and insights, enabling customers to accelerate cloud adoption. Trusted by thousands of enterprises, including 60 of the Fortune 500, Druva eliminates complex infrastructure and management costs by delivering data resilience through a single platform spanning multiple geographies and cloud environments. About the Role: The Foundation team at Druva designs and develops a highly scalable, petabyte-scale distributed cloud file system built on AWS. This service-oriented system handles critical features such as file system metadata management, versioning, and eventual consistency using AWS services like S3, DynamoDB, and Kinesis. Beyond the core file storage engine which supports backup storage for all Druva products the team builds and maintains allied components like indexing engines, key-value stores, and big data pipelines to enable scalable search, analytics, and compliance capabilities. As a Senior Staff Software Engineer, you will collaborate closely with cross-functional teams, architects, and DevOps to define high-level and low-level designs (HLD/LLD) for advanced data security and management services. You will stay abreast of emerging trends in data security, platforms, technologies, and APIs, applying these insights to enhance existing features and develop new capabilities. You will also mentor and guide junior engineers, fostering a culture of high-quality, high-velocity software development. Key Skills & Experience: 5 to 7 years of experience building enterprise-grade software products. Expertise in designing and implementing SaaS solutions at scale. Proficiency in Python or Golang for software development. Deep knowledge and hands-on experience with cloud storage and data management systems. Proven experience building storage systems focused on securing and protecting data at scale, including managing data and metadata. Prior experience working on data protection products is highly desirable. Familiarity with cloud platforms such as AWS and Azure is a plus. Strong hands-on developer with excellent communication and collaboration skills. Ability to influence architecture, design, and implementation for timely delivery of business outcomes. Desirable: Strong written and verbal communication skills. Experience with Agile methodologies (Scrum). In-depth knowledge of AWS cloud technologies. Responsibilities: Collaborate with architects, developers, and DevOps to define HLD and LLD for data security and management services and features. Monitor and evaluate emerging trends in data security, management platforms, technologies, and APIs to refine and develop features. Lead the integration of data management tools and applications to enhance product quality and user experience. Promote best practices and principles of high-quality SaaS software development. Mentor and train junior engineers on data management, security principles, and agile development methodologies. Qualifications: Bachelor s or Master s degree in Computer Science, Engineering, or a related field (Advanced degree preferred). Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field (Advanced degree preferred).

Senior Software Senior software Engineer Senior engineer
DR

Staff Data / Machine Learning Engineer

Druva

7+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Staff Data / Machine Learning Engineer Company: Druva Location: Pune, Maharashtra, India About Druva: Druva, the autonomous data security company, delivers data protection on autopilot through a 100% SaaS, fully managed platform that secures and recovers data from all threats. The Druva Data Security Cloud guarantees data availability, confidentiality, and integrity providing customers with autonomous protection, rapid incident response, and guaranteed data recovery. Trusted by over 6,000 customers worldwide including 65 of the Fortune 500 Druva safeguards business-critical data in today s connected world. Backed by over $350M in venture capital, Druva protects more than 200 PB of data globally and offers a $10 million Data Resiliency Guarantee against cyber threats. The Role & Team: Join Druva s Business Intelligence team, where data drives key insights and fuels operational and strategic decisions. As a Staff Data/Analytics/ML Engineer, you will lead the development of data-to-insights recommendation engines and drive collaboration across teams to deliver impactful, data-driven solutions. This is a high-impact role working alongside expert engineers and product leaders, leveraging industry-leading data platforms and tools. What You ll Do: Bridge the gap between data engineering, analytics, and machine learning to unlock actionable business insights. Collaborate cross-functionally with Product, Engineering, GTM, and Customer Success teams to build data-driven solutions that enhance decision-making and business outcomes. Design, build, and maintain scalable data pipelines and infrastructure supporting analytics, machine learning, and operational workflows. Develop and optimize data models for efficient analytics and reporting across large datasets. Lead feature engineering, model training, and deployment pipelines for real-time and batch ML/AI applications. Drive architectural improvements in data governance, observability, and platform scalability. Evaluate and implement cutting-edge data tools and platforms including Reverse ETL, MLOps, and DataOps frameworks. Mentor and guide data engineers, analysts, and ML practitioners, fostering technical excellence and collaboration. Translate complex business requirements into technical deliverables, prioritizing initiatives that maximize impact. What We Are Looking For: Bachelor s or Master s degree in Computer Science, Data Science, Engineering, Statistics, or a related field. 7+ years experience spanning data engineering, analytics engineering, and machine learning with a strong technical foundation in all three areas. Expertise in modern data stacks: Snowflake, dbt, Airflow, Spark, and cloud platforms (AWS, GCP, Azure). Proficiency with BI and analytics tools such as Looker, Sigma, Tableau, Power BI, or equivalents. Strong skills in SQL, Python, and distributed data processing frameworks (Spark, Dask, etc.). Experience designing and maintaining data pipelines, ETL/ELT workflows, and data transformations for analytics and ML use cases. Familiarity with ML frameworks like TensorFlow, PyTorch, Scikit-learn, and MLOps lifecycle management. Deep knowledge of data modeling, architecture, and governance best practices. Proven problem-solver who thrives in ambiguity and designs robust data solutions. Experience working in Agile environments with strong prioritization and collaboration skills. Excellent communication skills, capable of simplifying complex technical topics for non-technical stakeholders. Bonus Points For: Experience with Generative AI, LLMs, and integrating AI into business workflows. Knowledge of streaming architectures (Kafka, Kinesis, Pub/Sub) and real-time analytics. Familiarity with Data Contracts, Data Quality frameworks, or Data Mesh architectures. Experience with Reverse ETL tools such as Salesforce, Census, Hightouch, or Segment for operational analytics. If you re passionate about driving data innovation at scale and want to work in a dynamic environment protecting the world s critical data, Druva invites you to join our team! Qualification : Bachelors or Masters degree in Computer Science, Data Science, Engineering, Statistics, or a related field.

Data Engineer Staff Engineer Data Engineer Staff data engineer
IT

Data Architect

Indexnine Technologies Pvt. Ltd.

7+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Data Architect Cloud, Big Data & Scalable Data Engineering Location: Pune, India Experience Level: 7+ Years Job Type: Full-Time | On-site / Hybrid (Specify your policy) Job Summary We are seeking a visionary Data Architect based in Pune to lead our data engineering practice within product engineering services. This strategic role involves shaping the organization's data architecture, defining best practices for data lakes and data warehouses, and guiding architectural decisions across data engineering initiatives. If you're passionate about building cloud-based, future-ready data platforms using tools like Databricks, Snowflake, AWS, Azure, and Google BigQuery, this is your opportunity to make a significant impact. Key Responsibilities Design and implement enterprise-wide data architecture strategies, including data modeling, data governance, and integration frameworks. Lead the development of scalable data lakes, data warehouses, and data marts, especially using Databricks and medallion architecture. Build and optimize robust ETL/ELT data pipelines and real-time streaming solutions. Collaborate with security teams to implement strong data security and compliance practices, including GDPR and CCPA regulations. Standardize data governance policies and drive data quality across platforms and business units. Work closely with data engineers to implement high-performance cloud-native storage solutions using Azure ADLS Gen2, AWS S3, etc. Evaluate and introduce innovative data platforms, tools, and frameworks to enhance engineering capabilities. Provide technical leadership and mentorship to engineering teams across all data initiatives. Translate business data needs into technical architectures and create detailed documentation (e.g., ERDs, data flow diagrams, integration maps). Required Qualifications Bachelor s or Master s degree in Computer Science, Information Systems, or a related field. 7+ years of experience in data architecture, data engineering, or enterprise data solutions. Strong command of data modeling techniques (e.g., dimensional, data vault). Experience with relational databases (e.g., Oracle, SQL Server, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Hands-on expertise with Databricks, Snowflake, Amazon Redshift, or Google BigQuery. Knowledge of cloud platforms such as AWS, Azure, or GCP and their data ecosystems. Proficiency in SQL and at least one programming language (Python, Java, Scala). Familiarity with ETL/ELT tools, data pipeline orchestration (e.g., Airflow), and real-time streaming (e.g., Kafka, Flink). Solid understanding of data security, compliance, and data governance frameworks. Experience with Power BI, Tableau, or similar tools from an architectural standpoint. Preferred Qualifications Exposure to machine learning architectures and MLOps pipelines. Understanding of graph databases (e.g., Neo4j) and semantic data layers. Familiarity with data mesh, data fabric, and modern data management paradigms. Hands-on experience with real-time data streaming frameworks like Apache Flink, Kafka, or Spark Streaming. Be a key architect in shaping enterprise-wide data strategies and infrastructure. Collaborate with top-tier engineers and data scientists in India s growing tech hub. Access the latest cloud, AI, and big data tools and work on high-impact, global projects. Thrive in a culture that encourages innovation, ownership, and continuous learning. Qualification : Bachelors or Masters degree in Computer Science, Information Systems, or a related field.

Data Architect Data architect Full-Time Data Modeling
VI

Senior Azure Data Engineer

Vionsys It Solutions India Pvt.ltd

8+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Senior Azure Data Engineer Experience: 8 - 10 years Location: Kharadi, Pune Role & Responsibilities Design, develop, and maintain scalable, high-performance data pipelines using Azure Data Services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Build and optimize data models, ETL/ELT processes, and data integration workflows to support analytics and BI needs. Develop and manage data lakes, data warehouses, and real-time streaming solutions on Azure. Collaborate with data analysts, scientists, and software engineers to ensure smooth data integration and processing. Ensure data security, governance, and compliance following industry best practices and regulations. Monitor and troubleshoot data pipelines, focusing on performance and reliability enhancements. Automate data workflows and infrastructure using DevOps and CI/CD methodologies. Work closely with stakeholders to translate business requirements into robust data solutions. Required Skills & Qualifications 8-10 years of experience in data engineering, with at least 3 years focused on Azure data services. Strong expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Azure Data Lake, and Azure SQL Database. Proficient in SQL, Python, or Scala for data processing and transformation. Experience with Big Data technologies like Spark, Delta Lake, and Parquet. Hands-on experience with ETL/ELT development and orchestration of data pipelines. Knowledge of Azure DevOps, CI/CD pipelines, and Infrastructure as Code tools (Terraform, ARM templates, Bicep). Familiarity with data governance, security best practices, and compliance frameworks. Experience with Power BI, Snowflake, or other BI/analytics tools is a plus.

Senior Azure Data Azure data Engineer
VI

Senior Aws Data Engineer

Vionsys It Solutions India Pvt.ltd

5+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Senior AWS Data Engineer Experience: 5+ years Location: Kharadi, Pune Role & Responsibilities Design, develop, and optimize scalable data pipelines and ETL workflows using AWS services such as AWS Glue, Lambda, and Step Functions. Implement and maintain data lakes and data warehouses on AWS platforms including S3, Redshift, and Athena. Develop and manage both real-time and batch data processing solutions. Ensure data security, governance, and compliance following industry best practices. Collaborate with data scientists, analysts, and business stakeholders to deliver actionable, data-driven solutions. Optimize query performance and troubleshoot data issues proactively. Automate infrastructure deployment using Infrastructure as Code (IaC) tools like Terraform or CloudFormation. Implement monitoring, logging, and alerting frameworks using AWS CloudWatch, Prometheus, or equivalent tools. Mentor junior engineers and actively contribute to data engineering best practices and standards. Required Skills & Qualifications 5+ years of experience in data engineering, with at least 3 years focused on AWS cloud services. Strong hands-on experience with AWS services including Glue, Redshift, S3, Lambda, EMR, and Athena. Proficient in SQL, Python, and Spark for data processing and analytics. Experience designing and implementing ETL/ELT pipelines. Familiarity with DevOps practices, CI/CD pipelines, and automation tools such as Terraform, CloudFormation, and Jenkins. Deep understanding of data governance, security protocols, and compliance frameworks. Experience with real-time data streaming and processing technologies such as Kafka, Kinesis, or similar tools. Knowledge of database optimization techniques including indexing and partitioning.

Senior AWS Data Engineer Senior engineer
SC

Machine Learning Engineer

Scano

1+ Year | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Machine Learning Engineer Location: Pune Employment Type: Full-Time About the Role: We are seeking a Machine Learning Engineer with 1-3 years of hands-on experience to join our team. The ideal candidate will have proficiency in Python programming and a solid understanding of machine learning frameworks. You will work on building and deploying cutting-edge machine learning models and solutions, with a particular focus on computer vision and ML-Ops. Key Responsibilities: Develop Machine Learning Models: Build, train, and deploy machine learning models for various business applications. Computer Vision Solutions: Focus on building and deploying computer vision solutions at scale, leveraging frameworks like TensorFlow and OpenCV. Collaborate with Teams: Work with data scientists, software engineers, and other stakeholders to integrate machine learning solutions into products. Code Quality & Documentation: Write clean, maintainable, and readable code. Document your code and solutions for ease of understanding and future reference. Work with Data Pipelines: Understand and implement data pipelines for training machine learning models, ensuring data is pre-processed and transformed correctly. Version Control & Best Practices: Use Git and follow version control best practices to ensure collaboration and code integrity across the team. Machine Learning Frameworks: Implement machine learning algorithms using frameworks like TensorFlow, Keras, OpenCV, and other relevant libraries. ML-Ops: Familiarity with deploying machine learning models into production environments and managing their lifecycle. Minimum Qualifications: Experience: 1-3 years of experience as a Machine Learning Engineer or Data Scientist. Agile Development: Familiarity with the Agile development lifecycle and collaborative software development practices. Code Readability & Documentation: Ability to write clean, readable code and document your work thoroughly for future use and team collaboration. Third-Party Libraries & APIs: Experience in consuming third-party libraries and APIs to extend the functionality of your machine learning solutions. Version Control: Experience with Git and version control best practices. Data Pipelines: Understanding of data pipelines and how to handle data preprocessing, cleaning, and transformation for machine learning purposes. Core Python: Proficiency in Python programming and popular data science libraries (e.g., NumPy, Pandas, etc.). Machine Learning Frameworks: Knowledge of machine learning frameworks like TensorFlow and OpenCV. Preferred Qualifications: ETL Tools: Experience working with ETL (Extract, Transform, Load) tools and libraries to manage and preprocess data for machine learning. Computer Vision: Hands-on experience with computer vision tasks, especially with MaskRCNN for object detection and segmentation. ML-Ops: Knowledge of ML-Ops practices for deploying, monitoring, and maintaining machine learning models in production environments. Work on cutting-edge machine learning and computer vision projects. Collaborate with a talented, cross-functional team to solve real-world problems. Opportunity to grow your career in a dynamic and innovation-driven environment. Competitive compensation and benefits package. If you're passionate about machine learning, computer vision, and deploying scalable solutions, we'd love to have you on our team!

Machine Learning Machine Learning Engineer Machine engineer
TS

Data Analyst

Talentica Software (i) Pvt. Ltd.

5+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

About Talentica Software: Talentica Software is a specialized software development firm founded by seasoned industry experts and alumni of IIT Bombay. We partner with startups to create innovative products, using cutting-edge technologies to address real-world challenges. With over 21 years of experience, we have collaborated with more than 180 startups, primarily in the U.S., contributing to many successful exits. In 2022, Talentica Software was honored as one of India s Great Mid-Size Workplaces by Great Place to Work. What We re Looking For: We are seeking a motivated Data Analyst to join our growing team. If you're passionate about working with SQL, BigQuery, Tableau, and MongoDB, and enjoy optimizing data ecosystems, we d love to hear from you! In this role, you will play a key part in managing and enhancing our data infrastructure, working across SQL (Oracle), BigQuery, Tableau, and NoSQL databases like MongoDB. You'll also help build our Lakehouse architecture and ensure data accuracy while supporting the scalability of our platform. Your Responsibilities: Develop, optimize, and maintain SQL queries to support efficient data delivery for Tableau reports. Write and refine complex queries for Oracle and BigQuery databases to meet business reporting needs. Utilize MongoDB to query semi-structured data for analytics and reporting. Collaborate with BI developers and analysts to streamline data workflows and enhance report accuracy. Design and manage ETL/ELT pipelines for smooth data ingestion and transformation. Work with cross-functional teams to identify and implement improvements in data workflows. Troubleshoot and resolve data issues as they arise. Contribute to the early-stage development of our Lakehouse architecture. Prepare existing data workflows for seamless integration with modern cloud platforms. Stay current with emerging data technologies and contribute to ongoing modernization efforts. Perform data validation and reconciliation to ensure consistency across multiple data sources. Collaborate with data analysts and business stakeholders to resolve data discrepancies. Support data quality assurance initiatives and establish best practices for data reliability. What You ll Need to Succeed: Qualifications: A BE/BTech in Computer Science, Data Engineering, or a related field from a prestigious institution (IIT, NIT, BITS, etc.). Experience: At least 5 years of experience in SQL development and managing data pipelines. Technical Skills: Advanced SQL skills, including performance tuning and query optimization. Strong understanding of ETL/ELT processes and experience with data transformation. Hands-on experience with relational databases (Oracle, BigQuery) and NoSQL (MongoDB). Proficiency in Python or other scripting languages for automation. Familiarity with cloud platforms (AWS, GCP, Azure) is a plus. Experience with BI tools like Tableau is highly desirable. Soft Skills: Strong analytical and problem-solving abilities. Excellent communication and collaboration skills. Ability to manage multiple tasks independently in a fast-paced environment. What We Offer: Innovative Culture: We focus on cutting-edge development, not routine maintenance work. Our team thrives on staying ahead with the latest technologies. Continuous Learning: At Talentica, you ll find abundant opportunities to grow and keep up-to-date with the latest trends in technology. Brilliant Peers: Work alongside talented professionals from top engineering colleges (IITs, NITs, and more). Work-Life Balance: Enjoy flexibility with remote work options and adaptable schedules. Supportive Environment: 82% of our employees recommend Talentica to their peers (according to Glassdoor), thanks to our positive, collaborative work culture. Recognition & Rewards: Your hard work will be celebrated, with a culture that recognizes and appreciates your contributions. If you re excited about the prospect of working with a team of bright professionals and advancing your career, we d love to hear from you. Ready to make an impact? Apply today, and let s connect! Qualification : BE/BTech in Computer Science, Data Engineering, or a related field from a top-tier institution (IIT, NIT, BITS, etc.).

Data Analyst Data analyst Full-Time Data Analysis
TS

Elt Developer

Talentica Software (i) Pvt. Ltd.

3+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni of IIT Bombay. We specialize in helping startups build innovative products by leveraging the latest tools and technologies to solve real-world problems. Over the past 21 years, we've partnered with 180+ startups, primarily in the US, and have helped many achieve successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: What You ll Be Doing: As an ELT Developer, you will: Design, develop, and maintain ELT pipelines using GCP tools such as BigQuery, Dataflow, and Firestore. Optimize data pipelines for performance, scalability, and reliability. Transform raw data into structured formats that are ready for analytics and reporting. Integrate data from various sources into centralized repositories or operational systems. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver solutions. Document ELT processes, workflows, and best practices. Monitor and manage ELT jobs to ensure timely data availability. Troubleshoot and resolve issues in data pipelines to maintain data integrity. To Succeed in This Role, You Should Have: Qualification: A Bachelor's degree in Computer Science, Information Technology, or a related field from a top-tier institute (IIT, NIT, BITS, etc.). Experience: At least 3 years of hands-on experience in ELT/ETL development on cloud platforms. Technical Skills: Expertise in GCP services like BigQuery, Firestore, Dataflow, and Pub/Sub. Proficiency in Python for scripting and automation. Strong understanding of data warehousing concepts and data modeling. Experience with SQL for data querying and transformation. Familiarity with NoSQL databases such as Firestore. Knowledge of Apache Beam for building scalable data processing pipelines. Soft Skills: Excellent problem-solving abilities, strong communication skills, and the ability to collaborate effectively with cross-functional teams. Bonus Points If You: Have experience with GCP Cloud Scheduler or other orchestration tools. Hold a Google Professional Data Engineer certification or a similar qualification. Have worked with CI/CD pipelines for deploying ELT workflows. What You ll Find at Talentica: Innovative Culture: We specialize in cutting-edge development, not maintenance work. Our clients come to us for our technological expertise and innovation. Endless Learning Opportunities: You'll have ample opportunities to grow, learn, and stay up to date with the latest trends in technology. Talented Peers: Work alongside talented individuals from India s top engineering colleges (IITs, NITs, and others). Work-Life Balance: We understand the importance of work-life balance and offer flexible schedules and remote work options. Great Culture: 82% of our employees recommend Talentica to their friends (according to Glassdoor). Join us, and you'll see why! Recognition & Rewards: We celebrate success and ensure that your contributions are recognized and appreciated. If you're excited to work with a team of talented professionals and take your career to the next level, we d love to hear from you. Ready to take the next step? Fill out the form below, and we'll be in touch soon! About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni of IIT Bombay. We specialize in helping startups build innovative products by leveraging the latest tools and technologies to solve real-world problems. Over the past 21 years, we've partnered with 180+ startups, primarily in the US, and have helped many achieve successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: What You ll Be Doing: As an ELT Developer, you will: Design, develop, and maintain ELT pipelines using GCP tools such as BigQuery, Dataflow, and Firestore. Optimize data pipelines for performance, scalability, and reliability. Transform raw data into structured formats that are ready for analytics and reporting. Integrate data from various sources into centralized repositories or operational systems. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver solutions. Document ELT processes, workflows, and best practices. Monitor and manage ELT jobs to ensure timely data availability. Troubleshoot and resolve issues in data pipelines to maintain data integrity. To Succeed in This Role, You Should Have: Qualification: A Bachelor's degree in Computer Science, Information Technology, or a related field from a top-tier institute (IIT, NIT, BITS, etc.). Experience: At least 3 years of hands-on experience in ELT/ETL development on cloud platforms. Technical Skills: Expertise in GCP services like BigQuery, Firestore, Dataflow, and Pub/Sub. Proficiency in Python for scripting and automation. Strong understanding of data warehousing concepts and data modeling. Experience with SQL for data querying and transformation. Familiarity with NoSQL databases such as Firestore. Knowledge of Apache Beam for building scalable data processing pipelines. Soft Skills: Excellent problem-solving abilities, strong communication skills, and the ability to collaborate effectively with cross-functional teams. Bonus Points If You: Have experience with GCP Cloud Scheduler or other orchestration tools. Hold a Google Professional Data Engineer certification or a similar qualification. Have worked with CI/CD pipelines for deploying ELT workflows. What You ll Find at Talentica: Innovative Culture: We specialize in cutting-edge development, not maintenance work. Our clients come to us for our technological expertise and innovation. Endless Learning Opportunities: You'll have ample opportunities to grow, learn, and stay up to date with the latest trends in technology. Talented Peers: Work along...

ELT Developer Full-Time Data Integration ETL

1 - 20 of 0 jobs

* No exact matches found. Showing closest results instead
Sort by:

No results found

Modify search criteria or create an alert to get relevant jobs as soon as they’re posted

Create an alert

Continue to Save

Please login to your jobseeker account, or create a new one to save this job.

Feedback

Share Feedback