Spark Jobs in Pune

33 Jobs Found

CT

Data Engineer

Calfus Technologies India

3-4 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Data Engineer BI Analytics & DWH Location: Pune About Calfus At Calfus, we develop cutting-edge AI agents and software products that enable businesses to unlock the full potential of AI transforming operations, boosting revenue, and driving innovation. From startups to global enterprises, our clients trust us to deliver engineering excellence. Our teams have built ERP and cloud solutions that integrate seamlessly with core business systems, streamlining manual processes and empowering teams to focus on high-impact work. As one of the fastest-growing companies in our sector, we thrive on collaboration, speed, and innovation. If you re driven by impact and love working in fast-paced environments, we want to hear from you. About the Role We re looking for a Data Engineer with 3 4 years of experience to join our Business Intelligence & Data Warehouse team. In this role, you'll be responsible for building robust data pipelines, designing scalable data models, and supporting analytics and reporting capabilities. You will work with modern tools like Azure Data Factory, Databricks, and Snowflake, and help deliver reliable, performant data infrastructure for internal and client-facing initiatives. What You ll Do ETL/ELT Development Build and maintain efficient ETL/ELT pipelines using Azure Data Factory, Databricks, or equivalent. Ingest and consolidate data from multiple sources into data warehouses or data lakes. Data Modeling & Warehousing Design and implement relational and dimensional models suited for business reporting. Work with databases such as Snowflake, Redshift, Postgres, or SQL Server. SQL & Database Engineering Write performant SQL queries, stored procedures, and scripts for data transformation. Implement complex joins and aggregations for analytical workloads. BI & Visualization Support Collaborate with business users to support reporting in Power BI or Tableau. Enable data-driven decisions through accessible and accurate data models. Performance & Data Quality Monitor pipeline jobs for failures, performance issues, and delays. Apply data validation checks to ensure the integrity and accuracy of data. Bachelor s degree in Computer Science, Data Engineering, Information Systems, or related field. 3 4 years of hands-on experience in data engineering, with strong skills in ETL/ELT, SQL, and data modeling. Experience with cloud platforms (Azure, AWS) and tools like: Azure Data Factory Databricks SQL Server, Postgres, Redshift, or Snowflake Basic understanding of Python for scripting and automation. Familiarity with file formats like JSON, Parquet, and CSV. Exposure to BI tools such as Tableau or Power BI (nice to have). Benefits @ Calfus Medical, group, and parental insurance Provident fund & gratuity Birthday leave and wellness support High-growth, high-impact environment Diversity & Inclusion Calfus is proud to be an Equal Opportunity Employer. We believe that diversity drives innovation, and we are committed to fostering an inclusive, supportive, and respectful environment for all. Qualification : Bachelors degree in Computer Science, Data Engineering, Information Systems, or related field

Data Engineer Data Engineer Full-Time Data Engineering
CO

Data Science Engineer

Cognologix

3+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Position: Data Science Engineer Location: Pune Work Type: Full Time Minimum Experience: 3+ Years Top Skills: AI Applications, Python, Machine Learning, Deep Learning, NLP/NLG, Computer Vision, Object Detection About the Role We re looking for an experienced Data Science Engineer to join our Data & AI Practice. You will work on building and deploying intelligent, enterprise-grade AI solutions using the latest in Machine Learning, Deep Learning, Computer Vision, and Generative AI technologies. This is a role for engineers who thrive on ownership, innovation, and collaboration with the opportunity to mentor, lead, and make a real business impact through data. What You Will Work On Lead the design and development of AI/ML models and applications. Work with Product Management to translate business use cases into technical requirements and AI solutions. Develop and deploy Computer Vision, NLP, Deep Learning, and multi-modal GenAI applications. Perform dataset selection, feature engineering, and optimize data representation techniques. Mentor junior team members and contribute to team growth. Continuously explore and adopt the latest advancements in AI/ML, CV, NLP, and LLMs. Required Skills & Experience 3+ years of full lifecycle experience in building and deploying AI/ML applications. Proficiency in Python and core libraries: Pandas, NumPy, SciPy, Scikit-learn, NLTK. Hands-on experience with ML/DL/NLP frameworks: TensorFlow, Keras, PyTorch, HuggingFace Transformers, spaCy, CoreNLP. Deep knowledge in Linear Algebra, Probability, and Statistics. Strong foundation in Computer Vision: image classification, object detection (YOLO, Mask/Faster R-CNN), segmentation (semantic, instance, panoptic). Experience in Generative AI/LLMs, including Prompt Engineering, LangChain, LlamaIndex, Vector Search, Function Calling, Agentic Frameworks, and Document Processing. Exposure to cloud platforms: AWS (preferred), Azure, or GCP. Experience building RESTful APIs using frameworks like FastAPI, with async programming. Familiarity with CI/CD, Docker/Kubernetes, and scalable cloud-native deployments. Excellent problem-solving, analytical, and communication skills. Bonus Skills (Nice to Have) Experience in Agile/Scrum methodologies. Knowledge of MLOps/LLMOps: model versioning, tuning, deployment, monitoring. Experience with data visualization tools for analytics storytelling. Startup culture with autonomy, agility, and small team dynamics. Work on emerging AI/ML technologies across diverse real-world applications. Remote work options for high-performing team members. Competitive compensation with family-friendly benefits. Structured career progression based on performance and innovation. About Cognologix At Cognologix, we help businesses redefine their digital future through innovation and data-centric solutions. Our focus on cloud-native architectures, AI-driven intelligence, and automation-first thinking empowers enterprises to achieve meaningful transformation.

Data Science Data Science Engineer Data Engineer
IT

Data Architect

Indexnine Technologies Pvt. Ltd.

7+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Data Architect Cloud, Big Data & Scalable Data Engineering Location: Pune, India Experience Level: 7+ Years Job Type: Full-Time | On-site / Hybrid (Specify your policy) Job Summary We are seeking a visionary Data Architect based in Pune to lead our data engineering practice within product engineering services. This strategic role involves shaping the organization's data architecture, defining best practices for data lakes and data warehouses, and guiding architectural decisions across data engineering initiatives. If you're passionate about building cloud-based, future-ready data platforms using tools like Databricks, Snowflake, AWS, Azure, and Google BigQuery, this is your opportunity to make a significant impact. Key Responsibilities Design and implement enterprise-wide data architecture strategies, including data modeling, data governance, and integration frameworks. Lead the development of scalable data lakes, data warehouses, and data marts, especially using Databricks and medallion architecture. Build and optimize robust ETL/ELT data pipelines and real-time streaming solutions. Collaborate with security teams to implement strong data security and compliance practices, including GDPR and CCPA regulations. Standardize data governance policies and drive data quality across platforms and business units. Work closely with data engineers to implement high-performance cloud-native storage solutions using Azure ADLS Gen2, AWS S3, etc. Evaluate and introduce innovative data platforms, tools, and frameworks to enhance engineering capabilities. Provide technical leadership and mentorship to engineering teams across all data initiatives. Translate business data needs into technical architectures and create detailed documentation (e.g., ERDs, data flow diagrams, integration maps). Required Qualifications Bachelor s or Master s degree in Computer Science, Information Systems, or a related field. 7+ years of experience in data architecture, data engineering, or enterprise data solutions. Strong command of data modeling techniques (e.g., dimensional, data vault). Experience with relational databases (e.g., Oracle, SQL Server, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Hands-on expertise with Databricks, Snowflake, Amazon Redshift, or Google BigQuery. Knowledge of cloud platforms such as AWS, Azure, or GCP and their data ecosystems. Proficiency in SQL and at least one programming language (Python, Java, Scala). Familiarity with ETL/ELT tools, data pipeline orchestration (e.g., Airflow), and real-time streaming (e.g., Kafka, Flink). Solid understanding of data security, compliance, and data governance frameworks. Experience with Power BI, Tableau, or similar tools from an architectural standpoint. Preferred Qualifications Exposure to machine learning architectures and MLOps pipelines. Understanding of graph databases (e.g., Neo4j) and semantic data layers. Familiarity with data mesh, data fabric, and modern data management paradigms. Hands-on experience with real-time data streaming frameworks like Apache Flink, Kafka, or Spark Streaming. Be a key architect in shaping enterprise-wide data strategies and infrastructure. Collaborate with top-tier engineers and data scientists in India s growing tech hub. Access the latest cloud, AI, and big data tools and work on high-impact, global projects. Thrive in a culture that encourages innovation, ownership, and continuous learning. Qualification : Bachelors or Masters degree in Computer Science, Information Systems, or a related field.

Data Architect Data architect Full-Time Data Modeling
VI

Senior Azure Data Engineer

Vionsys It Solutions India Pvt.ltd

8+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Senior Azure Data Engineer Experience: 8 - 10 years Location: Kharadi, Pune Role & Responsibilities Design, develop, and maintain scalable, high-performance data pipelines using Azure Data Services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Build and optimize data models, ETL/ELT processes, and data integration workflows to support analytics and BI needs. Develop and manage data lakes, data warehouses, and real-time streaming solutions on Azure. Collaborate with data analysts, scientists, and software engineers to ensure smooth data integration and processing. Ensure data security, governance, and compliance following industry best practices and regulations. Monitor and troubleshoot data pipelines, focusing on performance and reliability enhancements. Automate data workflows and infrastructure using DevOps and CI/CD methodologies. Work closely with stakeholders to translate business requirements into robust data solutions. Required Skills & Qualifications 8-10 years of experience in data engineering, with at least 3 years focused on Azure data services. Strong expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Azure Data Lake, and Azure SQL Database. Proficient in SQL, Python, or Scala for data processing and transformation. Experience with Big Data technologies like Spark, Delta Lake, and Parquet. Hands-on experience with ETL/ELT development and orchestration of data pipelines. Knowledge of Azure DevOps, CI/CD pipelines, and Infrastructure as Code tools (Terraform, ARM templates, Bicep). Familiarity with data governance, security best practices, and compliance frameworks. Experience with Power BI, Snowflake, or other BI/analytics tools is a plus.

Senior Azure Data Azure data Engineer
VI

Senior Aws Data Engineer

Vionsys It Solutions India Pvt.ltd

5+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Senior AWS Data Engineer Experience: 5+ years Location: Kharadi, Pune Role & Responsibilities Design, develop, and optimize scalable data pipelines and ETL workflows using AWS services such as AWS Glue, Lambda, and Step Functions. Implement and maintain data lakes and data warehouses on AWS platforms including S3, Redshift, and Athena. Develop and manage both real-time and batch data processing solutions. Ensure data security, governance, and compliance following industry best practices. Collaborate with data scientists, analysts, and business stakeholders to deliver actionable, data-driven solutions. Optimize query performance and troubleshoot data issues proactively. Automate infrastructure deployment using Infrastructure as Code (IaC) tools like Terraform or CloudFormation. Implement monitoring, logging, and alerting frameworks using AWS CloudWatch, Prometheus, or equivalent tools. Mentor junior engineers and actively contribute to data engineering best practices and standards. Required Skills & Qualifications 5+ years of experience in data engineering, with at least 3 years focused on AWS cloud services. Strong hands-on experience with AWS services including Glue, Redshift, S3, Lambda, EMR, and Athena. Proficient in SQL, Python, and Spark for data processing and analytics. Experience designing and implementing ETL/ELT pipelines. Familiarity with DevOps practices, CI/CD pipelines, and automation tools such as Terraform, CloudFormation, and Jenkins. Deep understanding of data governance, security protocols, and compliance frameworks. Experience with real-time data streaming and processing technologies such as Kafka, Kinesis, or similar tools. Knowledge of database optimization techniques including indexing and partitioning.

Senior AWS Data Engineer Senior engineer
ES

Senior Big Data Software Engineer

Epam Systems

5-8 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

We are seeking a highly experienced Senior Big Data Software Engineer to join our dynamic team and tackle challenging projects that will enhance your skills and career. As a Senior Engineer, your contributions will be critical in designing and implementing Big Data solutions across a variety of projects. The ideal candidate will possess deep experience in Big Data and associated technologies, with a strong emphasis on Apache Spark, Python, Azure and AWS. #LI-DNI#EasyApply Technologies Hadoop Hive Responsibilities Develop and execute end-to-end Big Data solutions to meet complex business needs Work collaboratively with interdisciplinary teams to comprehend project needs and deliver superior software solutions Apply your expertise in Apache Spark, Python, Azure and AWS to create scalable and efficient data processing systems Maintain and enhance the performance, security, and scalability of Big Data applications Keep abreast of industry trends and technological advancements to foster continuous improvement in our development practices Requirements 5-8 years of direct experience in Big Data and related technologies Advanced knowledge and hands-on experience with Apache Spark High-level proficiency with Hadoop and Hive Proficiency in Python Prior experience with AWS and Azure native Cloud data services We offer Opportunity to work on technical challenges that may impact across geographies Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications Opportunity to share your ideas on international platforms Sponsored Tech Talks & Hackathons Unlimited access to LinkedIn learning solutions Possibility to relocate to any EPAM office for short and long-term projects Focused individual development Benefit package: Health benefits Retirement benefits Paid time off Flexible benefits Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)

Senior Data Big Data Software Senior software
VP

Sr Data Engineer

Vconstruct Private Limited

7-10 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Position: Senior Data Engineer Location: Pune Employment Type: Full-Time Company: vConstruct (Construction Technology Company) About vConstruct vConstruct is a Pune-based construction technology company focused on leveraging data science and analytics to transform the construction industry. Our Data Science and Analytics team is a close-knit group dedicated to supporting the business with robust data infrastructure and insightful analysis. Role Overview We are seeking a highly experienced Senior Data Engineer to lead the design, development, and maintenance of scalable data pipelines and infrastructure. This role involves working closely with cross-functional teams to manage diverse data sources, ensure data integrity, and support data-driven business initiatives. Key Responsibilities Lead the design and development of scalable, high-performance data pipelines and ETL/ELT frameworks following modern data engineering best practices. Architect complex data integration workflows that unify structured, semi-structured, and unstructured data from cloud and on-premise sources. Develop robust real-time, batch, and on-demand data pipelines equipped with monitoring, alerting, and automated error handling. Collaborate with analysts, data scientists, and business leaders to create reliable data models, quality frameworks, and SLAs. Ensure optimal pipeline performance, throughput, and proactive issue resolution. Work with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows aligned with enterprise standards. Enforce best practices in source control, code reviews, testing automation, and continuous delivery. Lead root cause analysis and preventive maintenance to minimize business impact from data failures. Establish standards for data modeling, transformation logic, and governance. Design and execute comprehensive testing strategies to ensure data reliability and pipeline resilience. Optimize pipeline and query performance for scalability, reliability, and cost-efficiency. Maintain detailed technical documentation including architecture diagrams, process flows, and integration specs. Facilitate discussions with business and operational teams to prioritize data initiatives and drive strategy. Qualifications 7-10 years of hands-on experience in data engineering with a track record of building scalable and secure data platforms. 5+ years of scripting experience in Python for data processing, automation, and ETL development. 4+ years experience with Snowflake, including performance tuning, security, and advanced SQL. 5+ years experience with data integration tools like Azure Data Factory, Fivetran, or Matillion. 5+ years writing complex, optimized SQL queries on large datasets. Proven experience integrating APIs, JSON, XML, and webhooks for data acquisition. Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools such as Apache Airflow. Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git). Familiarity with dbt or similar transformation tools and modular development practices. Experience with data visualization tools like Power BI is a plus. Strong interpersonal and communication skills to lead cross-functional technical discussions. Education Bachelor s or Master s degree in Computer Science, Information Technology, or a related field. Equivalent academic and professional experience will also be considered. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or a related field

Sr Data Engineer Sr engineer Data Engineer
VP

Senior Data Scientist

Vconstruct Private Limited

8-10 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Position: Senior Data Scientist Location: Pune Employment Type: Full-Time Company: vConstruct (Construction Technology Company) About vConstruct vConstruct is a Pune-based construction technology company focused on revolutionizing the construction industry through advanced AI and ML solutions. Our Data Science and Analytics team comprises Data Scientists, AI Engineers, Data Analysts, and Data Engineers working collaboratively to drive innovation across all construction project phases from pre-construction to post-construction. Our mission is to harness the power of data and AI to improve predictability, automate processes, and enhance efficiency in construction domains such as scheduling, planning, supply chain, safety, quality control, site management, financials, and virtual design construction. Role Overview We are seeking a highly skilled Senior Data Scientist to lead the development of innovative AI and machine learning solutions focused on construction data. You will work on cutting-edge projects involving Computer Vision, Predictive Analytics, Generative AI, and Large Language Models (LLMs) using technologies such as MS Azure AI Services, OpenAI, and various ML frameworks. Key Responsibilities Collaborate strategically with cross-functional teams to identify and solve business problems through scalable AI/ML solutions. Analyze construction project data to develop predictive models using traditional methods and generative AI. Apply machine learning algorithms to enhance project execution, safety, risk assessment, and other core construction processes. Lead end-to-end development of scalable predictive and ML models, including hypothesis generation, development, deployment, and monitoring. Build, validate, and optimize machine learning and statistical models; review and quality control models developed by junior team members. Partner with engineering and business teams to deeply understand data, processes, and business requirements, and implement appropriate solutions. Stay updated on advances in data science and machine learning to continuously enhance vConstruct s capabilities. Use statistical techniques to detect anomalies and optimize workflows to ensure timely, cost-effective project delivery. Collaborate with product managers and business leaders to drive data-driven decision-making and communicate insights effectively. Visualize insights using BI tools to support stakeholders in understanding data outcomes. Key Projects Include Developing GPT-based language models customized for construction industry data (structured and unstructured). Utilizing computer vision for object detection on 2D drawings and 3D BIM models. Applying statistical frameworks to predict construction site losses, win/loss opportunities, and quantity forecasts. Integrating AI models deeply into construction operations to automate and improve efficiency. Qualifications Bachelor s or Master s degree in Computer Science, Data Science, Statistics, Mathematics, or a related field. 8-10 years of professional experience, including at least 6 years in data science, machine learning, and analytics. Proven track record of delivering impactful, production-ready AI/ML solutions. Experience managing multiple projects in fast-paced, dynamic environments. Strong business acumen with the ability to translate technical insights into actionable business strategies and communicate effectively with stakeholders. Experience with construction data or related industries (engineering, manufacturing) is a plus. Technical Skills Expertise in Python, R, or Scala programming. Proficiency with ML, AI, and statistical frameworks and libraries such as TensorFlow, PyTorch, scikit-learn. Strong experience in predictive analytics, clustering, classification, regression, and multivariate techniques. Hands-on experience with data visualization tools such as Tableau, Power BI, Matplotlib. Familiarity with cloud platforms (preferably Azure), Azure ML Services, and Snowflake is a plus. Strong SQL skills and experience working with relational databases. Knowledge of NLP and Computer Vision technologies is advantageous. If you re passionate about transforming the construction industry through AI/ML innovation and want to work with a talented, motivated team, apply now to join vConstruct s visionary journey. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Statistics, Mathematics, or a related field

Senior Data Scientist Senior Scientist Data scientist
AS

Senior Etl Engineer

Accelirate Softech

5+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Senior ETL Engineer Location: Pune Role Overview: We are seeking a Senior ETL Engineer to design, develop, and optimize our end-to-end data infrastructure, including ETL pipelines, data lakes, and data warehouses. This role is instrumental in enabling reliable, scalable, and high-performance data operations while aligning with data governance best practices. You will be an integral part of a collaborative data team, working closely with Data Engineers, Architects, Analysts, Scientists, and other stakeholders to modernize and migrate our data systems to the cloud. Key Responsibilities: Convert SSIS stored procedures into Matillion mappings, and develop associated job schedules and audit frameworks. Design, build, and maintain efficient ETL pipelines to extract, transform, and load data from multiple sources into the data lake and data warehouse. Implement both full and incremental loads using SCD (Slowly Changing Dimensions) and CDC (Change Data Capture) methodologies for real-time and batch data processing. Develop and maintain robust error handling, job monitoring, and job audit mechanisms. Conduct data profiling, data cleansing, and root cause analysis to resolve data inconsistencies and improve data quality. Optimize data pipelines for performance, scalability, and data quality, using benchmarking and tuning techniques. Build dashboards or reports for ETL job monitoring, performance tracking, and system health checks. Support data governance practices, ensuring accuracy, availability, and security of production data. Contribute to cloud migration initiatives, transitioning data workloads from on-premise systems to modern cloud data platforms. Required Skills & Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 5+ years of experience as an ETL Engineer, Data Engineer, or in a similar data engineering role. Experience with cloud-based data platforms such as AWS, Azure, or GCP. Proficiency with data warehousing technologies like Snowflake, Redshift, Azure Synapse, or Databricks. Hands-on experience with ETL tools such as Matillion, SSIS, Informatica, AWS Glue, Azure Data Factory, StreamSets, STRiim, Oracle ODI, Coalesce, or Talend. Solid understanding of data modeling principles (E/R and Dimensional Modeling) and tools like ER/Studio or ERwin. Proficiency with SQL and programming/scripting languages such as Python, Scala, or Java. Experience with database tools such as Microsoft SSMS or Oracle Developer. Strong analytical, problem-solving, and data troubleshooting skills. Excellent communication and collaboration abilities. Ability to work efficiently in a fast-paced, agile, and dynamic environment. Qualification : Bachelor's degree in Computer Science, Engineering, or a related field.

Senior ETL Engineer Senior engineer ETL Engineer
TS

Elt Developer

Talentica Software (i) Pvt. Ltd.

3+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni of IIT Bombay. We specialize in helping startups build innovative products by leveraging the latest tools and technologies to solve real-world problems. Over the past 21 years, we've partnered with 180+ startups, primarily in the US, and have helped many achieve successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: What You ll Be Doing: As an ELT Developer, you will: Design, develop, and maintain ELT pipelines using GCP tools such as BigQuery, Dataflow, and Firestore. Optimize data pipelines for performance, scalability, and reliability. Transform raw data into structured formats that are ready for analytics and reporting. Integrate data from various sources into centralized repositories or operational systems. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver solutions. Document ELT processes, workflows, and best practices. Monitor and manage ELT jobs to ensure timely data availability. Troubleshoot and resolve issues in data pipelines to maintain data integrity. To Succeed in This Role, You Should Have: Qualification: A Bachelor's degree in Computer Science, Information Technology, or a related field from a top-tier institute (IIT, NIT, BITS, etc.). Experience: At least 3 years of hands-on experience in ELT/ETL development on cloud platforms. Technical Skills: Expertise in GCP services like BigQuery, Firestore, Dataflow, and Pub/Sub. Proficiency in Python for scripting and automation. Strong understanding of data warehousing concepts and data modeling. Experience with SQL for data querying and transformation. Familiarity with NoSQL databases such as Firestore. Knowledge of Apache Beam for building scalable data processing pipelines. Soft Skills: Excellent problem-solving abilities, strong communication skills, and the ability to collaborate effectively with cross-functional teams. Bonus Points If You: Have experience with GCP Cloud Scheduler or other orchestration tools. Hold a Google Professional Data Engineer certification or a similar qualification. Have worked with CI/CD pipelines for deploying ELT workflows. What You ll Find at Talentica: Innovative Culture: We specialize in cutting-edge development, not maintenance work. Our clients come to us for our technological expertise and innovation. Endless Learning Opportunities: You'll have ample opportunities to grow, learn, and stay up to date with the latest trends in technology. Talented Peers: Work alongside talented individuals from India s top engineering colleges (IITs, NITs, and others). Work-Life Balance: We understand the importance of work-life balance and offer flexible schedules and remote work options. Great Culture: 82% of our employees recommend Talentica to their friends (according to Glassdoor). Join us, and you'll see why! Recognition & Rewards: We celebrate success and ensure that your contributions are recognized and appreciated. If you're excited to work with a team of talented professionals and take your career to the next level, we d love to hear from you. Ready to take the next step? Fill out the form below, and we'll be in touch soon! About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni of IIT Bombay. We specialize in helping startups build innovative products by leveraging the latest tools and technologies to solve real-world problems. Over the past 21 years, we've partnered with 180+ startups, primarily in the US, and have helped many achieve successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: What You ll Be Doing: As an ELT Developer, you will: Design, develop, and maintain ELT pipelines using GCP tools such as BigQuery, Dataflow, and Firestore. Optimize data pipelines for performance, scalability, and reliability. Transform raw data into structured formats that are ready for analytics and reporting. Integrate data from various sources into centralized repositories or operational systems. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver solutions. Document ELT processes, workflows, and best practices. Monitor and manage ELT jobs to ensure timely data availability. Troubleshoot and resolve issues in data pipelines to maintain data integrity. To Succeed in This Role, You Should Have: Qualification: A Bachelor's degree in Computer Science, Information Technology, or a related field from a top-tier institute (IIT, NIT, BITS, etc.). Experience: At least 3 years of hands-on experience in ELT/ETL development on cloud platforms. Technical Skills: Expertise in GCP services like BigQuery, Firestore, Dataflow, and Pub/Sub. Proficiency in Python for scripting and automation. Strong understanding of data warehousing concepts and data modeling. Experience with SQL for data querying and transformation. Familiarity with NoSQL databases such as Firestore. Knowledge of Apache Beam for building scalable data processing pipelines. Soft Skills: Excellent problem-solving abilities, strong communication skills, and the ability to collaborate effectively with cross-functional teams. Bonus Points If You: Have experience with GCP Cloud Scheduler or other orchestration tools. Hold a Google Professional Data Engineer certification or a similar qualification. Have worked with CI/CD pipelines for deploying ELT workflows. What You ll Find at Talentica: Innovative Culture: We specialize in cutting-edge development, not maintenance work. Our clients come to us for our technological expertise and innovation. Endless Learning Opportunities: You'll have ample opportunities to grow, learn, and stay up to date with the latest trends in technology. Talented Peers: Work along...

ELT Developer Full-Time Data Integration ETL
TS

Python Bigdata Developer

Talentica Software (i) Pvt. Ltd.

4-6 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni from IIT Bombay. We specialize in helping startups build cutting-edge products and thrive on leveraging the latest technologies to solve real-world problems. With over 21 years of experience, we have worked with 180+ startups, primarily in the US, leading to many successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: We re looking for a Big Data Developer who is passionate about building intelligent, scalable solutions and eager to work with the latest technologies. If you're ready to drive the future of tech and collaborate on exciting projects with top-tier developers, we d love to have you join us. What You ll Be Doing: As a Big Data Developer, you will: Develop intelligent, scalable engineering solutions from scratch. Collaborate with customers to understand product vision and goals. Contribute to high-level and low-level product designs and roadmaps alongside a team of talented developers. Build products using cutting-edge technologies such as Python (Open-source tech stack), Kafka, Storm, Spark/Flask, Hadoop, Cassandra, MongoDB, and more. To Be Successful in This Role, You Should Have: Qualification: BE/BTech in any branch from IIT, NIT, BITS, VJTI, COEP, or other top institutes in India. Experience: 4-6 years of experience working with Python and Spark/Flask. Technical Skills: Strong knowledge of NoSQL databases (Cassandra, Aerospike, MongoDB). Experience with REST API frameworks (a plus). What You ll Find at Talentica: A Culture of Innovation: We focus on creating cutting-edge solutions, not maintaining old projects. Our clients come to us for our technological expertise. Endless Learning Opportunities: Continuously expand your skills and stay at the forefront of the latest advancements, building better, faster, and simpler products. Talented Peers: Work with talented professionals from India s top engineering colleges (IITs, NITs, and others). Work-Life Balance: We understand the importance of well-being and offer flexible schedules, including remote work options, to help you thrive both professionally and personally. A Great Culture: Our employees love working here! 82% of our team recommends Talentica to their friends (according to Glassdoor). At Talentica, we invite you to be part of a dynamic team that pushes boundaries and doesn t just follow trends. If you re ready to shape the future of the tech industry with us, we d love to hear from you. Qualification : BE/BTech in any branch from IIT, NIT, BITS, VJTI, COEP, or other top institutes in India.

Python Bigdata Developer Python developer Bigdata developer
TS

Senior Python Bigdata Developer

Talentica Software (i) Pvt. Ltd.

3-6 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and IIT Bombay alumni. We specialize in helping startups build innovative products by leveraging cutting-edge tools and technologies to solve real-world challenges. With over 21 years of experience, we ve worked with over 180 startups, primarily in the US, leading to numerous successful exits. In 2022, Talentica Software was recognized by Great Place to Work as one of India s Great Mid-Size Workplaces. What We re Looking For: We are seeking a Senior Python Big Data Developer to join our team. If you're passionate about building scalable solutions from scratch, enjoy collaborating with clients, and love working with the latest technologies, this is the perfect opportunity for you. We re looking for proactive problem-solvers who are eager to contribute to innovative projects and deliver impactful solutions. What You ll Be Doing: As a Senior Python Big Data Developer, your responsibilities will include: Developing Scalable Solutions: Design and implement intelligent, scalable engineering solutions from the ground up. Client Collaboration: Work closely with clients to understand their product vision, goals, and technical requirements. Product Design: Contribute to both high-level and low-level product designs while collaborating with a team of skilled developers. Innovative Product Development: Utilize cutting-edge open-source Python technologies such as Kafka, Storm, Spark/Flask, Hadoop, Cassandra, MongoDB, and more to build innovative products. To Be Successful in This Role, You Should Have: Qualifications: BE/BTech from top engineering institutes (IIT, NIT, BITS, VJTI, COEP, or other top 100 engineering colleges in India). Experience: 3.6-6 years of experience in Python and Spark/Flask. Tech Skills: Strong expertise in NoSQL databases (e.g., Cassandra, Aerospike, MongoDB). Familiarity with REST API frameworks is a plus. What You ll Find Here: A Culture of Innovation: We focus exclusively on cutting-edge development, working on projects that push the boundaries of technology. Our clients come to us for innovative solutions, not maintenance work. Endless Learning Opportunities: At Talentica, you ll continuously expand your skill set by exploring and applying the latest advancements in technology. Talented Peers: Work alongside top-tier engineers from India's premier institutions (IITs, NITs, and others), offering numerous opportunities for collaboration and learning. Work-Life Balance: We prioritize your well-being with flexible schedules and remote work options, helping you maintain a healthy work-life balance. A Great Culture: Our employees love working here! 82% of our team members recommend Talentica to their friends, according to Glassdoor. If you re eager to be part of a dynamic team that doesn t just follow trends but leads and innovates, Talentica is the place for you. Join us and help shape the future of the industry by working on impactful, high-tech projects. Qualification : BE/BTech from IIT, NIT, BITS, VJTI, COEP, or other top 100 engineering institutes in India.

Senior Python Senior python Bigdata Developer
CS

Data Engineering Architect

Cybage Software Private Limited

Fresher | Not Disclosed | Pune, Maharashtra, India | Full-time

Data Engineer - Media & Advertising Sector - Job Description We are looking for an experienced Data Engineer to join our team and drive business outcomes in the media and advertising sector. In this role, you will leverage advanced data technologies to design and implement comprehensive data strategies that focus on scalability, performance optimization, and secure data management. Successful candidates will have hands-on experience with Big Data technologies and machine learning models, as well as a deep understanding of the advertising domain and its data needs. Technical and Professional Requirements: Big Data Technologies: Proficiency with platforms such as BigQuery, Big Data, Hadoop, and Snowflake for managing and processing large-scale datasets. Programming/Scripting Languages: Strong experience in programming languages like Python, Java, or Go for developing data solutions. Machine Learning Models: Hands-on experience defining and implementing various Machine Learning models to address diverse business requirements. Data Scalability & Performance: Practical experience in handling performance and data scalability challenges to ensure efficient data processing and storage. Advertising Domain Knowledge: Familiarity with advertising data and experience working with datasets such as Campaign Performance, Ad Performance, Attribution, and Audience Data. Job Responsibilities: Data Strategy Design: Develop a comprehensive data strategy that aligns with business objectives. This includes designing data models, establishing database development standards, and managing data warehouses and data analytics systems. Data Source Identification: Identify internal and external data sources and create a plan for managing these data sources according to the overall business data strategy. Cross-Functional Collaboration: Work with various teams (engineering, product, analytics, etc.) to ensure the smooth functioning of the enterprise data system, facilitating cross-departmental cooperation. End-to-End Data Architecture: Manage the end-to-end data architecture process, from selecting the platform and designing technical architecture to developing applications, and finally testing and implementing the solution. Big Data Solution Planning: Plan and execute big data solutions using technologies like BigQuery, Big Data, Hadoop, and Snowflake. Data Accessibility & Security: Integrate technical functionality that ensures data accessibility, accuracy, and security throughout the data lifecycle. Educational Requirements: Any Graduate with 60% and above in your academic background. This position is ideal for someone who is passionate about data engineering and eager to tackle complex challenges in the media and advertising sector. If you're looking to drive innovation, work with cutting-edge technologies, and collaborate across teams, we would love to hear from you! Qualification : Any Graduate with 60% and above in your academic background.

Data Engineering Data Engineering Architect Data architect
IB

Data Engineer-data Modeling

International Business Machines Corporation

4+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Data Engineer IBM Consulting About the Role Join us at IBM Consulting in one of our Client Innovation Centers, where we deliver specialized technical and industry expertise to both public and private sector clients worldwide. Our centers bring local skills and technical capabilities to help clients drive innovation and adopt cutting-edge technologies. A career at IBM Consulting is built on fostering long-term relationships and collaborating closely with clients around the globe. You ll work with leaders across multiple industries to advance the hybrid cloud and AI journeys of some of the world s most innovative and influential companies. Your ability to create impactful change will be empowered by IBM's strategic partner ecosystem and our robust technology platforms, including IBM Software and Red Hat. At IBM, curiosity and a continual pursuit of knowledge form the cornerstone of success. In your role, you'll be encouraged to challenge norms, explore new ideas beyond your immediate responsibilities, and deliver innovative solutions that make a meaningful difference for clients. Our culture is rooted in growth and empathy, ensuring long-term career development in an environment that celebrates your unique skills and experiences. Your Role and Responsibilities As a Data Engineer at IBM, you ll unlock the power of data, revealing insightful stories and complex patterns. You ll contribute to data gathering, storage, and both batch and real-time processing, playing an essential role in defining data management systems and identifying key data for analysis. Your key responsibilities will include: Predictive Modeling: Implementing, validating, and maintaining statistical and predictive models, utilizing big data techniques along with various machine learning methodologies. Enterprise Search Applications: Designing and deploying enterprise search applications like Elasticsearch and Splunk to meet client-specific needs. Collaboration & Agile Practices: Working in an agile, team-oriented environment, collaborating with data scientists, engineers, consultants, and database administrators to bring statistical rigor to predictive behavior challenges. Data Integration & Cleansing: Developing teams or writing programs to efficiently cleanse and integrate data, build predictive models, and evaluate the results. Required Education Bachelor's Degree in Computer Science, Information Technology, Data Science, or a related field. Preferred Education Master's Degree in a relevant technical discipline. Required Technical and Professional Expertise 4+ years of experience in data modeling and data architecture. Proficiency in data modeling tools like ERwin, IBM Infosphere Data Architect, and experience with database management systems. Familiarity with various data models, including relational, dimensional, and NoSQL databases. Strong understanding of business processes and how data supports business decision-making. Expertise in database design principles, data warehousing concepts, and data governance practices. Preferred Technical and Professional Experience Exceptional analytical and problem-solving skills, with a sharp attention to detail. Ability to work collaboratively in a team-oriented environment and manage multiple projects simultaneously. Knowledge of SQL or similar programming languages. At IBM Consulting, we foster a culture of growth, innovation, and collaboration. As a Data Engineer, you ll have the opportunity to work with some of the brightest minds in the industry, all while impacting critical data-driven solutions for global clients. Join us and be a part of a diverse team committed to driving change and shaping the future of technology and analytics. Qualification : Bachelor's Degree in Computer Science, Information Technology, Data Science, or a related field.

Data Engineer Data Engineer Modeling Data Modeling
SY

Technical Lead Data

Syngenta

9+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Tech Lead Data Overview: As a Tech Lead Data, you will provide technical leadership to a team of experts, helping implement information-driven strategies and systems that support agricultural scientists in developing solutions for growers. You will manage end-to-end implementation of data environments beyond architectural design, ensuring that real-life data systems are developed and executed efficiently. You are a highly motivated problem solver with the ability to prioritize shifting workloads in a dynamic environment. You are an effective communicator and a confident leader passionate about making things happen within a fast-paced organization. Key Responsibilities: Lead the development of data and analytics capabilities within the R&D node of the enterprise data mesh, implementing architectural blueprints for various data platforms. Develop and implement an organizational data strategy aligned with business processes, including data model design, database development standards, and management of data warehouses and analytics systems. Identify and manage both internal and external data sources, creating a data management plan aligned with the organizational strategy. Collaborate with cross-functional teams, stakeholders, and vendors to ensure the smooth functioning of the enterprise data ecosystem. Guide the technical direction of data projects and initiatives, ensuring best practices in data engineering and analytics. Integrate technical functionality to ensure data accessibility, accuracy, and security. Perform continuous audits of data management systems and address performance issues, reporting breaches or vulnerabilities to stakeholders. Experience & Skills Required: 9+ years of experience in Big Data, data warehousing, data analytics, and/or Information Management projects. Proven experience building large-scale enterprise data architectures using both commercial and open-source Data Analytics technologies. Strong data modeling and architecture skills, including expertise in data warehousing, data normalization, and dimensional modeling (e.g., OLAP, data vault). Understanding of predictive modeling, Natural Language Processing (NLP), text analysis, and Machine Learning. Knowledge of security integration, including Kerberos authentication, SAML, data security, privacy techniques like data masking, and tokenization. Experience with DevOps engineering and Continuous Integration/Delivery tools. In-depth understanding of AWS Cloud solutions and integrating into legacy systems and COTS solutions. Familiarity with the following tools: Data Ingestion: Snaplogic, Glue, Lambda Storage: S3 Processing: Databricks DWH: Redshift, Databricks SQL Warehouse Databases: RDS Languages: Python (pyspark), SQL (sparksql), Java, R BI Tools: PowerBI, Dash, Spotfire, Qlik Catalog: Glue catalog, Unity Catalog Streaming: Kafka, EventHub AI/ML: MLOps, SageMaker Storage/Dataframe: S3, Deltalake, Iceberg, Parquet Qualifications: University bachelor s degree in Science, Technology, Engineering, or Mathematics (STEM). Fluency in English. Strong customer focus with excellent communication, teamwork, and negotiation skills. In-depth technical experience, ideally with AWS certification. Experience implementing data-first solutions. Experiences to be Gained: Continuous upskilling in the latest technologies, tools, and design practices. Exposure to R&D operations. Development of leadership and relationship-building skills with internal customers. Company Description: Syngenta Group is one of the world s leading sustainable agriculture innovation companies, with over 53,000 people in more than 100 countries. We strive to transform agriculture through tailor-made solutions for farmers, society, and the planet. We are committed to maintaining high standards of ethics, integrity, and creating an inclusive, discrimination-free workplace. Additional Information: Syngenta is an Equal Opportunity Employer. We do not discriminate based on race, color, religion, gender, national origin, age, sexual orientation, gender identity, marital status, veteran status, disability, or any other legally protected status. Qualification : University bachelors degree in Science, Technology, Engineering, or Mathematics (STEM).

Technical Lead Technical lead Data Data lead
HS

Senior Data Engineer/senior Arcihtect

Hsbc

8-10 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Role: Senior Architect Key Responsibilities: Platform Integration & Collaboration: Work across various platforms, collaborating with other support teams to ensure smooth integration and efficient operations. Solution Design & Development: Design, develop, test, and implement changes to solutions based on business requirements and strategic direction. Collaboration with Development Teams: Collaborate with development teams to test and maintain platforms and ensure smooth integration with other systems. Product/Project Support: Communicate regularly with Product Owners and agile Pods to provide ongoing support for products and projects. Guidance & Mentorship: Guide junior team members in development and delivery to help them grow and ensure efficient workflow. Release Support & Monitoring: Responsible for supporting production releases, conducting peer reviews, and overseeing the CI/CD pipeline implementation and service monitoring. Shift & On-Call Availability: Be flexible in working hours, ready to work in shifts and be on-call when needed. Requirements: To be successful in this role, you should meet the following criteria: Experience: 8-10 years of experience in software development, specifically in data analysis or big data projects. Technical Expertise: Strong skills in SpringBoot, Java 8, Kubernetes, Docker, Microservices, and PostgreSQL. Good understanding of CDP 7.1, HDFS filesystems, Unix, and Unix Shell Scripting. Knowledge of Elasticsearch, DevOps concepts, and related platforms. System Design: Proven experience in analyzing complex business requirements and translating them into effective system designs. Data Processing Expertise: Expertise in building and deploying production-level data processing batch systems supported by application support teams. Communication & Collaboration: Ability to work at pace, communicate clearly, and operate both independently and as part of a team. Desirable Skills: Good to have knowledge of Quantexa software, Angular, HTML, CSS, and JavaScript. Optional knowledge of cloud platforms. At HSBC, you'll have the opportunity to make a real impact. We support your career development, offer flexible working, and provide a collaborative, inclusive environment where you can thrive. Qualification : Person should have 8-10 years of experience in s/w development on data analysis or big data projects.

Senior Data Engineer Senior engineer Data Engineer
TM

Associate Data Architect

Tech Mahindra

10+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Summary: The ServiceNow Solution Architect is responsible for delivering comprehensive ServiceNow integration solutions for complex client environments. This role requires a deep understanding of key ServiceNow technologies such as Integration Hub, SSO, Web Services, LDAP, JDBC, and others. The Solution Architect will lead technical delivery, manage stakeholder relationships, and deliver solutions in both agile and traditional software project methodologies. Additionally, the role involves mentoring and leading offshore development teams and collaborating closely with engagement leads, project managers, and business analysts. Key Responsibilities: 1. ServiceNow Integration Expertise: Deep knowledge of ServiceNow integration technologies including Integration Hub, SSO, Web Services, LDAP, JDBC, etc. Design and deliver complex ServiceNow solutions in client environments, ensuring timely and budget-conscious project execution. 2. Business Analysis & Documentation: Apply common business analysis techniques and approaches to effectively translate client requirements into technical solutions. Author clear and comprehensive documentation for all phases of the project, ensuring all technical and functional aspects are well-documented. 3. Project Delivery & Stakeholder Management: Lead projects from inception to delivery, ensuring the solutions meet client needs and align with business objectives. Work closely with clients, managing multiple stakeholders and ensuring strong communication throughout the lifecycle. Influence and align stakeholders, guiding them through complex situations with clear and open communication. 4. Agile & Traditional Methodologies: Lead both agile and traditional project methodologies to deliver technology solutions. Ensure project goals and deadlines are met while adapting to challenges. 5. Team Leadership: Lead offshore development teams, ensuring high-quality solutions are delivered. Collaborate with engagement leads, project managers, and business analysts to meet client objectives. Develop and mentor team members, providing guidance on technical and project-related issues. 6. Scripting and Development: Utilize JavaScript, CSS, AngularJS, and ServiceNow-specific scripting (Flows, Business Rules, Client Scripts, UI Actions, Widgets, UI Pages) to deliver custom solutions. 7. Continuous Learning & Development: Stay current on the latest ServiceNow updates and innovations to continuously improve skills. Seek out development opportunities and drive your own professional growth. Required Qualifications: 1. Experience: Over 10 years in a corporate IT environment. Extensive experience in consulting, professional services, and technical delivery. Proven track record of delivering complex ServiceNow projects on time and within budget. Strong experience in client-facing roles with a history of managing relationships and expectations. 2. Certifications: Certified ServiceNow System Administrator. Certified Implementation Specialist in at least 3 product suites. ITIL Foundation Certification (v3 or v4). 3. Technical Expertise: Strong expertise in ServiceNow scripting (JavaScript, CSS, Angular JS), including Flows, Business Rules, Client Scripts, UI Actions, Widgets, and UI Pages. Solid understanding of Integration Hub, SSO, Web Services, LDAP, JDBC. 4. Education: Bachelor s degree in Business, Engineering, IT, Science, or related technical field preferred. 5. Leadership & Communication: Experience leading offshore teams and collaborating with cross-functional teams in multi-location settings. Strong negotiator and influencer with the ability to manage stakeholders and resolve conflicts effectively. Desired Skills: A passionate approach to areas of expertise with a proactive attitude toward continuous learning. Ability to demonstrate drive and resilience in overcoming setbacks and challenges to achieve team and project goals. Qualification : Bachelor's degree in Business, Engineering, IT, Science, other Technical qualification or related field preferred

Associate Data Data Associate Architect Associate architect
CE

Data Engineer Ii

Cencora

4+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Overview As a Data Engineer II, you will provide accurate and pertinent data to support the Legal and Compliance departments. This role requires expertise in SQL, SAP BusinessObjects, and knowledge of Wholesale Distribution processes such as Customer Sales, Payments, Plant Receipts, and Returns. Your primary responsibilities include designing analytics models, maintaining data integrity, conducting root-cause analyses, and guiding data validation and quality control efforts. You will collaborate with various teams and stakeholders to address complex business challenges and deliver seamless, reliable data-driven solutions. Primary Responsibilities Business Analytics Support: Translate business needs into semantic data requirements and implement analytics enhancements. Data Mining & Insights: Identify growth opportunities, analyze pricing activities, and recommend profitability improvements. Data Integrity: Validate data sources, address inaccuracies, and ensure high data quality through automation and monitoring tools. Cross-Functional Collaboration: Work with Inside Sales, Finance, and Sourcing to develop forecasts and actionable insights. Data Analysis: Identify trends, conduct root-cause analyses, and assess the impact of operational policies and governance frameworks. Reporting: Develop and deliver performance reports, dashboards, and statistical analyses for internal and external stakeholders. Mentorship: Guide and train team members in using analytics tools and techniques to improve business decision-making. Experience & Skills Required Experience 4+ years in healthcare data analytics or data engineering. Essential Skills Proficiency in SAP and BusinessObjects. Strong background in Business Intelligence and data visualization. Deep understanding of distribution processes (purchases, sales, payments). Prior experience mentoring or coaching team members. Desired Skills Experience in pharmaceutical wholesale. Familiarity with tools like Microsoft Power BI or Tableau. Technical Skills Programming: Proficiency in SQL, R, Python. Data Management: Data modeling, governance, quality assurance, and advanced statistical analysis. Visualization Tools: Tableau, Power BI, Alteryx, QlikSense. Statistical Tools: SAS, SPSS. Microsoft Office Suite. Behavioral Skills Critical thinking and problem-solving. Detail-oriented with a strong ability to identify data anomalies. Effective time management and adaptability to new challenges. Strong interpersonal communication and learning agility. Be part of a team dedicated to innovation and creating healthier futures. Work in a collaborative and supportive environment. Develop your skills with opportunities for professional growth. Qualification : 4+ years of directly related experience in healthcare data analytics or data engineering.

Data Engineer Data Engineer Ii Engineer ii
CT

Data Engineering Lead

Calfus Technologies India

6-12 Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Data Engineering Lead BI Analytics & DWH Location: Pune About Calfus At Calfus, we build groundbreaking AI agents and enterprise software that are redefining what s possible for businesses. Whether it's automating workflows, integrating ERP systems, or deploying AI-powered solutions, we help companies scale smarter and faster. Our engineering and data teams are at the core of this innovation designing and delivering high-performance solutions that unlock massive business value. As we grow rapidly, we re looking for driven individuals ready to make a meaningful impact. About the Role We re hiring a Data Engineering Lead to own and drive our BI Analytics & Data Warehousing strategy. You'll lead the architecture, development, and optimization of data pipelines, models, and interactive dashboards that power strategic insights across the business. You ll work hands-on with ETL tools, SQL, Power BI, Tableau, Python, and cloud platforms like Azure and AWS while mentoring junior engineers and collaborating with cross-functional stakeholders. What You ll Do Data Architecture & Modeling Design and implement scalable data models that support self-service BI and analytical reporting. Manage data modeling across structured, semi-structured, and cloud-native data sources. ETL/ELT & Integration Oversee ETL processes using SSIS, Airflow, or equivalent tools for seamless data movement. Handle complex data transformation using SQL Server, Postgres, Snowflake, and Redshift. Visualization & Reporting Develop and lead dashboard/report design using Power BI, Tableau, QuickSight, Plotly, or Dash. Drive best practices in dashboard performance, UX, and storytelling with data. Advanced Data Engineering Use Python, PySpark, NumPy, and Pandas for data wrangling and exploratory analysis. Work with Azure Databricks, MongoDB, and cloud storage (S3, Azure Blob) to build robust pipelines. Automation & DevOps Orchestrate pipelines using Apache Airflow, and implement CI/CD for data engineering workflows. Manage version control and code quality across projects using Git-based workflows. Stakeholder Collaboration Partner with business leaders and analysts to translate requirements into scalable data solutions. Align technical delivery with strategic business goals and drive cross-functional data initiatives. Leadership & Mentorship Guide and mentor junior team members across data and BI functions. Foster a culture of innovation, ownership, and continuous learning. What You Bring Bachelor s in Computer Science, Information Systems, Data Engineering, or related field. 6 12 years of experience in BI architecture, data engineering, and analytics. Deep expertise in: ETL tools: SSIS, Airflow Databases: SQL Server, Snowflake, Postgres, Redshift, MongoDB BI Tools: Power BI, Tableau, QuickSight, Plotly/Dash Python for data analysis, automation, and pipeline development Cloud Platforms: Azure, AWS (S3, Lambda, Databricks) Strong SQL and data modeling skills (relational and dimensional). Familiarity with CRISP-DM, data governance practices, and performance tuning. Bonus Points If You Have Experience working with Azure SDK. Ability to work with REST APIs and perform web scraping. BI architecture design and deployment at scale. Growth-driven culture with clear career paths. Work on industry-defining AI and enterprise products. Exposure to diverse clients, industries, and technologies. Strong focus on wellness, flexibility, and learning. Benefits Medical, group, and parental insurance Provident fund & gratuity Birthday leave & employee wellness programs Highly collaborative and innovative work environment Diversity & Inclusion Calfus is an Equal Opportunity Employer. We believe that diversity fuels innovation. We re committed to creating a welcoming and inclusive workplace for everyone regardless of race, gender, age, background, or identity. Lead the future of data at Calfus. Apply now and help power decision-making through scalable, smart, and stunning data engineering solutions. Qualification : Bachelors in Computer Science Information Systems, Data Engineering, or related field

Data Engineering Data Engineering Lead Data lead
DR

Staff Data / Machine Learning Engineer

Druva

7+ Years | Not Disclosed | Pune, Maharashtra, India | Full-time

Job Title: Staff Data / Machine Learning Engineer Company: Druva Location: Pune, Maharashtra, India About Druva: Druva, the autonomous data security company, delivers data protection on autopilot through a 100% SaaS, fully managed platform that secures and recovers data from all threats. The Druva Data Security Cloud guarantees data availability, confidentiality, and integrity providing customers with autonomous protection, rapid incident response, and guaranteed data recovery. Trusted by over 6,000 customers worldwide including 65 of the Fortune 500 Druva safeguards business-critical data in today s connected world. Backed by over $350M in venture capital, Druva protects more than 200 PB of data globally and offers a $10 million Data Resiliency Guarantee against cyber threats. The Role & Team: Join Druva s Business Intelligence team, where data drives key insights and fuels operational and strategic decisions. As a Staff Data/Analytics/ML Engineer, you will lead the development of data-to-insights recommendation engines and drive collaboration across teams to deliver impactful, data-driven solutions. This is a high-impact role working alongside expert engineers and product leaders, leveraging industry-leading data platforms and tools. What You ll Do: Bridge the gap between data engineering, analytics, and machine learning to unlock actionable business insights. Collaborate cross-functionally with Product, Engineering, GTM, and Customer Success teams to build data-driven solutions that enhance decision-making and business outcomes. Design, build, and maintain scalable data pipelines and infrastructure supporting analytics, machine learning, and operational workflows. Develop and optimize data models for efficient analytics and reporting across large datasets. Lead feature engineering, model training, and deployment pipelines for real-time and batch ML/AI applications. Drive architectural improvements in data governance, observability, and platform scalability. Evaluate and implement cutting-edge data tools and platforms including Reverse ETL, MLOps, and DataOps frameworks. Mentor and guide data engineers, analysts, and ML practitioners, fostering technical excellence and collaboration. Translate complex business requirements into technical deliverables, prioritizing initiatives that maximize impact. What We Are Looking For: Bachelor s or Master s degree in Computer Science, Data Science, Engineering, Statistics, or a related field. 7+ years experience spanning data engineering, analytics engineering, and machine learning with a strong technical foundation in all three areas. Expertise in modern data stacks: Snowflake, dbt, Airflow, Spark, and cloud platforms (AWS, GCP, Azure). Proficiency with BI and analytics tools such as Looker, Sigma, Tableau, Power BI, or equivalents. Strong skills in SQL, Python, and distributed data processing frameworks (Spark, Dask, etc.). Experience designing and maintaining data pipelines, ETL/ELT workflows, and data transformations for analytics and ML use cases. Familiarity with ML frameworks like TensorFlow, PyTorch, Scikit-learn, and MLOps lifecycle management. Deep knowledge of data modeling, architecture, and governance best practices. Proven problem-solver who thrives in ambiguity and designs robust data solutions. Experience working in Agile environments with strong prioritization and collaboration skills. Excellent communication skills, capable of simplifying complex technical topics for non-technical stakeholders. Bonus Points For: Experience with Generative AI, LLMs, and integrating AI into business workflows. Knowledge of streaming architectures (Kafka, Kinesis, Pub/Sub) and real-time analytics. Familiarity with Data Contracts, Data Quality frameworks, or Data Mesh architectures. Experience with Reverse ETL tools such as Salesforce, Census, Hightouch, or Segment for operational analytics. If you re passionate about driving data innovation at scale and want to work in a dynamic environment protecting the world s critical data, Druva invites you to join our team! Qualification : Bachelors or Masters degree in Computer Science, Data Science, Engineering, Statistics, or a related field.

Data Engineer Staff Engineer Data Engineer Staff data engineer

1 - 20 of 0 jobs

* No exact matches found. Showing closest results instead
Sort by:

No results found

Modify search criteria or create an alert to get relevant jobs as soon as they’re posted

Create an alert

Continue to Save

Please login to your jobseeker account, or create a new one to save this job.

Feedback

Share Feedback