SQL Data Engineer Jobs in Pune
344 Jobs Found
Ai/ml Engineer
Roxiler Systems
AI/ML Engineer Experience: 2 3 Years Education: BBA, BSc, BTech/BE, MSc, MTech, MCA Location: Pune About the Role We are seeking a passionate AI/ML Engineer to design, build, and scale production-grade AI systems that power our platform. You will work on real-world AI problems such as document intelligence, real-time voice AI, and intelligent job-to-candidate matching systems. This role requires strong hands-on experience in LLM engineering, backend development, and AI system productionization. Required Skills Python (FastAPI) LangChain, LlamaIndex OpenAI API, Anthropic Good to Have Postgres (Pgvector), Supabase Redis Docker LangSmith GitHub Actions Roles & Responsibilities Build Agentic Workflows: Design and deploy AI agents capable of reasoning and decision-making using LangChain or LlamaIndex. Develop Voice AI Systems: Build low-latency, real-time conversational voice bots for candidate outreach using WebSockets, STT, and TTS, ensuring effective context retention and state management. Engineer Data Pipelines: Create robust parsing systems that enforce strict JSON outputs from LLMs for resume data extraction, along with data cleaning pipelines for unstructured formats (PDF/DOCX). Implement Advanced RAG Systems: Develop retrieval pipelines using Pgvector or Pinecone with hybrid search (semantic + keyword) for accurate job-to-candidate matching. Productionize & Monitor AI Systems: Set up tracing and observability using LangSmith to debug chains, monitor token usage, and optimize performance and cost. Backend Integration: Package AI logic into scalable, asynchronous microservices using FastAPI and Docker. Technical Requirements 1. Generative AI & LLM Engineering Experience enforcing structured JSON outputs using function calling. Strong prompt engineering skills (Chain-of-Thought, Few-Shot). Hands-on experience orchestrating complex AI pipelines using LangChain or LlamaIndex. 2. Voice AI & Real-Time Processing Experience with STT/TTS APIs (e.g., Whisper, Deepgram). Strong understanding of WebSockets and async programming for real-time audio streaming. Ability to design conversation managers with memory and context handling. 3. Search & Data (RAG) Experience with vector databases such as Pgvector, Pinecone, or Qdrant. Expertise in chunking, cleaning, and ingesting unstructured data. 4. MLOps & Production Engineering Observability and tracing using LangSmith. Writing automated AI evaluation scripts to test prompts before deployment. Experience optimizing cost by balancing model performance and token usage. 5. Core Backend Engineering Strong Python skills with FastAPI. Proficiency in async/await patterns for concurrent processing. Experience with Docker and relational databases (SQL). 6. Machine Learning & Algorithms Understanding of recommendation systems (Collaborative Filtering, Two-Tower models). Experience with ranking and re-ranking techniques (LTR, Cross-Encoders). Familiarity with traditional ML models using Scikit-learn or XGBoost. The Applied Mindset We Value Model Strategy: Ability to choose the right model based on cost, latency, and intelligence requirements. Security First: Awareness of prompt injection and jailbreaking risks and strategies to mitigate them. Hallucination Control: Strong grounding techniques to ensure factual and reliable AI outputs. Tech Stack Overview Languages: Python (FastAPI) AI & Orchestration: LangChain, LlamaIndex, OpenAI API, Anthropic Voice AI: Deepgram, Twilio Databases: Postgres (Pgvector), Supabase, Redis DevOps & MLOps: Docker, LangSmith, GitHub Actions Qualification : BBA, BSc, BTech/BE, MSc, MTech, MCA
Data Engineer
Calfus Technologies India
Data Engineer BI Analytics & DWH Location: Pune About Calfus At Calfus, we develop cutting-edge AI agents and software products that enable businesses to unlock the full potential of AI transforming operations, boosting revenue, and driving innovation. From startups to global enterprises, our clients trust us to deliver engineering excellence. Our teams have built ERP and cloud solutions that integrate seamlessly with core business systems, streamlining manual processes and empowering teams to focus on high-impact work. As one of the fastest-growing companies in our sector, we thrive on collaboration, speed, and innovation. If you re driven by impact and love working in fast-paced environments, we want to hear from you. About the Role We re looking for a Data Engineer with 3 4 years of experience to join our Business Intelligence & Data Warehouse team. In this role, you'll be responsible for building robust data pipelines, designing scalable data models, and supporting analytics and reporting capabilities. You will work with modern tools like Azure Data Factory, Databricks, and Snowflake, and help deliver reliable, performant data infrastructure for internal and client-facing initiatives. What You ll Do ETL/ELT Development Build and maintain efficient ETL/ELT pipelines using Azure Data Factory, Databricks, or equivalent. Ingest and consolidate data from multiple sources into data warehouses or data lakes. Data Modeling & Warehousing Design and implement relational and dimensional models suited for business reporting. Work with databases such as Snowflake, Redshift, Postgres, or SQL Server. SQL & Database Engineering Write performant SQL queries, stored procedures, and scripts for data transformation. Implement complex joins and aggregations for analytical workloads. BI & Visualization Support Collaborate with business users to support reporting in Power BI or Tableau. Enable data-driven decisions through accessible and accurate data models. Performance & Data Quality Monitor pipeline jobs for failures, performance issues, and delays. Apply data validation checks to ensure the integrity and accuracy of data. Bachelor s degree in Computer Science, Data Engineering, Information Systems, or related field. 3 4 years of hands-on experience in data engineering, with strong skills in ETL/ELT, SQL, and data modeling. Experience with cloud platforms (Azure, AWS) and tools like: Azure Data Factory Databricks SQL Server, Postgres, Redshift, or Snowflake Basic understanding of Python for scripting and automation. Familiarity with file formats like JSON, Parquet, and CSV. Exposure to BI tools such as Tableau or Power BI (nice to have). Benefits @ Calfus Medical, group, and parental insurance Provident fund & gratuity Birthday leave and wellness support High-growth, high-impact environment Diversity & Inclusion Calfus is proud to be an Equal Opportunity Employer. We believe that diversity drives innovation, and we are committed to fostering an inclusive, supportive, and respectful environment for all. Qualification : Bachelors degree in Computer Science, Data Engineering, Information Systems, or related field
Data Engineering Lead
Calfus Technologies India
Data Engineering Lead BI Analytics & DWH Location: Pune About Calfus At Calfus, we build groundbreaking AI agents and enterprise software that are redefining what s possible for businesses. Whether it's automating workflows, integrating ERP systems, or deploying AI-powered solutions, we help companies scale smarter and faster. Our engineering and data teams are at the core of this innovation designing and delivering high-performance solutions that unlock massive business value. As we grow rapidly, we re looking for driven individuals ready to make a meaningful impact. About the Role We re hiring a Data Engineering Lead to own and drive our BI Analytics & Data Warehousing strategy. You'll lead the architecture, development, and optimization of data pipelines, models, and interactive dashboards that power strategic insights across the business. You ll work hands-on with ETL tools, SQL, Power BI, Tableau, Python, and cloud platforms like Azure and AWS while mentoring junior engineers and collaborating with cross-functional stakeholders. What You ll Do Data Architecture & Modeling Design and implement scalable data models that support self-service BI and analytical reporting. Manage data modeling across structured, semi-structured, and cloud-native data sources. ETL/ELT & Integration Oversee ETL processes using SSIS, Airflow, or equivalent tools for seamless data movement. Handle complex data transformation using SQL Server, Postgres, Snowflake, and Redshift. Visualization & Reporting Develop and lead dashboard/report design using Power BI, Tableau, QuickSight, Plotly, or Dash. Drive best practices in dashboard performance, UX, and storytelling with data. Advanced Data Engineering Use Python, PySpark, NumPy, and Pandas for data wrangling and exploratory analysis. Work with Azure Databricks, MongoDB, and cloud storage (S3, Azure Blob) to build robust pipelines. Automation & DevOps Orchestrate pipelines using Apache Airflow, and implement CI/CD for data engineering workflows. Manage version control and code quality across projects using Git-based workflows. Stakeholder Collaboration Partner with business leaders and analysts to translate requirements into scalable data solutions. Align technical delivery with strategic business goals and drive cross-functional data initiatives. Leadership & Mentorship Guide and mentor junior team members across data and BI functions. Foster a culture of innovation, ownership, and continuous learning. What You Bring Bachelor s in Computer Science, Information Systems, Data Engineering, or related field. 6 12 years of experience in BI architecture, data engineering, and analytics. Deep expertise in: ETL tools: SSIS, Airflow Databases: SQL Server, Snowflake, Postgres, Redshift, MongoDB BI Tools: Power BI, Tableau, QuickSight, Plotly/Dash Python for data analysis, automation, and pipeline development Cloud Platforms: Azure, AWS (S3, Lambda, Databricks) Strong SQL and data modeling skills (relational and dimensional). Familiarity with CRISP-DM, data governance practices, and performance tuning. Bonus Points If You Have Experience working with Azure SDK. Ability to work with REST APIs and perform web scraping. BI architecture design and deployment at scale. Growth-driven culture with clear career paths. Work on industry-defining AI and enterprise products. Exposure to diverse clients, industries, and technologies. Strong focus on wellness, flexibility, and learning. Benefits Medical, group, and parental insurance Provident fund & gratuity Birthday leave & employee wellness programs Highly collaborative and innovative work environment Diversity & Inclusion Calfus is an Equal Opportunity Employer. We believe that diversity fuels innovation. We re committed to creating a welcoming and inclusive workplace for everyone regardless of race, gender, age, background, or identity. Lead the future of data at Calfus. Apply now and help power decision-making through scalable, smart, and stunning data engineering solutions. Qualification : Bachelors in Computer Science Information Systems, Data Engineering, or related field
Senior/lead Java Developer
Cognologix
Position: Senior / Lead Java Developer Location: Pune Work Type: Full Time Minimum Experience: 6 8 Years Top Skills: Core Java, Spring Boot, Cloud-Native Microservices About the Role At Cognologix, we empower data-driven enterprises to harness the full potential of their data. From scalable analytics to machine learning platforms, we help clients navigate their digital transformation journeys. As a Senior/Lead Java Developer, you will work with modern cloud-native technologies to build distributed systems that process terabytes of data efficiently and intelligently. Key Responsibilities Collaborate with Data Scientists, Engineers, and Product Managers to transform complex data into actionable insights. Design and develop high-performance, low-latency Java-based microservices. Own the end-to-end architecture, implementation, and maintenance of backend systems. Design and implement REST APIs and contribute to living documentation and test specifications. Write clean, scalable, and testable code following best development practices. Build and maintain data pipelines using Apache Spark, Google Data Pipelines, or similar tools. Mentor junior developers and actively contribute to team growth and knowledge sharing. Continuously optimize and enhance the software development lifecycle. What You Bring (Must-Have Skills) 5+ years of hands-on experience building scalable cloud-native applications. Proficient in Java, Spring, Spring Boot, and Spring Security frameworks. Experience with Groovy, SQL, or NoSQL databases. Familiarity with distributed event-driven architectures using Kafka, GCP Pub/Sub, etc. Solid understanding of RESTful API design principles and performance optimization. Experience in working with Google Cloud Platform (GCP) and BigQuery is a plus. Nice to Have (Preferred Skills) Exposure to containerized environments and tools such as Docker, Istio, and Kubernetes. Experience with big data technologies like Apache Spark, Flink, or similar platforms. Understanding of CI/CD pipelines, DevOps practices, and cloud infrastructure automation. Full-stack development experience or a willingness to contribute beyond backend responsibilities. High autonomy, fast-paced environment, and flat hierarchy Work on emerging technologies and solve meaningful problems at scale Remote work options available for experienced professionals Competitive compensation and family-friendly benefits Clear path for performance-based career growth About Cognologix Cognologix helps companies disrupt and innovate by reimagining their business models. We specialize in building modern, scalable, cloud-native products with a focus on data engineering, analytics, and automation. Our agile teams deliver high-quality, tech-driven outcomes across industries and geographies.
Sr Data Engineer
Vconstruct Private Limited
Position: Senior Data Engineer Location: Pune Employment Type: Full-Time Company: vConstruct (Construction Technology Company) About vConstruct vConstruct is a Pune-based construction technology company focused on leveraging data science and analytics to transform the construction industry. Our Data Science and Analytics team is a close-knit group dedicated to supporting the business with robust data infrastructure and insightful analysis. Role Overview We are seeking a highly experienced Senior Data Engineer to lead the design, development, and maintenance of scalable data pipelines and infrastructure. This role involves working closely with cross-functional teams to manage diverse data sources, ensure data integrity, and support data-driven business initiatives. Key Responsibilities Lead the design and development of scalable, high-performance data pipelines and ETL/ELT frameworks following modern data engineering best practices. Architect complex data integration workflows that unify structured, semi-structured, and unstructured data from cloud and on-premise sources. Develop robust real-time, batch, and on-demand data pipelines equipped with monitoring, alerting, and automated error handling. Collaborate with analysts, data scientists, and business leaders to create reliable data models, quality frameworks, and SLAs. Ensure optimal pipeline performance, throughput, and proactive issue resolution. Work with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows aligned with enterprise standards. Enforce best practices in source control, code reviews, testing automation, and continuous delivery. Lead root cause analysis and preventive maintenance to minimize business impact from data failures. Establish standards for data modeling, transformation logic, and governance. Design and execute comprehensive testing strategies to ensure data reliability and pipeline resilience. Optimize pipeline and query performance for scalability, reliability, and cost-efficiency. Maintain detailed technical documentation including architecture diagrams, process flows, and integration specs. Facilitate discussions with business and operational teams to prioritize data initiatives and drive strategy. Qualifications 7-10 years of hands-on experience in data engineering with a track record of building scalable and secure data platforms. 5+ years of scripting experience in Python for data processing, automation, and ETL development. 4+ years experience with Snowflake, including performance tuning, security, and advanced SQL. 5+ years experience with data integration tools like Azure Data Factory, Fivetran, or Matillion. 5+ years writing complex, optimized SQL queries on large datasets. Proven experience integrating APIs, JSON, XML, and webhooks for data acquisition. Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools such as Apache Airflow. Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git). Familiarity with dbt or similar transformation tools and modular development practices. Experience with data visualization tools like Power BI is a plus. Strong interpersonal and communication skills to lead cross-functional technical discussions. Education Bachelor s or Master s degree in Computer Science, Information Technology, or a related field. Equivalent academic and professional experience will also be considered. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or a related field
Senior Data Scientist
Vconstruct Private Limited
Position: Senior Data Scientist Location: Pune Employment Type: Full-Time Company: vConstruct (Construction Technology Company) About vConstruct vConstruct is a Pune-based construction technology company focused on revolutionizing the construction industry through advanced AI and ML solutions. Our Data Science and Analytics team comprises Data Scientists, AI Engineers, Data Analysts, and Data Engineers working collaboratively to drive innovation across all construction project phases from pre-construction to post-construction. Our mission is to harness the power of data and AI to improve predictability, automate processes, and enhance efficiency in construction domains such as scheduling, planning, supply chain, safety, quality control, site management, financials, and virtual design construction. Role Overview We are seeking a highly skilled Senior Data Scientist to lead the development of innovative AI and machine learning solutions focused on construction data. You will work on cutting-edge projects involving Computer Vision, Predictive Analytics, Generative AI, and Large Language Models (LLMs) using technologies such as MS Azure AI Services, OpenAI, and various ML frameworks. Key Responsibilities Collaborate strategically with cross-functional teams to identify and solve business problems through scalable AI/ML solutions. Analyze construction project data to develop predictive models using traditional methods and generative AI. Apply machine learning algorithms to enhance project execution, safety, risk assessment, and other core construction processes. Lead end-to-end development of scalable predictive and ML models, including hypothesis generation, development, deployment, and monitoring. Build, validate, and optimize machine learning and statistical models; review and quality control models developed by junior team members. Partner with engineering and business teams to deeply understand data, processes, and business requirements, and implement appropriate solutions. Stay updated on advances in data science and machine learning to continuously enhance vConstruct s capabilities. Use statistical techniques to detect anomalies and optimize workflows to ensure timely, cost-effective project delivery. Collaborate with product managers and business leaders to drive data-driven decision-making and communicate insights effectively. Visualize insights using BI tools to support stakeholders in understanding data outcomes. Key Projects Include Developing GPT-based language models customized for construction industry data (structured and unstructured). Utilizing computer vision for object detection on 2D drawings and 3D BIM models. Applying statistical frameworks to predict construction site losses, win/loss opportunities, and quantity forecasts. Integrating AI models deeply into construction operations to automate and improve efficiency. Qualifications Bachelor s or Master s degree in Computer Science, Data Science, Statistics, Mathematics, or a related field. 8-10 years of professional experience, including at least 6 years in data science, machine learning, and analytics. Proven track record of delivering impactful, production-ready AI/ML solutions. Experience managing multiple projects in fast-paced, dynamic environments. Strong business acumen with the ability to translate technical insights into actionable business strategies and communicate effectively with stakeholders. Experience with construction data or related industries (engineering, manufacturing) is a plus. Technical Skills Expertise in Python, R, or Scala programming. Proficiency with ML, AI, and statistical frameworks and libraries such as TensorFlow, PyTorch, scikit-learn. Strong experience in predictive analytics, clustering, classification, regression, and multivariate techniques. Hands-on experience with data visualization tools such as Tableau, Power BI, Matplotlib. Familiarity with cloud platforms (preferably Azure), Azure ML Services, and Snowflake is a plus. Strong SQL skills and experience working with relational databases. Knowledge of NLP and Computer Vision technologies is advantageous. If you re passionate about transforming the construction industry through AI/ML innovation and want to work with a talented, motivated team, apply now to join vConstruct s visionary journey. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Statistics, Mathematics, or a related field
Senior Etl Engineer
Accelirate Softech
Senior ETL Engineer Location: Pune Role Overview: We are seeking a Senior ETL Engineer to design, develop, and optimize our end-to-end data infrastructure, including ETL pipelines, data lakes, and data warehouses. This role is instrumental in enabling reliable, scalable, and high-performance data operations while aligning with data governance best practices. You will be an integral part of a collaborative data team, working closely with Data Engineers, Architects, Analysts, Scientists, and other stakeholders to modernize and migrate our data systems to the cloud. Key Responsibilities: Convert SSIS stored procedures into Matillion mappings, and develop associated job schedules and audit frameworks. Design, build, and maintain efficient ETL pipelines to extract, transform, and load data from multiple sources into the data lake and data warehouse. Implement both full and incremental loads using SCD (Slowly Changing Dimensions) and CDC (Change Data Capture) methodologies for real-time and batch data processing. Develop and maintain robust error handling, job monitoring, and job audit mechanisms. Conduct data profiling, data cleansing, and root cause analysis to resolve data inconsistencies and improve data quality. Optimize data pipelines for performance, scalability, and data quality, using benchmarking and tuning techniques. Build dashboards or reports for ETL job monitoring, performance tracking, and system health checks. Support data governance practices, ensuring accuracy, availability, and security of production data. Contribute to cloud migration initiatives, transitioning data workloads from on-premise systems to modern cloud data platforms. Required Skills & Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 5+ years of experience as an ETL Engineer, Data Engineer, or in a similar data engineering role. Experience with cloud-based data platforms such as AWS, Azure, or GCP. Proficiency with data warehousing technologies like Snowflake, Redshift, Azure Synapse, or Databricks. Hands-on experience with ETL tools such as Matillion, SSIS, Informatica, AWS Glue, Azure Data Factory, StreamSets, STRiim, Oracle ODI, Coalesce, or Talend. Solid understanding of data modeling principles (E/R and Dimensional Modeling) and tools like ER/Studio or ERwin. Proficiency with SQL and programming/scripting languages such as Python, Scala, or Java. Experience with database tools such as Microsoft SSMS or Oracle Developer. Strong analytical, problem-solving, and data troubleshooting skills. Excellent communication and collaboration abilities. Ability to work efficiently in a fast-paced, agile, and dynamic environment. Qualification : Bachelor's degree in Computer Science, Engineering, or a related field.
Tableau Architect
Accelirate Softech
Tableau Architect Location: Pune Role Overview: We are looking for an experienced Tableau Architect to lead the design, development, and optimization of scalable data visualization solutions. The ideal candidate will bring deep expertise in Tableau, strong data architecture skills, and a passion for mentoring and guiding teams. You will play a pivotal role in delivering impactful analytics and ensuring best practices are followed across the organization. Key Responsibilities: Lead and mentor junior Tableau developers and analysts in Pune, fostering skill development and enforcing adherence to data visualization best practices. Architect, design, and implement scalable, high-performing Tableau dashboards and data models to support business analytics needs. Optimize Tableau environments to ensure efficient performance with large datasets and complex visualizations. Guide and support data integration efforts from diverse data sources into Tableau, ensuring data consistency and reliability. Conduct training sessions, hands-on workshops, and provide one-on-one mentorship to upskill team members. Collaborate with cross-functional teams including data engineers, business analysts, and IT to align on data and reporting requirements. Troubleshoot and resolve technical issues related to Tableau workbooks, data connections, and server performance. Create and maintain clear, user-friendly documentation for internal and external stakeholders, including architecture diagrams, user guides, and training materials. Technical Skills: Advanced proficiency in Tableau Desktop, Tableau Prep, and Tableau Server. Strong background in data modeling, ETL processes, and data architecture. Expertise in SQL and experience working with relational databases (e.g., SQL Server, Oracle). Hands-on experience in data integration from multiple sources and ensuring data quality. Proven ability to optimize dashboard performance for speed and responsiveness with large-scale datasets. Familiarity with cloud platforms such as AWS or Azure for data storage and analytics. Soft Skills & Additional Requirements: Experience in training and mentoring junior analysts, with a focus on building local talent in Pune. Excellent communication skills, especially when working with distributed and cross-functional teams. Strong problem-solving abilities to diagnose data and performance issues effectively. Commitment to producing high-quality documentation and reusable templates.
Staff Data / Machine Learning Engineer
Druva
Job Title: Staff Data / Machine Learning Engineer Company: Druva Location: Pune, Maharashtra, India About Druva: Druva, the autonomous data security company, delivers data protection on autopilot through a 100% SaaS, fully managed platform that secures and recovers data from all threats. The Druva Data Security Cloud guarantees data availability, confidentiality, and integrity providing customers with autonomous protection, rapid incident response, and guaranteed data recovery. Trusted by over 6,000 customers worldwide including 65 of the Fortune 500 Druva safeguards business-critical data in today s connected world. Backed by over $350M in venture capital, Druva protects more than 200 PB of data globally and offers a $10 million Data Resiliency Guarantee against cyber threats. The Role & Team: Join Druva s Business Intelligence team, where data drives key insights and fuels operational and strategic decisions. As a Staff Data/Analytics/ML Engineer, you will lead the development of data-to-insights recommendation engines and drive collaboration across teams to deliver impactful, data-driven solutions. This is a high-impact role working alongside expert engineers and product leaders, leveraging industry-leading data platforms and tools. What You ll Do: Bridge the gap between data engineering, analytics, and machine learning to unlock actionable business insights. Collaborate cross-functionally with Product, Engineering, GTM, and Customer Success teams to build data-driven solutions that enhance decision-making and business outcomes. Design, build, and maintain scalable data pipelines and infrastructure supporting analytics, machine learning, and operational workflows. Develop and optimize data models for efficient analytics and reporting across large datasets. Lead feature engineering, model training, and deployment pipelines for real-time and batch ML/AI applications. Drive architectural improvements in data governance, observability, and platform scalability. Evaluate and implement cutting-edge data tools and platforms including Reverse ETL, MLOps, and DataOps frameworks. Mentor and guide data engineers, analysts, and ML practitioners, fostering technical excellence and collaboration. Translate complex business requirements into technical deliverables, prioritizing initiatives that maximize impact. What We Are Looking For: Bachelor s or Master s degree in Computer Science, Data Science, Engineering, Statistics, or a related field. 7+ years experience spanning data engineering, analytics engineering, and machine learning with a strong technical foundation in all three areas. Expertise in modern data stacks: Snowflake, dbt, Airflow, Spark, and cloud platforms (AWS, GCP, Azure). Proficiency with BI and analytics tools such as Looker, Sigma, Tableau, Power BI, or equivalents. Strong skills in SQL, Python, and distributed data processing frameworks (Spark, Dask, etc.). Experience designing and maintaining data pipelines, ETL/ELT workflows, and data transformations for analytics and ML use cases. Familiarity with ML frameworks like TensorFlow, PyTorch, Scikit-learn, and MLOps lifecycle management. Deep knowledge of data modeling, architecture, and governance best practices. Proven problem-solver who thrives in ambiguity and designs robust data solutions. Experience working in Agile environments with strong prioritization and collaboration skills. Excellent communication skills, capable of simplifying complex technical topics for non-technical stakeholders. Bonus Points For: Experience with Generative AI, LLMs, and integrating AI into business workflows. Knowledge of streaming architectures (Kafka, Kinesis, Pub/Sub) and real-time analytics. Familiarity with Data Contracts, Data Quality frameworks, or Data Mesh architectures. Experience with Reverse ETL tools such as Salesforce, Census, Hightouch, or Segment for operational analytics. If you re passionate about driving data innovation at scale and want to work in a dynamic environment protecting the world s critical data, Druva invites you to join our team! Qualification : Bachelors or Masters degree in Computer Science, Data Science, Engineering, Statistics, or a related field.
Data Architect
Indexnine Technologies Pvt. Ltd.
Job Title: Data Architect Cloud, Big Data & Scalable Data Engineering Location: Pune, India Experience Level: 7+ Years Job Type: Full-Time | On-site / Hybrid (Specify your policy) Job Summary We are seeking a visionary Data Architect based in Pune to lead our data engineering practice within product engineering services. This strategic role involves shaping the organization's data architecture, defining best practices for data lakes and data warehouses, and guiding architectural decisions across data engineering initiatives. If you're passionate about building cloud-based, future-ready data platforms using tools like Databricks, Snowflake, AWS, Azure, and Google BigQuery, this is your opportunity to make a significant impact. Key Responsibilities Design and implement enterprise-wide data architecture strategies, including data modeling, data governance, and integration frameworks. Lead the development of scalable data lakes, data warehouses, and data marts, especially using Databricks and medallion architecture. Build and optimize robust ETL/ELT data pipelines and real-time streaming solutions. Collaborate with security teams to implement strong data security and compliance practices, including GDPR and CCPA regulations. Standardize data governance policies and drive data quality across platforms and business units. Work closely with data engineers to implement high-performance cloud-native storage solutions using Azure ADLS Gen2, AWS S3, etc. Evaluate and introduce innovative data platforms, tools, and frameworks to enhance engineering capabilities. Provide technical leadership and mentorship to engineering teams across all data initiatives. Translate business data needs into technical architectures and create detailed documentation (e.g., ERDs, data flow diagrams, integration maps). Required Qualifications Bachelor s or Master s degree in Computer Science, Information Systems, or a related field. 7+ years of experience in data architecture, data engineering, or enterprise data solutions. Strong command of data modeling techniques (e.g., dimensional, data vault). Experience with relational databases (e.g., Oracle, SQL Server, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Hands-on expertise with Databricks, Snowflake, Amazon Redshift, or Google BigQuery. Knowledge of cloud platforms such as AWS, Azure, or GCP and their data ecosystems. Proficiency in SQL and at least one programming language (Python, Java, Scala). Familiarity with ETL/ELT tools, data pipeline orchestration (e.g., Airflow), and real-time streaming (e.g., Kafka, Flink). Solid understanding of data security, compliance, and data governance frameworks. Experience with Power BI, Tableau, or similar tools from an architectural standpoint. Preferred Qualifications Exposure to machine learning architectures and MLOps pipelines. Understanding of graph databases (e.g., Neo4j) and semantic data layers. Familiarity with data mesh, data fabric, and modern data management paradigms. Hands-on experience with real-time data streaming frameworks like Apache Flink, Kafka, or Spark Streaming. Be a key architect in shaping enterprise-wide data strategies and infrastructure. Collaborate with top-tier engineers and data scientists in India s growing tech hub. Access the latest cloud, AI, and big data tools and work on high-impact, global projects. Thrive in a culture that encourages innovation, ownership, and continuous learning. Qualification : Bachelors or Masters degree in Computer Science, Information Systems, or a related field.
Senior Azure Data Engineer
Vionsys It Solutions India Pvt.ltd
Job Title: Senior Azure Data Engineer Experience: 8 - 10 years Location: Kharadi, Pune Role & Responsibilities Design, develop, and maintain scalable, high-performance data pipelines using Azure Data Services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Build and optimize data models, ETL/ELT processes, and data integration workflows to support analytics and BI needs. Develop and manage data lakes, data warehouses, and real-time streaming solutions on Azure. Collaborate with data analysts, scientists, and software engineers to ensure smooth data integration and processing. Ensure data security, governance, and compliance following industry best practices and regulations. Monitor and troubleshoot data pipelines, focusing on performance and reliability enhancements. Automate data workflows and infrastructure using DevOps and CI/CD methodologies. Work closely with stakeholders to translate business requirements into robust data solutions. Required Skills & Qualifications 8-10 years of experience in data engineering, with at least 3 years focused on Azure data services. Strong expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Azure Data Lake, and Azure SQL Database. Proficient in SQL, Python, or Scala for data processing and transformation. Experience with Big Data technologies like Spark, Delta Lake, and Parquet. Hands-on experience with ETL/ELT development and orchestration of data pipelines. Knowledge of Azure DevOps, CI/CD pipelines, and Infrastructure as Code tools (Terraform, ARM templates, Bicep). Familiarity with data governance, security best practices, and compliance frameworks. Experience with Power BI, Snowflake, or other BI/analytics tools is a plus.
Senior Aws Data Engineer
Vionsys It Solutions India Pvt.ltd
Job Title: Senior AWS Data Engineer Experience: 5+ years Location: Kharadi, Pune Role & Responsibilities Design, develop, and optimize scalable data pipelines and ETL workflows using AWS services such as AWS Glue, Lambda, and Step Functions. Implement and maintain data lakes and data warehouses on AWS platforms including S3, Redshift, and Athena. Develop and manage both real-time and batch data processing solutions. Ensure data security, governance, and compliance following industry best practices. Collaborate with data scientists, analysts, and business stakeholders to deliver actionable, data-driven solutions. Optimize query performance and troubleshoot data issues proactively. Automate infrastructure deployment using Infrastructure as Code (IaC) tools like Terraform or CloudFormation. Implement monitoring, logging, and alerting frameworks using AWS CloudWatch, Prometheus, or equivalent tools. Mentor junior engineers and actively contribute to data engineering best practices and standards. Required Skills & Qualifications 5+ years of experience in data engineering, with at least 3 years focused on AWS cloud services. Strong hands-on experience with AWS services including Glue, Redshift, S3, Lambda, EMR, and Athena. Proficient in SQL, Python, and Spark for data processing and analytics. Experience designing and implementing ETL/ELT pipelines. Familiarity with DevOps practices, CI/CD pipelines, and automation tools such as Terraform, CloudFormation, and Jenkins. Deep understanding of data governance, security protocols, and compliance frameworks. Experience with real-time data streaming and processing technologies such as Kafka, Kinesis, or similar tools. Knowledge of database optimization techniques including indexing and partitioning.
Informatica Senior Developer (idmc)
Codevian Technologies
Informatica Senior Developer (IDMC) Pune Location: Pune Experience: 5+ Years Start Date: Immediate Salary: Best in Industry Qualification: Bachelor s / Master s Degree in Computer Science, IT, or a related field Job Summary: We are hiring a skilled and experienced Informatica Senior Developer specializing in IDMC (Informatica Intelligent Data Management Cloud) for our Pune location. The role involves leading the design and development of scalable MDM solutions, ensuring data governance, and optimizing cloud data integrations across enterprise systems. If you're looking to lead next-gen data initiatives using cloud-native technologies, this is the role for you. Key Responsibilities: MDM Architecture & Solution Design: Design scalable and secure Informatica MDM solutions on IDMC. Define enterprise-wide data governance, data modeling, and metadata frameworks. IDMC Implementation Leadership: Lead end-to-end MDM project lifecycles including development, testing, deployment, and optimization. Ensure high-quality and business-aligned IDMC solutions. Cloud Data Integration: Integrate MDM with cloud and enterprise systems using Cloud Data Integration and Cloud Application Integration. Tune data flows for maximum performance and availability. Data Governance & Compliance: Implement data security, compliance (GDPR, CCPA), and quality rules using IDMC features. Ensure consistent and accurate data across business domains. Leadership & Mentorship: Mentor junior developers and guide them through complex workflows in IDMC. Establish best practices and coding standards within the team. Cross-Team Collaboration: Partner with business analysts, data architects, and stakeholders to align MDM initiatives with enterprise goals. Troubleshooting & Continuous Improvement: Lead resolution of technical issues in production and development environments. Continuously optimize MDM workflows for better performance and efficiency. Documentation & Reporting: Maintain clear and comprehensive documentation on architecture, configurations, and workflow processes. Provide regular project status updates to leadership and stakeholders. Key Requirements: Experience & Expertise: 5+ years of hands-on experience with Informatica MDM and IDMC. Proven experience designing and deploying cloud-native MDM solutions. In-depth knowledge of Cloud Data Integration, Cloud Application Integration, and Cloud Data Quality. Technical Skills: Strong command over SQL, Java, RESTful APIs, and web services. Experience with cloud-native data architecture, governance, and data security on IDMC. Familiarity with Azure, AWS, or Google Cloud is a plus. Work in a leading-edge cloud data engineering team based in Pune. Shape the data landscape of global enterprises through MDM excellence. Enjoy a collaborative culture, flexible working environment, and top-tier compensation. Apply Now to join as an Informatica Senior Developer (IDMC) and lead transformative data initiatives from our Pune office! Qualification : Bachelors / Masters Degree in Computer Science, IT, or a related field
Python Developer
Radarsoft Technologies Llp
Job Title: Python Developer Location: Pune Experience: 2+ Years Job Type: Full-Time Job Summary: We are seeking a highly motivated and skilled Python Developer to join our development team in Pune. As a Python Developer, you will play a key role in back-end development and the overall software development process. You will work on creating and optimizing web applications, integrating with databases, and collaborating with a team of engineers to deliver high-quality software solutions. The ideal candidate should have a strong understanding of object-oriented programming (OOP), web development frameworks, and solid experience with databases. If you're passionate about Python, back-end development, and problem-solving, we would love to hear from you. Key Responsibilities: Back-End Development: Design and develop robust back-end systems using Python, ensuring high performance, reliability, and scalability. Web Application Development: Collaborate with front-end developers to integrate back-end services with web applications. Database Management: Design and maintain databases, write efficient SQL queries, and manage data integration and storage. Code Quality: Write clean, maintainable, and efficient code while adhering to best practices and industry standards. Troubleshooting & Debugging: Analyze and resolve issues related to performance, bugs, and data inconsistencies. Team Collaboration: Work closely with cross-functional teams including front-end developers, UI/UX designers, and product managers to ensure a seamless product experience. Optimization & Testing: Optimize application performance and write unit and integration tests to ensure code quality and reliability. Continuous Learning: Stay up-to-date with the latest Python development tools, frameworks, and best practices. Skills & Qualifications: Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field. Experience: Minimum 2 years of professional experience in Python development. Programming Skills: Strong proficiency in Python and a deep understanding of Object-Oriented Programming (OOP). Frameworks & Tools: Experience with Python web frameworks like Django, Flask, or FastAPI. Databases: Hands-on experience working with databases such as MySQL, PostgreSQL, or MongoDB. Strong knowledge of SQL and NoSQL databases. Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot and optimize code. Version Control: Proficient with Git or other version control systems. Collaboration: Ability to work in a collaborative team environment and communicate effectively with team members. Development Practices: Familiarity with Agile development methodologies and code review processes. What We Offer: Growth Opportunities: Opportunities for professional development and growth within the company. Collaborative Environment: Work in a team-oriented environment where knowledge sharing and collaboration are encouraged. Challenging Projects: Work on innovative and complex projects that will enhance your problem-solving and technical skills. Competitive Compensation: Competitive salary and benefits package. Work-Life Balance: A healthy work-life balance with flexible working hours. If you're passionate about Python development, back-end systems, and working with a talented team, we encourage you to apply for this exciting opportunity! Qualification : Bachelor's degree in Computer Science, Engineering, or a related field.
Data Analyst
Talentica Software (i) Pvt. Ltd.
About Talentica Software: Talentica Software is a specialized software development firm founded by seasoned industry experts and alumni of IIT Bombay. We partner with startups to create innovative products, using cutting-edge technologies to address real-world challenges. With over 21 years of experience, we have collaborated with more than 180 startups, primarily in the U.S., contributing to many successful exits. In 2022, Talentica Software was honored as one of India s Great Mid-Size Workplaces by Great Place to Work. What We re Looking For: We are seeking a motivated Data Analyst to join our growing team. If you're passionate about working with SQL, BigQuery, Tableau, and MongoDB, and enjoy optimizing data ecosystems, we d love to hear from you! In this role, you will play a key part in managing and enhancing our data infrastructure, working across SQL (Oracle), BigQuery, Tableau, and NoSQL databases like MongoDB. You'll also help build our Lakehouse architecture and ensure data accuracy while supporting the scalability of our platform. Your Responsibilities: Develop, optimize, and maintain SQL queries to support efficient data delivery for Tableau reports. Write and refine complex queries for Oracle and BigQuery databases to meet business reporting needs. Utilize MongoDB to query semi-structured data for analytics and reporting. Collaborate with BI developers and analysts to streamline data workflows and enhance report accuracy. Design and manage ETL/ELT pipelines for smooth data ingestion and transformation. Work with cross-functional teams to identify and implement improvements in data workflows. Troubleshoot and resolve data issues as they arise. Contribute to the early-stage development of our Lakehouse architecture. Prepare existing data workflows for seamless integration with modern cloud platforms. Stay current with emerging data technologies and contribute to ongoing modernization efforts. Perform data validation and reconciliation to ensure consistency across multiple data sources. Collaborate with data analysts and business stakeholders to resolve data discrepancies. Support data quality assurance initiatives and establish best practices for data reliability. What You ll Need to Succeed: Qualifications: A BE/BTech in Computer Science, Data Engineering, or a related field from a prestigious institution (IIT, NIT, BITS, etc.). Experience: At least 5 years of experience in SQL development and managing data pipelines. Technical Skills: Advanced SQL skills, including performance tuning and query optimization. Strong understanding of ETL/ELT processes and experience with data transformation. Hands-on experience with relational databases (Oracle, BigQuery) and NoSQL (MongoDB). Proficiency in Python or other scripting languages for automation. Familiarity with cloud platforms (AWS, GCP, Azure) is a plus. Experience with BI tools like Tableau is highly desirable. Soft Skills: Strong analytical and problem-solving abilities. Excellent communication and collaboration skills. Ability to manage multiple tasks independently in a fast-paced environment. What We Offer: Innovative Culture: We focus on cutting-edge development, not routine maintenance work. Our team thrives on staying ahead with the latest technologies. Continuous Learning: At Talentica, you ll find abundant opportunities to grow and keep up-to-date with the latest trends in technology. Brilliant Peers: Work alongside talented professionals from top engineering colleges (IITs, NITs, and more). Work-Life Balance: Enjoy flexibility with remote work options and adaptable schedules. Supportive Environment: 82% of our employees recommend Talentica to their peers (according to Glassdoor), thanks to our positive, collaborative work culture. Recognition & Rewards: Your hard work will be celebrated, with a culture that recognizes and appreciates your contributions. If you re excited about the prospect of working with a team of bright professionals and advancing your career, we d love to hear from you. Ready to make an impact? Apply today, and let s connect! Qualification : BE/BTech in Computer Science, Data Engineering, or a related field from a top-tier institution (IIT, NIT, BITS, etc.).
Elt Developer
Talentica Software (i) Pvt. Ltd.
About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni of IIT Bombay. We specialize in helping startups build innovative products by leveraging the latest tools and technologies to solve real-world problems. Over the past 21 years, we've partnered with 180+ startups, primarily in the US, and have helped many achieve successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: What You ll Be Doing: As an ELT Developer, you will: Design, develop, and maintain ELT pipelines using GCP tools such as BigQuery, Dataflow, and Firestore. Optimize data pipelines for performance, scalability, and reliability. Transform raw data into structured formats that are ready for analytics and reporting. Integrate data from various sources into centralized repositories or operational systems. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver solutions. Document ELT processes, workflows, and best practices. Monitor and manage ELT jobs to ensure timely data availability. Troubleshoot and resolve issues in data pipelines to maintain data integrity. To Succeed in This Role, You Should Have: Qualification: A Bachelor's degree in Computer Science, Information Technology, or a related field from a top-tier institute (IIT, NIT, BITS, etc.). Experience: At least 3 years of hands-on experience in ELT/ETL development on cloud platforms. Technical Skills: Expertise in GCP services like BigQuery, Firestore, Dataflow, and Pub/Sub. Proficiency in Python for scripting and automation. Strong understanding of data warehousing concepts and data modeling. Experience with SQL for data querying and transformation. Familiarity with NoSQL databases such as Firestore. Knowledge of Apache Beam for building scalable data processing pipelines. Soft Skills: Excellent problem-solving abilities, strong communication skills, and the ability to collaborate effectively with cross-functional teams. Bonus Points If You: Have experience with GCP Cloud Scheduler or other orchestration tools. Hold a Google Professional Data Engineer certification or a similar qualification. Have worked with CI/CD pipelines for deploying ELT workflows. What You ll Find at Talentica: Innovative Culture: We specialize in cutting-edge development, not maintenance work. Our clients come to us for our technological expertise and innovation. Endless Learning Opportunities: You'll have ample opportunities to grow, learn, and stay up to date with the latest trends in technology. Talented Peers: Work alongside talented individuals from India s top engineering colleges (IITs, NITs, and others). Work-Life Balance: We understand the importance of work-life balance and offer flexible schedules and remote work options. Great Culture: 82% of our employees recommend Talentica to their friends (according to Glassdoor). Join us, and you'll see why! Recognition & Rewards: We celebrate success and ensure that your contributions are recognized and appreciated. If you're excited to work with a team of talented professionals and take your career to the next level, we d love to hear from you. Ready to take the next step? Fill out the form below, and we'll be in touch soon! About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni of IIT Bombay. We specialize in helping startups build innovative products by leveraging the latest tools and technologies to solve real-world problems. Over the past 21 years, we've partnered with 180+ startups, primarily in the US, and have helped many achieve successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: What You ll Be Doing: As an ELT Developer, you will: Design, develop, and maintain ELT pipelines using GCP tools such as BigQuery, Dataflow, and Firestore. Optimize data pipelines for performance, scalability, and reliability. Transform raw data into structured formats that are ready for analytics and reporting. Integrate data from various sources into centralized repositories or operational systems. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver solutions. Document ELT processes, workflows, and best practices. Monitor and manage ELT jobs to ensure timely data availability. Troubleshoot and resolve issues in data pipelines to maintain data integrity. To Succeed in This Role, You Should Have: Qualification: A Bachelor's degree in Computer Science, Information Technology, or a related field from a top-tier institute (IIT, NIT, BITS, etc.). Experience: At least 3 years of hands-on experience in ELT/ETL development on cloud platforms. Technical Skills: Expertise in GCP services like BigQuery, Firestore, Dataflow, and Pub/Sub. Proficiency in Python for scripting and automation. Strong understanding of data warehousing concepts and data modeling. Experience with SQL for data querying and transformation. Familiarity with NoSQL databases such as Firestore. Knowledge of Apache Beam for building scalable data processing pipelines. Soft Skills: Excellent problem-solving abilities, strong communication skills, and the ability to collaborate effectively with cross-functional teams. Bonus Points If You: Have experience with GCP Cloud Scheduler or other orchestration tools. Hold a Google Professional Data Engineer certification or a similar qualification. Have worked with CI/CD pipelines for deploying ELT workflows. What You ll Find at Talentica: Innovative Culture: We specialize in cutting-edge development, not maintenance work. Our clients come to us for our technological expertise and innovation. Endless Learning Opportunities: You'll have ample opportunities to grow, learn, and stay up to date with the latest trends in technology. Talented Peers: Work along...
Qa Specialist
Talentica Software (i) Pvt. Ltd.
About Talentica Software: Talentica Software is a specialized software development firm founded by industry veterans and IIT Bombay alumni. We excel in helping startups build innovative products by leveraging cutting-edge tools and technologies to solve real-world challenges. Over the past 21 years, we ve collaborated with over 180 startups, primarily in the US, and have contributed to numerous successful exits. In 2022, Talentica Software was recognized by Great Place to Work as one of India s Great Mid-Size Workplaces. What We re Looking For: We are seeking a meticulous and detail-oriented QA Specialist who is passionate about ensuring data quality. You will work closely with our analytics team to design and execute robust QA processes, validate data pipelines, and automate repetitive QA tasks. Your contributions will play a crucial role in delivering accurate, reliable, and high-quality solutions. If you enjoy solving problems, automating processes, and ensuring data integrity, this role is tailor-made for you! What You ll Be Doing: As a QA Specialist, your responsibilities will include: Designing and implementing comprehensive QA processes for data and analytics deliverables. Validating end-to-end data pipelines, including data sources, ETL processes, data extracts, calculations, visualizations, and application interfaces. Conducting functional, regression, performance, and tolerance-range testing across reports and data systems. Simulating end-user interactions to ensure a smooth user experience with analytics outputs. Validating application tracking functionalities, including data collection through app usage. Verifying calculations and metrics in BI tools like Tableau, Power BI, and others. Performing database validation using SQL (Oracle, BigQuery) and NoSQL (MongoDB) systems. Automating recurring QA tasks in the analytics/BI environment where possible. Identifying, documenting, and tracking data quality issues and discrepancies. Collaborating with cross-functional teams including data engineers, BI developers, and product managers to ensure high-quality analytics deliverables. To Succeed in This Role, You Should Have: Qualifications: BE/B.Tech degree from top engineering institutions such as IIT, NIT, BITS, VJTI, or equivalent. Experience: 2+ years of experience in QA, data validation, or analytics testing. Technical Skills: Hands-on experience testing in BI tools environments. Proficiency in SQL, with experience in Oracle and BigQuery (preferred). Familiarity with NoSQL databases like MongoDB (a plus). Experience with regression testing and simulating user interactions in BI tools. Bonus Points If You Have: Knowledge of scripting languages like R or Python. Experience in automation testing in analytics or BI environments. Familiarity with Databricks. Soft Skills: Strong communication skills, with the ability to collaborate effectively across teams. Ability to present complex findings to both technical and non-technical stakeholders. What You ll Find at Talentica: Innovative Culture: We focus exclusively on cutting-edge development, not routine maintenance. Our technological expertise sets us apart. Endless Learning Opportunities: This is a place to grow. You ll have access to constant learning opportunities and stay updated on the latest trends in technology. Talented Peers: Work with brilliant professionals from India s top engineering colleges (IITs, NITs, and more). Work-Life Balance: We value flexibility and offer remote work options and flexible schedules to ensure a healthy work-life balance. Great Culture: 82% of our employees recommend Talentica to their peers (according to Glassdoor). We pride ourselves on our supportive and collaborative work environment. Recognition & Rewards: We celebrate success and ensure that your contributions are recognized and appreciated. If you re passionate about ensuring data integrity, automating processes, and solving problems in a fast-paced, innovative environment, we d love to hear from you. Qualification : BE/B.Tech from IIT, NIT, BITS, VJTI, or any other top Indian engineering college.
Data Engineer
Talentica Software (i) Pvt. Ltd.
About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni from IITB. For over 21 years, we have been helping startups build products using cutting-edge technologies. With a focus on solving real-world problems, we ve worked with over 180+ startups, primarily in the US, leading to numerous successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: We are seeking a Data Engineer to join the product engineering team for a SAAS-based Subscription Management Platform. If you have a passion for working with data and a drive to innovate, we encourage you to apply. What You ll Be Doing: Data Transformation: Use Python and PySpark to transform large datasets and build efficient data pipelines. Pipeline Creation: Work with Kafka and Debezium to create and deploy real-time data pipelines. SQL Expertise: Write and optimize complex SQL queries for data aggregation and transformation. Delta Lake & Databricks: Utilize Delta Lake and Databricks for efficient data storage and management. Collaboration: Work with cross-functional teams to ensure data is accessible, reliable, and well-organized for product teams. To Be Successful in This Role, You Should Have: Qualification: BE/BTech from a top-tier engineering institute. Experience: 5+ years of experience in the data engineering field. Must-Have Skills: Strong proficiency in Python and PySpark for data transformation. Experience with Kafka and Debezium for data pipeline creation and deployment. Excellent SQL skills, especially for complex data aggregation and transformation. Familiarity with Delta Lake and Databricks. A solid understanding of all stages of the SDLC and experience with Agile/SCRUM methodology. Good-to-Have Skills: Understanding of machine learning algorithms. Familiarity with ETL tools like Matillion or Google Data Studio. Experience with creating BI reports using tools like Looker or Tableau. Familiarity with writing APIs to extract data from databases. What You ll Find Here: Culture of Innovation: We focus on technology expertise and innovation, not maintenance projects. Our customers come to us for cutting-edge solutions. Endless Learning Opportunities: Stay ahead of the curve by exploring new advancements in your field and applying them to build better, faster, and simpler products. Talented Peers: Work alongside experienced graduates from India's top 20 engineering colleges, including IITs, NITs, and other top-tier institutes. Flexibility: We value work-life balance and offer flexible schedules, including remote work options. Great Culture: 82% of our employees recommend Talentica to their friends, according to Glassdoor. You'll love being part of our team! At Talentica, we don t just follow trends we lead them. If you re looking for a dynamic, fast-paced environment with opportunities to innovate, grow, and shape the future of technology, Talentica is the place for you. Join us and make a real difference! Qualification : BE/BTech from a top-tier engineering institute.
Data Engineer-data Modeling
International Business Machines Corporation
Data Engineer IBM Consulting About the Role Join us at IBM Consulting in one of our Client Innovation Centers, where we deliver specialized technical and industry expertise to both public and private sector clients worldwide. Our centers bring local skills and technical capabilities to help clients drive innovation and adopt cutting-edge technologies. A career at IBM Consulting is built on fostering long-term relationships and collaborating closely with clients around the globe. You ll work with leaders across multiple industries to advance the hybrid cloud and AI journeys of some of the world s most innovative and influential companies. Your ability to create impactful change will be empowered by IBM's strategic partner ecosystem and our robust technology platforms, including IBM Software and Red Hat. At IBM, curiosity and a continual pursuit of knowledge form the cornerstone of success. In your role, you'll be encouraged to challenge norms, explore new ideas beyond your immediate responsibilities, and deliver innovative solutions that make a meaningful difference for clients. Our culture is rooted in growth and empathy, ensuring long-term career development in an environment that celebrates your unique skills and experiences. Your Role and Responsibilities As a Data Engineer at IBM, you ll unlock the power of data, revealing insightful stories and complex patterns. You ll contribute to data gathering, storage, and both batch and real-time processing, playing an essential role in defining data management systems and identifying key data for analysis. Your key responsibilities will include: Predictive Modeling: Implementing, validating, and maintaining statistical and predictive models, utilizing big data techniques along with various machine learning methodologies. Enterprise Search Applications: Designing and deploying enterprise search applications like Elasticsearch and Splunk to meet client-specific needs. Collaboration & Agile Practices: Working in an agile, team-oriented environment, collaborating with data scientists, engineers, consultants, and database administrators to bring statistical rigor to predictive behavior challenges. Data Integration & Cleansing: Developing teams or writing programs to efficiently cleanse and integrate data, build predictive models, and evaluate the results. Required Education Bachelor's Degree in Computer Science, Information Technology, Data Science, or a related field. Preferred Education Master's Degree in a relevant technical discipline. Required Technical and Professional Expertise 4+ years of experience in data modeling and data architecture. Proficiency in data modeling tools like ERwin, IBM Infosphere Data Architect, and experience with database management systems. Familiarity with various data models, including relational, dimensional, and NoSQL databases. Strong understanding of business processes and how data supports business decision-making. Expertise in database design principles, data warehousing concepts, and data governance practices. Preferred Technical and Professional Experience Exceptional analytical and problem-solving skills, with a sharp attention to detail. Ability to work collaboratively in a team-oriented environment and manage multiple projects simultaneously. Knowledge of SQL or similar programming languages. At IBM Consulting, we foster a culture of growth, innovation, and collaboration. As a Data Engineer, you ll have the opportunity to work with some of the brightest minds in the industry, all while impacting critical data-driven solutions for global clients. Join us and be a part of a diverse team committed to driving change and shaping the future of technology and analytics. Qualification : Bachelor's Degree in Computer Science, Information Technology, Data Science, or a related field.
Data Engineer Ii
Cencora
Transform Healthcare with Data: Join Cencora as a Data Engineer II At Cencora, our team members are at the heart of everything we do. We are on a mission to create healthier futures, and every individual here plays a crucial role in fulfilling that purpose. We believe in making a difference at the intersection of healthcare, technology, and innovation. If you're ready to shape the future of health and help improve lives globally, Cencora is the place for you. We are looking for a Data Engineer II to join our dynamic team. This role is pivotal in delivering accurate and reliable data to support our Legal and Compliance departments, with a direct impact on driving data-driven decisions that improve operational efficiencies and support strategic business goals. What You ll Do: As a Data Engineer II, you will be responsible for transforming raw data into actionable insights and building solutions that enhance business operations. Your role will span across multiple platforms, using SQL, SAP BusinessObjects, and a variety of other tools, to ensure that our data remains accurate, accessible, and consistent. Enhance Analytics Solutions: Lead the design and implementation of enhancements to business analytics solutions that align with evolving business needs. You ll turn complex business challenges into accessible data access requirements. Data Mining & Analysis: Perform data mining on vast datasets to uncover growth opportunities in sales, margin, and market share. Analyze pricing activities, including discounts, allowances, programs, and contract pricing, to drive profitability. Data Quality Assurance: Validate, cleanse, and aggregate data, ensuring its accuracy and integrity. You ll identify and resolve data inaccuracies, improving the overall quality of enterprise data. Collaboration & Problem-Solving: Work cross-functionally with teams like Inside Sales, Finance, and Sourcing to develop performance forecasts, projections, and plans based on data assumptions and variables. Automated Solutions: Identify opportunities for automated solutions to enhance data quality and efficiency across the enterprise. Report Development: Collaborate with internal stakeholders to define reporting deliverables, ensuring that data is appropriately named, structured, and ready for decision-making. Data Integrity & Monitoring: Monitor and update data changes on a mass scale using tools, ensuring the highest level of data integrity is maintained. What You Bring to the Table: Experience: You have 4+ years of direct experience in healthcare data analytics or data engineering. You know your way around large datasets and understand how to unlock insights that drive business decisions. Technical Expertise: Proficient in SAP and BusinessObjects, with an extensive background in Business Intelligence and SQL. Strong understanding of the wholesale distribution process, including purchases, sales, payments, and supplier rebates. Knowledge of pharmaceutical wholesale processes and chargebacks to wholesalers is a plus. Familiar with data visualization tools like Power BI or Tableau. Analytical Mindset: You re a critical thinker with an eye for detail, always ready to dive into data to uncover trends, identify issues, and solve problems. Mentorship: You bring leadership experience, with a knack for mentoring and guiding team members. Communication Skills: Your ability to communicate complex data insights to non-technical stakeholders is top-notch. You can explain trends and patterns with clarity and confidence. Bonus Points: Familiarity with Microsoft Power BI, Tableau, or other data visualization tools. Experience with Big Data analysis tools and techniques. Background in data governance and data management. What You ll Get from Us: Meaningful Work: At Cencora, your work directly impacts the future of healthcare. Your expertise in data will help us make strategic, data-driven decisions that improve lives globally. Growth Opportunities: We invest in our team members' growth through mentorship, professional development, and the chance to shape the future of healthcare technology. Collaborative Environment: Work alongside innovative professionals in a culture that values diverse perspectives and fosters collaboration. Comprehensive Benefits: We offer a range of benefits designed to support you in every aspect of life health, wellness, work-life balance, and more. Join Cencora Today! If you re ready to leverage your data engineering expertise to drive meaningful change, we d love to hear from you! Apply now to become part of a purpose-driven company at the forefront of innovation in the healthcare sector. Cencora is committed to building a healthier future, and we want you on this journey with us.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted