Senior BIG Data Engineer Jobs in Pune
365 Jobs Found
Qa Automation Engineer
Cognologix
Designation: QA Automation Engineer Location: Pune Work Type: Full Time Experience Required: 6 8 Years About the Role At Cognologix, we empower clients to deploy cloud-native applications confidently through robust and intelligent test automation. As a QA Automation Engineer, you will design and implement automation frameworks for integration, end-to-end, and generative testing, ensuring performance, reliability, and quality across deployments. Key Responsibilities Collaborate with developers and architects to design and develop test automation scripts. Create reusable, modular, and multi-thread-safe automation code. Improve non-functional automation performance by parallelizing test executions. Conduct test planning, defect lifecycle management, traceability matrix mapping, and security/breaking testing. Validate GenAI features such as prompt/response behavior, hallucination checks, and content moderation. Use GenAI tools (e.g., Copilot, Codium) to refactor, document, and enhance automation frameworks. Required Skills Solid experience testing microservice-oriented and cloud-native applications. Proficiency with tools such as HTTP, Curl, Postman, Fiddler, Swagger. Strong programming skills in Java, Python, or C#. Working knowledge of Linux systems and shell scripting. Expertise in test automation frameworks (e.g., JUnit, TestNG). Hands-on experience with UI testing using Selenium or similar tools. Exposure to CI/CD tools like Jenkins, GitLab CI. Ability to test AI-driven features and integrate AI tools into test processes. Preferred Skills (Good to Have) Experience with GenAI-enabled testing tools or platforms. Familiarity with fairness, bias, and explainability issues in GenAI testing. Big Data migration validation and reporting experience. Performance testing (load, stress, spike) using JMeter or Gatling. Experience in Security, Resilience, or Disaster Recovery Testing. Strong ability to validate GenAI outputs in automation pipelines. Higher degree of autonomy, startup culture & small agile teams. Remote work flexibility based on maturity and performance. Exposure to emerging technologies and GenAI tools. Competitive salary & comprehensive family benefits. Performance-based career growth. About Cognologix Cognologix helps companies disrupt and innovate by reimagining business models through cutting-edge technology. We re a data- and automation-driven organization at the forefront of digital transformation, empowering clients to confidently deliver their next-generation products.
Senior/lead Java Developer
Cognologix
Position: Senior / Lead Java Developer Location: Pune Work Type: Full Time Minimum Experience: 6 8 Years Top Skills: Core Java, Spring Boot, Cloud-Native Microservices About the Role At Cognologix, we empower data-driven enterprises to harness the full potential of their data. From scalable analytics to machine learning platforms, we help clients navigate their digital transformation journeys. As a Senior/Lead Java Developer, you will work with modern cloud-native technologies to build distributed systems that process terabytes of data efficiently and intelligently. Key Responsibilities Collaborate with Data Scientists, Engineers, and Product Managers to transform complex data into actionable insights. Design and develop high-performance, low-latency Java-based microservices. Own the end-to-end architecture, implementation, and maintenance of backend systems. Design and implement REST APIs and contribute to living documentation and test specifications. Write clean, scalable, and testable code following best development practices. Build and maintain data pipelines using Apache Spark, Google Data Pipelines, or similar tools. Mentor junior developers and actively contribute to team growth and knowledge sharing. Continuously optimize and enhance the software development lifecycle. What You Bring (Must-Have Skills) 5+ years of hands-on experience building scalable cloud-native applications. Proficient in Java, Spring, Spring Boot, and Spring Security frameworks. Experience with Groovy, SQL, or NoSQL databases. Familiarity with distributed event-driven architectures using Kafka, GCP Pub/Sub, etc. Solid understanding of RESTful API design principles and performance optimization. Experience in working with Google Cloud Platform (GCP) and BigQuery is a plus. Nice to Have (Preferred Skills) Exposure to containerized environments and tools such as Docker, Istio, and Kubernetes. Experience with big data technologies like Apache Spark, Flink, or similar platforms. Understanding of CI/CD pipelines, DevOps practices, and cloud infrastructure automation. Full-stack development experience or a willingness to contribute beyond backend responsibilities. High autonomy, fast-paced environment, and flat hierarchy Work on emerging technologies and solve meaningful problems at scale Remote work options available for experienced professionals Competitive compensation and family-friendly benefits Clear path for performance-based career growth About Cognologix Cognologix helps companies disrupt and innovate by reimagining their business models. We specialize in building modern, scalable, cloud-native products with a focus on data engineering, analytics, and automation. Our agile teams deliver high-quality, tech-driven outcomes across industries and geographies.
Sr Data Engineer
Vconstruct Private Limited
Position: Senior Data Engineer Location: Pune Employment Type: Full-Time Company: vConstruct (Construction Technology Company) About vConstruct vConstruct is a Pune-based construction technology company focused on leveraging data science and analytics to transform the construction industry. Our Data Science and Analytics team is a close-knit group dedicated to supporting the business with robust data infrastructure and insightful analysis. Role Overview We are seeking a highly experienced Senior Data Engineer to lead the design, development, and maintenance of scalable data pipelines and infrastructure. This role involves working closely with cross-functional teams to manage diverse data sources, ensure data integrity, and support data-driven business initiatives. Key Responsibilities Lead the design and development of scalable, high-performance data pipelines and ETL/ELT frameworks following modern data engineering best practices. Architect complex data integration workflows that unify structured, semi-structured, and unstructured data from cloud and on-premise sources. Develop robust real-time, batch, and on-demand data pipelines equipped with monitoring, alerting, and automated error handling. Collaborate with analysts, data scientists, and business leaders to create reliable data models, quality frameworks, and SLAs. Ensure optimal pipeline performance, throughput, and proactive issue resolution. Work with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows aligned with enterprise standards. Enforce best practices in source control, code reviews, testing automation, and continuous delivery. Lead root cause analysis and preventive maintenance to minimize business impact from data failures. Establish standards for data modeling, transformation logic, and governance. Design and execute comprehensive testing strategies to ensure data reliability and pipeline resilience. Optimize pipeline and query performance for scalability, reliability, and cost-efficiency. Maintain detailed technical documentation including architecture diagrams, process flows, and integration specs. Facilitate discussions with business and operational teams to prioritize data initiatives and drive strategy. Qualifications 7-10 years of hands-on experience in data engineering with a track record of building scalable and secure data platforms. 5+ years of scripting experience in Python for data processing, automation, and ETL development. 4+ years experience with Snowflake, including performance tuning, security, and advanced SQL. 5+ years experience with data integration tools like Azure Data Factory, Fivetran, or Matillion. 5+ years writing complex, optimized SQL queries on large datasets. Proven experience integrating APIs, JSON, XML, and webhooks for data acquisition. Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools such as Apache Airflow. Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git). Familiarity with dbt or similar transformation tools and modular development practices. Experience with data visualization tools like Power BI is a plus. Strong interpersonal and communication skills to lead cross-functional technical discussions. Education Bachelor s or Master s degree in Computer Science, Information Technology, or a related field. Equivalent academic and professional experience will also be considered. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or a related field
Senior Data Scientist
Vconstruct Private Limited
Position: Senior Data Scientist Location: Pune Employment Type: Full-Time Company: vConstruct (Construction Technology Company) About vConstruct vConstruct is a Pune-based construction technology company focused on revolutionizing the construction industry through advanced AI and ML solutions. Our Data Science and Analytics team comprises Data Scientists, AI Engineers, Data Analysts, and Data Engineers working collaboratively to drive innovation across all construction project phases from pre-construction to post-construction. Our mission is to harness the power of data and AI to improve predictability, automate processes, and enhance efficiency in construction domains such as scheduling, planning, supply chain, safety, quality control, site management, financials, and virtual design construction. Role Overview We are seeking a highly skilled Senior Data Scientist to lead the development of innovative AI and machine learning solutions focused on construction data. You will work on cutting-edge projects involving Computer Vision, Predictive Analytics, Generative AI, and Large Language Models (LLMs) using technologies such as MS Azure AI Services, OpenAI, and various ML frameworks. Key Responsibilities Collaborate strategically with cross-functional teams to identify and solve business problems through scalable AI/ML solutions. Analyze construction project data to develop predictive models using traditional methods and generative AI. Apply machine learning algorithms to enhance project execution, safety, risk assessment, and other core construction processes. Lead end-to-end development of scalable predictive and ML models, including hypothesis generation, development, deployment, and monitoring. Build, validate, and optimize machine learning and statistical models; review and quality control models developed by junior team members. Partner with engineering and business teams to deeply understand data, processes, and business requirements, and implement appropriate solutions. Stay updated on advances in data science and machine learning to continuously enhance vConstruct s capabilities. Use statistical techniques to detect anomalies and optimize workflows to ensure timely, cost-effective project delivery. Collaborate with product managers and business leaders to drive data-driven decision-making and communicate insights effectively. Visualize insights using BI tools to support stakeholders in understanding data outcomes. Key Projects Include Developing GPT-based language models customized for construction industry data (structured and unstructured). Utilizing computer vision for object detection on 2D drawings and 3D BIM models. Applying statistical frameworks to predict construction site losses, win/loss opportunities, and quantity forecasts. Integrating AI models deeply into construction operations to automate and improve efficiency. Qualifications Bachelor s or Master s degree in Computer Science, Data Science, Statistics, Mathematics, or a related field. 8-10 years of professional experience, including at least 6 years in data science, machine learning, and analytics. Proven track record of delivering impactful, production-ready AI/ML solutions. Experience managing multiple projects in fast-paced, dynamic environments. Strong business acumen with the ability to translate technical insights into actionable business strategies and communicate effectively with stakeholders. Experience with construction data or related industries (engineering, manufacturing) is a plus. Technical Skills Expertise in Python, R, or Scala programming. Proficiency with ML, AI, and statistical frameworks and libraries such as TensorFlow, PyTorch, scikit-learn. Strong experience in predictive analytics, clustering, classification, regression, and multivariate techniques. Hands-on experience with data visualization tools such as Tableau, Power BI, Matplotlib. Familiarity with cloud platforms (preferably Azure), Azure ML Services, and Snowflake is a plus. Strong SQL skills and experience working with relational databases. Knowledge of NLP and Computer Vision technologies is advantageous. If you re passionate about transforming the construction industry through AI/ML innovation and want to work with a talented, motivated team, apply now to join vConstruct s visionary journey. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Statistics, Mathematics, or a related field
Senior Etl Engineer
Accelirate Softech
Senior ETL Engineer Location: Pune Role Overview: We are seeking a Senior ETL Engineer to design, develop, and optimize our end-to-end data infrastructure, including ETL pipelines, data lakes, and data warehouses. This role is instrumental in enabling reliable, scalable, and high-performance data operations while aligning with data governance best practices. You will be an integral part of a collaborative data team, working closely with Data Engineers, Architects, Analysts, Scientists, and other stakeholders to modernize and migrate our data systems to the cloud. Key Responsibilities: Convert SSIS stored procedures into Matillion mappings, and develop associated job schedules and audit frameworks. Design, build, and maintain efficient ETL pipelines to extract, transform, and load data from multiple sources into the data lake and data warehouse. Implement both full and incremental loads using SCD (Slowly Changing Dimensions) and CDC (Change Data Capture) methodologies for real-time and batch data processing. Develop and maintain robust error handling, job monitoring, and job audit mechanisms. Conduct data profiling, data cleansing, and root cause analysis to resolve data inconsistencies and improve data quality. Optimize data pipelines for performance, scalability, and data quality, using benchmarking and tuning techniques. Build dashboards or reports for ETL job monitoring, performance tracking, and system health checks. Support data governance practices, ensuring accuracy, availability, and security of production data. Contribute to cloud migration initiatives, transitioning data workloads from on-premise systems to modern cloud data platforms. Required Skills & Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 5+ years of experience as an ETL Engineer, Data Engineer, or in a similar data engineering role. Experience with cloud-based data platforms such as AWS, Azure, or GCP. Proficiency with data warehousing technologies like Snowflake, Redshift, Azure Synapse, or Databricks. Hands-on experience with ETL tools such as Matillion, SSIS, Informatica, AWS Glue, Azure Data Factory, StreamSets, STRiim, Oracle ODI, Coalesce, or Talend. Solid understanding of data modeling principles (E/R and Dimensional Modeling) and tools like ER/Studio or ERwin. Proficiency with SQL and programming/scripting languages such as Python, Scala, or Java. Experience with database tools such as Microsoft SSMS or Oracle Developer. Strong analytical, problem-solving, and data troubleshooting skills. Excellent communication and collaboration abilities. Ability to work efficiently in a fast-paced, agile, and dynamic environment. Qualification : Bachelor's degree in Computer Science, Engineering, or a related field.
Senior Python Engineer
Opcito Technologies Private Limited
Senior Python Engineer (Cloud & Backend) Pune, Maharashtra | 8 12 Years Experience | Full-time | Tech Stack: Python, AWS, FastAPI, Docker, Kubernetes, PostgreSQL, MongoDB We re hunting for a backend boss who lives and breathes Python and knows how to scale systems like a pro. If you re into building high-performance microservices, playing with cloud infra, and turning chaos into clean code let s talk. What you ll be doing: Design and build Python-based microservices for data ingestion, processing, and querying Craft clean, scalable REST APIs and data models Write unit tests that don t break when someone sneezes Work hand-in-hand with cross-functional teams to ship solid software on time, every time Optimize performance, reliability, and scalability like a true backend engineer Contribute to smart CI/CD pipelines and continuous improvement What you bring: 8 12 years of solid backend dev experience Strong Python skills, especially with Asyncio and FastAPI Deep experience with AWS, REST, and cloud-native architecture Fluent in PostgreSQL & MongoDB Comfortable with Docker, Kubernetes, and identity protocols (SSO, SAML) Familiar with CI/CD, testing frameworks, and performance tuning Bonus if you're curious about GenAI, vector databases, or ML We re not just tech nerds we re transformation partners. At Opcito, you ll get the chance to work on real impact projects using the best tools and practices out there (hello, DevOps, cloud-native, containers, and serverless). Perks & Culture: Growth-first mindset + learning budgets Pay that matches your skill & experience A friendly, no-BS, collaborative team Flexible schedules we trust you to get it done Social & corporate events you ll actually enjoy Recognition game strong: Great Place to Work (2021 24) Top 50 IT Workplaces India Best for Millennials 2023 GPTW ISO/IEC 27001:2013 Certified Top Developers India Clutch Hit Apply and let's build cool stuff together.
Senior Staff Software Engineer (foundation)
Druva
Job Title: Senior Staff Software Engineer (Foundation) Company: Druva Location: Pune, India About Druva: Druva empowers organizations with cyber, data, and operational resilience through the Data Resiliency Cloud the industry s first and only SaaS solution at scale. Our platform simplifies data protection, streamlines governance, and provides unparalleled data visibility and insights, enabling customers to accelerate cloud adoption. Trusted by thousands of enterprises, including 60 of the Fortune 500, Druva eliminates complex infrastructure and management costs by delivering data resilience through a single platform spanning multiple geographies and cloud environments. About the Role: The Foundation team at Druva designs and develops a highly scalable, petabyte-scale distributed cloud file system built on AWS. This service-oriented system handles critical features such as file system metadata management, versioning, and eventual consistency using AWS services like S3, DynamoDB, and Kinesis. Beyond the core file storage engine which supports backup storage for all Druva products the team builds and maintains allied components like indexing engines, key-value stores, and big data pipelines to enable scalable search, analytics, and compliance capabilities. As a Senior Staff Software Engineer, you will collaborate closely with cross-functional teams, architects, and DevOps to define high-level and low-level designs (HLD/LLD) for advanced data security and management services. You will stay abreast of emerging trends in data security, platforms, technologies, and APIs, applying these insights to enhance existing features and develop new capabilities. You will also mentor and guide junior engineers, fostering a culture of high-quality, high-velocity software development. Key Skills & Experience: 5 to 7 years of experience building enterprise-grade software products. Expertise in designing and implementing SaaS solutions at scale. Proficiency in Python or Golang for software development. Deep knowledge and hands-on experience with cloud storage and data management systems. Proven experience building storage systems focused on securing and protecting data at scale, including managing data and metadata. Prior experience working on data protection products is highly desirable. Familiarity with cloud platforms such as AWS and Azure is a plus. Strong hands-on developer with excellent communication and collaboration skills. Ability to influence architecture, design, and implementation for timely delivery of business outcomes. Desirable: Strong written and verbal communication skills. Experience with Agile methodologies (Scrum). In-depth knowledge of AWS cloud technologies. Responsibilities: Collaborate with architects, developers, and DevOps to define HLD and LLD for data security and management services and features. Monitor and evaluate emerging trends in data security, management platforms, technologies, and APIs to refine and develop features. Lead the integration of data management tools and applications to enhance product quality and user experience. Promote best practices and principles of high-quality SaaS software development. Mentor and train junior engineers on data management, security principles, and agile development methodologies. Qualifications: Bachelor s or Master s degree in Computer Science, Engineering, or a related field (Advanced degree preferred). Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field (Advanced degree preferred).
Data Architect
Indexnine Technologies Pvt. Ltd.
Job Title: Data Architect Cloud, Big Data & Scalable Data Engineering Location: Pune, India Experience Level: 7+ Years Job Type: Full-Time | On-site / Hybrid (Specify your policy) Job Summary We are seeking a visionary Data Architect based in Pune to lead our data engineering practice within product engineering services. This strategic role involves shaping the organization's data architecture, defining best practices for data lakes and data warehouses, and guiding architectural decisions across data engineering initiatives. If you're passionate about building cloud-based, future-ready data platforms using tools like Databricks, Snowflake, AWS, Azure, and Google BigQuery, this is your opportunity to make a significant impact. Key Responsibilities Design and implement enterprise-wide data architecture strategies, including data modeling, data governance, and integration frameworks. Lead the development of scalable data lakes, data warehouses, and data marts, especially using Databricks and medallion architecture. Build and optimize robust ETL/ELT data pipelines and real-time streaming solutions. Collaborate with security teams to implement strong data security and compliance practices, including GDPR and CCPA regulations. Standardize data governance policies and drive data quality across platforms and business units. Work closely with data engineers to implement high-performance cloud-native storage solutions using Azure ADLS Gen2, AWS S3, etc. Evaluate and introduce innovative data platforms, tools, and frameworks to enhance engineering capabilities. Provide technical leadership and mentorship to engineering teams across all data initiatives. Translate business data needs into technical architectures and create detailed documentation (e.g., ERDs, data flow diagrams, integration maps). Required Qualifications Bachelor s or Master s degree in Computer Science, Information Systems, or a related field. 7+ years of experience in data architecture, data engineering, or enterprise data solutions. Strong command of data modeling techniques (e.g., dimensional, data vault). Experience with relational databases (e.g., Oracle, SQL Server, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Hands-on expertise with Databricks, Snowflake, Amazon Redshift, or Google BigQuery. Knowledge of cloud platforms such as AWS, Azure, or GCP and their data ecosystems. Proficiency in SQL and at least one programming language (Python, Java, Scala). Familiarity with ETL/ELT tools, data pipeline orchestration (e.g., Airflow), and real-time streaming (e.g., Kafka, Flink). Solid understanding of data security, compliance, and data governance frameworks. Experience with Power BI, Tableau, or similar tools from an architectural standpoint. Preferred Qualifications Exposure to machine learning architectures and MLOps pipelines. Understanding of graph databases (e.g., Neo4j) and semantic data layers. Familiarity with data mesh, data fabric, and modern data management paradigms. Hands-on experience with real-time data streaming frameworks like Apache Flink, Kafka, or Spark Streaming. Be a key architect in shaping enterprise-wide data strategies and infrastructure. Collaborate with top-tier engineers and data scientists in India s growing tech hub. Access the latest cloud, AI, and big data tools and work on high-impact, global projects. Thrive in a culture that encourages innovation, ownership, and continuous learning. Qualification : Bachelors or Masters degree in Computer Science, Information Systems, or a related field.
Senior Azure Data Engineer
Vionsys It Solutions India Pvt.ltd
Job Title: Senior Azure Data Engineer Experience: 8 - 10 years Location: Kharadi, Pune Role & Responsibilities Design, develop, and maintain scalable, high-performance data pipelines using Azure Data Services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Build and optimize data models, ETL/ELT processes, and data integration workflows to support analytics and BI needs. Develop and manage data lakes, data warehouses, and real-time streaming solutions on Azure. Collaborate with data analysts, scientists, and software engineers to ensure smooth data integration and processing. Ensure data security, governance, and compliance following industry best practices and regulations. Monitor and troubleshoot data pipelines, focusing on performance and reliability enhancements. Automate data workflows and infrastructure using DevOps and CI/CD methodologies. Work closely with stakeholders to translate business requirements into robust data solutions. Required Skills & Qualifications 8-10 years of experience in data engineering, with at least 3 years focused on Azure data services. Strong expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Azure Data Lake, and Azure SQL Database. Proficient in SQL, Python, or Scala for data processing and transformation. Experience with Big Data technologies like Spark, Delta Lake, and Parquet. Hands-on experience with ETL/ELT development and orchestration of data pipelines. Knowledge of Azure DevOps, CI/CD pipelines, and Infrastructure as Code tools (Terraform, ARM templates, Bicep). Familiarity with data governance, security best practices, and compliance frameworks. Experience with Power BI, Snowflake, or other BI/analytics tools is a plus.
Senior Aws Data Engineer
Vionsys It Solutions India Pvt.ltd
Job Title: Senior AWS Data Engineer Experience: 5+ years Location: Kharadi, Pune Role & Responsibilities Design, develop, and optimize scalable data pipelines and ETL workflows using AWS services such as AWS Glue, Lambda, and Step Functions. Implement and maintain data lakes and data warehouses on AWS platforms including S3, Redshift, and Athena. Develop and manage both real-time and batch data processing solutions. Ensure data security, governance, and compliance following industry best practices. Collaborate with data scientists, analysts, and business stakeholders to deliver actionable, data-driven solutions. Optimize query performance and troubleshoot data issues proactively. Automate infrastructure deployment using Infrastructure as Code (IaC) tools like Terraform or CloudFormation. Implement monitoring, logging, and alerting frameworks using AWS CloudWatch, Prometheus, or equivalent tools. Mentor junior engineers and actively contribute to data engineering best practices and standards. Required Skills & Qualifications 5+ years of experience in data engineering, with at least 3 years focused on AWS cloud services. Strong hands-on experience with AWS services including Glue, Redshift, S3, Lambda, EMR, and Athena. Proficient in SQL, Python, and Spark for data processing and analytics. Experience designing and implementing ETL/ELT pipelines. Familiarity with DevOps practices, CI/CD pipelines, and automation tools such as Terraform, CloudFormation, and Jenkins. Deep understanding of data governance, security protocols, and compliance frameworks. Experience with real-time data streaming and processing technologies such as Kafka, Kinesis, or similar tools. Knowledge of database optimization techniques including indexing and partitioning.
Senior Software Engineer - CPD (SME - Linux/Systems)
Rubrik
Senior Software Engineer CPD (SME - Linux/Systems) Location: Pune, India About the Role & Team As a Senior Software Engineer in the Continuous Product Delivery (CPD) team, you will lead a small team and collaborate closely with core engineering, product, and support teams. Your focus will be ensuring long-term stability and enhancing the customer experience for Rubrik s data backup and management products. You will gain deep knowledge of Rubrik s distributed job framework, data lifecycle management, filesystem, and metadata store. The CPD team, working alongside Platform and Systems Engineering, is tasked with developing a secure, scalable, and high-performance software-defined platform to simplify the management of physical and virtual appliances both on-premises and in the cloud. Rubrik values engineers who take ownership, exercise judgment, and are empowered to make critical decisions that drive customer delight. Key Responsibilities Own the full lifecycle of features including design, implementation, and testing. Design and develop infrastructure services for Linux kernel and Ubuntu OS upgrades. Diagnose and resolve complex customer environment issues. Write and maintain code primarily in Python and/or Scala. Troubleshoot complex software problems efficiently. Collaborate cross-functionally to define and deliver new features. Maintain technical documentation and participate in code reviews. Drive continuous process and software quality improvements. Stay current with emerging software development trends. About You BTech/MTech/PhD in Computer Science or related field. 6 10 years of software development experience on Linux, preferably in Platform, Systems, Kernel, or Networking domains. Strong fundamentals in data structures, algorithms, and distributed system design. Deep knowledge of Linux distributions, especially Ubuntu. Strong systems programming skills and expertise in debugging and performance troubleshooting. Experience performing Linux kernel upgrades and kernel debugging. Proficiency in scripting languages and one or more of C++, Java, or Scala. Experience in large distributed systems design is preferred. Familiarity with storage, filesystems, or data protection technologies is a plus. Excellent communication and teamwork skills. About Rubrik Rubrik (NYSE: RBRK) is on a mission to secure the world s data through its Zero Trust Data Security platform. Leveraging machine learning, Rubrik Security Cloud safeguards data across enterprise, cloud, and SaaS applications, ensuring data integrity, availability, and resilience against cyber threats and operational disruptions. Qualification : BTech/MTech/PhD in Computer Science or related field.
Senior Software Engineer - Cpd
Rubrik
Senior Software Engineer Continuous Product Delivery (CPD) Location: Pune, India About the Role & Team As a Senior Software Engineer in the CPD team, you will play a vital role in ensuring long-term stability and exceptional customer experience for Rubrik s on-premise data backup and management platform. You will collaborate closely with core engineering, product, and support teams while gaining deep expertise in Rubrik s distributed job framework, data lifecycle management, filesystem, and metadata store. We are looking for a highly skilled C++ developer with familiarity in Python and/or Scala, capable of developing and maintaining high-performance software applications. You will be empowered to take ownership, exercise sound judgment, and make impactful decisions, fostering a motivated and engaged engineering culture. Key Responsibilities Design, develop, and maintain high-quality software applications and libraries primarily in C++. Write and maintain supporting code in Python and/or Scala as needed. Troubleshoot complex software issues quickly and accurately. Collaborate with cross-functional teams to define, design, and deliver new features. Participate in code reviews, maintain coding standards, and author technical documentation. Drive continuous software quality and process improvements. Stay current with emerging software development trends and technologies. Qualifications & Skills B.Tech/M.Tech with 9 13 years of professional software development experience. Strong programming and troubleshooting skills, especially in C++. Proven ability to debug complex issues and deliver timely fixes. Excellent software design skills with understanding of distributed systems and multi-threading. Knowledge of the storage domain is a plus. Familiarity with operating systems such as Windows. Solid grasp of data structures, algorithms, design patterns, networking protocols, and security concepts. Experience with software development methodologies, tools, and processes. Strong analytical, problem-solving, communication, and teamwork skills. About Rubrik Rubrik (NYSE: RBRK) is on a mission to secure the world s data through its Zero Trust Data Security platform. Powered by machine learning, Rubrik Security Cloud protects data across enterprise, cloud, and SaaS applications helping businesses maintain data integrity, availability, and resilience against cyberattacks and disruptions.
Python Bigdata Developer
Talentica Software (i) Pvt. Ltd.
About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni from IIT Bombay. We specialize in helping startups build cutting-edge products and thrive on leveraging the latest technologies to solve real-world problems. With over 21 years of experience, we have worked with 180+ startups, primarily in the US, leading to many successful exits. In 2022, Great Place to Work recognized Talentica Software as one of India s Great Mid-Size Workplaces. What We re Looking For: We re looking for a Big Data Developer who is passionate about building intelligent, scalable solutions and eager to work with the latest technologies. If you're ready to drive the future of tech and collaborate on exciting projects with top-tier developers, we d love to have you join us. What You ll Be Doing: As a Big Data Developer, you will: Develop intelligent, scalable engineering solutions from scratch. Collaborate with customers to understand product vision and goals. Contribute to high-level and low-level product designs and roadmaps alongside a team of talented developers. Build products using cutting-edge technologies such as Python (Open-source tech stack), Kafka, Storm, Spark/Flask, Hadoop, Cassandra, MongoDB, and more. To Be Successful in This Role, You Should Have: Qualification: BE/BTech in any branch from IIT, NIT, BITS, VJTI, COEP, or other top institutes in India. Experience: 4-6 years of experience working with Python and Spark/Flask. Technical Skills: Strong knowledge of NoSQL databases (Cassandra, Aerospike, MongoDB). Experience with REST API frameworks (a plus). What You ll Find at Talentica: A Culture of Innovation: We focus on creating cutting-edge solutions, not maintaining old projects. Our clients come to us for our technological expertise. Endless Learning Opportunities: Continuously expand your skills and stay at the forefront of the latest advancements, building better, faster, and simpler products. Talented Peers: Work with talented professionals from India s top engineering colleges (IITs, NITs, and others). Work-Life Balance: We understand the importance of well-being and offer flexible schedules, including remote work options, to help you thrive both professionally and personally. A Great Culture: Our employees love working here! 82% of our team recommends Talentica to their friends (according to Glassdoor). At Talentica, we invite you to be part of a dynamic team that pushes boundaries and doesn t just follow trends. If you re ready to shape the future of the tech industry with us, we d love to hear from you. Qualification : BE/BTech in any branch from IIT, NIT, BITS, VJTI, COEP, or other top institutes in India.
Devops Sre Manager
Talentica Software (i) Pvt. Ltd.
About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and alumni from IIT Bombay. We specialize in helping startups build innovative products by leveraging the latest tools and technologies to solve real-world challenges. With over 21 years of experience, we've partnered with 180+ startups, primarily in the US, and contributed to numerous successful exits. In 2022, Talentica Software was recognized by Great Place to Work as one of India s Great Mid-Size Workplaces. What We re Looking For: We are seeking a DevOps SRE Manager to lead our cloud operations, with a primary focus on Google Cloud Platform (GCP) and secondary support for AWS. In this role, you will manage two critical teams: one DevOps team responsible for GCP infrastructure, and a CloudOps/SRE team ensuring 24/7 uptime for our mission-critical services. This position requires a blend of technical expertise, leadership skills, and customer relationship management. You ll be responsible for ensuring the reliability, scalability, and security of our infrastructure while overseeing smooth cloud operations. What You ll Be Doing: As a DevOps SRE Manager, your responsibilities will include: Managing GCP Operations: Oversee DevOps operations within Google Cloud Platform using tools like Terraform, Kubernetes (GKE), Prometheus, and Grafana. Infrastructure Automation: Ensure timely execution of tasks and optimize infrastructure automation to improve operational efficiency. CI/CD Enhancement: Drive improvements to CI/CD pipelines, enforce cloud security best practices, and enhance software delivery processes. System Reliability: Improve system reliability through advanced monitoring, logging, and alerting solutions. Cloud Optimization: Optimize cloud infrastructure for cost-effectiveness, scalability, and security, ensuring long-term operational efficiency. Leading CloudOps/SRE Teams: Manage a 24x7 CloudOps/SRE team focused on maintaining service uptime and providing prompt incident response. Incident Management: Lead incident management processes, including conducting Root Cause Analysis (RCA) and ensuring adherence to SLAs. Implement Observability Best Practices: Utilize Grafana, Prometheus, and Opsgenie to implement observability best practices. Promote Automation: Foster self-healing, automated infrastructure to reduce manual interventions and improve operational efficiency. Customer Relationship Management: Build and maintain strong customer relationships through transparent and clear communication. Mentorship and Leadership: Lead and mentor cross-functional teams of DevOps and CloudOps/SRE engineers, ensuring high productivity, continuous professional growth, and performance reviews. AWS Support: Provide basic-to-intermediate support for AWS services (IAM, EC2, S3, Lambda, CloudFormation) and assist in hybrid cloud integration when required. To Be Successful in This Role, You Should Have: Qualifications: BE/BTech from a reputable engineering institute. Experience: 8-12 years of experience in DevOps, CloudOps, or SRE roles. Technical Expertise: Primary Cloud Platform: Expertise in Google Cloud Platform (GCP). Secondary Cloud Platform: Experience with AWS. Infrastructure as Code (IaC): Strong experience with Terraform. Containerization & Orchestration: Hands-on experience with Kubernetes (GKE). CI/CD & Automation: Expertise in tools such as Jenkins, GitOps, and Ansible. Monitoring & Observability: Proficient in Prometheus, Grafana. Incident & Alerting: Familiarity with Opsgenie. Big Data & Streaming: Experience with Kafka, Airflow, Druid. AWS Services: Experience with IAM, EC2, S3, Lambda, CloudFormation, and CloudWatch. Additional Skills: Proven experience managing 24x7 operations and multi-cloud environments. Hands-on expertise with GCP infrastructure, Terraform, Kubernetes, and CI/CD pipelines. Experience with incident management, RCA, monitoring, and alerting. Strong understanding of reliability engineering, automation, and cloud security best practices. Bonus Points If You Have: Experience working with Kafka, Airflow, and Druid in large-scale environments. Certifications such as GCP Professional DevOps Engineer, AWS Solutions Architect, or Kubernetes. Working knowledge of AWS cloud services, especially in hybrid-cloud environments. What You ll Find Here: A Culture of Innovation: We focus exclusively on cutting-edge development. Our clients seek our expertise for innovative solutions, not maintenance work. Endless Learning Opportunities: Constantly expand your skills and stay on top of the latest trends and advancements in cloud technologies. Talented Peers: Work alongside top-tier engineers from India s best institutes (IITs, NITs, and others), fostering a collaborative and growth-oriented environment. Work-Life Balance: We value your well-being and offer flexible schedules and remote work options to help you maintain a healthy work-life balance. A Great Culture: 82% of our employees recommend Talentica to their peers (according to Glassdoor), which speaks to the positive work environment we ve built. Recognition & Rewards: We celebrate success and ensure that your contributions are recognized and appreciated. At Talentica, we invite you to take ownership of large-scale, impactful projects and work with cutting-edge technologies. If you re ready to make a real difference in shaping the future of our industry, we d love to have you join us. Qualification : BE/BTech from a reputable engineering institute.
Senior Python Bigdata Developer
Talentica Software (i) Pvt. Ltd.
About Talentica Software: Talentica Software is a boutique software development company founded by industry veterans and IIT Bombay alumni. We specialize in helping startups build innovative products by leveraging cutting-edge tools and technologies to solve real-world challenges. With over 21 years of experience, we ve worked with over 180 startups, primarily in the US, leading to numerous successful exits. In 2022, Talentica Software was recognized by Great Place to Work as one of India s Great Mid-Size Workplaces. What We re Looking For: We are seeking a Senior Python Big Data Developer to join our team. If you're passionate about building scalable solutions from scratch, enjoy collaborating with clients, and love working with the latest technologies, this is the perfect opportunity for you. We re looking for proactive problem-solvers who are eager to contribute to innovative projects and deliver impactful solutions. What You ll Be Doing: As a Senior Python Big Data Developer, your responsibilities will include: Developing Scalable Solutions: Design and implement intelligent, scalable engineering solutions from the ground up. Client Collaboration: Work closely with clients to understand their product vision, goals, and technical requirements. Product Design: Contribute to both high-level and low-level product designs while collaborating with a team of skilled developers. Innovative Product Development: Utilize cutting-edge open-source Python technologies such as Kafka, Storm, Spark/Flask, Hadoop, Cassandra, MongoDB, and more to build innovative products. To Be Successful in This Role, You Should Have: Qualifications: BE/BTech from top engineering institutes (IIT, NIT, BITS, VJTI, COEP, or other top 100 engineering colleges in India). Experience: 3.6-6 years of experience in Python and Spark/Flask. Tech Skills: Strong expertise in NoSQL databases (e.g., Cassandra, Aerospike, MongoDB). Familiarity with REST API frameworks is a plus. What You ll Find Here: A Culture of Innovation: We focus exclusively on cutting-edge development, working on projects that push the boundaries of technology. Our clients come to us for innovative solutions, not maintenance work. Endless Learning Opportunities: At Talentica, you ll continuously expand your skill set by exploring and applying the latest advancements in technology. Talented Peers: Work alongside top-tier engineers from India's premier institutions (IITs, NITs, and others), offering numerous opportunities for collaboration and learning. Work-Life Balance: We prioritize your well-being with flexible schedules and remote work options, helping you maintain a healthy work-life balance. A Great Culture: Our employees love working here! 82% of our team members recommend Talentica to their friends, according to Glassdoor. If you re eager to be part of a dynamic team that doesn t just follow trends but leads and innovates, Talentica is the place for you. Join us and help shape the future of the industry by working on impactful, high-tech projects. Qualification : BE/BTech from IIT, NIT, BITS, VJTI, COEP, or other top 100 engineering institutes in India.
Data Engineering Architect
Cybage Software Private Limited
Data Engineer - Media & Advertising Sector - Job Description We are looking for an experienced Data Engineer to join our team and drive business outcomes in the media and advertising sector. In this role, you will leverage advanced data technologies to design and implement comprehensive data strategies that focus on scalability, performance optimization, and secure data management. Successful candidates will have hands-on experience with Big Data technologies and machine learning models, as well as a deep understanding of the advertising domain and its data needs. Technical and Professional Requirements: Big Data Technologies: Proficiency with platforms such as BigQuery, Big Data, Hadoop, and Snowflake for managing and processing large-scale datasets. Programming/Scripting Languages: Strong experience in programming languages like Python, Java, or Go for developing data solutions. Machine Learning Models: Hands-on experience defining and implementing various Machine Learning models to address diverse business requirements. Data Scalability & Performance: Practical experience in handling performance and data scalability challenges to ensure efficient data processing and storage. Advertising Domain Knowledge: Familiarity with advertising data and experience working with datasets such as Campaign Performance, Ad Performance, Attribution, and Audience Data. Job Responsibilities: Data Strategy Design: Develop a comprehensive data strategy that aligns with business objectives. This includes designing data models, establishing database development standards, and managing data warehouses and data analytics systems. Data Source Identification: Identify internal and external data sources and create a plan for managing these data sources according to the overall business data strategy. Cross-Functional Collaboration: Work with various teams (engineering, product, analytics, etc.) to ensure the smooth functioning of the enterprise data system, facilitating cross-departmental cooperation. End-to-End Data Architecture: Manage the end-to-end data architecture process, from selecting the platform and designing technical architecture to developing applications, and finally testing and implementing the solution. Big Data Solution Planning: Plan and execute big data solutions using technologies like BigQuery, Big Data, Hadoop, and Snowflake. Data Accessibility & Security: Integrate technical functionality that ensures data accessibility, accuracy, and security throughout the data lifecycle. Educational Requirements: Any Graduate with 60% and above in your academic background. This position is ideal for someone who is passionate about data engineering and eager to tackle complex challenges in the media and advertising sector. If you're looking to drive innovation, work with cutting-edge technologies, and collaborate across teams, we would love to hear from you! Qualification : Any Graduate with 60% and above in your academic background.
Data Engineer-data Modeling
International Business Machines Corporation
Data Engineer IBM Consulting About the Role Join us at IBM Consulting in one of our Client Innovation Centers, where we deliver specialized technical and industry expertise to both public and private sector clients worldwide. Our centers bring local skills and technical capabilities to help clients drive innovation and adopt cutting-edge technologies. A career at IBM Consulting is built on fostering long-term relationships and collaborating closely with clients around the globe. You ll work with leaders across multiple industries to advance the hybrid cloud and AI journeys of some of the world s most innovative and influential companies. Your ability to create impactful change will be empowered by IBM's strategic partner ecosystem and our robust technology platforms, including IBM Software and Red Hat. At IBM, curiosity and a continual pursuit of knowledge form the cornerstone of success. In your role, you'll be encouraged to challenge norms, explore new ideas beyond your immediate responsibilities, and deliver innovative solutions that make a meaningful difference for clients. Our culture is rooted in growth and empathy, ensuring long-term career development in an environment that celebrates your unique skills and experiences. Your Role and Responsibilities As a Data Engineer at IBM, you ll unlock the power of data, revealing insightful stories and complex patterns. You ll contribute to data gathering, storage, and both batch and real-time processing, playing an essential role in defining data management systems and identifying key data for analysis. Your key responsibilities will include: Predictive Modeling: Implementing, validating, and maintaining statistical and predictive models, utilizing big data techniques along with various machine learning methodologies. Enterprise Search Applications: Designing and deploying enterprise search applications like Elasticsearch and Splunk to meet client-specific needs. Collaboration & Agile Practices: Working in an agile, team-oriented environment, collaborating with data scientists, engineers, consultants, and database administrators to bring statistical rigor to predictive behavior challenges. Data Integration & Cleansing: Developing teams or writing programs to efficiently cleanse and integrate data, build predictive models, and evaluate the results. Required Education Bachelor's Degree in Computer Science, Information Technology, Data Science, or a related field. Preferred Education Master's Degree in a relevant technical discipline. Required Technical and Professional Expertise 4+ years of experience in data modeling and data architecture. Proficiency in data modeling tools like ERwin, IBM Infosphere Data Architect, and experience with database management systems. Familiarity with various data models, including relational, dimensional, and NoSQL databases. Strong understanding of business processes and how data supports business decision-making. Expertise in database design principles, data warehousing concepts, and data governance practices. Preferred Technical and Professional Experience Exceptional analytical and problem-solving skills, with a sharp attention to detail. Ability to work collaboratively in a team-oriented environment and manage multiple projects simultaneously. Knowledge of SQL or similar programming languages. At IBM Consulting, we foster a culture of growth, innovation, and collaboration. As a Data Engineer, you ll have the opportunity to work with some of the brightest minds in the industry, all while impacting critical data-driven solutions for global clients. Join us and be a part of a diverse team committed to driving change and shaping the future of technology and analytics. Qualification : Bachelor's Degree in Computer Science, Information Technology, Data Science, or a related field.
Data Engineer Ii
Cencora
Transform Healthcare with Data: Join Cencora as a Data Engineer II At Cencora, our team members are at the heart of everything we do. We are on a mission to create healthier futures, and every individual here plays a crucial role in fulfilling that purpose. We believe in making a difference at the intersection of healthcare, technology, and innovation. If you're ready to shape the future of health and help improve lives globally, Cencora is the place for you. We are looking for a Data Engineer II to join our dynamic team. This role is pivotal in delivering accurate and reliable data to support our Legal and Compliance departments, with a direct impact on driving data-driven decisions that improve operational efficiencies and support strategic business goals. What You ll Do: As a Data Engineer II, you will be responsible for transforming raw data into actionable insights and building solutions that enhance business operations. Your role will span across multiple platforms, using SQL, SAP BusinessObjects, and a variety of other tools, to ensure that our data remains accurate, accessible, and consistent. Enhance Analytics Solutions: Lead the design and implementation of enhancements to business analytics solutions that align with evolving business needs. You ll turn complex business challenges into accessible data access requirements. Data Mining & Analysis: Perform data mining on vast datasets to uncover growth opportunities in sales, margin, and market share. Analyze pricing activities, including discounts, allowances, programs, and contract pricing, to drive profitability. Data Quality Assurance: Validate, cleanse, and aggregate data, ensuring its accuracy and integrity. You ll identify and resolve data inaccuracies, improving the overall quality of enterprise data. Collaboration & Problem-Solving: Work cross-functionally with teams like Inside Sales, Finance, and Sourcing to develop performance forecasts, projections, and plans based on data assumptions and variables. Automated Solutions: Identify opportunities for automated solutions to enhance data quality and efficiency across the enterprise. Report Development: Collaborate with internal stakeholders to define reporting deliverables, ensuring that data is appropriately named, structured, and ready for decision-making. Data Integrity & Monitoring: Monitor and update data changes on a mass scale using tools, ensuring the highest level of data integrity is maintained. What You Bring to the Table: Experience: You have 4+ years of direct experience in healthcare data analytics or data engineering. You know your way around large datasets and understand how to unlock insights that drive business decisions. Technical Expertise: Proficient in SAP and BusinessObjects, with an extensive background in Business Intelligence and SQL. Strong understanding of the wholesale distribution process, including purchases, sales, payments, and supplier rebates. Knowledge of pharmaceutical wholesale processes and chargebacks to wholesalers is a plus. Familiar with data visualization tools like Power BI or Tableau. Analytical Mindset: You re a critical thinker with an eye for detail, always ready to dive into data to uncover trends, identify issues, and solve problems. Mentorship: You bring leadership experience, with a knack for mentoring and guiding team members. Communication Skills: Your ability to communicate complex data insights to non-technical stakeholders is top-notch. You can explain trends and patterns with clarity and confidence. Bonus Points: Familiarity with Microsoft Power BI, Tableau, or other data visualization tools. Experience with Big Data analysis tools and techniques. Background in data governance and data management. What You ll Get from Us: Meaningful Work: At Cencora, your work directly impacts the future of healthcare. Your expertise in data will help us make strategic, data-driven decisions that improve lives globally. Growth Opportunities: We invest in our team members' growth through mentorship, professional development, and the chance to shape the future of healthcare technology. Collaborative Environment: Work alongside innovative professionals in a culture that values diverse perspectives and fosters collaboration. Comprehensive Benefits: We offer a range of benefits designed to support you in every aspect of life health, wellness, work-life balance, and more. Join Cencora Today! If you re ready to leverage your data engineering expertise to drive meaningful change, we d love to hear from you! Apply now to become part of a purpose-driven company at the forefront of innovation in the healthcare sector. Cencora is committed to building a healthier future, and we want you on this journey with us.
Senior Engineer - Data Analytics
Altimetrik
Job Overview Senior Engineer - Data Analytics in the Manufacturing domain with 3-7 years of experience. Lead data analytics projects focusing on aerospace reliability and warranty analysis. Develop solutions using Python and Power BI, creating insightful dashboards. Analyze warranty and aftermarket data for valuable insights. Collaborate across teams to address challenges. Streamline data processes using VBA and MS Excel. Drive reliability analysis initiatives for product performance. Communicate findings effectively and mentor junior team members. Demonstrate strong project management and leadership skills. Preferred: Experience in After-market data analysis, strong communication skills, proficiency in VB.Net. Education: Bachelor of Technology or Bachelor of Engineering in Computer Science coupled with an MBA in Business Analytics or Data Science. Preferred certifications: Microsoft Certified: Data Analyst Associate and Certified Reliability Engineer (CRE). Roles & Responsibilities Lead and oversee data analytics projects with a focus on reliability and warranty analysis in the aerospace industry. Utilize Python and Power BI to develop advanced data analytics solutions and create insightful Power BI dashboards for stakeholders. Conduct in-depth analysis of warranty data and aftermarket performance to provide valuable insights and recommendations. Collaborate with cross-functional teams to understand and address the unique challenges of the aerospace aftermarket business. Apply expertise in VBA and MS Excel to streamline data processes and enhance data visualization. Drive reliability analysis initiatives to ensure product performance and customer satisfaction. Communicate findings effectively through reports and presentations. Mentor junior team members and contribute to their professional development. Demonstrate strong leadership skills in project management and team coordination. Maintain a high level of professionalism and uphold ethical standards in data analysis and reporting. Our ideal candidate Extensive experience in Python, Power BI, Warranty Analysis, Aerospace V&V (Verification and Validation) processes, and Reliability Analysis 3-7 years of experience with advanced proficiency in Python for developing data analysis scripts and automation tools Expertise in Power BI for creating interactive visualizations and dashboards In-depth knowledge of Warranty Analysis and Reliability Analysis methodologies Ability to apply VBA and MS Excel for data manipulation and analysis Education: Bachelor of Technology (B.Tech) or Bachelor of Engineering (B.E) in Computer Science or Information Technology, coupled with a Master of Business Administration (MBA) in Business Analytics or Data Science Certification: Microsoft Certified: Data Analyst Associate and Certified Reliability Engineer (CRE) preferred Company overview Altimetrik delivers outcomes for our clients by rapidly enabling digital business & culture and infuse speed and agility into enterprise technology and connected solutions. We are practitioners of end-to-end business and technology transformation. We tap into an organization s technology, people, and assets to fuel fast, meaningful results for global enterprise customers across financial services, payments, retail, automotive, healthcare, manufacturing, and other industries. Founded in 2012 and with offices across the globe, Altimetrik makes industries, leaders and Fortune 500 companies more agile, empowered and successful.Altimetrik helps get companies get unstuck . We re a technology company that lives organizations a process and context to solve problems in unconventional ways. We re a catalyst for organization s talent and technology, helping teams push boundaries and challenge traditional approaches. We make delivery more bold, efficient, collaborative and even more enjoyable. Qualification : Bachelor of Technology (B.Tech) or Bachelor of Engineering (B.E) in Computer Science or Information Technology, coupled with a Master of Business Administration (MBA) in Business Analytics or Data Science
Senior Data Engineer/senior Arcihtect
Hsbc
Role: Senior Architect Key Responsibilities: Platform Integration & Collaboration: Work across various platforms, collaborating with other support teams to ensure smooth integration and efficient operations. Solution Design & Development: Design, develop, test, and implement changes to solutions based on business requirements and strategic direction. Collaboration with Development Teams: Collaborate with development teams to test and maintain platforms and ensure smooth integration with other systems. Product/Project Support: Communicate regularly with Product Owners and agile Pods to provide ongoing support for products and projects. Guidance & Mentorship: Guide junior team members in development and delivery to help them grow and ensure efficient workflow. Release Support & Monitoring: Responsible for supporting production releases, conducting peer reviews, and overseeing the CI/CD pipeline implementation and service monitoring. Shift & On-Call Availability: Be flexible in working hours, ready to work in shifts and be on-call when needed. Requirements: To be successful in this role, you should meet the following criteria: Experience: 8-10 years of experience in software development, specifically in data analysis or big data projects. Technical Expertise: Strong skills in SpringBoot, Java 8, Kubernetes, Docker, Microservices, and PostgreSQL. Good understanding of CDP 7.1, HDFS filesystems, Unix, and Unix Shell Scripting. Knowledge of Elasticsearch, DevOps concepts, and related platforms. System Design: Proven experience in analyzing complex business requirements and translating them into effective system designs. Data Processing Expertise: Expertise in building and deploying production-level data processing batch systems supported by application support teams. Communication & Collaboration: Ability to work at pace, communicate clearly, and operate both independently and as part of a team. Desirable Skills: Good to have knowledge of Quantexa software, Angular, HTML, CSS, and JavaScript. Optional knowledge of cloud platforms. At HSBC, you'll have the opportunity to make a real impact. We support your career development, offer flexible working, and provide a collaborative, inclusive environment where you can thrive. Qualification : Person should have 8-10 years of experience in s/w development on data analysis or big data projects.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted