Data Engineer She1Wyc9Ec at Zscaler

Job Title: Senior Generative AI & Data Engineer (Python) Remote | Chandigarh/Punjab Preferred Experience Required: 5+ Years Employment Type: Full-Time Work Days: 5 Days a Week Notice: Immediate Joiners Preferred About the Role We are seeking an experienced Senior Generative AI & Data Engineer with over 5 years of expertise in Python and enterprise-level AI/data engineering. This fully remote position is ideal for professionals based in Chandigarh or Punjab looking to contribute to cutting-edge AI projects while working from home. Key Responsibilities: Design and develop complex Large Language Model (LLM) layers and modules including flow creation, supervision, retrievers, and connection management. Build and optimize scalable data models, data pipelines, and translation layers for efficient data processing. Lead enterprise-grade Python development efforts with clean, maintainable code. Drive Generative AI engineering initiatives to innovate and enhance AI capabilities. Manage data engineering tasks using PostgreSQL, Polars, and orchestration tools such as Apache Airflow (DAGs). Oversee operational data workflows using key-value stores and queuing systems. Develop robust and scalable web services using FastAPI. Collaborate closely with cross-functional teams to deliver innovative engineering solutions aligned with business needs. Required Skills & Expertise: Strong proficiency in Python for enterprise applications. Hands-on experience in Generative AI engineering and LLM module development. Expertise in data engineering with PostgreSQL and Polars. Skilled in workflow orchestration using Airflow DAGs. Proficient in building web APIs with FastAPI. Experience managing key-value stores and message queuing systems for data operations. Work remotely while contributing to enterprise-level AI and data engineering projects. Collaborate with a dynamic, innovative team passionate about cutting-edge technology. Competitive salary and opportunities for professional growth. Flexible working environment supporting work-life balance.

Sr. Big Data Engineer Location: India The Impact You Will Have: You will work on a variety of impactful customer technical Big Data projects, which may include building reference architectures, how-to's and production-grade MVPs. Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications. Consult on architecture and design; bootstrap or implement strategic customer projects that lead to a customer's successful understanding, evaluation and adoption of Databricks. Work with Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement-specific product and support issues. What We Look For: 10+ years experience with Big Data Technologies such as Apache Spark , Kafka, Cloud Native and Data Lakes in a customer-facing post-sales, technical architecture or consulting role. 6+ years of experience working on Big Data Architectures independently. Strong experience working in the Databricks ecosystem. Comfortable writing code in either Python or Scala. Experience working across Cloud Platforms (GCP / AWS / Azure). Documentation and white-boarding skills. Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects. About Databricks: Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics, and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake, and MLflow. Benefits: At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees.

Working at Atlassian At Atlassian, we believe in empowering our employees with the flexibility to choose where they work whether in the office, from home, or a hybrid combination of both. This approach gives Atlassians greater control over their work-life balance, family priorities, and personal goals. We are a distributed-first company, hiring people across the globe where we have legal entities, with virtual interviews and onboarding processes in place. We are currently looking for a Senior Data Engineer to join our Go-To-Market Data Engineering (GTM-DE) team. This team is responsible for building and maintaining our data lake, ensuring our big data pipelines and services are optimized, and facilitating the movement of billions of messages each day. You'll work directly with business stakeholders, platform, and engineering teams to enable growth and retention strategies at Atlassian. We re looking for someone who is passionate about building scalable services and enjoys problem-solving in a fast-paced environment. What You ll Do: Help stakeholder teams ingest data into our data lake more efficiently. Improve the performance of our data pipelines, ensuring scalability. Innovate to create self-serve data engineering capabilities within the company. Design and build micro-services that support large-scale data ingestion and processing. Architect and enable self-serve data engineering services to help scale Atlassian's growth. Work with a cloud-based AWS data lake, leveraging open-source tools like Spark and Airflow. Apply your technical skills to build reliable and scalable services to support a multi-petabyte data lake. Work collaboratively in a fast-paced environment where creativity is key to success. What We Expect on Your First Day: A BS in Computer Science or equivalent professional experience. At least 5+ years of professional experience as a Sr. Software Engineer or Sr. Data Engineer. Strong proficiency in programming (preferably Python, Java, or Scala). Experience writing SQL, structuring data, and understanding data storage practices. Familiarity with data modeling and data warehousing concepts. Hands-on experience building data pipelines, platforms, microservices, and REST APIs. Familiarity with Spark, Hive, Airflow, and other streaming technologies to process large-scale streaming data. Experience working with Amazon Web Services (AWS), particularly EMR, Kinesis, RDS, S3, SQS, and similar services. Familiarity with Agile, TDD, and CI/CD development practices. A strong focus on data quality with experience using tools or frameworks to detect data issues and anomalies. A willingness to accept failure, learn from it, and continuously improve. Open-mindedness to explore unconventional solutions. Preferred Experience: Experience building self-service tooling and platforms. Experience designing and implementing Kappa architecture platforms. Experience with Databricks, including using their APIs to build pipelines. Contributions to open-source projects, such as creating Airflow operators. Perks & Benefits: Atlassian offers a wide range of perks and benefits to support you, your family, and your engagement with the community. Our offerings include: Comprehensive health coverage. Paid volunteer days to give back to your community. Wellness resources to support your mental and physical health. And much more to help you thrive both personally and professionally. This role offers you the opportunity to work on cutting-edge technologies, innovate at scale, and contribute to the overall growth and success of Atlassian. If you're passionate about data engineering, building scalable services, and working in a collaborative, fast-paced environment, we d love to hear from you! Qualification : A BS in Computer Science or equivalent professional experience.

Working at Atlassian At Atlassian, we empower our employees by giving them the flexibility to choose where they work whether in an office, from home, or through a combination of both. This approach helps Atlassians balance their work, family, and personal goals. We are a distributed-first company, and we can hire talented people from any country where we have a legal entity. All interviews and onboarding are conducted virtually to accommodate our global workforce. About the Role: Data Engineer At Atlassian, we are seeking a Data Engineer to join our Go-To-Market Data Engineering (GTM-DE) team. This team is responsible for building and maintaining our data lake, managing big data pipelines, and facilitating the movement of billions of messages every day. You will work directly with business stakeholders and collaborate with platform and engineering teams to support Atlassian s growth and retention strategies. We are looking for a structured thinker who is passionate about building scalable services and is ready to tackle the challenge of helping Atlassian scale its operations. If you enjoy solving complex problems and working in a fast-paced environment, this is the opportunity for you. What You ll Do: Help stakeholder teams efficiently ingest data into our data lake. Optimize data pipelines for better performance and scalability. Develop microservices, design architectures, and build self-serve capabilities at scale. Work with a cloud-based AWS data lake and leverage open-source technologies like Presto, Spark, Airflow, and Hive. Apply your technical expertise to manage and orchestrate multi-petabyte scale data lakes. Work with minimal legacy, spending more time on innovation and improving the platform experience. What We Expect on Your First Day: A BS in Computer Science or equivalent experience. At least 2 years of professional experience as a Software Engineer or Data Engineer. Strong programming skills in Python, Java, or Scala (a combination of these is preferred). Experience with data modeling, data warehousing, and SQL. Familiarity with modern software development practices like Agile, TDD, and CI/CD. Hands-on experience with Spark, Hive, Airflow, and other streaming technologies to process large-scale data. Experience with Amazon Web Services (AWS), particularly EMR, Kinesis, RDS, S3, and SQS. A growth mindset with a willingness to learn from failures and continuously improve. Open to exploring innovative solutions that may seem unconventional at first. Preferred Experience: Experience building self-service tooling and platforms. Experience designing and implementing Kappa architecture platforms. A passion for building and maintaining continuous integration pipelines. Experience with Databricks and its APIs. Contributions to open-source projects, such as building Airflow operators. Our Perks & Benefits: Atlassian offers a variety of perks and benefits to support your work, family, and community engagement. Some of the benefits we provide include: Health coverage to keep you well. Paid volunteer days to give back to your community. Wellness resources to support your physical and mental health. Plus many more offerings to help you thrive in both your personal and professional life. At Atlassian, you will be part of an innovative team where you can develop and grow your skills while making a direct impact on the company's growth and success. If you're ready to tackle complex data challenges in a fast-paced environment, we want to hear from you! Qualification : A BS in Computer Science or equivalent experience.

Position Title: Senior Data Engineer, Products and Platform Data Engineering About the Team: Atlassian's Data Engineering team is a highly skilled group dedicated to building world-class data solutions and applications that power crucial business decisions throughout the organization. We manage and maintain multiple analytical data models and pipelines across Atlassian, providing a unified way of analyzing products, customers, operations, and their interconnections. We re the backbone of the data-driven culture at Atlassian, supporting teams across Finance, Growth, Product Analysis, Customer Insights, Sales, and Marketing. We are looking for a Senior Data Engineer to join our Products and Platform Data Engineering team. This role reports to the Data Engineering Manager, based in Sydney. In this role, you will help build the infrastructure that enables our data solutions to grow and scale, making sure that business stakeholders have access to accurate and actionable insights. You ll partner closely with Data Analytics, Data Scientists, and various stakeholders to deliver high-impact data solutions across Atlassian's ecosystem. What You ll Do: Collaborate with Data and Business Teams: Partner with Product Analytics, Data Scientists, and other stakeholders to understand their needs and architect/build data solutions that provide valuable insights and drive business decisions. Design and Build Data Models and Pipelines: Develop scalable data models and build data acquisition/ingestion processes that can handle large volumes of data, ensuring they meet the product and business requirements. Develop Backend Systems: Build and maintain backend data systems that help Atlassian scale its data infrastructure, enabling seamless flow and access to critical data. Lead End-to-End Data Solutions: Take full ownership of building, scaling, and improving data pipelines and processes across Atlassian. You'll handle requirements from vague concepts, iterating to refine solutions rapidly. Improve Data Quality: Drive initiatives to improve the data quality within the team by using and enhancing internal tools and frameworks that automatically detect and resolve data quality issues. Mentor and Support Team Members: Help foster a culture of learning by mentoring junior engineers and ensuring best practices are maintained across the team. What We re Looking For: BS in Computer Science or equivalent experience. 8+ years of experience as a Senior Data Engineer or in a similar role, with a deep understanding of data engineering processes and infrastructure. Strong programming skills in Python (other languages such as Java or Scala are a plus) and experience with data-centric programming. Proficiency in SQL and experience designing and optimizing relational databases for large-scale data storage and retrieval. Experience with Spark (SparkSQL) and other tools in the big data ecosystem to build scalable data pipelines (e.g., Apache Kafka, Hive, Flink, etc.). Familiarity with AWS (Amazon Web Services) or similar cloud platforms and experience with services like EMR, S3, Kinesis, and RDS. Experience with data modeling and designing efficient storage solutions for both structured and unstructured data. Hands-on experience with scheduling frameworks like Airflow or equivalent tools to orchestrate workflows. Strong experience with Agile methodologies, including TDD, CICD, and continuous iteration for improvement. Problem-solving mindset: Ability to turn vague requirements into concrete solutions and handle complex challenges with creative, scalable solutions. Nice-to-Have Skills: Experience building self-service data platforms for internal teams to access and work with data independently. Experience with real-time data processing using technologies like Apache Kafka or Flink. Familiarity with Databricks and their APIs. Knowledge of monitoring and observability tools for ensuring high data quality and reliable data systems. At Atlassian, we believe in delivering high-quality solutions through collaboration, innovation, and a focus on customer success. This is a fantastic opportunity to join a fast-growing company and help build the data systems that power key business decisions across the organization. You will have the chance to work with cutting-edge technology and shape Atlassian s data-driven culture. If you're an experienced Data Engineer with a passion for building scalable data solutions and working with teams to drive business value, we d love to hear from you! Qualification : BS in Computer Science or equivalent experience.

Key Accountabilities: Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting. If necessary, create prototypes to validate proposed ideas and solicit input from stakeholders. Excellent grasp of and expertise with test-driven development and continuous integration processes. Analysis and Design Converts high-level design to low-level design and implements it. Collaborate with Team Leads to define/clarify business requirements, estimate development costs, and finalize work plans. Run unit and integration tests on all created code Create and run unit and integration tests throughout the development lifecycle. Benchmark application code proactively to prevent performance and scalability concerns. Collaborate with the Quality Assurance Team on issue reporting, resolution, and change management. Support and Troubleshooting Assist the Operations Team with any environmental issues that arise during application deployment in the Development, QA, Staging, and Production environments. Assist other teams in resolving issues that may develop as a result of applications or the integration of multiple components. Knowledge and Experience: Understanding of design concepts and architectural basics. Knowledge of performance engineering. Understanding of quality processes and estimate methods. Fundamental grasp of the project domain. The ability to transform functional and nonfunctional needs into system requirements. The ability to develop and code complicated applications is required. The ability to create test cases and scenarios based on specifications. Solid knowledge of SDLC and agile techniques. Knowledge of current technology and trends. Logical thinking and problem-solving abilities, as well as the capacity to collaborate. Primary skills: Cloud Platform, Azure, Databricks, ADF, ADO. Sought: SQL, Python, PowerBI. General Knowledge: PowerApps, Java. 6-10 years of experience in software development with minimum 2 years of cloud computing. Education: Bachelor of Science in Computer Science, Engineering, or related technical field. Qualification : Bachelor of Science in Computer Science, Engineering, or related technical field.

Senior Data Engineer Hyderabad (On-site, Full-time) Location: Hyderabad, Telangana Work Type: On-site, Full-time Experience: 5+ Years Industry: AI & Data Science Company: Blend About Blend: Blend is a leading AI services company focused on solving real-world problems through the fusion of artificial intelligence, data science, and human ingenuity. We believe in co-creating meaningful impact by aligning top-tier talent with cutting-edge technology. Our goal is to deliver transformative solutions that unlock value for our clients and enrich the work and lives of our people. Job Overview: We are seeking a highly skilled Senior Data Engineer with strong experience in AWS, Databricks, Python, SQL, and Apache Spark/PySpark. You will be responsible for designing, developing, and maintaining scalable data architectures and pipelines to support analytics, machine learning, and business intelligence efforts across the organization. Key Responsibilities: Design and build scalable data pipelines using AWS services (Glue, Lambda, S3, EMR) and Databricks Notebooks & Workflows. Develop and manage robust ETL/ELT workflows using Python and SQL to handle structured and semi-structured data. Implement distributed data processing using Apache Spark or PySpark. Create and maintain data lakes in AWS Databricks. Collaborate with data scientists, analysts, and cross-functional teams to provide high-quality, accessible datasets. Ensure adherence to data governance, quality, and security best practices. Monitor, troubleshoot, and optimize the performance of data systems. Conduct code reviews and enforce engineering best practices. Mentor junior engineers and support their technical growth. Required Qualifications: Bachelor's or Master s degree in Computer Science, Engineering, or related field. 5+ years of experience in Data Engineering, with 2+ years working in AWS Databricks environments. Strong programming skills in Python for data processing and workflow automation. Advanced expertise in SQL for data transformation and querying large datasets. Proficient in distributed data processing using Apache Spark/PySpark. Solid understanding of data modeling, data warehousing, and performance optimization techniques. Hands-on experience with AWS services such as Glue, S3, Lambda, and EMR. Familiarity with version control tools like Git or CodeCommit. Experience with workflow orchestration tools like Airflow or AWS Step Functions (preferred but not mandatory). Be part of a forward-thinking, AI-driven organization. Work with cutting-edge cloud technologies and data platforms. Thrive in a culture of innovation, mentorship, and continuous learning. Enjoy opportunities to grow technically and professionally while driving real-world impact. Apply Now to join Blend as a Senior Data Engineer and help build data infrastructure that powers intelligent decision-making. Qualification : Bachelor's or Masters degree in Computer Science, Engineering, or related field.

Azure Data Engineer (Mid-Level) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience Level: 5+ Years Industry: Information Technology / Cloud Data Engineering Job Overview We are hiring an experienced Azure Data Engineer (Mid-Level) to join our team in Hyderabad. In this role, you will work closely with business stakeholders, analysts, and IT teams to design, implement, and manage scalable, high-performance data solutions on the Azure Cloud Platform. Your expertise in data modeling, ETL development, and cloud-based data warehousing will be critical in supporting data-driven decision-making across the organization. Key Responsibilities Analyze large datasets and deliver clear, actionable reports using statistical techniques. Design and implement data pipelines, data collection systems, and analytics strategies that enhance operational efficiency. Develop and maintain data systems, ensuring high data quality, consistency, and integrity. Collaborate with business stakeholders, analysts, and developers to translate business requirements into technical solutions. Design, build, and manage distributed data systems and applications on the Azure Cloud. Lead and execute ETL development, including data extraction, transformation, and loading using tools like Informatica or SSIS. Conduct technical design reviews, performance tuning, and testing of data workflows. Adapt to changing priorities and contribute as an individual contributor or team leader depending on project scope. Required Qualifications & Skills Bachelor s degree in Computer Science, Information Systems, or a related field. Minimum 5+ years of experience in data engineering, data analysis, or database design. Proficient in SQL and T-SQL for querying and managing relational databases. Hands-on experience with ETL frameworks such as Informatica or SSIS. Strong understanding of data modeling, data mining, and segmentation techniques. Experience working with structured and unstructured data sources. Proficient in statistical tools and packages (Excel, SSIS, SAS, etc.). Strong analytical mindset with excellent attention to detail and data accuracy. Preferred Skills (Good to Have) Experience with Python and Apache Spark for data manipulation and automation. Experience with modern data platforms: Azure Synapse Analytics Azure Databricks Amazon Redshift Prior experience in developing automation solutions using Python or similar scripting languages. Knowledge of Enterprise Data Warehousing (EDW) concepts and solutions. Competitive compensation package with benefits. Work with cutting-edge cloud technologies in real-world environments. Collaborative, fast-paced, and innovation-driven workplace. Career development support with continuous learning opportunities. A chance to make a tangible impact on enterprise-level data systems. Apply Now If you are a data-driven professional with a strong command of Azure and ETL tools, and you re looking to advance your career in data engineering, apply now and become part of a forward-thinking tech team based in Hyderabad! Qualification : Bachelors degree in Computer Science, Information Systems, or a related field.

Data Engineering Support Engineer SIMA (5+ Years) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience: 5+ Years Industry: Data Engineering / Cloud Support Job Overview We are seeking an experienced Data Engineering Support Engineer with a strong background in maintaining and optimizing data pipelines, ensuring platform reliability, and supporting cloud data infrastructure. This role is critical to sustaining smooth data operations for the SIMA platform in Hyderabad. Key Responsibilities Maintain and support data pipelines and transformations on Azure cloud platforms. Ensure platform stability and reliability through proactive monitoring and issue resolution. Manage scheduling and monitoring using Azure Data Factory (ADF) triggers, Azure Monitor, and Log Analytics (KQL). Handle data ingestion and validation workflows via ADF, Event Hub, APIs, and PySpark, including managing schema drift. Manage CI/CD pipelines using Azure DevOps YAML, deploying solutions for ADF, Synapse, and Databricks. Optimize data transformations and performance using PySpark and Delta Lake techniques like partitioning and caching. Implement and maintain security best practices using Azure RBAC, Key Vault, NSGs, and Integration Runtime configuration. Conduct Root Cause Analysis (RCA), document findings, maintain disaster recovery playbooks, and implement proactive alerting. Required Skills 5+ years of hands-on experience in data engineering support roles. Expertise in Azure Data Factory (ADF) scheduling, triggers, and monitoring. Proficient with PySpark for data transformations and performance optimization. Experience with Delta Lake optimizations including partitioning and caching. Skilled in CI/CD practices using Azure DevOps for deploying data workflows. Strong knowledge of Azure security features: RBAC, Key Vault, Network Security Groups (NSGs). Ability to perform detailed Root Cause Analysis (RCA) and develop disaster recovery strategies. Familiarity with data ingestion tools like Event Hub and API integrations. Experience with Kusto Query Language (KQL) for Log Analytics queries. Join a dynamic team maintaining critical data infrastructure supporting business operations. Work with advanced Azure data services and cloud-based data platforms. Competitive salary and comprehensive benefits. Opportunity for growth and skill development in cloud data engineering. Apply Now If you are a detail-oriented data engineering professional with expertise in Azure platform support, apply today to become a vital part of our Hyderabad-based SIMA team!

Job Title: Senior Data Engineer Location: Hyderabad, Telangana, India Job Type: Full-Time | Permanent Experience Required: 6+ Years Open Positions: 2 About the Role: We are seeking a highly skilled and experienced Data Engineer to join our team in Hyderabad. As a key member of our data engineering unit, you will be responsible for designing and optimizing end-to-end data pipelines using Python, PySpark, and Databricks. This role requires strong technical expertise, a passion for solving complex data challenges, and the ability to lead best practices within the Supply Chain data domain. Key Responsibilities: Develop and maintain scalable data pipelines using Python, PySpark, and Databricks for complex data transformation within Supply Chain operations. Implement advanced data engineering solutions that support real-time and batch data processing for analytics and business intelligence. Analyze, optimize, and refactor existing data workflows to improve performance and reliability. Collaborate with cross-functional teams to understand data requirements and translate them into robust technical solutions. Take ownership of projects and deliver high-quality outcomes with minimal supervision. Provide leadership and guidance on coding standards, design patterns, and data engineering best practices. Clearly communicate technical ideas and solutions to both technical and non-technical stakeholders. Required Skills & Qualifications: 6+ years of hands-on experience in data engineering. Proficient in Python, PySpark, and Databricks for building and maintaining data pipelines. Strong problem-solving skills with a proven ability to create innovative solutions for complex data challenges. Excellent communication and interpersonal skills; able to work effectively with cross-functional teams. Experience leading and mentoring team members on technical best practices and architecture decisions. Ability to work independently, manage priorities, and drive projects to completion with minimal oversight. Perks & Benefits: Competitive compensation package Exposure to cutting-edge technologies in cloud-based data engineering Opportunity to work on large-scale Supply Chain data solutions Collaborative, innovation-driven work environment Career growth and mentorship opportunities

Job Title: Azure Data Engineer Location: Hyderabad / Bangalore (Hybrid) Job Type: Full-time Salary: Negotiable Position Overview: We are looking for an Azure Data Engineer with 5-8 years of experience to join our team. As an Azure Data Engineer, you will design, implement, and manage data solutions on the Microsoft Azure cloud platform. The ideal candidate will have a strong background in writing complex SQL stored procedures, implementing OLTP database solutions using Microsoft SQL Server, and working with Azure Synapse, PySpark, and Azure Databricks for big data processing. Key Responsibilities: Data Integration and Collaboration: Collaborate with cross-functional teams to gather, analyze, and document business requirements for data integration projects. Complex SQL Expertise: Write and optimize complex T-SQL, Dynamic SQL, and Spark SQL queries, including the creation of stored procedures for data transformation and business validation logic. Big Data Processing: Utilize Azure Synapse/Databricks to write notebooks using Spark SQL or PySpark for processing and analyzing large volumes of data. Data Pipeline Development: Develop and maintain robust data pipelines using Azure Data Factory to ensure seamless data flow across systems. OLTP Systems: Contribute to the enhancement and optimization of OLTP systems using SQL Server. Data Quality and Integrity: Ensure data quality, integrity, and accuracy in all systems. Programming and Algorithm Development: Utilize strong algorithmic programming skills to handle data processing and transformation. Qualifications: Educational Background: Bachelor s degree in Computer Science, Information Technology, or a related field. Experience: 5-8 years of experience in database development, data integration, and writing complex T-SQL queries. Technical Skills: Expertise in T-SQL and Spark SQL/PySpark (experience with Azure Synapse and Databricks is essential). Hands-on experience with Azure Data Factory for building data pipelines. Strong experience with OLTP systems using SQL Server. Problem-Solving Skills: Excellent problem-solving abilities with a strong focus on attention to detail. Adaptability: Ability to work in a collaborative and fast-paced environment, focusing on delivering high-quality solutions. Other Details: Notice Period: 0-15 days MAX Work Location: Hyderabad / Bangalore (Hybrid) If you're an experienced Azure Data Engineer with a passion for big data and cloud technologies, apply now to join our team and make an impact with innovative data solutions! Qualification : Bachelors degree in Computer Science, Information Technology, or a related field.

Job Title: Senior Data Engineer Company Name: Zessta Job Type: Full-time Responsibilities: Analyze customer data to enhance customer experience and provide actionable insights. Build and maintain integrations to support advanced data science workflows, ensuring seamless interaction with the Product API. Actively participate in onboarding and training clients on how to use the product effectively. Provide insights into client-to-business interactions, ensuring that the data can be leveraged for strategic decisions. Act as a liaison between the client and the organization, ensuring both parties' needs and expectations are met. Identify opportunities for clients to expand their usage of the product, driving engagement and long-term value. Address customer complaints and requests, offering product support to improve overall satisfaction and experience. Skills and Experience: Excellent communication and interpersonal skills to work effectively with clients and internal teams. Strong understanding of data modeling and architecture. Hands-on experience with data integrations and data pipelining tools to connect systems and enable smooth data flow. Proficiency in programming languages, preferably Python or R, to process and analyze data. Experience with container orchestration platforms like Docker and Kubernetes. Familiarity with distributed computing frameworks such as Spark, Hadoop, and Dask to handle large-scale data processing. Experience with version control software such as Git to manage code and collaborate with teams. Knowledge of project management tools such as JIRA to track and manage project progress and tasks. Familiarity with tools like Figma and Mixpanel is a plus. Education and Experience: Bachelor s or Master s degree from premier institutes (preferred). 4-12 years of relevant experience in data engineering, data science, or related fields. What We Offer: Competitive salary and benefits package. Opportunities for career growth and skill development. The chance to work on cutting-edge technologies and impactful projects. If you have a passion for data engineering and improving customer experience, and you're ready to take on new challenges, we'd love to hear from you. Apply now to join our team at Zessta and contribute to driving innovation and business success! Qualification : Bachelors or Masters degree from premier institutes (preferred).

Introduction In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients globally. Our centers provide locally-based skills and technical expertise to drive innovation and the adoption of new technologies. A career at IBM Consulting involves building long-term relationships and collaborating closely with clients across industries. You'll work alongside visionaries to help them on their hybrid cloud and AI journeys, enhancing the value and impact of some of the most innovative companies in the world. With access to IBM s strategic partner ecosystem and cutting-edge technology platforms, including IBM Software and Red Hat, you will be empowered to accelerate client transformations and create meaningful change. Curiosity and a constant quest for knowledge serve as the foundation for success at IBM. In your role, you'll be encouraged to challenge the status quo, explore ideas beyond your current role, and come up with creative solutions that will make a significant impact across a wide network of clients. Our culture of evolution and empathy is centered on long-term career growth and development opportunities in an environment that celebrates your unique skills and experience. Your Role and Responsibilities As a Data Engineer at IBM, you will be a critical player in designing and developing applications, while also providing guidance to project teams on complex coding, troubleshooting, and execution. Your key responsibilities include: Solution Design and Construction: Lead the design and construction of new data solutions using the latest technologies, ensuring business value and meeting user requirements. Continuous Improvement: Advocate for continuous improvement by testing solutions and working within an Agile framework to enhance and iterate the developed solutions. Innovation: Stay current with the latest technology trends, discovering and implementing creative solutions to solve business problems. Collaboration: Work with diverse teams to deliver impactful data solutions while ensuring scalability, quality, and performance. Required Education Bachelor s Degree in a relevant field Required Technical and Professional Expertise Apache Spark (PySpark): In-depth knowledge of Spark s architecture, core APIs, and using PySpark for distributed data processing. Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts. Proficiency in Python: Expertise in Python programming, particularly focused on data processing and manipulation. Data Processing Frameworks: Experience with Pandas, NumPy, and other data processing libraries. SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation. Cloud Platforms: Experience working with cloud platforms such as AWS, Azure, or GCP, including working with cloud storage systems. Preferred Technical and Professional Experience Architecture Strategy: Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring of data solutions. Cross-Team Collaboration: Partnering with technology teams, including application development, enterprise architecture, testing services, and network engineering. Security: Familiarity with detection and prevention tools for company products and customer-facing platforms. How You ll Grow At IBM, we offer opportunities for career development and provide an environment where you are encouraged to continuously grow, learn, and expand your expertise. Working with cutting-edge technologies and a diverse set of clients, you will be able to stay ahead of industry trends and make meaningful contributions that have a real impact. About IBM Consulting IBM Consulting helps organizations tackle their most pressing challenges through innovative and agile solutions. By partnering with clients, we drive technology transformations, helping them optimize their operations and leverage new technologies like AI, cloud, and data. Our team s expertise spans across many industries, delivering solutions that enable clients to navigate digital transformations. This role offers an exciting opportunity to work with leading technologies while contributing to client success in a highly dynamic environment. If you re passionate about solving complex data problems and delivering impactful solutions, IBM Consulting is the place to grow your career. Qualification : Bachelors Degree in a relevant field

Job Summary We are seeking a skilled and experienced Cybersecurity Detection and Implementation Engineer with expertise in YARA rules creation, playbook implementation, and data ingestion techniques. This role presents an exciting opportunity to contribute to the design and implementation of cutting-edge cybersecurity solutions while collaborating with a talented team of professionals. Responsibilities Design, develop, and maintain YARA rules for threat detection and malware analysis, ensuring high accuracy and effectiveness. Conduct research and analysis to identify emerging threats and vulnerabilities and develop proactive detection mechanisms. Identify and implement detection use cases based on emerging threats and TTPs using MITRE ATT&CK framework. Contribute to optimization of detection rules to eliminate false positives and improve detection efficiency. Collaborate with cross-functional teams to understand customer requirements and customize cybersecurity solutions to meet their needs. Participate in security incident response activities, providing technical expertise and support as needed. Stay abreast of the latest cybersecurity trends, technologies, and best practices, and share knowledge with the team. Work closely with customers to understand their security challenges and requirements and provide expert guidance and support. Qualifications Bachelor s degree in computer science, Information Security, or related field. 3 years of experience in cybersecurity, with a focus on detection engineering and implementation. Proficiency in creating and maintaining YARA rules for threat detection and malware analysis. Solid understanding of MITRE ATT&CK framework and developing detection rules based on it. Solid understanding of data ingestion techniques and technologies, including log management systems and data lakes. Knowledge and experience in developing use cases for Cloud, Identity, Endpoint and Data Exfiltration use cases. Hands-on experience with SIEM (Security Information and Event Management) solutions such as Splunk, ELK, or QRadar. Excellent analytical and problem-solving skills, with the ability to troubleshoot complex technical issues. Strong communication and interpersonal skills, with the ability to effectively collaborate with internal teams and customers. Relevant cybersecurity certifications (e.g., CISSP, CEH, GIAC) are a plus. If you are a passionate and driven cybersecurity professional with expertise in writing detection rules and is enthusiastic about emerging threats and protecting customers, we want to hear from you. Join us in our mission to protect our organization and our customers from cyber threats. Qualification : Bachelors degree in computer science, Information Security, or related field.

Job Description We are looking for a passionate engineer interested in working at an early-stage startup building innovative cloud-native data protection solutions. The ideal candidate must be comfortable learning and scoping business requirements to develop effective solutions. This is a great opportunity for engineers who are eager to step out of their comfort zone and solve impactful modern data security concerns. Desired Background and Experience: Must be a problem solver with the ability to think critically and creatively. Minimum of 8 years of experience building products using Java and/or Python. Prior experience in startups is a huge plus. Comfortable with rapid prototyping and implementation of products in an agile team environment. Data engineering experience with implementation of data ingestion, ETL, data pipeline/workflows. Experience implementing database views and UDFs to control access to data using row and column filters. Working experience in databases and data warehouses. Proficient in one or more of the following: AWS RDS, AWS Data Lake, Redshift, Athena, Databricks, and Snowflake. Experience implementing data solutions using Spark. Ability to write and tune complex SQL queries.

Job Description Location: Hyderabad, Telangana, India Job Type: Permanent (full-time) Experience: 6+ years No. of Openings: 2 Key Responsibilities: Tech Stack Expertise: Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. Innovative Problem-Solving: Demonstrate technical expertise by thinking creatively and providing innovative solutions to complex data-related challenges, pushing boundaries in Supply Chain data analytics. Communication Skills: Exceptional communication abilities to effectively convey technical concepts, collaborate with cross-functional teams, and articulate solutions to non-technical stakeholders. Autonomous Work: Ability to work independently and proactively, taking ownership of projects, and delivering high-quality solutions with minimal supervision. Guidance and Best Practices: Lead the team by setting coding standards, advocating for reusable and modularized code, implementing design patterns, and guiding on best practices in data engineering. Perks and Benefits: Strong expertise in Python, Pyspark, and Databricks, with hands-on experience in developing and optimizing data pipelines for complex data transformations. Exceptional problem-solving skills, with a demonstrated ability to think creatively and develop innovative solutions for data-related issues. Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders. Self-driven and autonomous work style, capable of taking ownership of projects and delivering high-quality results independently. Experience in guiding and mentoring teams on coding standards, design patterns, and best practices in data engineering.

Join Amgen s Mission of Serving Patients At Amgen, you re part of something bigger our shared mission to serve patients with serious illnesses drives everything we do. Since 1980, we ve been pioneers in the biotech industry, focusing on Oncology, Inflammation, General Medicine, and Rare Diseases, helping millions of patients live longer, fuller lives. Amgen remains on the cutting edge of innovation, combining biology and technology with human genetic data to push beyond what s possible today. Specialist IS Engineer What You ll Do As a Specialist IS Engineer, you will develop and implement the next generation of pharmacovigilance platforms while supporting existing technologies. This includes designing, developing, and deploying complex software solutions while mentoring junior developers. You ll collaborate with cross-functional teams to deliver high-quality, scalable solutions that ensure system reliability and innovation in safety systems. Key Responsibilities Design, develop, and deploy solutions for pharmacovigilance systems to enhance adverse event intake and distribution. Ensure technical implementation aligns with GxP validation processes and IS Change Control standards. Collaborate with partners to prioritize system enhancements and new functionalities for safety systems. Develop innovative solutions using Generative AI and large language models (LLMs) like OpenAI GPT for improved decision-making and efficiency. Rapidly prototype and translate concepts into working code. Drive automation and process improvements within the drug-safety ecosystem. Conduct code reviews and maintain technical documentation for architecture, design, deployment, and disaster recovery. Lead technical root cause analyses and collaborate with software vendors to resolve system-related issues. Basic Qualifications Master s Degree with 4 6 years of experience, or Bachelor s Degree with 6 8 years of experience, or Diploma with 10 12 years of experience in Computer Science, Software Development, or a related field Required Skills Must-Have: Proficiency in SQL, Databricks, and data modeling concepts Experience in Python or JavaScript and reporting tools like Power BI or Tableau Familiarity with PV terminologies and regulatory compliance Hands-on experience with SDLC, ETL tools (Informatica, Databricks), and API integrations (MuleSoft) Strong problem-solving skills, collaborative mindset, and effective communication Knowledge of ITIL processes and GxP validation Nice-to-Have: Experience with COTS Pharmacovigilance Platforms (e.g., Argus) Cloud experience with AWS or Azure Knowledge of AI, Machine Learning (ML), Natural Language Processing (NLP) Professional certifications such as SAFe Agile Software Engineer or SAFe for Teams Soft Skills Strong verbal and written communication skills Analytical and problem-solving mindset Ability to collaborate with global, virtual teams Initiative-driven with an ownership mindset Adaptability and resilience in ambiguous situations What You Can Expect Amgen offers a collaborative, science-driven culture and comprehensive benefits, including competitive salaries, professional growth support, and a focus on your well-being. Shift Information: This role may require working late shifts, with potential for evening or night schedules based on business needs. Apply now to make a real difference in the lives of patients while transforming your career at careers.amgen.com. Equal Opportunity Employer: Amgen is committed to creating a diverse and inclusive environment. We provide reasonable accommodations to individuals with disabilities.

General Summary: Qualcomm is at the forefront of technological innovation, leveraging data-driven insights to power business decisions. We are seeking a Senior/Lead Data Engineer to design, develop, and implement advanced data solutions to support Qualcomm s business goals. This role will involve building scalable data pipelines, integrating large datasets, and collaborating with cross-functional teams to unlock the value of data. As a key technical leader, you will help shape Qualcomm s data infrastructure and work closely with data scientists, analysts, and business stakeholders to ensure the delivery of reliable and high-quality data solutions. Key Responsibilities: Design and implement scalable data pipelines and ETL processes for structured and unstructured data. Develop and optimize data lake, data warehouse, and real-time data processing solutions. Collaborate with data scientists, analysts, and product teams to understand data requirements and translate them into robust data solutions. Ensure data quality, reliability, and security across all data systems and pipelines. Build and maintain data models that support business intelligence and advanced analytics needs. Optimize data workflows for performance, scalability, and cost-efficiency. Provide technical leadership and mentorship to junior data engineers. Stay up to date with emerging technologies and recommend solutions to improve data architecture. Minimum Qualifications: Bachelor s or Master s degree in Computer Science, Information Systems, Engineering, or related field. 5+ years of experience in data engineering or related roles. Proficiency in Python, SQL, and Scala, with experience in building scalable ETL pipelines. Strong experience with big data technologies (e.g., Hadoop, Spark, Kafka). Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Redshift, BigQuery, Snowflake). Solid understanding of data modeling, data architecture, and real-time data processing. Experience with CI/CD, containerization (Docker, Kubernetes), and DevOps practices. Preferred Qualifications: Knowledge of machine learning pipelines and working with data science teams. Experience with streaming data frameworks (e.g., Apache Flink, Spark Streaming). Strong understanding of data governance, compliance, and security best practices. Excellent problem-solving, communication, and team collaboration skills. Why Join Qualcomm? At Qualcomm, you ll work on cutting-edge projects, collaborating with global teams to solve challenging problems. We offer: Continuous learning and growth opportunities. Flexible working arrangements and a supportive work culture. The chance to work with innovative technologies and industry leaders.

About HSBC If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you're aiming to reach the top or seeking an exciting new direction, HSBC offers opportunities, support, and rewards to take you further. As one of the largest banking and financial services organizations globally, with operations across 64 countries and territories, HSBC is committed to enabling businesses to thrive, economies to prosper, and ultimately, helping people fulfill their ambitions. The Role We are seeking an experienced Senior Software Engineer to join our team. You will become part of HSBC s Data Provisioning Technologies team, responsible for managing and working on the cutting edge of CDP (Cloudera Data Platform) and ODP (Open Data Platform) platforms. As part of one of the largest Big Data estates in the banking industry, you will be instrumental in creating engineering solutions for Hadoop platform pipelines and utilizing industry-leading cloud technologies. Responsibilities Contribute to Hadoop Engineering tasks, developing solutions for data pipeline management on CDP/ODP platforms. Work with Python, Ansible, and Kubernetes to create scalable, efficient solutions within a Big Data environment. Collaborate with the Data/Analytics teams to ensure the smooth operation of data systems and platforms. Design and implement technical solutions while adhering to best practices for CI/CD, DevOps, and GitOps methodologies. Develop and support solutions utilizing cloud technologies, ensuring the scalability and robustness of platforms. Contribute to debugging, troubleshooting, and maintaining the high-quality performance of data systems. Utilize Shell scripting, YAML, and modern automation tools to improve deployment and operational efficiency. Work with GitHub, Jenkins, Ansible for version control, continuous integration, and deployment. Requirements To be successful in this role, you should meet the following requirements: 3-6 years of experience in Hadoop Engineering with practical expertise in Python, Ansible, and DevOps methodologies. Strong knowledge of HDP (Hadoop Distribution), CDP, Linux, Python, Ansible, and Kubernetes. Proficient in Shell scripting, YAML, and technical design. Strong understanding of CI/CD concepts and hands-on experience with tools like GitHub, Jenkins, and Ansible. Familiarity with Test automation tools such as JUnit, Selenium, and Cucumber. Experience with industry-leading Cloud technologies and hands-on development in cloud environments. Working knowledge of GitOps and DevSecOps principles. Knowledgeable in Agile methodologies and ideally, certified in one of the frameworks. Strong communication and networking skills, with the ability to collaborate across teams. Ability to work autonomously, take accountability, and drive results in a high-pressure environment. A strong commitment to high-quality standards, and ownership of individual contributions. You ll have the opportunity to work on innovative projects at the forefront of the banking industry. A global platform with exposure to diverse teams and technologies. Join a company committed to professional development and career growth. Achieve more when you join HSBC. Qualification : 3-6 Years Experience in Hadoop Engineering with working experience on Python, Ansible DevOps methodologies.

Data Engineer Location: Noida Experience: 2 5 Years Employment Type: Full Time About Times Internet Times Internet is India s largest digital products company, building premium digital platforms across diverse sectors like News, Sports, Fintech, and Enterprise Solutions. Our brands such as TOI, ET, Cricbuzz, Times Prime, Willow TV, and Whatshot reach millions and are designed to simplify and enrich everyday experiences. We take pride in fostering an inclusive, innovative workplace. As an equal opportunity employer, we ve maintained gender pay parity (independently verified by Aon Hewitt) and are committed to building a diverse and equitable team. About the Business Unit ET B2B The Economic Times B2B Verticals (ETB2B) is a leading business media platform, delivering insightful content, newsletters, and premium conferences across 23+ sectors including Auto, Energy, Pharma, Retail, and HR. With a monthly reach of over 8 million professionals, ETB2B powers business decision-making and industry learning through platforms like ET Masterclass, vConfex, and the ET B2B Intent Signal Platform a cutting-edge initiative leveraging behavioral data, enrichment tools, and event-driven insights. Role Overview As a Data Engineer, you will work on building scalable data pipelines, deploying machine learning models, and extracting actionable buyer intent signals using a variety of data sources and advanced ML/NLP techniques. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines to process large-scale structured and unstructured data (web behavior, CRM, third-party APIs, etc.). Build predictive models to extract buyer intent signals, leveraging NLP, behavioral analytics, and pattern recognition. Use modern ML and NLP tools: spaCy, Transformers, Scikit-learn, TensorFlow, PyTorch, and OpenAI APIs. Collaborate with product managers, backend engineers, and data scientists to deploy models into production and optimize performance. Ensure data pipeline reliability, compliance (GDPR, SOC 2), and freshness through robust monitoring and alerting systems. Enhance pipeline and model inference efficiency for near real-time scoring applications. Document workflows, model performance, and pipeline architecture for internal transparency and reproducibility. Required Skills & Qualifications Strong experience in Python for data engineering, ML pipelines, and model integration. Proficiency with ETL tools (Airflow, Prefect), data processing frameworks (Pandas, Dask), and workflow orchestration. Knowledge of machine learning and NLP techniques (entity extraction, sentiment analysis, text classification). Familiarity with ML model deployment via Docker, Kubernetes, and cloud ML services (AWS SageMaker, GCP AI Platform, Azure ML). Experience with relational databases (PostgreSQL, MySQL) and cloud data warehouses (BigQuery, Redshift, Snowflake). Strong grasp of version control (Git), CI/CD pipelines, and agile collaboration tools. Ability to interpret, visualize, and communicate model insights effectively working alongside analysts or through dashboards. Education & Experience Bachelor s or Master s degree in Computer Science, Data Science, Statistics, or a related technical field. 2 5 years of hands-on experience in data engineering, applied ML, or software development, ideally in SaaS, Martech, or B2B analytics domains. Be part of India s largest digital ecosystem. Work on impactful, high-scale products with real-world value. Collaborate with top minds in data, AI, and product development. Enjoy a culture of innovation, inclusion, and continuous growth. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Statistics, or a related technical field