Data Engineer Jobs in Hyderabad
376 Jobs Found
Data Engineering Manager
Kanerika Software
Job Title: Data Engineering Manager Location: Hyderabad About Kanerika Kanerika Inc. is a leading global software products and services company dedicated to empowering data-driven enterprises. We help businesses accelerate digital transformation and maximize impact by delivering innovative, custom data solutions that optimize operations, enhance customer experiences, and fuel growth. Our Accolades Best Place to Work 2022 Great Place to Work Top 10 Most Recommended RPA Startups 2022 RPA Today Technology Innovation Award 2021 Frost & Sullivan India for Kompass composable solution Recognized for strong data privacy and security standards: ISO 27701, SOC2, GDPR compliant With a 4.5/5 Glassdoor rating, Kanerika fosters an inclusive, growth-oriented culture where employees thrive. We offer: Flexible working hours and generous parental leave Mandatory training on a safe and inclusive work environment Mentorship, professional development, and certification support Company-sponsored outings and work-life balance initiatives Join a vibrant, diverse community where your contributions truly matter. The Role We are looking for an experienced Data Engineering Manager to lead and inspire our data engineering team in Hyderabad. Partnering closely with Data Architects, you ll drive the design and development of scalable, cloud-based data pipelines and models, ensuring data quality, security, and performance. What You ll Do Lead and mentor a high-performing data engineering team, driving productivity and accountability. Collaborate with architects and development leads to build scalable, enterprise-grade data solutions. Oversee agile workflows, manage escalations, and coordinate hiring and resource planning. Use data-driven insights to guide team priorities and continuous improvement. Support pre-sales activities and work cross-functionally with sales and recruitment teams. Foster a culture of innovation, quality-first mindset, and customer focus. Who You Are A proactive leader with experience managing mid to large-sized teams and complex projects. An effective communicator, both verbally and in writing, with a knack for visually presenting ideas and core values. Results-oriented with a proven track record of delivering successful projects and publishing customer case studies. A process-driven, independent thinker who thrives under pressure and embraces continuous learning. Passionate about inclusivity and committed to contributing authentically to a diverse team environment.
Senior Data Engineer
Blend360 India
Senior Data Engineer Hyderabad (On-site, Full-time) Location: Hyderabad, Telangana Work Type: On-site, Full-time Experience: 5+ Years Industry: AI & Data Science Company: Blend About Blend: Blend is a leading AI services company focused on solving real-world problems through the fusion of artificial intelligence, data science, and human ingenuity. We believe in co-creating meaningful impact by aligning top-tier talent with cutting-edge technology. Our goal is to deliver transformative solutions that unlock value for our clients and enrich the work and lives of our people. Job Overview: We are seeking a highly skilled Senior Data Engineer with strong experience in AWS, Databricks, Python, SQL, and Apache Spark/PySpark. You will be responsible for designing, developing, and maintaining scalable data architectures and pipelines to support analytics, machine learning, and business intelligence efforts across the organization. Key Responsibilities: Design and build scalable data pipelines using AWS services (Glue, Lambda, S3, EMR) and Databricks Notebooks & Workflows. Develop and manage robust ETL/ELT workflows using Python and SQL to handle structured and semi-structured data. Implement distributed data processing using Apache Spark or PySpark. Create and maintain data lakes in AWS Databricks. Collaborate with data scientists, analysts, and cross-functional teams to provide high-quality, accessible datasets. Ensure adherence to data governance, quality, and security best practices. Monitor, troubleshoot, and optimize the performance of data systems. Conduct code reviews and enforce engineering best practices. Mentor junior engineers and support their technical growth. Required Qualifications: Bachelor's or Master s degree in Computer Science, Engineering, or related field. 5+ years of experience in Data Engineering, with 2+ years working in AWS Databricks environments. Strong programming skills in Python for data processing and workflow automation. Advanced expertise in SQL for data transformation and querying large datasets. Proficient in distributed data processing using Apache Spark/PySpark. Solid understanding of data modeling, data warehousing, and performance optimization techniques. Hands-on experience with AWS services such as Glue, S3, Lambda, and EMR. Familiarity with version control tools like Git or CodeCommit. Experience with workflow orchestration tools like Airflow or AWS Step Functions (preferred but not mandatory). Be part of a forward-thinking, AI-driven organization. Work with cutting-edge cloud technologies and data platforms. Thrive in a culture of innovation, mentorship, and continuous learning. Enjoy opportunities to grow technically and professionally while driving real-world impact. Apply Now to join Blend as a Senior Data Engineer and help build data infrastructure that powers intelligent decision-making. Qualification : Bachelor's or Masters degree in Computer Science, Engineering, or related field.
Azure Data Engineer (mid)
Syren Technologies
Azure Data Engineer (Mid-Level) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience Level: 5+ Years Industry: Information Technology / Cloud Data Engineering Job Overview We are hiring an experienced Azure Data Engineer (Mid-Level) to join our team in Hyderabad. In this role, you will work closely with business stakeholders, analysts, and IT teams to design, implement, and manage scalable, high-performance data solutions on the Azure Cloud Platform. Your expertise in data modeling, ETL development, and cloud-based data warehousing will be critical in supporting data-driven decision-making across the organization. Key Responsibilities Analyze large datasets and deliver clear, actionable reports using statistical techniques. Design and implement data pipelines, data collection systems, and analytics strategies that enhance operational efficiency. Develop and maintain data systems, ensuring high data quality, consistency, and integrity. Collaborate with business stakeholders, analysts, and developers to translate business requirements into technical solutions. Design, build, and manage distributed data systems and applications on the Azure Cloud. Lead and execute ETL development, including data extraction, transformation, and loading using tools like Informatica or SSIS. Conduct technical design reviews, performance tuning, and testing of data workflows. Adapt to changing priorities and contribute as an individual contributor or team leader depending on project scope. Required Qualifications & Skills Bachelor s degree in Computer Science, Information Systems, or a related field. Minimum 5+ years of experience in data engineering, data analysis, or database design. Proficient in SQL and T-SQL for querying and managing relational databases. Hands-on experience with ETL frameworks such as Informatica or SSIS. Strong understanding of data modeling, data mining, and segmentation techniques. Experience working with structured and unstructured data sources. Proficient in statistical tools and packages (Excel, SSIS, SAS, etc.). Strong analytical mindset with excellent attention to detail and data accuracy. Preferred Skills (Good to Have) Experience with Python and Apache Spark for data manipulation and automation. Experience with modern data platforms: Azure Synapse Analytics Azure Databricks Amazon Redshift Prior experience in developing automation solutions using Python or similar scripting languages. Knowledge of Enterprise Data Warehousing (EDW) concepts and solutions. Competitive compensation package with benefits. Work with cutting-edge cloud technologies in real-world environments. Collaborative, fast-paced, and innovation-driven workplace. Career development support with continuous learning opportunities. A chance to make a tangible impact on enterprise-level data systems. Apply Now If you are a data-driven professional with a strong command of Azure and ETL tools, and you re looking to advance your career in data engineering, apply now and become part of a forward-thinking tech team based in Hyderabad! Qualification : Bachelors degree in Computer Science, Information Systems, or a related field.
Data Engineering Support Engineer - Sima
Syren Technologies
Data Engineering Support Engineer SIMA (5+ Years) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience: 5+ Years Industry: Data Engineering / Cloud Support Job Overview We are seeking an experienced Data Engineering Support Engineer with a strong background in maintaining and optimizing data pipelines, ensuring platform reliability, and supporting cloud data infrastructure. This role is critical to sustaining smooth data operations for the SIMA platform in Hyderabad. Key Responsibilities Maintain and support data pipelines and transformations on Azure cloud platforms. Ensure platform stability and reliability through proactive monitoring and issue resolution. Manage scheduling and monitoring using Azure Data Factory (ADF) triggers, Azure Monitor, and Log Analytics (KQL). Handle data ingestion and validation workflows via ADF, Event Hub, APIs, and PySpark, including managing schema drift. Manage CI/CD pipelines using Azure DevOps YAML, deploying solutions for ADF, Synapse, and Databricks. Optimize data transformations and performance using PySpark and Delta Lake techniques like partitioning and caching. Implement and maintain security best practices using Azure RBAC, Key Vault, NSGs, and Integration Runtime configuration. Conduct Root Cause Analysis (RCA), document findings, maintain disaster recovery playbooks, and implement proactive alerting. Required Skills 5+ years of hands-on experience in data engineering support roles. Expertise in Azure Data Factory (ADF) scheduling, triggers, and monitoring. Proficient with PySpark for data transformations and performance optimization. Experience with Delta Lake optimizations including partitioning and caching. Skilled in CI/CD practices using Azure DevOps for deploying data workflows. Strong knowledge of Azure security features: RBAC, Key Vault, Network Security Groups (NSGs). Ability to perform detailed Root Cause Analysis (RCA) and develop disaster recovery strategies. Familiarity with data ingestion tools like Event Hub and API integrations. Experience with Kusto Query Language (KQL) for Log Analytics queries. Join a dynamic team maintaining critical data infrastructure supporting business operations. Work with advanced Azure data services and cloud-based data platforms. Competitive salary and comprehensive benefits. Opportunity for growth and skill development in cloud data engineering. Apply Now If you are a detail-oriented data engineering professional with expertise in Azure platform support, apply today to become a vital part of our Hyderabad-based SIMA team!
Senior Data Engineer
Wallero Technologies
Job Title: Senior Data Engineer Location: Hyderabad, Telangana, India Job Type: Full-Time | Permanent Experience Required: 6+ Years Open Positions: 2 About the Role: We are seeking a highly skilled and experienced Data Engineer to join our team in Hyderabad. As a key member of our data engineering unit, you will be responsible for designing and optimizing end-to-end data pipelines using Python, PySpark, and Databricks. This role requires strong technical expertise, a passion for solving complex data challenges, and the ability to lead best practices within the Supply Chain data domain. Key Responsibilities: Develop and maintain scalable data pipelines using Python, PySpark, and Databricks for complex data transformation within Supply Chain operations. Implement advanced data engineering solutions that support real-time and batch data processing for analytics and business intelligence. Analyze, optimize, and refactor existing data workflows to improve performance and reliability. Collaborate with cross-functional teams to understand data requirements and translate them into robust technical solutions. Take ownership of projects and deliver high-quality outcomes with minimal supervision. Provide leadership and guidance on coding standards, design patterns, and data engineering best practices. Clearly communicate technical ideas and solutions to both technical and non-technical stakeholders. Required Skills & Qualifications: 6+ years of hands-on experience in data engineering. Proficient in Python, PySpark, and Databricks for building and maintaining data pipelines. Strong problem-solving skills with a proven ability to create innovative solutions for complex data challenges. Excellent communication and interpersonal skills; able to work effectively with cross-functional teams. Experience leading and mentoring team members on technical best practices and architecture decisions. Ability to work independently, manage priorities, and drive projects to completion with minimal oversight. Perks & Benefits: Competitive compensation package Exposure to cutting-edge technologies in cloud-based data engineering Opportunity to work on large-scale Supply Chain data solutions Collaborative, innovation-driven work environment Career growth and mentorship opportunities
Staff Software Engineer, Google Cloud Databases
Google Careers
Staff Software Engineer Google Cloud Databases Location: Hyderabad, Telangana, India Minimum Qualifications Bachelor s degree or equivalent practical experience. 8+ years of software development experience, including strong data structures and algorithms knowledge. 5+ years of experience testing and launching software products. 3+ years of experience with software design and architecture. Preferred Qualifications Master s or PhD in Engineering, Computer Science, or related technical field. 3+ years in a technical leadership role, leading projects and setting technical direction. Experience collaborating on cross-functional or cross-business projects. Proficiency in C++ and related frameworks. Knowledge of storage technologies such as SAN, NAS, Object Storage, and Cloud Storage. About the Role At Google Cloud, software engineers innovate on technologies that transform how billions connect, explore, and engage with data and services globally. As a Staff Software Engineer focused on Google Cloud Databases, you will design and develop scalable, reliable distributed database services that meet demanding performance and availability requirements. You will be empowered to act like an owner, anticipate customer needs, and innovate across the full stack. Your work will directly impact the performance and reliability of core Google Cloud services used worldwide. Responsibilities Architect, develop, and maintain scalable, high-performance backend services for distributed database systems. Own end-to-end module design and implementation with a focus on engineering excellence. Produce high-quality, well-documented, maintainable codebases. Lead code reviews to ensure consistent quality and best practices. Mentor and guide junior engineers, fostering their technical development and career growth. Collaborate closely with cross-functional teams including Product Management, UX/UI, and customers to deliver impactful solutions. About Google Cloud Google Cloud empowers organizations worldwide to digitally transform their operations with enterprise-grade solutions built on Google s cutting-edge technology. Serving customers in over 200 countries and territories, Google Cloud is a trusted partner for growth and innovation across industries. Qualification : Bachelor's degree or equivalent practical experience.
Senior Data Scientist
Microsoft
Senior Data Scientist Location: Hyderabad, Telangana, India Employment Type: Full-Time Overview Microsoft Search powers delightful and relevant experiences for enterprise users, and AI-driven Copilots have turned futuristic visions into current-day reality. We are seeking candidates who can help build the next-generation machine learning systems to drive innovation in search ranking, clustering, recommendation systems, and much more. As a Senior Data Scientist in the team, you will work independently on complex problems, define success metrics, and contribute to design and review processes for machine learning/data pipelines across the team. If you're ready to tackle challenging data science problems and help shape the future of search, we want you on our team! Key Responsibilities End-to-End Ranking: Oversee the ranking of search results and contribute to enhancing search relevance. Large Language Models (LLMs): Work on developing and deploying large language models to improve search experience and AI-powered copilots. AI-powered Copilot Scenarios: Drive innovations in AI systems that enhance user productivity and engagement through Copilot capabilities. Compliance & Privacy: Develop machine learning training pipelines at scale that are privacy and compliance-aware. Personalization: Customize search results and recommend relevant content based on user preferences. Qualifications Required Qualifications: Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or a related field AND 2+ years of data science experience OR Master s Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or a related field AND 5+ years of data science experience OR Bachelor s Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 7+ years of data science experience. Experience working with both structured and unstructured data, applying statistical techniques, and reporting results. Hands-on experience with implementing and shipping production-quality machine learning models or data pipelines. 2+ years of customer-facing, project-delivery experience, professional services, and/or consulting experience. Strong programming skills in Python, R, or similar languages, and familiarity with machine learning libraries. Preferred Qualifications: Prior work or research experience in the Search domain is highly preferred. Familiarity with large-scale distributed systems, cloud platforms (such as Azure), and real-time machine learning applications. Experience with deep learning and large language models (LLMs). Familiarity with compliance and privacy in machine learning pipelines. Microsoft s mission is to empower every person and organization on the planet to achieve more. At Microsoft Search, you will be part of a team solving impactful problems for millions globally. Join us to drive cutting-edge advancements in AI and contribute to shaping the future of search and user experiences. Employee Benefits Industry-leading healthcare coverage Generous time off and family leave policies Access to educational resources and professional development Employee discounts on Microsoft products and services Opportunities for networking and global collaborations Inclusive and supportive work environment with a focus on work-life balance Microsoft is an equal opportunity employer. We are committed to creating a diverse and inclusive environment where every individual is treated with respect and can thrive. Join us to make a global impact through innovation, collaboration, and diversity.
Solutions Architect
Kore.ai
Job Opening: Solutions Architect Location: Hyderabad | Full-Time About Kore.ai Kore.ai is a pioneering force in enterprise AI transformation, empowering organizations through our comprehensive agentic AI platform. With innovative offerings across "AI for Service," "AI for Work," and "AI for Process," we enable over 400+ Global 2000 companies to fundamentally reimagine their operations, customer experiences, and employee productivity. Our end-to-end platform enables enterprises to build, deploy, manage, monitor, and continuously improve agentic applications at scale. We've automated over 1 billion interactions every year with voice and digital AI in customer service, and transformed employee experiences for tens of thousands of employees through productivity and AI-driven workflow automation. Recognized as a leader by Gartner, Forrester, IDC, ISG, and Everest, Kore.ai has secured Series D funding of $150M, including strategic investment from NVIDIA to drive Enterprise AI innovation. Founded in 2014 and headquartered in Florida, we maintain a global presence with offices in India, the UK, Germany, Korea, and Japan. About the Role The Solutions Architect will play a key role in translating business requirements into technical specifications and designing cutting-edge solutions to meet customer needs. The role involves creating detailed design documents, defining implementation strategies, and collaborating with teams to develop high-quality, scalable applications. As a leader, you will work closely with clients to propose technical solutions that resolve business issues while driving the overall architecture and technical direction. What You'll Do Design & Architecture: Prepare detailed design documents and approaches using various tools. Define implementation approaches, algorithms, and code structure to meet requirements. Technical Leadership: Lead the analysis, design, and implementation planning of technical/business solutions. Take a cross-team leadership role to ensure the solution aligns with business objectives. Customer Interaction: Interface with customers to understand their technical environments and propose technical solutions to resolve business challenges. Technology Selection: Stay up to date with the latest technologies and tools, evaluating and selecting appropriate technologies as per project requirements. System Integration: Identify interfaces with other products and ensure seamless integration. Work on scaling and optimizing the performance of large systems and web applications. Development & Implementation: Define and create SOAP & RESTful web services. Work on reporting & analytics, and consumer/employee-facing business applications. Qualifications & Experience Experience: 10+ years of overall technical experience with a minimum of 3 years as a Technical Solution Architect. Technical Skills: Experience in OOPS, Multi-threading, JavaScript, jQuery, Node.js, HTML5, CSS3, and user authentication/authorization models. System Design & Architecture: Experience in defining technical solutions, creating technical specifications, and working on large-scale systems and web applications. Experience in API Development: Expertise in SOAP & RESTful web services, along with experience in system integration and reporting & analytics. Nice to Have: Experience in Smartbot development and integrating with NLP engines, and familiarity with AI frameworks and technologies. Education Qualification Graduate in Engineering or Master's in Computer Applications (MCA) preferred. Be a part of a global leader in AI technology, driving transformation in enterprise operations and customer experiences. Work in an innovative environment with cutting-edge technologies, where you ll lead technical solutions that impact global businesses. Collaborate with a talented team and contribute to building scalable, impactful AI applications that are transforming industries. Kore.ai, founded in 2014 by serial entrepreneur Raj Koneru, is headquartered in Florida, USA, with additional offices in India, the UK, Germany, Korea, and Japan. Our diverse and talented team of professionals is committed to driving the future of enterprise AI solutions. We ve earned recognition from top analysts like Gartner, Forrester, and IDC, making us a leader in the AI space. Qualification : Graduate in Engineering or Master's in Computer Applications (MCA) preferred.
Azure Data Engineer
Quadrant Technologies
Job Title: Azure Data Engineer Location: Hyderabad / Bangalore (Hybrid) Job Type: Full-time Salary: Negotiable Position Overview: We are looking for an Azure Data Engineer with 5-8 years of experience to join our team. As an Azure Data Engineer, you will design, implement, and manage data solutions on the Microsoft Azure cloud platform. The ideal candidate will have a strong background in writing complex SQL stored procedures, implementing OLTP database solutions using Microsoft SQL Server, and working with Azure Synapse, PySpark, and Azure Databricks for big data processing. Key Responsibilities: Data Integration and Collaboration: Collaborate with cross-functional teams to gather, analyze, and document business requirements for data integration projects. Complex SQL Expertise: Write and optimize complex T-SQL, Dynamic SQL, and Spark SQL queries, including the creation of stored procedures for data transformation and business validation logic. Big Data Processing: Utilize Azure Synapse/Databricks to write notebooks using Spark SQL or PySpark for processing and analyzing large volumes of data. Data Pipeline Development: Develop and maintain robust data pipelines using Azure Data Factory to ensure seamless data flow across systems. OLTP Systems: Contribute to the enhancement and optimization of OLTP systems using SQL Server. Data Quality and Integrity: Ensure data quality, integrity, and accuracy in all systems. Programming and Algorithm Development: Utilize strong algorithmic programming skills to handle data processing and transformation. Qualifications: Educational Background: Bachelor s degree in Computer Science, Information Technology, or a related field. Experience: 5-8 years of experience in database development, data integration, and writing complex T-SQL queries. Technical Skills: Expertise in T-SQL and Spark SQL/PySpark (experience with Azure Synapse and Databricks is essential). Hands-on experience with Azure Data Factory for building data pipelines. Strong experience with OLTP systems using SQL Server. Problem-Solving Skills: Excellent problem-solving abilities with a strong focus on attention to detail. Adaptability: Ability to work in a collaborative and fast-paced environment, focusing on delivering high-quality solutions. Other Details: Notice Period: 0-15 days MAX Work Location: Hyderabad / Bangalore (Hybrid) If you're an experienced Azure Data Engineer with a passion for big data and cloud technologies, apply now to join our team and make an impact with innovative data solutions! Qualification : Bachelors degree in Computer Science, Information Technology, or a related field.
Senior Data Engineer
Zessta Software Services Pvt.ltd.
Job Title: Senior Data Engineer Company Name: Zessta Job Type: Full-time Responsibilities: Analyze customer data to enhance customer experience and provide actionable insights. Build and maintain integrations to support advanced data science workflows, ensuring seamless interaction with the Product API. Actively participate in onboarding and training clients on how to use the product effectively. Provide insights into client-to-business interactions, ensuring that the data can be leveraged for strategic decisions. Act as a liaison between the client and the organization, ensuring both parties' needs and expectations are met. Identify opportunities for clients to expand their usage of the product, driving engagement and long-term value. Address customer complaints and requests, offering product support to improve overall satisfaction and experience. Skills and Experience: Excellent communication and interpersonal skills to work effectively with clients and internal teams. Strong understanding of data modeling and architecture. Hands-on experience with data integrations and data pipelining tools to connect systems and enable smooth data flow. Proficiency in programming languages, preferably Python or R, to process and analyze data. Experience with container orchestration platforms like Docker and Kubernetes. Familiarity with distributed computing frameworks such as Spark, Hadoop, and Dask to handle large-scale data processing. Experience with version control software such as Git to manage code and collaborate with teams. Knowledge of project management tools such as JIRA to track and manage project progress and tasks. Familiarity with tools like Figma and Mixpanel is a plus. Education and Experience: Bachelor s or Master s degree from premier institutes (preferred). 4-12 years of relevant experience in data engineering, data science, or related fields. What We Offer: Competitive salary and benefits package. Opportunities for career growth and skill development. The chance to work on cutting-edge technologies and impactful projects. If you have a passion for data engineering and improving customer experience, and you're ready to take on new challenges, we'd love to hear from you. Apply now to join our team at Zessta and contribute to driving innovation and business success! Qualification : Bachelors or Masters degree from premier institutes (preferred).
Data Engineer-data Platforms
International Business Machines Corporation
Introduction In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients globally. Our centers provide locally-based skills and technical expertise to drive innovation and the adoption of new technologies. A career at IBM Consulting involves building long-term relationships and collaborating closely with clients across industries. You'll work alongside visionaries to help them on their hybrid cloud and AI journeys, enhancing the value and impact of some of the most innovative companies in the world. With access to IBM s strategic partner ecosystem and cutting-edge technology platforms, including IBM Software and Red Hat, you will be empowered to accelerate client transformations and create meaningful change. Curiosity and a constant quest for knowledge serve as the foundation for success at IBM. In your role, you'll be encouraged to challenge the status quo, explore ideas beyond your current role, and come up with creative solutions that will make a significant impact across a wide network of clients. Our culture of evolution and empathy is centered on long-term career growth and development opportunities in an environment that celebrates your unique skills and experience. Your Role and Responsibilities As a Data Engineer at IBM, you will be a critical player in designing and developing applications, while also providing guidance to project teams on complex coding, troubleshooting, and execution. Your key responsibilities include: Solution Design and Construction: Lead the design and construction of new data solutions using the latest technologies, ensuring business value and meeting user requirements. Continuous Improvement: Advocate for continuous improvement by testing solutions and working within an Agile framework to enhance and iterate the developed solutions. Innovation: Stay current with the latest technology trends, discovering and implementing creative solutions to solve business problems. Collaboration: Work with diverse teams to deliver impactful data solutions while ensuring scalability, quality, and performance. Required Education Bachelor s Degree in a relevant field Required Technical and Professional Expertise Apache Spark (PySpark): In-depth knowledge of Spark s architecture, core APIs, and using PySpark for distributed data processing. Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts. Proficiency in Python: Expertise in Python programming, particularly focused on data processing and manipulation. Data Processing Frameworks: Experience with Pandas, NumPy, and other data processing libraries. SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation. Cloud Platforms: Experience working with cloud platforms such as AWS, Azure, or GCP, including working with cloud storage systems. Preferred Technical and Professional Experience Architecture Strategy: Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring of data solutions. Cross-Team Collaboration: Partnering with technology teams, including application development, enterprise architecture, testing services, and network engineering. Security: Familiarity with detection and prevention tools for company products and customer-facing platforms. How You ll Grow At IBM, we offer opportunities for career development and provide an environment where you are encouraged to continuously grow, learn, and expand your expertise. Working with cutting-edge technologies and a diverse set of clients, you will be able to stay ahead of industry trends and make meaningful contributions that have a real impact. About IBM Consulting IBM Consulting helps organizations tackle their most pressing challenges through innovative and agile solutions. By partnering with clients, we drive technology transformations, helping them optimize their operations and leverage new technologies like AI, cloud, and data. Our team s expertise spans across many industries, delivering solutions that enable clients to navigate digital transformations. This role offers an exciting opportunity to work with leading technologies while contributing to client success in a highly dynamic environment. If you re passionate about solving complex data problems and delivering impactful solutions, IBM Consulting is the place to grow your career. Qualification : Bachelors Degree in a relevant field
Cybersecurity Data/ Detection/ Implementation Engineer
Netenrich Technologies
Job Summary We are seeking a skilled and experienced Cybersecurity Detection and Implementation Engineer with expertise in YARA rules creation, playbook implementation, and data ingestion techniques. This role presents an exciting opportunity to contribute to the design and implementation of cutting-edge cybersecurity solutions while collaborating with a talented team of professionals. Responsibilities Design, develop, and maintain YARA rules for threat detection and malware analysis, ensuring high accuracy and effectiveness. Conduct research and analysis to identify emerging threats and vulnerabilities and develop proactive detection mechanisms. Identify and implement detection use cases based on emerging threats and TTPs using MITRE ATT&CK framework. Contribute to optimization of detection rules to eliminate false positives and improve detection efficiency. Collaborate with cross-functional teams to understand customer requirements and customize cybersecurity solutions to meet their needs. Participate in security incident response activities, providing technical expertise and support as needed. Stay abreast of the latest cybersecurity trends, technologies, and best practices, and share knowledge with the team. Work closely with customers to understand their security challenges and requirements and provide expert guidance and support. Qualifications Bachelor s degree in computer science, Information Security, or related field. 3 years of experience in cybersecurity, with a focus on detection engineering and implementation. Proficiency in creating and maintaining YARA rules for threat detection and malware analysis. Solid understanding of MITRE ATT&CK framework and developing detection rules based on it. Solid understanding of data ingestion techniques and technologies, including log management systems and data lakes. Knowledge and experience in developing use cases for Cloud, Identity, Endpoint and Data Exfiltration use cases. Hands-on experience with SIEM (Security Information and Event Management) solutions such as Splunk, ELK, or QRadar. Excellent analytical and problem-solving skills, with the ability to troubleshoot complex technical issues. Strong communication and interpersonal skills, with the ability to effectively collaborate with internal teams and customers. Relevant cybersecurity certifications (e.g., CISSP, CEH, GIAC) are a plus. If you are a passionate and driven cybersecurity professional with expertise in writing detection rules and is enthusiastic about emerging threats and protecting customers, we want to hear from you. Join us in our mission to protect our organization and our customers from cyber threats. Qualification : Bachelors degree in computer science, Information Security, or related field.
Senior Data Engineer
Omniwyse Technologies
Job Description We are looking for a passionate engineer interested in working at an early-stage startup building innovative cloud-native data protection solutions. The ideal candidate must be comfortable learning and scoping business requirements to develop effective solutions. This is a great opportunity for engineers who are eager to step out of their comfort zone and solve impactful modern data security concerns. Desired Background and Experience: Must be a problem solver with the ability to think critically and creatively. Minimum of 8 years of experience building products using Java and/or Python. Prior experience in startups is a huge plus. Comfortable with rapid prototyping and implementation of products in an agile team environment. Data engineering experience with implementation of data ingestion, ETL, data pipeline/workflows. Experience implementing database views and UDFs to control access to data using row and column filters. Working experience in databases and data warehouses. Proficient in one or more of the following: AWS RDS, AWS Data Lake, Redshift, Athena, Databricks, and Snowflake. Experience implementing data solutions using Spark. Ability to write and tune complex SQL queries.
Data Engineer
Wallero Technologies
Job Description Location: Hyderabad, Telangana, India Job Type: Permanent (full-time) Experience: 6+ years No. of Openings: 2 Key Responsibilities: Tech Stack Expertise: Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. Innovative Problem-Solving: Demonstrate technical expertise by thinking creatively and providing innovative solutions to complex data-related challenges, pushing boundaries in Supply Chain data analytics. Communication Skills: Exceptional communication abilities to effectively convey technical concepts, collaborate with cross-functional teams, and articulate solutions to non-technical stakeholders. Autonomous Work: Ability to work independently and proactively, taking ownership of projects, and delivering high-quality solutions with minimal supervision. Guidance and Best Practices: Lead the team by setting coding standards, advocating for reusable and modularized code, implementing design patterns, and guiding on best practices in data engineering. Perks and Benefits: Strong expertise in Python, Pyspark, and Databricks, with hands-on experience in developing and optimizing data pipelines for complex data transformations. Exceptional problem-solving skills, with a demonstrated ability to think creatively and develop innovative solutions for data-related issues. Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders. Self-driven and autonomous work style, capable of taking ownership of projects and delivering high-quality results independently. Experience in guiding and mentoring teams on coding standards, design patterns, and best practices in data engineering.
AI/ML Developer
Infor
Position: AI/ML Developer Company: Infor Location: Hyderabad, India Experience: 2-5 years Skills: AI/ML, Python, AWS, SQL Role Summary: As an AI/ML Developer at Infor, you will be at the forefront of creating and delivering state-of-the-art enterprise applications and automation solutions powered by Infor s AI, RPA, and OS platform technologies. Your primary mission will be to identify impactful AI/ML use cases, develop proof of concepts (PoCs), and deliver automation solutions that drive workforce productivity and enhance business outcomes for our clients. Key Responsibilities: Use Case Identification: Work closely with customers to understand their business challenges and identify opportunities for AI/ML solutions to address these needs. Data Insights: Perform exploratory data analysis on large, complex datasets to uncover key insights. Assess data quality and share findings that can inform decision-making. Data Preparation: Collect, clean, preprocess, and augment datasets for training and testing AI models, ensuring they are ready for AI tasks. Model Development: Design, train, and fine-tune AI/ML models, evaluating them against appropriate performance metrics and optimizing for maximum efficiency. Integration & Deployment: Partner with software engineers to integrate AI/ML models seamlessly into enterprise applications and systems. Address deployment challenges to ensure smooth production workflows. Continuous Improvement: Monitor the performance of deployed AI models, gather user feedback, and iterate to improve models, algorithms, and user experience. Proof of Concepts (PoCs): Develop PoCs to demonstrate the feasibility and effectiveness of AI/ML solutions, showcasing the potential of new technologies to clients. Collaboration: Work closely with development teams to explore and implement new use cases for AI and automation. Best Practices: Collaborate with your team to establish best practices and ensure high-quality development standards. Innovation: Contribute to the innovation of cloud-based enterprise automation solutions and the development of cutting-edge AI technologies. Key Requirements: Experience: Minimum 3 years of hands-on experience in implementing AI/ML models in enterprise environments. AI/ML Knowledge: Strong understanding of supervised and unsupervised learning, reinforcement learning, deep learning, and probabilistic models. Programming Skills: Proficiency in Python or R, with experience in SQL for querying databases. Data Handling: Expertise in working with large datasets, performing data preprocessing, and effectively managing data pipelines. Cloud Infrastructure: Experience with AWS Sagemaker or Azure ML is preferred for deploying machine learning solutions. Frameworks & Libraries: Familiarity with machine learning libraries like scikit-learn, Keras, TensorFlow, PyTorch, or NLTK is a plus. Analytical Skills: Strong critical thinking and problem-solving abilities, with the capacity to design and run experiments to validate hypotheses. Business Process Understanding: Knowledge of business processes and how they can be automated through AI and ML. Domain Expertise: Experience or interest in areas like Demand Forecasting, Anomaly Detection, Pricing, Recommendations, or Analytics. Global Experience: Proven experience in working with global customers on diverse projects, understanding their needs, and delivering tailored solutions. Communication Skills: Excellent verbal and written communication skills, with the ability to clearly explain complex AI concepts to clients and team members. Collaboration & Independence: Ability to work both independently and as part of a team, collaborating with cross-functional teams to drive success. Educational Background: A Bachelor's or Master's degree in Computer Science, Mathematics, Statistics, or a related field. Specialization: Coursework or expertise in AI, ML, Deep Learning, NLP/NLU, Computer Vision, or similar domains is highly desirable.
Senior Software Engineer
Blend360 India
Role Overview: We are looking for an experienced Senior Python Engineer with expertise in FastAPI and microservices architecture to join our dynamic team. In this role, you will lead the design, development, and deployment of scalable and resilient backend services. The ideal candidate will have a strong technical background in Python development, microservices architecture, and FastAPI, along with proven experience leading technical teams and ensuring high performance, security, and maintainability of applications. Key Responsibilities: Lead the design, development, and deployment of microservice-based applications, ensuring scalability and resilience. Develop and maintain FastAPI-based backend services with a focus on performance, security, and scalability. Implement best practices in logging, monitoring, health checks, scalability, resilience, service discovery, and API gateways. Ensure code quality, security, and performance optimization across the application stack. Work with containerization technologies like Docker and Kubernetes for seamless application deployment. Collaborate with cross-functional teams to define, design, and ship new features effectively and efficiently. Establish and manage CI/CD pipelines for seamless and automated application deployment. Implement best practices for API design, development, and security to ensure robust and reliable services. Set up and maintain monitoring and logging tools (e.g., Prometheus, Grafana) for proactive issue detection and resolution. Ensure adherence to version control systems (e.g., Git) and support collaborative workflows across teams. Qualifications: Proven experience in leading technical teams and developing scalable applications using microservices architecture. Proficiency in Python and FastAPI for building high-performance backend services. In-depth knowledge of Pydantic for data validation in FastAPI applications. Hands-on experience with containerization technologies (e.g., Docker, Kubernetes) for managing deployment and scalability. Familiarity with CI/CD pipelines and automation tools to streamline application development. Strong expertise in API design and implementation best practices. Experience with monitoring and logging tools like Prometheus and Grafana. Strong understanding of security best practices in microservices-based applications. Nice to Have: Experience with Retriever models, including the implementation of chunking strategies. Familiarity with vector databases and their relevant use cases. Understanding of optimal approaches for querying LLM models via API. Experience with prompt engineering and strategies for effective interactions with LLMs. Exposure to various prompt engineering techniques in different scenarios. At Blend, we are driven by the belief that AI and human expertise can combine to create meaningful, lasting impact. By joining our team, you ll have the opportunity to work on cutting-edge technologies, collaborate with brilliant minds, and contribute to innovative projects that shape the future.
Senior Python Developer
Blend360 India
Role Overview: We are looking for a Software Engineer to play a key role in migrating our workflow orchestration system from Azkaban to Apache Airflow. This is a high-impact opportunity to contribute to modernizing our data processing infrastructure, working on a critical migration project that will enhance the performance and scalability of our systems. Key Responsibilities: Migration Strategy: Design, develop, and execute the migration strategy from Azkaban to Apache Airflow, ensuring a smooth transition and minimal disruption to ongoing operations. Automation: Develop Python scripts and automation tools to support the migration process and automate various tasks such as calling APIs and performing database interactions. Testing and Data Validation: Implement best practices for testing and data validation to ensure the accuracy and reliability of the migrated workflows. Process Automation: Collaborate with the development team to automate several manual processes related to release, upgrades, and deployments, improving operational efficiency. Collaboration: Work closely with platform owners and data teams to ensure that workflows continue to operate with the same performance and reliability post-migration. Optimization: Optimize Airflow DAGs for efficiency, modularity, and maintainability, ensuring scalable and high-performance data pipelines. DevOps Practices: Leverage previous DevOps experience focusing on continuous deployment and monitoring, ensuring the smooth and continuous operation of the migration process. Qualifications: Education: Bachelor s degree in Computer Science, Software Engineering, or a related field. Programming Languages: Proficiency in Python for writing automation scripts, including calling APIs and interacting with databases. Kubernetes Ecosystem: Experience creating YAMLs and Helm charts for managing Kubernetes resources. DevOps Experience: Hands-on experience with DevOps practices, particularly focusing on continuous deployment and monitoring. Orchestration System: Proficiency with Apache Airflow or any orchestration system; experience in creating DAGs to run custom workflows is a plus. Jupyter Notebooks: Familiarity with Jupyter notebooks for data processing and analysis is a plus. Qualification : Bachelors degree in computer science, Software Engineering, or a related field.
Manager - Data Scientist
Blend360 India
Job Title: Manager - Data Science Location: Hyderabad Department: Data Science Employment Type: Full-Time, Permanent Role Overview: As a Manager - Data Science at Blend, you won t just manage you'll lead by doing. This role demands strong hands-on expertise in Machine Learning (ML), Generative AI, Python, SQL, and any cloud environment (GCP, Azure, or AWS). You will stay deeply engaged in the technical side while mentoring and growing a high-performing team. You ll be responsible for leading end-to-end AI/ML project execution, collaborating with cross-functional teams, and driving innovation within Blend's Data Science practice. If you love solving complex problems, thrive in a fast-paced environment, and can translate business challenges into cutting-edge AI solutions, we d love to have you on board! Key Responsibilities: Delivery & Project Management: Lead the development and implementation of ML models, Generative AI solutions, and predictive analytics. Perform data mining, feature engineering, and statistical analysis to extract meaningful insights. Own project roadmaps, ensure quality control, and drive timely delivery of projects. Collaborate with Data Engineering teams to deploy and operationalize ML models. Automate and optimize workflows to enhance efficiency and streamline processes. Practice Development: Contribute to the scaling of Blend s Data Science practice by building new capabilities. Design industry-specific AI/ML solutions and contribute to thought leadership in AI/ML. Evaluate emerging AI trends and tools and integrate them into Blend s ecosystem. Lead innovation initiatives, research, and internal AI development. People & Leadership: Mentor and develop a high-performance data science team. Guide team members' career development and set performance benchmarks. Collaborate with cross-functional teams to ensure seamless execution of projects. Qualifications: Experience: 8+ years in Data Science & AI, with hands-on expertise in ML, Generative AI, Python, and SQL. Strong knowledge of ML algorithms (Classification, Regression, Forecasting, NLP, LLMs, Optimization, etc.). Proven experience in end-to-end ML deployment, including working with Azure, AWS, GCP, or Databricks. Industry Expertise: Demonstrated ability to solve complex business challenges in Retail, CPG, BFSI, Healthcare, or eCommerce. In-depth understanding of statistics, probability, stochastic processes, and causal inference. Excellent communication skills with the ability to explain AI concepts to non-technical stakeholders. Experience with big data tools such as Hadoop, Hive, PySpark, and ML pipelines. Bonus: Experience with Google Analytics, Adobe Analytics, or digital marketing analytics. Education: Bachelor s/Master s degree in Computer Science, Statistics, Math, Operations Research, or a related field. What You Get in Return: Competitive Salary: Your skills and contributions are highly valued, and we ensure your salary reflects your expertise and experience. Dynamic Career Growth: Our vibrant environment offers opportunities for rapid growth, providing the right tools, mentorship, and experiences to fast-track your career. Idea Tanks: Our Idea Tanks offer a space for you to pitch, experiment, and collaborate on ideas that can shape the future. Growth Chats: Engage in casual Growth Chats to learn from the best, whether it s over lunch or a laid-back session with peers. Snack Zone: Enjoy a variety of snacks to keep your energy high and ideas flowing. Recognition & Rewards: Expect regular Hive-Fives, shoutouts, and the chance to see your ideas come to life as part of our reward program. Fuel Your Growth Journey with Certifications: We support your growth by covering the cost of certifications to level up your skills. If you're ready to lead cutting-edge AI projects and grow within a dynamic team, Blend is the place for you. Apply today to be part of an innovative and collaborative culture! Qualification : Bachelors/Masters degree inComputer Science, Statistics, Math, Operations Research, or a related field.
BI Senior Analyst (Tableau Developer)
Blend360 India
Job Title: BI (Tableau) Developer Location: Hyderabad Department: Business Intelligence Employment Type: Full-Time, Permanent Role Overview: As a BI (Tableau) Developer, you'll turn raw data into compelling visual stories that help drive decision-making. You will collaborate closely with clients, create stunning dashboards, and lead end-to-end BI projects. If you're passionate about transforming data insights into actionable strategies and thrive in a dynamic, consulting-driven environment, this role is for you. Key Responsibilities: End-to-End BI Implementation: Manage the full BI lifecycle, including data modelling, report building, delivery, and post-implementation support. Create visually stunning Tableau dashboards and reports that provide business insights. Write efficient SQL queries to extract, transform, and analyze data for visualizations. Tableau Development: Design, develop, and maintain interactive Tableau dashboards that are both engaging and functional. Ensure data visualization best practices are followed, ensuring dashboards are intuitive and actionable. Business Knowledge & Collaboration: Work directly with clients to understand their business needs and translate them into impactful BI solutions. Provide data-driven insights that enable clients to make informed decisions. Cross-Tool Integration: Experience with other BI tools like Power BI or Qlik Sense is a plus, allowing for versatile solutions across platforms. Qualifications: Experience: 5+ years in Business Intelligence, specifically focusing on Tableau development and SQL. Strong understanding of data visualization best practices and BI architecture to ensure high-quality, actionable reports. Proven ability to implement BI solutions for complex business scenarios, driving real-world impact with data-driven insights. Ability to tackle challenges with a proactive, solutions-oriented mindset. A track record of delivering projects with enthusiasm and drive, even in fast-paced environments. Ability to mentor and collaborate, contributing to a positive and innovative team dynamic. Creative thinker: Always looking for new ways to leverage data to drive business strategies. Competitive Salary: Your skills and contributions are highly valued, and we ensure your salary reflects your expertise. Dynamic Career Growth: A vibrant environment that offers opportunities for rapid growth, mentorship, and development. Idea Tanks: A platform for you to pitch, experiment, and collaborate on ideas that shape the future. Growth Chats: Casual, insightful discussions with peers to foster learning and skill development. Snack Zone: A variety of snacks to keep your energy high and ideas flowing. Recognition & Rewards: Regular shoutouts and rewards for your great work, making your contributions celebrated. Fuel Your Growth Journey with Certifications: Blend supports your personal and professional growth by covering the cost of certifications. If you are passionate about Tableau, data visualization, and transforming data into insights, apply today to join an innovative, collaborative team at Blend!
Engineering Manager, Enterprise Data And Engineering, Corpeng
Google Careers
About the Job Like Google's own ambitions, the work of a Software Engineering Manager goes far beyond Search. This role combines technical leadership with team management to drive large-scale, impactful projects while enabling your team of engineers to deliver their best work. You ll not only contribute to product strategy and manage project goals but also foster the growth of talented engineers across your team. Google s engineering teams tackle challenges in information retrieval, artificial intelligence, distributed computing, large-scale system design, networking, security, and data analytics, among others. As a manager, you will lead engineering teams across multiple locations and drive high-impact solutions for complex challenges. Our Enterprise Data & Engineering (EDE) team is focused on unlocking the value of enterprise data, making it accessible, reliable, secure, and actionable for Googlers. Corp Eng builds business solutions that scale globally to support Google s internal operations and services. Our mission is simple: We are Google for Googlers delivering tools and experiences that help every Googler create impactful products and services. Responsibilities Conceive and deliver data management and analytics solutions to meet Googlers' needs, driving high-impact projects across Google. Influence Connected Data strategy, ensuring consistent and secure data assets built on canonical entity schema for higher-level insights. Ensure data integrity and security, implementing procedures to maintain the highest levels of confidentiality and data protection. Partner with internal teams to define and implement solutions that improve business processes. Maintain the highest standards of development practices, including technical design, systems configuration, testing, and writing clean, modular code. Minimum Qualifications Bachelor's degree or equivalent practical experience. 8 years of experience in software development using one or more programming languages (e.g., Python, C, C++, Java, JavaScript). 3 years of technical leadership experience overseeing projects, with 2 years in people management or team leadership. Experience in data management, data integration, distributed databases, and SQL pipelines. Preferred Qualifications Master s degree or PhD in Computer Science or a related technical field. Experience implementing and integrating third-party applications in domains like Finance, Supply Chain, HR, and Marketing.
1 - 20 of 376 Data Engineer in Hyderabad jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted
1 - 20 of 376