BIG Data Engineer Jobs in Hyderabad
249 Jobs Found
Data Modeler
Gspann
Position Title: Data Modeler Location: Hyderabad Department: Data & Analytics Experience Required: 4+ Years Employment Type: Full-Time Company: GSPANN Technologies Job Description: GSPANN is seeking a highly skilled and detail-oriented Data Modeler to join our Hyderabad team. In this role, you will be responsible for developing and optimizing conceptual, logical, and physical data models that support business intelligence and decision-making processes. You will work closely with business stakeholders and technical teams to turn complex data into meaningful insights. Roles and Responsibilities: Translate business requirements into well-structured data models. Design and implement conceptual, logical, and physical data models for enterprise applications. Collaborate with cross-functional teams including data engineers, analysts, and business users. Ensure data integrity and consistency across various data sources and systems. Use data modeling tools (e.g., ERwin, ER/Studio) to document metadata and relationships. Participate in data profiling, analysis, and cleansing initiatives. Provide technical leadership on data structure standards and best practices. Support data governance, cataloging, and quality assurance efforts. Work in Agile environments and contribute to sprint planning and execution. Required Skills and Experience: Bachelor s or Master s degree in Computer Science, Information Technology, or related field. 4+ years of experience in data modeling (relational, dimensional, or NoSQL). Hands-on experience with tools such as ERwin, ER/Studio, or equivalent. Strong SQL skills and ability to handle large datasets. Experience with RDBMS systems (e.g., Oracle, SQL Server, PostgreSQL). Familiarity with cloud data platforms such as AWS, GCP, or Azure. Strong analytical skills and attention to detail. Excellent communication and stakeholder management skills. Nice to Have: Experience with Snowflake, BigQuery, or Redshift. Exposure to ETL tools and data pipeline development. Knowledge of metadata and data lineage tools. Experience in domains such as retail, healthcare, or finance. Be part of a forward-thinking company at the cutting edge of data and digital transformation. Work in a collaborative environment that encourages learning and growth. Gain exposure to global projects and next-gen technologies. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or related field.
Technical Lead - Backend Development
Zl Tech
Technical Lead Backend Development Location: Hyderabad, IN Employment Type: Full-Time Department: Engineering & Product Development Role Overview ZL Technologies is seeking a highly skilled Technical Lead Backend Development with deep expertise in Java and large-scale distributed systems. As a key member of our engineering team, you will architect, develop, and optimize server-side components, ensuring high scalability, availability, and performance. You will lead backend development efforts, mentor teams, and deliver robust solutions that power our cutting-edge products. Key Responsibilities Design, develop, and maintain scalable and robust backend services and system architectures using Java. Architect and build reusable code and libraries to support efficient application development and future scalability. Collaborate closely with cross-functional teams and stakeholders to understand requirements and translate them into effective technical solutions. Lead, mentor, and guide engineering teams to deliver high-quality, optimized code in adherence to organizational standards and best practices. Manage and optimize search and retrieval performance internally, contributing to information retrieval components. Ensure software solutions meet high standards of quality, scalability, and maintainability. Apply strong analytical and problem-solving skills to make decisions on architecture and implementation. Maintain clear communication and documentation throughout the software development lifecycle. Required Qualifications 7+ years of hands-on experience in backend development, focusing on large-scale distributed systems, complex software design, scalability, and performance optimization. Strong proficiency in Java server-side development. Experience in information retrieval systems with an emphasis on optimizing internal search performance. Proven ability to lead technical teams and manage project deliverables. In-depth knowledge of algorithms and data structures. Bachelor s degree in Computer Science, Engineering, or a related field (Master s degree preferred). Experience with coding standards, version control systems (especially Git), and software best practices. Excellent problem-solving and decision-making capabilities. Preferred Skills and Technologies Familiarity with open-source tools and frameworks such as Tomcat, Lucene, Zookeeper, Kafka, Netty, and NoSQL databases. Experience building RESTful APIs and microservices architectures. Hands-on experience with containerization technologies like Docker and orchestration tools such as Kubernetes. Knowledge of big data technologies and cloud platforms. Strong understanding of Unix/Linux and Windows operating systems, networking, and system scaling techniques. Excellent verbal and written communication skills. Lead backend development for cutting-edge enterprise solutions. Work in a collaborative, innovation-driven environment. Opportunity to influence product architecture and engineering best practices. Be part of a fast-growing company with a global impact. Qualification : Bachelors degree in Computer Science, Engineering, or a related field (Masters degree preferred).
Data Engineering Manager
Kanerika Software
Job Title: Data Engineering Manager Location: Hyderabad About Kanerika Kanerika Inc. is a leading global software products and services company dedicated to empowering data-driven enterprises. We help businesses accelerate digital transformation and maximize impact by delivering innovative, custom data solutions that optimize operations, enhance customer experiences, and fuel growth. Our Accolades Best Place to Work 2022 Great Place to Work Top 10 Most Recommended RPA Startups 2022 RPA Today Technology Innovation Award 2021 Frost & Sullivan India for Kompass composable solution Recognized for strong data privacy and security standards: ISO 27701, SOC2, GDPR compliant With a 4.5/5 Glassdoor rating, Kanerika fosters an inclusive, growth-oriented culture where employees thrive. We offer: Flexible working hours and generous parental leave Mandatory training on a safe and inclusive work environment Mentorship, professional development, and certification support Company-sponsored outings and work-life balance initiatives Join a vibrant, diverse community where your contributions truly matter. The Role We are looking for an experienced Data Engineering Manager to lead and inspire our data engineering team in Hyderabad. Partnering closely with Data Architects, you ll drive the design and development of scalable, cloud-based data pipelines and models, ensuring data quality, security, and performance. What You ll Do Lead and mentor a high-performing data engineering team, driving productivity and accountability. Collaborate with architects and development leads to build scalable, enterprise-grade data solutions. Oversee agile workflows, manage escalations, and coordinate hiring and resource planning. Use data-driven insights to guide team priorities and continuous improvement. Support pre-sales activities and work cross-functionally with sales and recruitment teams. Foster a culture of innovation, quality-first mindset, and customer focus. Who You Are A proactive leader with experience managing mid to large-sized teams and complex projects. An effective communicator, both verbally and in writing, with a knack for visually presenting ideas and core values. Results-oriented with a proven track record of delivering successful projects and publishing customer case studies. A process-driven, independent thinker who thrives under pressure and embraces continuous learning. Passionate about inclusivity and committed to contributing authentically to a diverse team environment.
Senior Data Scientist
Salesforce
Senior Data Scientist Data | Hyderabad, India | Full-Time About Salesforce We re Salesforce, the Customer Company, empowering businesses worldwide with AI, Data, and CRM. We believe business is a platform for change helping companies innovate, grow, and connect with customers in new ways. Join us to be a Trailblazer driving your career and impacting the future of business. Role Overview We re seeking an experienced Senior Data Scientist to lead development of advanced marketing attribution, causal inference, and uplift models that enhance marketing effectiveness and efficiency. You will design experiments, establish consistent measurement frameworks, and deliver impactful data-driven insights supporting marketing, customer engagement, and digital initiatives. You will own the full model lifecycle from ideation and prototyping to deployment and ongoing production monitoring ensuring rigor, scalability, and ethical application aligned with Salesforce s core value of Trust. Key Responsibilities Develop sophisticated statistical and machine learning models to optimize marketing investments (e.g., attribution, uplift, causal inference). Create algorithms for marketing spend optimization and ROI improvement across multiple channels. Lead full lifecycle model development: data exploration, design, testing, deployment, monitoring, and tuning. Design statistically sound experiments (A/B, multi-cell) to measure marketing and campaign impact. Collaborate cross-functionally with marketing, engineering, and analytics teams to operationalize measurement and experimentation frameworks. Stay updated on innovations in SaaS, AdTech, paid media, and analytics to continuously evolve modeling approaches. Advocate responsible and ethical use of data and models in line with company policies. Required Skills & Experience Master s or Ph.D. in Statistics, Economics, Industrial Engineering, Operations Research, Applied Math, or related quantitative fields. 8+ years of hands-on experience designing marketing optimization models (multi-channel attribution, uplift, customer lifetime value, propensity). Extensive experience in experiment design and causal inference for business impact evaluation. Strong programming skills in Python, R, PySpark, Java. Expert-level SQL skills for large-scale data exploration and manipulation. Experience with cloud platforms like GCP or AWS for scalable model development and deployment preferred. Exceptional quantitative reasoning and ability to translate analysis into actionable business insights. Excellent communication skills, capable of collaborating across diverse teams. Creative problem-solving mindset with ability to simplify complex challenges. Experience with B2B customer data and Salesforce products is a plus. Work on high-impact projects using state-of-the-art AI and analytics technologies. Collaborate with top-tier data science and marketing experts. Thrive in an innovative, inclusive culture that values Trust and continuous learning. Drive real-world business transformation at a global scale. If you are passionate about marketing science and advanced analytics, and want to lead innovation in a fast-paced environment, we encourage you to apply! Qualification : Masters or Ph.D. in Statistics, Economics, Industrial Engineering, Operations Research, Applied Math, or related quantitative fields.
Senior Data Engineer
Blend360 India
Senior Data Engineer Hyderabad (On-site, Full-time) Location: Hyderabad, Telangana Work Type: On-site, Full-time Experience: 5+ Years Industry: AI & Data Science Company: Blend About Blend: Blend is a leading AI services company focused on solving real-world problems through the fusion of artificial intelligence, data science, and human ingenuity. We believe in co-creating meaningful impact by aligning top-tier talent with cutting-edge technology. Our goal is to deliver transformative solutions that unlock value for our clients and enrich the work and lives of our people. Job Overview: We are seeking a highly skilled Senior Data Engineer with strong experience in AWS, Databricks, Python, SQL, and Apache Spark/PySpark. You will be responsible for designing, developing, and maintaining scalable data architectures and pipelines to support analytics, machine learning, and business intelligence efforts across the organization. Key Responsibilities: Design and build scalable data pipelines using AWS services (Glue, Lambda, S3, EMR) and Databricks Notebooks & Workflows. Develop and manage robust ETL/ELT workflows using Python and SQL to handle structured and semi-structured data. Implement distributed data processing using Apache Spark or PySpark. Create and maintain data lakes in AWS Databricks. Collaborate with data scientists, analysts, and cross-functional teams to provide high-quality, accessible datasets. Ensure adherence to data governance, quality, and security best practices. Monitor, troubleshoot, and optimize the performance of data systems. Conduct code reviews and enforce engineering best practices. Mentor junior engineers and support their technical growth. Required Qualifications: Bachelor's or Master s degree in Computer Science, Engineering, or related field. 5+ years of experience in Data Engineering, with 2+ years working in AWS Databricks environments. Strong programming skills in Python for data processing and workflow automation. Advanced expertise in SQL for data transformation and querying large datasets. Proficient in distributed data processing using Apache Spark/PySpark. Solid understanding of data modeling, data warehousing, and performance optimization techniques. Hands-on experience with AWS services such as Glue, S3, Lambda, and EMR. Familiarity with version control tools like Git or CodeCommit. Experience with workflow orchestration tools like Airflow or AWS Step Functions (preferred but not mandatory). Be part of a forward-thinking, AI-driven organization. Work with cutting-edge cloud technologies and data platforms. Thrive in a culture of innovation, mentorship, and continuous learning. Enjoy opportunities to grow technically and professionally while driving real-world impact. Apply Now to join Blend as a Senior Data Engineer and help build data infrastructure that powers intelligent decision-making. Qualification : Bachelor's or Masters degree in Computer Science, Engineering, or related field.
Azure Data Engineer (mid)
Syren Technologies
Azure Data Engineer (Mid-Level) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience Level: 5+ Years Industry: Information Technology / Cloud Data Engineering Job Overview We are hiring an experienced Azure Data Engineer (Mid-Level) to join our team in Hyderabad. In this role, you will work closely with business stakeholders, analysts, and IT teams to design, implement, and manage scalable, high-performance data solutions on the Azure Cloud Platform. Your expertise in data modeling, ETL development, and cloud-based data warehousing will be critical in supporting data-driven decision-making across the organization. Key Responsibilities Analyze large datasets and deliver clear, actionable reports using statistical techniques. Design and implement data pipelines, data collection systems, and analytics strategies that enhance operational efficiency. Develop and maintain data systems, ensuring high data quality, consistency, and integrity. Collaborate with business stakeholders, analysts, and developers to translate business requirements into technical solutions. Design, build, and manage distributed data systems and applications on the Azure Cloud. Lead and execute ETL development, including data extraction, transformation, and loading using tools like Informatica or SSIS. Conduct technical design reviews, performance tuning, and testing of data workflows. Adapt to changing priorities and contribute as an individual contributor or team leader depending on project scope. Required Qualifications & Skills Bachelor s degree in Computer Science, Information Systems, or a related field. Minimum 5+ years of experience in data engineering, data analysis, or database design. Proficient in SQL and T-SQL for querying and managing relational databases. Hands-on experience with ETL frameworks such as Informatica or SSIS. Strong understanding of data modeling, data mining, and segmentation techniques. Experience working with structured and unstructured data sources. Proficient in statistical tools and packages (Excel, SSIS, SAS, etc.). Strong analytical mindset with excellent attention to detail and data accuracy. Preferred Skills (Good to Have) Experience with Python and Apache Spark for data manipulation and automation. Experience with modern data platforms: Azure Synapse Analytics Azure Databricks Amazon Redshift Prior experience in developing automation solutions using Python or similar scripting languages. Knowledge of Enterprise Data Warehousing (EDW) concepts and solutions. Competitive compensation package with benefits. Work with cutting-edge cloud technologies in real-world environments. Collaborative, fast-paced, and innovation-driven workplace. Career development support with continuous learning opportunities. A chance to make a tangible impact on enterprise-level data systems. Apply Now If you are a data-driven professional with a strong command of Azure and ETL tools, and you re looking to advance your career in data engineering, apply now and become part of a forward-thinking tech team based in Hyderabad! Qualification : Bachelors degree in Computer Science, Information Systems, or a related field.
Data Architect
Syren Technologies
Data Architect Hyderabad Experience: 10-17 Years Job Type: Full-Time | On-site/Hybrid Location: Hyderabad, India Industry: Data Engineering / Cloud Architecture Job Overview We are looking for an experienced Data Architect with 10+ years of expertise in designing, optimizing, and managing enterprise-scale data architectures on Azure Cloud. The ideal candidate will lead efforts to enhance data pipeline performance, ensure robust data governance, and drive cost-effective cloud resource utilization. If you excel in architecting scalable, secure, and high-performing data solutions, this is your chance to join a dynamic team in Hyderabad. Key Roles & Responsibilities Design, optimize, and maintain data pipelines, ETL processes, and complex queries to maximize performance and scalability. Improve query execution plans, indexing strategies, and optimize storage in Azure SQL, Azure Synapse Analytics, and Azure Data Lake. Implement advanced data management techniques such as data partitioning, caching, and compression for efficient data processing. Monitor cloud resource consumption and implement cost-saving strategies without impacting system performance. Optimize use of Azure services including Databricks, Data Factory, Synapse Analytics, and storage accounts to balance performance and cost. Establish and enforce coding standards, design patterns, and best practices for data pipeline development and cloud infrastructure management. Define and implement data governance, security, and compliance policies aligned with organizational and regulatory requirements. Develop and oversee CI/CD pipelines using DevOps methodologies tailored to data engineering workflows. Implement monitoring, alerting, and logging solutions using Azure Monitor, Log Analytics, and Application Insights to ensure system reliability. Architect solutions for high availability and disaster recovery to maintain business continuity. Optimize Power BI data models, DAX queries, and report performance; ensure governance and data refresh strategies meet business needs. Collaborate with cross-functional teams and business stakeholders to translate requirements into scalable and actionable data insights. Required Skills & Qualifications 10+ years of experience in data architecture, cloud data engineering, or related roles. Deep expertise in Azure Cloud data services: Azure SQL, Synapse Analytics, Data Lake, Databricks, Data Factory. Strong background in ETL pipeline optimization, query tuning, and storage management. Proven experience with data governance, security frameworks, and compliance standards. Familiarity with DevOps principles, especially CI/CD for data workflows. Expertise in monitoring tools like Azure Monitor, Log Analytics, and Application Insights. Hands-on experience optimizing Power BI solutions, including data modeling and report design. Excellent communication and stakeholder management skills. Work on large-scale, cutting-edge data projects impacting enterprise business decisions. Collaborate with a passionate, skilled team in a fast-paced, innovative environment. Competitive salary and benefits package. Opportunity to shape the future of data architecture within a leading organization. Apply Today If you are an expert Data Architect ready to take your career to the next level with advanced Azure data technologies, apply now and join our Hyderabad team!
Senior Data Engineer
Wallero Technologies
Job Title: Senior Data Engineer Location: Hyderabad, Telangana, India Job Type: Full-Time | Permanent Experience Required: 6+ Years Open Positions: 2 About the Role: We are seeking a highly skilled and experienced Data Engineer to join our team in Hyderabad. As a key member of our data engineering unit, you will be responsible for designing and optimizing end-to-end data pipelines using Python, PySpark, and Databricks. This role requires strong technical expertise, a passion for solving complex data challenges, and the ability to lead best practices within the Supply Chain data domain. Key Responsibilities: Develop and maintain scalable data pipelines using Python, PySpark, and Databricks for complex data transformation within Supply Chain operations. Implement advanced data engineering solutions that support real-time and batch data processing for analytics and business intelligence. Analyze, optimize, and refactor existing data workflows to improve performance and reliability. Collaborate with cross-functional teams to understand data requirements and translate them into robust technical solutions. Take ownership of projects and deliver high-quality outcomes with minimal supervision. Provide leadership and guidance on coding standards, design patterns, and data engineering best practices. Clearly communicate technical ideas and solutions to both technical and non-technical stakeholders. Required Skills & Qualifications: 6+ years of hands-on experience in data engineering. Proficient in Python, PySpark, and Databricks for building and maintaining data pipelines. Strong problem-solving skills with a proven ability to create innovative solutions for complex data challenges. Excellent communication and interpersonal skills; able to work effectively with cross-functional teams. Experience leading and mentoring team members on technical best practices and architecture decisions. Ability to work independently, manage priorities, and drive projects to completion with minimal oversight. Perks & Benefits: Competitive compensation package Exposure to cutting-edge technologies in cloud-based data engineering Opportunity to work on large-scale Supply Chain data solutions Collaborative, innovation-driven work environment Career growth and mentorship opportunities
Senior Data Scientist
Microsoft
Senior Data Scientist Location: Hyderabad, Telangana, India Employment Type: Full-Time Overview Microsoft Search powers delightful and relevant experiences for enterprise users, and AI-driven Copilots have turned futuristic visions into current-day reality. We are seeking candidates who can help build the next-generation machine learning systems to drive innovation in search ranking, clustering, recommendation systems, and much more. As a Senior Data Scientist in the team, you will work independently on complex problems, define success metrics, and contribute to design and review processes for machine learning/data pipelines across the team. If you're ready to tackle challenging data science problems and help shape the future of search, we want you on our team! Key Responsibilities End-to-End Ranking: Oversee the ranking of search results and contribute to enhancing search relevance. Large Language Models (LLMs): Work on developing and deploying large language models to improve search experience and AI-powered copilots. AI-powered Copilot Scenarios: Drive innovations in AI systems that enhance user productivity and engagement through Copilot capabilities. Compliance & Privacy: Develop machine learning training pipelines at scale that are privacy and compliance-aware. Personalization: Customize search results and recommend relevant content based on user preferences. Qualifications Required Qualifications: Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or a related field AND 2+ years of data science experience OR Master s Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or a related field AND 5+ years of data science experience OR Bachelor s Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 7+ years of data science experience. Experience working with both structured and unstructured data, applying statistical techniques, and reporting results. Hands-on experience with implementing and shipping production-quality machine learning models or data pipelines. 2+ years of customer-facing, project-delivery experience, professional services, and/or consulting experience. Strong programming skills in Python, R, or similar languages, and familiarity with machine learning libraries. Preferred Qualifications: Prior work or research experience in the Search domain is highly preferred. Familiarity with large-scale distributed systems, cloud platforms (such as Azure), and real-time machine learning applications. Experience with deep learning and large language models (LLMs). Familiarity with compliance and privacy in machine learning pipelines. Microsoft s mission is to empower every person and organization on the planet to achieve more. At Microsoft Search, you will be part of a team solving impactful problems for millions globally. Join us to drive cutting-edge advancements in AI and contribute to shaping the future of search and user experiences. Employee Benefits Industry-leading healthcare coverage Generous time off and family leave policies Access to educational resources and professional development Employee discounts on Microsoft products and services Opportunities for networking and global collaborations Inclusive and supportive work environment with a focus on work-life balance Microsoft is an equal opportunity employer. We are committed to creating a diverse and inclusive environment where every individual is treated with respect and can thrive. Join us to make a global impact through innovation, collaboration, and diversity.
Azure Data Engineer
Quadrant Technologies
Job Title: Azure Data Engineer Location: Hyderabad / Bangalore (Hybrid) Job Type: Full-time Salary: Negotiable Position Overview: We are looking for an Azure Data Engineer with 5-8 years of experience to join our team. As an Azure Data Engineer, you will design, implement, and manage data solutions on the Microsoft Azure cloud platform. The ideal candidate will have a strong background in writing complex SQL stored procedures, implementing OLTP database solutions using Microsoft SQL Server, and working with Azure Synapse, PySpark, and Azure Databricks for big data processing. Key Responsibilities: Data Integration and Collaboration: Collaborate with cross-functional teams to gather, analyze, and document business requirements for data integration projects. Complex SQL Expertise: Write and optimize complex T-SQL, Dynamic SQL, and Spark SQL queries, including the creation of stored procedures for data transformation and business validation logic. Big Data Processing: Utilize Azure Synapse/Databricks to write notebooks using Spark SQL or PySpark for processing and analyzing large volumes of data. Data Pipeline Development: Develop and maintain robust data pipelines using Azure Data Factory to ensure seamless data flow across systems. OLTP Systems: Contribute to the enhancement and optimization of OLTP systems using SQL Server. Data Quality and Integrity: Ensure data quality, integrity, and accuracy in all systems. Programming and Algorithm Development: Utilize strong algorithmic programming skills to handle data processing and transformation. Qualifications: Educational Background: Bachelor s degree in Computer Science, Information Technology, or a related field. Experience: 5-8 years of experience in database development, data integration, and writing complex T-SQL queries. Technical Skills: Expertise in T-SQL and Spark SQL/PySpark (experience with Azure Synapse and Databricks is essential). Hands-on experience with Azure Data Factory for building data pipelines. Strong experience with OLTP systems using SQL Server. Problem-Solving Skills: Excellent problem-solving abilities with a strong focus on attention to detail. Adaptability: Ability to work in a collaborative and fast-paced environment, focusing on delivering high-quality solutions. Other Details: Notice Period: 0-15 days MAX Work Location: Hyderabad / Bangalore (Hybrid) If you're an experienced Azure Data Engineer with a passion for big data and cloud technologies, apply now to join our team and make an impact with innovative data solutions! Qualification : Bachelors degree in Computer Science, Information Technology, or a related field.
Senior Data Engineer
Zessta Software Services Pvt.ltd.
Job Title: Senior Data Engineer Company Name: Zessta Job Type: Full-time Responsibilities: Analyze customer data to enhance customer experience and provide actionable insights. Build and maintain integrations to support advanced data science workflows, ensuring seamless interaction with the Product API. Actively participate in onboarding and training clients on how to use the product effectively. Provide insights into client-to-business interactions, ensuring that the data can be leveraged for strategic decisions. Act as a liaison between the client and the organization, ensuring both parties' needs and expectations are met. Identify opportunities for clients to expand their usage of the product, driving engagement and long-term value. Address customer complaints and requests, offering product support to improve overall satisfaction and experience. Skills and Experience: Excellent communication and interpersonal skills to work effectively with clients and internal teams. Strong understanding of data modeling and architecture. Hands-on experience with data integrations and data pipelining tools to connect systems and enable smooth data flow. Proficiency in programming languages, preferably Python or R, to process and analyze data. Experience with container orchestration platforms like Docker and Kubernetes. Familiarity with distributed computing frameworks such as Spark, Hadoop, and Dask to handle large-scale data processing. Experience with version control software such as Git to manage code and collaborate with teams. Knowledge of project management tools such as JIRA to track and manage project progress and tasks. Familiarity with tools like Figma and Mixpanel is a plus. Education and Experience: Bachelor s or Master s degree from premier institutes (preferred). 4-12 years of relevant experience in data engineering, data science, or related fields. What We Offer: Competitive salary and benefits package. Opportunities for career growth and skill development. The chance to work on cutting-edge technologies and impactful projects. If you have a passion for data engineering and improving customer experience, and you're ready to take on new challenges, we'd love to hear from you. Apply now to join our team at Zessta and contribute to driving innovation and business success! Qualification : Bachelors or Masters degree from premier institutes (preferred).
Data Engineer-data Platforms
International Business Machines Corporation
Introduction In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients globally. Our centers provide locally-based skills and technical expertise to drive innovation and the adoption of new technologies. A career at IBM Consulting involves building long-term relationships and collaborating closely with clients across industries. You'll work alongside visionaries to help them on their hybrid cloud and AI journeys, enhancing the value and impact of some of the most innovative companies in the world. With access to IBM s strategic partner ecosystem and cutting-edge technology platforms, including IBM Software and Red Hat, you will be empowered to accelerate client transformations and create meaningful change. Curiosity and a constant quest for knowledge serve as the foundation for success at IBM. In your role, you'll be encouraged to challenge the status quo, explore ideas beyond your current role, and come up with creative solutions that will make a significant impact across a wide network of clients. Our culture of evolution and empathy is centered on long-term career growth and development opportunities in an environment that celebrates your unique skills and experience. Your Role and Responsibilities As a Data Engineer at IBM, you will be a critical player in designing and developing applications, while also providing guidance to project teams on complex coding, troubleshooting, and execution. Your key responsibilities include: Solution Design and Construction: Lead the design and construction of new data solutions using the latest technologies, ensuring business value and meeting user requirements. Continuous Improvement: Advocate for continuous improvement by testing solutions and working within an Agile framework to enhance and iterate the developed solutions. Innovation: Stay current with the latest technology trends, discovering and implementing creative solutions to solve business problems. Collaboration: Work with diverse teams to deliver impactful data solutions while ensuring scalability, quality, and performance. Required Education Bachelor s Degree in a relevant field Required Technical and Professional Expertise Apache Spark (PySpark): In-depth knowledge of Spark s architecture, core APIs, and using PySpark for distributed data processing. Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts. Proficiency in Python: Expertise in Python programming, particularly focused on data processing and manipulation. Data Processing Frameworks: Experience with Pandas, NumPy, and other data processing libraries. SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation. Cloud Platforms: Experience working with cloud platforms such as AWS, Azure, or GCP, including working with cloud storage systems. Preferred Technical and Professional Experience Architecture Strategy: Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring of data solutions. Cross-Team Collaboration: Partnering with technology teams, including application development, enterprise architecture, testing services, and network engineering. Security: Familiarity with detection and prevention tools for company products and customer-facing platforms. How You ll Grow At IBM, we offer opportunities for career development and provide an environment where you are encouraged to continuously grow, learn, and expand your expertise. Working with cutting-edge technologies and a diverse set of clients, you will be able to stay ahead of industry trends and make meaningful contributions that have a real impact. About IBM Consulting IBM Consulting helps organizations tackle their most pressing challenges through innovative and agile solutions. By partnering with clients, we drive technology transformations, helping them optimize their operations and leverage new technologies like AI, cloud, and data. Our team s expertise spans across many industries, delivering solutions that enable clients to navigate digital transformations. This role offers an exciting opportunity to work with leading technologies while contributing to client success in a highly dynamic environment. If you re passionate about solving complex data problems and delivering impactful solutions, IBM Consulting is the place to grow your career. Qualification : Bachelors Degree in a relevant field
Ai/ml Developer
Infor
Summary: As an AI/ML Developer, you ll play a pivotal role in creating and delivering cutting-edge enterprise applications and automations using Infor s AI, RPA, and OS platform technology. Your mission will be to identify innovative use cases, develop proof of concepts (PoCs), and deliver enterprise automation solutions that elevate workforce productivity and improve business performance for our customers. Title: Software Engineer Experience: 2-5 years. Skill: AI/ML, Python, AWS, SQL Location: Hyderabad Key Responsibilities: Use Case Identification: Dive deep into customer requirements and business challenges. Identify innovative use cases that can be addressed through AI/ML solutions. Data Insights: Perform exploratory data analysis on large and complex datasets. Assess data quality, extract insights, and share findings. Data Preparation: Gather relevant datasets for training and testing. Clean, preprocess, and augment data to ensure suitability for AI tasks. Model Development: Train and fine-tune AI/ML models. Evaluate performance using appropriate metrics and benchmarks, optimizing for efficiency. Integration and Deployment: Collaborate with software engineers and developers to seamlessly integrate AI/ML models into enterprise systems and applications. Handle production deployment challenges. Continuous Improvement: Evaluate and enhance the performance and capabilities of deployed AI products. Monitor user feedback and iterate on models and algorithms to address limitations and enhance user experience. Proof of Concepts (PoCs): Develop PoCs to validate the feasibility and effectiveness of proposed solutions. Showcase the art of the possible to our clients. Collaboration with Development Teams: Work closely with development teams on new use cases. Best Practices and Requirements: Collaborate with team members to determine best practices and requirements. Innovation: Contribute to our efforts in enterprise automation and cloud innovation. Key Requirements: Experience: A minimum 3 years of hands-on experience in implementing AI/ML models in enterprise systems. AI/ML Concepts: In-depth understanding of supervised and unsupervised learning, reinforcement learning, deep learning, and probabilistic models. Programming Languages: Proficiency in Python or R, along with querying languages like SQL. Data Handling: Ability to work with large datasets, perform data preprocessing, and wrangle data effectively. Cloud Infrastructure: Experience with AWS Sagemaker or Azure ML for implementing ML solutions is highly preferred. Frameworks and Libraries: Familiarity with scikit-learn, Keras, TensorFlow, PyTorch, or NLTK is a plus. Analytical Skills: Strong critical thinking abilities to identify problems, formulate hypotheses, and design experiments. Business Process Understanding: Good understanding of business processes and how they can be automated. Domain Expertise: Familiarity with Demand Forecasting, Anomaly Detection, Pricing, Recommendation, or Analytics solutions. Global Project Experience: Proven track record of working with global customers on multiple projects. Customer Interaction: Experience facing customers and understanding their needs. Communication Skills: Excellent verbal and written communication skills. Analytical Mindset: Strong analytical and problem-solving skills. Collaboration: Ability to work independently and collaboratively. Educational Background: Bachelor s or Master s degree in Computer Science, Mathematics, Statistics, or a related field. Specialization: Coursework or specialization in AI, ML, Statistics & Probability, Deep Learning, Computer Vision, or NLP/NLU is advantageous. About Infor: Infor is a global leader in business cloud software products for companies in industry specific markets. Infor builds complete industry suites in the cloud and efficiently deploys technology that puts the user experience first, leverages data science, and integrates easily into existing systems. Over 60,000 organizations worldwide rely on Infor to help overcome market disruptions and achieve business-wide digital transformation.
Senior Data Engineer
Omniwyse Technologies
Job Description We are looking for a passionate engineer interested in working at an early-stage startup building innovative cloud-native data protection solutions. The ideal candidate must be comfortable learning and scoping business requirements to develop effective solutions. This is a great opportunity for engineers who are eager to step out of their comfort zone and solve impactful modern data security concerns. Desired Background and Experience: Must be a problem solver with the ability to think critically and creatively. Minimum of 8 years of experience building products using Java and/or Python. Prior experience in startups is a huge plus. Comfortable with rapid prototyping and implementation of products in an agile team environment. Data engineering experience with implementation of data ingestion, ETL, data pipeline/workflows. Experience implementing database views and UDFs to control access to data using row and column filters. Working experience in databases and data warehouses. Proficient in one or more of the following: AWS RDS, AWS Data Lake, Redshift, Athena, Databricks, and Snowflake. Experience implementing data solutions using Spark. Ability to write and tune complex SQL queries.
Data Engineer
Wallero Technologies
Job Description Location: Hyderabad, Telangana, India Job Type: Permanent (full-time) Experience: 6+ years No. of Openings: 2 Key Responsibilities: Tech Stack Expertise: Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. Innovative Problem-Solving: Demonstrate technical expertise by thinking creatively and providing innovative solutions to complex data-related challenges, pushing boundaries in Supply Chain data analytics. Communication Skills: Exceptional communication abilities to effectively convey technical concepts, collaborate with cross-functional teams, and articulate solutions to non-technical stakeholders. Autonomous Work: Ability to work independently and proactively, taking ownership of projects, and delivering high-quality solutions with minimal supervision. Guidance and Best Practices: Lead the team by setting coding standards, advocating for reusable and modularized code, implementing design patterns, and guiding on best practices in data engineering. Perks and Benefits: Strong expertise in Python, Pyspark, and Databricks, with hands-on experience in developing and optimizing data pipelines for complex data transformations. Exceptional problem-solving skills, with a demonstrated ability to think creatively and develop innovative solutions for data-related issues. Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders. Self-driven and autonomous work style, capable of taking ownership of projects and delivering high-quality results independently. Experience in guiding and mentoring teams on coding standards, design patterns, and best practices in data engineering.
Senior Sde - M365 Security Engineering
Microsoft
Overview If so, the M65 Security Engineering at Microsoft have a great opportunity for you. We are looking for candidates to work on solutions that protect Microsoft services against cyberattacks. We are a team that values diversity of multiple fronts and believes in deep collaboration bringing the best side of technology. Our team consists of engineers with expertise in large-scale software systems, security analysis, big data, and machine learning. We delight in digging in deep to analyse the billions of events and terabytes of data generated each day by all Microsoft products and services (e.g., Azure, M365) services for evidence of suspicious activities. We ensure that critical security components are present throughout the infrastructure powering these services and that these components are kept up to date. Qualifications Required Qualifications: 8+ years of professional software engineering experience designing, building, and running cloud services at large scale in C#, .Net or any high-level programming language. Excellent coding skills, strong understanding in OOPS, design patterns and their application. Self-learner with passion for technologies. Must know Secure by Design principles. Outstanding ability to both work independently and coordinate across geographies. Outstanding ability to communicate complex ideas and concepts to a variety of cross-group stakeholders. Strong organization skills, a bias for action, and ability to deliver results. Proven ability to deal with ambiguity and drive for clarity. Excellent ability to work efficiently, prioritize workflow, ramp quickly, and meet demanding deadlines. Outstanding communication skills and collaboration capabilities. Self-learner with passion for technologies. Able to deep dive in complex areas and self-drive. Preferred Qualifications: Proficient working knowledge of cloud-computing environments like Microsoft Azure, AWS, GCP - Azure preferred. Hands on experience in an object-oriented programming language such as C#, Java or Scala. Strong software design and problem-solving skills. Experience with modern software services engineering practices such as testing in production, live monitoring, data driven engineering. Rapid prototyping and iteration skills the next line. Experience with web service development and familiar with related technologies. Basic automation scripting skills with PowerShell and developing modules. Experience building and shipping production grade software or services. Experience using agile methodologies or test-driven development (TDD) Rapid prototyping and iteration skills. Background Check: Ability to meet Microsoft, customer and/or Government security screening requirements are required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud background check: This position will be required to pass the Microsoft Cloud background check upon higher/transfer and every 2 years they are after. Microsoft is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, gender, sexual orientation, gender identity or expression, religion, national origin, middle status, age, disability, veteran status, genetic information, or any other protected status. Our Culture: Growth mindset we practice a learn it all vs a know-it-all attitude. Wins are cheered, failures are celebrated and viewed as learning opportunities. Candour we believe in transparency and receiving and providing regular constructive feedback across the hierarchy. Diverse and Inclusive every voice matters and is appreciated. This is a safe environment where you can express yourself without fear of retribution. Leadership oriented each of us are leaderswho strive to create clarity, generateenergy,and deliver success.We believe in leading withempathy,trust,andcontext rather than control. Responsibilities Write well designed code with an emphasis on quality, maintainability, scalability, and performance. Analyse security threats to M365 and build monitoring components to address those threats. Solid understanding of Design and implement to enable real time, highly scalable, performant, and sustainable solutions. Deliver automated and well-tested features across different services and platforms. Use engineering best practices throughout the software development lifecycle to establish maintainable, reliable, and secure systems. Collaborate with teammates in various roles to plan and execute on key deliverables. Work in a culture of continuous improvement, adaptation, reflection, and growth. Learn quickly from your peers, projects, and interactions with customers. Provide on call support and monitor the health of services in production as part of DevOps culture. Execute the Dev-Sec-Ops approach to software delivery by designing, coding, testing, deploying and operating components of Microsoft 365 security monitoring system.
Manager - Data Scientist
Blend360 India
Job Title: Manager - Data Science Location: Hyderabad Department: Data Science Employment Type: Full-Time, Permanent Role Overview: As a Manager - Data Science at Blend, you won t just manage you'll lead by doing. This role demands strong hands-on expertise in Machine Learning (ML), Generative AI, Python, SQL, and any cloud environment (GCP, Azure, or AWS). You will stay deeply engaged in the technical side while mentoring and growing a high-performing team. You ll be responsible for leading end-to-end AI/ML project execution, collaborating with cross-functional teams, and driving innovation within Blend's Data Science practice. If you love solving complex problems, thrive in a fast-paced environment, and can translate business challenges into cutting-edge AI solutions, we d love to have you on board! Key Responsibilities: Delivery & Project Management: Lead the development and implementation of ML models, Generative AI solutions, and predictive analytics. Perform data mining, feature engineering, and statistical analysis to extract meaningful insights. Own project roadmaps, ensure quality control, and drive timely delivery of projects. Collaborate with Data Engineering teams to deploy and operationalize ML models. Automate and optimize workflows to enhance efficiency and streamline processes. Practice Development: Contribute to the scaling of Blend s Data Science practice by building new capabilities. Design industry-specific AI/ML solutions and contribute to thought leadership in AI/ML. Evaluate emerging AI trends and tools and integrate them into Blend s ecosystem. Lead innovation initiatives, research, and internal AI development. People & Leadership: Mentor and develop a high-performance data science team. Guide team members' career development and set performance benchmarks. Collaborate with cross-functional teams to ensure seamless execution of projects. Qualifications: Experience: 8+ years in Data Science & AI, with hands-on expertise in ML, Generative AI, Python, and SQL. Strong knowledge of ML algorithms (Classification, Regression, Forecasting, NLP, LLMs, Optimization, etc.). Proven experience in end-to-end ML deployment, including working with Azure, AWS, GCP, or Databricks. Industry Expertise: Demonstrated ability to solve complex business challenges in Retail, CPG, BFSI, Healthcare, or eCommerce. In-depth understanding of statistics, probability, stochastic processes, and causal inference. Excellent communication skills with the ability to explain AI concepts to non-technical stakeholders. Experience with big data tools such as Hadoop, Hive, PySpark, and ML pipelines. Bonus: Experience with Google Analytics, Adobe Analytics, or digital marketing analytics. Education: Bachelor s/Master s degree in Computer Science, Statistics, Math, Operations Research, or a related field. What You Get in Return: Competitive Salary: Your skills and contributions are highly valued, and we ensure your salary reflects your expertise and experience. Dynamic Career Growth: Our vibrant environment offers opportunities for rapid growth, providing the right tools, mentorship, and experiences to fast-track your career. Idea Tanks: Our Idea Tanks offer a space for you to pitch, experiment, and collaborate on ideas that can shape the future. Growth Chats: Engage in casual Growth Chats to learn from the best, whether it s over lunch or a laid-back session with peers. Snack Zone: Enjoy a variety of snacks to keep your energy high and ideas flowing. Recognition & Rewards: Expect regular Hive-Fives, shoutouts, and the chance to see your ideas come to life as part of our reward program. Fuel Your Growth Journey with Certifications: We support your growth by covering the cost of certifications to level up your skills. If you're ready to lead cutting-edge AI projects and grow within a dynamic team, Blend is the place for you. Apply today to be part of an innovative and collaborative culture! Qualification : Bachelors/Masters degree inComputer Science, Statistics, Math, Operations Research, or a related field.
Engineering Manager, Enterprise Data And Engineering, Corpeng
Google Careers
About the Job Like Google's own ambitions, the work of a Software Engineering Manager goes far beyond Search. This role combines technical leadership with team management to drive large-scale, impactful projects while enabling your team of engineers to deliver their best work. You ll not only contribute to product strategy and manage project goals but also foster the growth of talented engineers across your team. Google s engineering teams tackle challenges in information retrieval, artificial intelligence, distributed computing, large-scale system design, networking, security, and data analytics, among others. As a manager, you will lead engineering teams across multiple locations and drive high-impact solutions for complex challenges. Our Enterprise Data & Engineering (EDE) team is focused on unlocking the value of enterprise data, making it accessible, reliable, secure, and actionable for Googlers. Corp Eng builds business solutions that scale globally to support Google s internal operations and services. Our mission is simple: We are Google for Googlers delivering tools and experiences that help every Googler create impactful products and services. Responsibilities Conceive and deliver data management and analytics solutions to meet Googlers' needs, driving high-impact projects across Google. Influence Connected Data strategy, ensuring consistent and secure data assets built on canonical entity schema for higher-level insights. Ensure data integrity and security, implementing procedures to maintain the highest levels of confidentiality and data protection. Partner with internal teams to define and implement solutions that improve business processes. Maintain the highest standards of development practices, including technical design, systems configuration, testing, and writing clean, modular code. Minimum Qualifications Bachelor's degree or equivalent practical experience. 8 years of experience in software development using one or more programming languages (e.g., Python, C, C++, Java, JavaScript). 3 years of technical leadership experience overseeing projects, with 2 years in people management or team leadership. Experience in data management, data integration, distributed databases, and SQL pipelines. Preferred Qualifications Master s degree or PhD in Computer Science or a related technical field. Experience implementing and integrating third-party applications in domains like Finance, Supply Chain, HR, and Marketing.
Senior/lead Data Engineer
Qualcomm
General Summary: Qualcomm is at the forefront of technological innovation, leveraging data-driven insights to power business decisions. We are seeking a Senior/Lead Data Engineer to design, develop, and implement advanced data solutions to support Qualcomm s business goals. This role will involve building scalable data pipelines, integrating large datasets, and collaborating with cross-functional teams to unlock the value of data. As a key technical leader, you will help shape Qualcomm s data infrastructure and work closely with data scientists, analysts, and business stakeholders to ensure the delivery of reliable and high-quality data solutions. Key Responsibilities: Design and implement scalable data pipelines and ETL processes for structured and unstructured data. Develop and optimize data lake, data warehouse, and real-time data processing solutions. Collaborate with data scientists, analysts, and product teams to understand data requirements and translate them into robust data solutions. Ensure data quality, reliability, and security across all data systems and pipelines. Build and maintain data models that support business intelligence and advanced analytics needs. Optimize data workflows for performance, scalability, and cost-efficiency. Provide technical leadership and mentorship to junior data engineers. Stay up to date with emerging technologies and recommend solutions to improve data architecture. Minimum Qualifications: Bachelor s or Master s degree in Computer Science, Information Systems, Engineering, or related field. 5+ years of experience in data engineering or related roles. Proficiency in Python, SQL, and Scala, with experience in building scalable ETL pipelines. Strong experience with big data technologies (e.g., Hadoop, Spark, Kafka). Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Redshift, BigQuery, Snowflake). Solid understanding of data modeling, data architecture, and real-time data processing. Experience with CI/CD, containerization (Docker, Kubernetes), and DevOps practices. Preferred Qualifications: Knowledge of machine learning pipelines and working with data science teams. Experience with streaming data frameworks (e.g., Apache Flink, Spark Streaming). Strong understanding of data governance, compliance, and security best practices. Excellent problem-solving, communication, and team collaboration skills. Why Join Qualcomm? At Qualcomm, you ll work on cutting-edge projects, collaborating with global teams to solve challenging problems. We offer: Continuous learning and growth opportunities. Flexible working arrangements and a supportive work culture. The chance to work with innovative technologies and industry leaders.
Big Data Platform Automation Engineer/senior Software Engineer
Hsbc
About HSBC If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you're aiming to reach the top or seeking an exciting new direction, HSBC offers opportunities, support, and rewards to take you further. As one of the largest banking and financial services organizations globally, with operations across 64 countries and territories, HSBC is committed to enabling businesses to thrive, economies to prosper, and ultimately, helping people fulfill their ambitions. The Role We are seeking an experienced Senior Software Engineer to join our team. You will become part of HSBC s Data Provisioning Technologies team, responsible for managing and working on the cutting edge of CDP (Cloudera Data Platform) and ODP (Open Data Platform) platforms. As part of one of the largest Big Data estates in the banking industry, you will be instrumental in creating engineering solutions for Hadoop platform pipelines and utilizing industry-leading cloud technologies. Responsibilities Contribute to Hadoop Engineering tasks, developing solutions for data pipeline management on CDP/ODP platforms. Work with Python, Ansible, and Kubernetes to create scalable, efficient solutions within a Big Data environment. Collaborate with the Data/Analytics teams to ensure the smooth operation of data systems and platforms. Design and implement technical solutions while adhering to best practices for CI/CD, DevOps, and GitOps methodologies. Develop and support solutions utilizing cloud technologies, ensuring the scalability and robustness of platforms. Contribute to debugging, troubleshooting, and maintaining the high-quality performance of data systems. Utilize Shell scripting, YAML, and modern automation tools to improve deployment and operational efficiency. Work with GitHub, Jenkins, Ansible for version control, continuous integration, and deployment. Requirements To be successful in this role, you should meet the following requirements: 3-6 years of experience in Hadoop Engineering with practical expertise in Python, Ansible, and DevOps methodologies. Strong knowledge of HDP (Hadoop Distribution), CDP, Linux, Python, Ansible, and Kubernetes. Proficient in Shell scripting, YAML, and technical design. Strong understanding of CI/CD concepts and hands-on experience with tools like GitHub, Jenkins, and Ansible. Familiarity with Test automation tools such as JUnit, Selenium, and Cucumber. Experience with industry-leading Cloud technologies and hands-on development in cloud environments. Working knowledge of GitOps and DevSecOps principles. Knowledgeable in Agile methodologies and ideally, certified in one of the frameworks. Strong communication and networking skills, with the ability to collaborate across teams. Ability to work autonomously, take accountability, and drive results in a high-pressure environment. A strong commitment to high-quality standards, and ownership of individual contributions. You ll have the opportunity to work on innovative projects at the forefront of the banking industry. A global platform with exposure to diverse teams and technologies. Join a company committed to professional development and career growth. Achieve more when you join HSBC. Qualification : 3-6 Years Experience in Hadoop Engineering with working experience on Python, Ansible DevOps methodologies.
1 - 20 of 249 BIG Data Engineer in Hyderabad jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted
1 - 20 of 249