Data Processing Jobs in Hyderabad
320 Jobs Found
Data Engineering Manager
Kanerika Software
Job Title: Data Engineering Manager Location: Hyderabad About Kanerika Kanerika Inc. is a leading global software products and services company dedicated to empowering data-driven enterprises. We help businesses accelerate digital transformation and maximize impact by delivering innovative, custom data solutions that optimize operations, enhance customer experiences, and fuel growth. Our Accolades Best Place to Work 2022 Great Place to Work Top 10 Most Recommended RPA Startups 2022 RPA Today Technology Innovation Award 2021 Frost & Sullivan India for Kompass composable solution Recognized for strong data privacy and security standards: ISO 27701, SOC2, GDPR compliant With a 4.5/5 Glassdoor rating, Kanerika fosters an inclusive, growth-oriented culture where employees thrive. We offer: Flexible working hours and generous parental leave Mandatory training on a safe and inclusive work environment Mentorship, professional development, and certification support Company-sponsored outings and work-life balance initiatives Join a vibrant, diverse community where your contributions truly matter. The Role We are looking for an experienced Data Engineering Manager to lead and inspire our data engineering team in Hyderabad. Partnering closely with Data Architects, you ll drive the design and development of scalable, cloud-based data pipelines and models, ensuring data quality, security, and performance. What You ll Do Lead and mentor a high-performing data engineering team, driving productivity and accountability. Collaborate with architects and development leads to build scalable, enterprise-grade data solutions. Oversee agile workflows, manage escalations, and coordinate hiring and resource planning. Use data-driven insights to guide team priorities and continuous improvement. Support pre-sales activities and work cross-functionally with sales and recruitment teams. Foster a culture of innovation, quality-first mindset, and customer focus. Who You Are A proactive leader with experience managing mid to large-sized teams and complex projects. An effective communicator, both verbally and in writing, with a knack for visually presenting ideas and core values. Results-oriented with a proven track record of delivering successful projects and publishing customer case studies. A process-driven, independent thinker who thrives under pressure and embraces continuous learning. Passionate about inclusivity and committed to contributing authentically to a diverse team environment.
Principal Solution Architect - Technical
Arcesium
Principal Solution Architect Technical Locations: Hyderabad Company: Arcesium Company Overview Arcesium is a global financial technology firm solving complex, data-intensive challenges for some of the world s most sophisticated financial institutions. Through relentless innovation, we empower clients to achieve transformational outcomes by delivering scalable and intelligent solutions that address critical needs in operations, data, and analytics. As the fintech industry evolves rapidly, Arcesium is uniquely positioned for strategic expansion. Our culture emphasizes intellectual curiosity, proactive ownership, and collaboration. We offer our people opportunities to make meaningful contributions from day one. About the Role We are seeking an experienced and strategic Principal Solution Architect to join our Client and Partner Development team as a Forward Deployed Solution Architect. This is a high-impact, client-facing role that blends technology, business strategy, and consulting. As a key liaison between clients and Arcesium s product teams, you will help articulate and deliver technically robust solutions that meet real-world investment management challenges. Your work will involve defining and delivering platform-powered, scalable architectures that create measurable business value for our clients. Key Responsibilities Solution Architecture & Delivery Collaborate with client stakeholders (CTOs, CDOs, Heads of Technology) to define and accelerate data strategies using Arcesium s platform. Deconstruct complex client problems and architect robust, scalable technical solutions using Arcesium s capabilities. Drive Proof of Concepts (PoCs), end-to-end solution delivery, and platform implementations. Client Engagement & Communication Present high-impact solutions via written proposals, diagrams, demos, and presentations. Lead governance, project planning, and expectation management for assigned clients. Collaborate with client-side development teams to onboard and train them on Arcesium's architecture, APIs, and data flow strategies. Internal Collaboration & Feedback Partner with Forward Deployed Engineers, Data Strategists, and Product Managers to ensure solution success. Provide feedback and improvement opportunities across products, processes, and solution delivery mechanisms. Represent Arcesium s technical capabilities in sales pitches, technical demos, and pre-sales discussions. Ideal Candidate Profile Experience & Background 7 12 years of client-facing experience in solutioning, technical consulting, implementations, or professional services. Prior experience in software development is a strong plus (languages: Python, Java, SQL). Experience managing cross-functional projects across business and technical domains. Technical Skills Deep understanding of solution architecture, system design, and data integration. Familiarity with cloud platforms (e.g., AWS), modern APIs, and data processing pipelines. Strong command of software engineering processes and DevOps practices. Soft Skills Outstanding communication and stakeholder management skills. Demonstrated ability to translate complex technical topics into simple, impactful solutions for diverse audiences. Comfortable working in a fast-paced, high-stakes client environment. Preferred Familiarity with financial services, investment management, or fintech is advantageous. Awareness of industry trends in data strategy, cloud infrastructure, and advanced analytics. Work at the intersection of finance and cutting-edge technology. Be a core part of strategic transformation for some of the world s leading financial institutions. Collaborate with high-caliber peers in a culture of ownership, growth, and excellence. Access continuous learning and development opportunities to accelerate your career. Equal Opportunity Employer Arcesium is an equal opportunity employer. We are committed to building a diverse and inclusive workforce. We welcome individuals from all backgrounds and walks of life to apply.
Senior Data Engineer
Blend360 India
Senior Data Engineer Hyderabad (On-site, Full-time) Location: Hyderabad, Telangana Work Type: On-site, Full-time Experience: 5+ Years Industry: AI & Data Science Company: Blend About Blend: Blend is a leading AI services company focused on solving real-world problems through the fusion of artificial intelligence, data science, and human ingenuity. We believe in co-creating meaningful impact by aligning top-tier talent with cutting-edge technology. Our goal is to deliver transformative solutions that unlock value for our clients and enrich the work and lives of our people. Job Overview: We are seeking a highly skilled Senior Data Engineer with strong experience in AWS, Databricks, Python, SQL, and Apache Spark/PySpark. You will be responsible for designing, developing, and maintaining scalable data architectures and pipelines to support analytics, machine learning, and business intelligence efforts across the organization. Key Responsibilities: Design and build scalable data pipelines using AWS services (Glue, Lambda, S3, EMR) and Databricks Notebooks & Workflows. Develop and manage robust ETL/ELT workflows using Python and SQL to handle structured and semi-structured data. Implement distributed data processing using Apache Spark or PySpark. Create and maintain data lakes in AWS Databricks. Collaborate with data scientists, analysts, and cross-functional teams to provide high-quality, accessible datasets. Ensure adherence to data governance, quality, and security best practices. Monitor, troubleshoot, and optimize the performance of data systems. Conduct code reviews and enforce engineering best practices. Mentor junior engineers and support their technical growth. Required Qualifications: Bachelor's or Master s degree in Computer Science, Engineering, or related field. 5+ years of experience in Data Engineering, with 2+ years working in AWS Databricks environments. Strong programming skills in Python for data processing and workflow automation. Advanced expertise in SQL for data transformation and querying large datasets. Proficient in distributed data processing using Apache Spark/PySpark. Solid understanding of data modeling, data warehousing, and performance optimization techniques. Hands-on experience with AWS services such as Glue, S3, Lambda, and EMR. Familiarity with version control tools like Git or CodeCommit. Experience with workflow orchestration tools like Airflow or AWS Step Functions (preferred but not mandatory). Be part of a forward-thinking, AI-driven organization. Work with cutting-edge cloud technologies and data platforms. Thrive in a culture of innovation, mentorship, and continuous learning. Enjoy opportunities to grow technically and professionally while driving real-world impact. Apply Now to join Blend as a Senior Data Engineer and help build data infrastructure that powers intelligent decision-making. Qualification : Bachelor's or Masters degree in Computer Science, Engineering, or related field.
Data Architect
Syren Technologies
Data Architect Hyderabad Experience: 10-17 Years Job Type: Full-Time | On-site/Hybrid Location: Hyderabad, India Industry: Data Engineering / Cloud Architecture Job Overview We are looking for an experienced Data Architect with 10+ years of expertise in designing, optimizing, and managing enterprise-scale data architectures on Azure Cloud. The ideal candidate will lead efforts to enhance data pipeline performance, ensure robust data governance, and drive cost-effective cloud resource utilization. If you excel in architecting scalable, secure, and high-performing data solutions, this is your chance to join a dynamic team in Hyderabad. Key Roles & Responsibilities Design, optimize, and maintain data pipelines, ETL processes, and complex queries to maximize performance and scalability. Improve query execution plans, indexing strategies, and optimize storage in Azure SQL, Azure Synapse Analytics, and Azure Data Lake. Implement advanced data management techniques such as data partitioning, caching, and compression for efficient data processing. Monitor cloud resource consumption and implement cost-saving strategies without impacting system performance. Optimize use of Azure services including Databricks, Data Factory, Synapse Analytics, and storage accounts to balance performance and cost. Establish and enforce coding standards, design patterns, and best practices for data pipeline development and cloud infrastructure management. Define and implement data governance, security, and compliance policies aligned with organizational and regulatory requirements. Develop and oversee CI/CD pipelines using DevOps methodologies tailored to data engineering workflows. Implement monitoring, alerting, and logging solutions using Azure Monitor, Log Analytics, and Application Insights to ensure system reliability. Architect solutions for high availability and disaster recovery to maintain business continuity. Optimize Power BI data models, DAX queries, and report performance; ensure governance and data refresh strategies meet business needs. Collaborate with cross-functional teams and business stakeholders to translate requirements into scalable and actionable data insights. Required Skills & Qualifications 10+ years of experience in data architecture, cloud data engineering, or related roles. Deep expertise in Azure Cloud data services: Azure SQL, Synapse Analytics, Data Lake, Databricks, Data Factory. Strong background in ETL pipeline optimization, query tuning, and storage management. Proven experience with data governance, security frameworks, and compliance standards. Familiarity with DevOps principles, especially CI/CD for data workflows. Expertise in monitoring tools like Azure Monitor, Log Analytics, and Application Insights. Hands-on experience optimizing Power BI solutions, including data modeling and report design. Excellent communication and stakeholder management skills. Work on large-scale, cutting-edge data projects impacting enterprise business decisions. Collaborate with a passionate, skilled team in a fast-paced, innovative environment. Competitive salary and benefits package. Opportunity to shape the future of data architecture within a leading organization. Apply Today If you are an expert Data Architect ready to take your career to the next level with advanced Azure data technologies, apply now and join our Hyderabad team!
Senior Data Engineer
Wallero Technologies
Job Title: Senior Data Engineer Location: Hyderabad, Telangana, India Job Type: Full-Time | Permanent Experience Required: 6+ Years Open Positions: 2 About the Role: We are seeking a highly skilled and experienced Data Engineer to join our team in Hyderabad. As a key member of our data engineering unit, you will be responsible for designing and optimizing end-to-end data pipelines using Python, PySpark, and Databricks. This role requires strong technical expertise, a passion for solving complex data challenges, and the ability to lead best practices within the Supply Chain data domain. Key Responsibilities: Develop and maintain scalable data pipelines using Python, PySpark, and Databricks for complex data transformation within Supply Chain operations. Implement advanced data engineering solutions that support real-time and batch data processing for analytics and business intelligence. Analyze, optimize, and refactor existing data workflows to improve performance and reliability. Collaborate with cross-functional teams to understand data requirements and translate them into robust technical solutions. Take ownership of projects and deliver high-quality outcomes with minimal supervision. Provide leadership and guidance on coding standards, design patterns, and data engineering best practices. Clearly communicate technical ideas and solutions to both technical and non-technical stakeholders. Required Skills & Qualifications: 6+ years of hands-on experience in data engineering. Proficient in Python, PySpark, and Databricks for building and maintaining data pipelines. Strong problem-solving skills with a proven ability to create innovative solutions for complex data challenges. Excellent communication and interpersonal skills; able to work effectively with cross-functional teams. Experience leading and mentoring team members on technical best practices and architecture decisions. Ability to work independently, manage priorities, and drive projects to completion with minimal oversight. Perks & Benefits: Competitive compensation package Exposure to cutting-edge technologies in cloud-based data engineering Opportunity to work on large-scale Supply Chain data solutions Collaborative, innovation-driven work environment Career growth and mentorship opportunities
Software Engineer III, Artificial Intelligence/Machine Learning
Google Careers
Software Engineer III - Artificial Intelligence/Machine Learning Company: Google Location: Hyderabad, Telangana, India Minimum Qualifications: Bachelor s degree or equivalent practical experience. 2 years of experience in software development with one or more programming languages, or 1 year with an advanced degree. 2 years of experience in data structures or algorithms. 1 year of experience in one or more of the following: Speech/audio technologies (e.g., voice recognition), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field. 1 year of experience with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging). Preferred Qualifications: Master's degree or PhD in Computer Science or related technical fields. Experience developing accessible technologies. About the Job Google's software engineers work on next-generation technologies that reshape how billions of users connect, explore, and interact with information. Our projects scale massively and extend well beyond web search. We're looking for engineers who can bring fresh ideas from diverse areas including information retrieval, distributed computing, large-scale system design, networking, data storage, security, artificial intelligence, natural language processing, UI design, and mobile technologies. As a software engineer, you will focus on critical projects and have opportunities to switch teams and roles as Google s fast-paced business grows. We need engineers who are versatile, demonstrate leadership skills, and are eager to tackle new challenges across the full-stack to help push technology forward. Our mission is to organize the world's information and make it universally accessible and useful. The Devices & Services team at Google combines AI, software, and hardware to create groundbreaking user experiences. We research, design, and develop new technologies to make user interactions faster, seamless, and more powerful. Whether capturing new ways to sense the world, advancing form factors, or improving interaction methods, the Devices & Services team is making a positive impact on people's lives through technology. Responsibilities Write product or system development code. Collaborate with peers and stakeholders through design and code reviews to ensure best practices (e.g., style guidelines, accuracy, testability, and efficiency). Contribute to documentation and educational content, adapting it based on updates and feedback. Triage product or system issues, debug, track, and resolve them by analyzing the sources of issues and their impact on hardware, network, or service operations. Implement solutions in one or more specialized Machine Learning (ML) areas, utilizing ML infrastructure and contributing to model optimization and data processing. Qualification : Bachelors degree or equivalent practical experience.
Azure Data Engineer
Quadrant Technologies
Job Title: Azure Data Engineer Location: Hyderabad / Bangalore (Hybrid) Job Type: Full-time Salary: Negotiable Position Overview: We are looking for an Azure Data Engineer with 5-8 years of experience to join our team. As an Azure Data Engineer, you will design, implement, and manage data solutions on the Microsoft Azure cloud platform. The ideal candidate will have a strong background in writing complex SQL stored procedures, implementing OLTP database solutions using Microsoft SQL Server, and working with Azure Synapse, PySpark, and Azure Databricks for big data processing. Key Responsibilities: Data Integration and Collaboration: Collaborate with cross-functional teams to gather, analyze, and document business requirements for data integration projects. Complex SQL Expertise: Write and optimize complex T-SQL, Dynamic SQL, and Spark SQL queries, including the creation of stored procedures for data transformation and business validation logic. Big Data Processing: Utilize Azure Synapse/Databricks to write notebooks using Spark SQL or PySpark for processing and analyzing large volumes of data. Data Pipeline Development: Develop and maintain robust data pipelines using Azure Data Factory to ensure seamless data flow across systems. OLTP Systems: Contribute to the enhancement and optimization of OLTP systems using SQL Server. Data Quality and Integrity: Ensure data quality, integrity, and accuracy in all systems. Programming and Algorithm Development: Utilize strong algorithmic programming skills to handle data processing and transformation. Qualifications: Educational Background: Bachelor s degree in Computer Science, Information Technology, or a related field. Experience: 5-8 years of experience in database development, data integration, and writing complex T-SQL queries. Technical Skills: Expertise in T-SQL and Spark SQL/PySpark (experience with Azure Synapse and Databricks is essential). Hands-on experience with Azure Data Factory for building data pipelines. Strong experience with OLTP systems using SQL Server. Problem-Solving Skills: Excellent problem-solving abilities with a strong focus on attention to detail. Adaptability: Ability to work in a collaborative and fast-paced environment, focusing on delivering high-quality solutions. Other Details: Notice Period: 0-15 days MAX Work Location: Hyderabad / Bangalore (Hybrid) If you're an experienced Azure Data Engineer with a passion for big data and cloud technologies, apply now to join our team and make an impact with innovative data solutions! Qualification : Bachelors degree in Computer Science, Information Technology, or a related field.
Senior Data Engineer
Zessta Software Services Pvt.ltd.
Job Title: Senior Data Engineer Company Name: Zessta Job Type: Full-time Responsibilities: Analyze customer data to enhance customer experience and provide actionable insights. Build and maintain integrations to support advanced data science workflows, ensuring seamless interaction with the Product API. Actively participate in onboarding and training clients on how to use the product effectively. Provide insights into client-to-business interactions, ensuring that the data can be leveraged for strategic decisions. Act as a liaison between the client and the organization, ensuring both parties' needs and expectations are met. Identify opportunities for clients to expand their usage of the product, driving engagement and long-term value. Address customer complaints and requests, offering product support to improve overall satisfaction and experience. Skills and Experience: Excellent communication and interpersonal skills to work effectively with clients and internal teams. Strong understanding of data modeling and architecture. Hands-on experience with data integrations and data pipelining tools to connect systems and enable smooth data flow. Proficiency in programming languages, preferably Python or R, to process and analyze data. Experience with container orchestration platforms like Docker and Kubernetes. Familiarity with distributed computing frameworks such as Spark, Hadoop, and Dask to handle large-scale data processing. Experience with version control software such as Git to manage code and collaborate with teams. Knowledge of project management tools such as JIRA to track and manage project progress and tasks. Familiarity with tools like Figma and Mixpanel is a plus. Education and Experience: Bachelor s or Master s degree from premier institutes (preferred). 4-12 years of relevant experience in data engineering, data science, or related fields. What We Offer: Competitive salary and benefits package. Opportunities for career growth and skill development. The chance to work on cutting-edge technologies and impactful projects. If you have a passion for data engineering and improving customer experience, and you're ready to take on new challenges, we'd love to hear from you. Apply now to join our team at Zessta and contribute to driving innovation and business success! Qualification : Bachelors or Masters degree from premier institutes (preferred).
Data Engineer-data Platforms
International Business Machines Corporation
Introduction In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients globally. Our centers provide locally-based skills and technical expertise to drive innovation and the adoption of new technologies. A career at IBM Consulting involves building long-term relationships and collaborating closely with clients across industries. You'll work alongside visionaries to help them on their hybrid cloud and AI journeys, enhancing the value and impact of some of the most innovative companies in the world. With access to IBM s strategic partner ecosystem and cutting-edge technology platforms, including IBM Software and Red Hat, you will be empowered to accelerate client transformations and create meaningful change. Curiosity and a constant quest for knowledge serve as the foundation for success at IBM. In your role, you'll be encouraged to challenge the status quo, explore ideas beyond your current role, and come up with creative solutions that will make a significant impact across a wide network of clients. Our culture of evolution and empathy is centered on long-term career growth and development opportunities in an environment that celebrates your unique skills and experience. Your Role and Responsibilities As a Data Engineer at IBM, you will be a critical player in designing and developing applications, while also providing guidance to project teams on complex coding, troubleshooting, and execution. Your key responsibilities include: Solution Design and Construction: Lead the design and construction of new data solutions using the latest technologies, ensuring business value and meeting user requirements. Continuous Improvement: Advocate for continuous improvement by testing solutions and working within an Agile framework to enhance and iterate the developed solutions. Innovation: Stay current with the latest technology trends, discovering and implementing creative solutions to solve business problems. Collaboration: Work with diverse teams to deliver impactful data solutions while ensuring scalability, quality, and performance. Required Education Bachelor s Degree in a relevant field Required Technical and Professional Expertise Apache Spark (PySpark): In-depth knowledge of Spark s architecture, core APIs, and using PySpark for distributed data processing. Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts. Proficiency in Python: Expertise in Python programming, particularly focused on data processing and manipulation. Data Processing Frameworks: Experience with Pandas, NumPy, and other data processing libraries. SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation. Cloud Platforms: Experience working with cloud platforms such as AWS, Azure, or GCP, including working with cloud storage systems. Preferred Technical and Professional Experience Architecture Strategy: Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring of data solutions. Cross-Team Collaboration: Partnering with technology teams, including application development, enterprise architecture, testing services, and network engineering. Security: Familiarity with detection and prevention tools for company products and customer-facing platforms. How You ll Grow At IBM, we offer opportunities for career development and provide an environment where you are encouraged to continuously grow, learn, and expand your expertise. Working with cutting-edge technologies and a diverse set of clients, you will be able to stay ahead of industry trends and make meaningful contributions that have a real impact. About IBM Consulting IBM Consulting helps organizations tackle their most pressing challenges through innovative and agile solutions. By partnering with clients, we drive technology transformations, helping them optimize their operations and leverage new technologies like AI, cloud, and data. Our team s expertise spans across many industries, delivering solutions that enable clients to navigate digital transformations. This role offers an exciting opportunity to work with leading technologies while contributing to client success in a highly dynamic environment. If you re passionate about solving complex data problems and delivering impactful solutions, IBM Consulting is the place to grow your career. Qualification : Bachelors Degree in a relevant field
Senior Data Engineer
Omniwyse Technologies
Job Description We are looking for a passionate engineer interested in working at an early-stage startup building innovative cloud-native data protection solutions. The ideal candidate must be comfortable learning and scoping business requirements to develop effective solutions. This is a great opportunity for engineers who are eager to step out of their comfort zone and solve impactful modern data security concerns. Desired Background and Experience: Must be a problem solver with the ability to think critically and creatively. Minimum of 8 years of experience building products using Java and/or Python. Prior experience in startups is a huge plus. Comfortable with rapid prototyping and implementation of products in an agile team environment. Data engineering experience with implementation of data ingestion, ETL, data pipeline/workflows. Experience implementing database views and UDFs to control access to data using row and column filters. Working experience in databases and data warehouses. Proficient in one or more of the following: AWS RDS, AWS Data Lake, Redshift, Athena, Databricks, and Snowflake. Experience implementing data solutions using Spark. Ability to write and tune complex SQL queries.
Data Engineer
Wallero Technologies
Job Description Location: Hyderabad, Telangana, India Job Type: Permanent (full-time) Experience: 6+ years No. of Openings: 2 Key Responsibilities: Tech Stack Expertise: Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. Innovative Problem-Solving: Demonstrate technical expertise by thinking creatively and providing innovative solutions to complex data-related challenges, pushing boundaries in Supply Chain data analytics. Communication Skills: Exceptional communication abilities to effectively convey technical concepts, collaborate with cross-functional teams, and articulate solutions to non-technical stakeholders. Autonomous Work: Ability to work independently and proactively, taking ownership of projects, and delivering high-quality solutions with minimal supervision. Guidance and Best Practices: Lead the team by setting coding standards, advocating for reusable and modularized code, implementing design patterns, and guiding on best practices in data engineering. Perks and Benefits: Strong expertise in Python, Pyspark, and Databricks, with hands-on experience in developing and optimizing data pipelines for complex data transformations. Exceptional problem-solving skills, with a demonstrated ability to think creatively and develop innovative solutions for data-related issues. Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders. Self-driven and autonomous work style, capable of taking ownership of projects and delivering high-quality results independently. Experience in guiding and mentoring teams on coding standards, design patterns, and best practices in data engineering.
Senior Data Analyst
Iq Eq Regcom Limited
Job Description Responsibilities We have a fantastic opportunity for an experienced Data Analyst join our global Data Transformation team. This role will play a major part in the delivery of our Group Data Strategy and Data Transformation Journey by delivering, enhancing, and maintaining our IQEQ Data Platform which will drive how our data is managed and used to deliver outcomes in a host of key areas to maximise business value and growth delivering improvements for internal and external stakeholders and clients. In this role, you will drive requirements gathering and deliver appropriate solutions aligned with project goals. You will document functional designs, implement proper controls around business requests, and collaborate globally on Data Platform Data Services design initiatives. The role involves identifying and documenting system gaps and enhancements, working cross-functionally with IT teams to deliver high-quality solutions, and continuously seeking process improvements. Success requires quick adaptation to understand both client and internal stakeholder needs, ensuring efficient delivery of business requirements. Experience (what does the role do on a day-to-day basis) Experience of coding in programming languages such SQL (required), Python (required), Java and Excel VBA. Data analysis experience, database administration knowledge, data mining and manipulation. Proficient in MS Excel with a working knowledge of Excel VBA. Comfortable using APIs, SQL query writing, report development / BI tools (Crystal, SSRS, SSIS, Tableau). Experience of writing technical documentation and presenting information clearly to senior stakeholders. Knowledge of the funds industry and accounting knowledge beneficial. Working in global environment. Key behaviours we expect to see In addition to demonstrating our Group Values (Authentic, Bold, and Collaborative), the role holder will be expected to demonstrate the following: Communicates Effectively Adjusting communication style to fit the audience & message. Providing timely information to help others across the organisation. Encourages the open expression of diverse ideas and opinions Action Orientated Readily taking action on challenges without unnecessary planning and identifies new opportunities, taking ownership of them Interpersonal Savvy Relating comfortably with people across all levels, functions, cultures & geographies. Builds rapport in an open, friendly & accepting way An analytical mind, excellent problem-solving & diagnostic skills, attention to detail Qualifications Required Experience Education / professional qualifications Bachelor's degree in computer science or another technical field 8-10 years of experience in a Data Analyst capacity Background in Financial Industry preferable in the Alternative Asset management domain Experience with Investment management accounting system such as Investran, Paxus, Efront etc preferrable Background & Technical experience Knowledge of BI, Data and Analytics Knowledge of programming languages, SQL, Python, Knowledge of Excel Formulas Excellent analytical and numerical skills. Strong problem solving and conceptual thinking. Other company, product, and market knowledge Experience of working in a complex, multi-country professional services, financial services or BPO organisation with complex processing requirements Multi-country experience and demonstrates an ability to work in a multi-cultural, talented, and demanding team environment. Possess the skills and the personality to operate effectively in a very fast-paced complex global business with an in-depth knowledge of program management Excellent communication skills in both written and oral form, with staff members, customers, suppliers, and the management team with the ability to make decisions, act and get results Passion, dynamism, and drive Personal presence, integrity, and credibility Ability to solve problems either independently or by utilising other members of the team where necessary Strong analytical and troubleshooting skills. Ability to investigate and analyse information, and to draw conclusions. Ability to meet and adhere to internal and external deliverables whilst maintaining an exceptionally high standard. Languages Must be fully proficient in spoken and written English, additional European languages will be an asset Qualification : Bachelor's degree in computer science or another technical field
Python Developer
Machint Solutions
Python Developer Experience: 5-10 Years Job type: New Employment type: Permanent Job function: Information Technology Preferred work mode: Work from office Location: Hyderabad Job description: Design and implement integrations between our games and various social networks using a combination of PHP and Javascript SDKs In depth knowledge and experience of object-oriented analysis and design, with - Java and Java EE technologies, using frameworks such as Spring/Jersey essential Familiarity with source control (Subversion, git), bug tracking systems (JIRA), build and dependency management systems (ant, ivy, maven), continuous integration, packaging and deployment. Experience in software development based on common agile application development methodologies, TDD/BDD/Scrum/Kanban Develop large and complex modules and components of larger system designs Design large and complex modules and components of larger system designs Actively participate in quality assurance activities including design and code reviews, unit testing, defect fixes, operational readiness Develop and conduct targeted technical mentoring, training and workshops Understand, and be able to articulate, the distinction between game-specific features and game-agnostic features Design and implement APIs and services that provide a strong and stable platform that can be leveraged by all our games
Kafka Developer
Wilco Source Technologies Pvt. Ltd
Job Requirements What You Will Do Design and develop high-volume, low-latency applications for mission-critical systems, ensuring high availability and performance. Drive the design, development, and delivery of cutting-edge features for Kafka on Confluent / Apache Kafka. Develop programs using Kafka APIs and Kafka Streams API. Define partitioning strategies and configure brokers, topics, producers, consumers, schema registry, and KSQL. Optimize and tune Kafka performance to ensure efficiency and scalability. Implement kStream applications in Java, including handling grouping, aggregation, and more. Demonstrate scaling expertise in managing kStream applications. Ensure designs comply with specifications and best practices. Contribute to all phases of the development lifecycle, from requirement analysis to deployment and maintenance. Apply knowledge and experience with cloud technologies to support scalable and resilient Kafka deployments.
Senior Python Developer
Blend360 India
Role Overview: We are looking for a Software Engineer to play a key role in migrating our workflow orchestration system from Azkaban to Apache Airflow. This is a high-impact opportunity to contribute to modernizing our data processing infrastructure, working on a critical migration project that will enhance the performance and scalability of our systems. Key Responsibilities: Migration Strategy: Design, develop, and execute the migration strategy from Azkaban to Apache Airflow, ensuring a smooth transition and minimal disruption to ongoing operations. Automation: Develop Python scripts and automation tools to support the migration process and automate various tasks such as calling APIs and performing database interactions. Testing and Data Validation: Implement best practices for testing and data validation to ensure the accuracy and reliability of the migrated workflows. Process Automation: Collaborate with the development team to automate several manual processes related to release, upgrades, and deployments, improving operational efficiency. Collaboration: Work closely with platform owners and data teams to ensure that workflows continue to operate with the same performance and reliability post-migration. Optimization: Optimize Airflow DAGs for efficiency, modularity, and maintainability, ensuring scalable and high-performance data pipelines. DevOps Practices: Leverage previous DevOps experience focusing on continuous deployment and monitoring, ensuring the smooth and continuous operation of the migration process. Qualifications: Education: Bachelor s degree in Computer Science, Software Engineering, or a related field. Programming Languages: Proficiency in Python for writing automation scripts, including calling APIs and interacting with databases. Kubernetes Ecosystem: Experience creating YAMLs and Helm charts for managing Kubernetes resources. DevOps Experience: Hands-on experience with DevOps practices, particularly focusing on continuous deployment and monitoring. Orchestration System: Proficiency with Apache Airflow or any orchestration system; experience in creating DAGs to run custom workflows is a plus. Jupyter Notebooks: Familiarity with Jupyter notebooks for data processing and analysis is a plus. Qualification : Bachelors degree in computer science, Software Engineering, or a related field.
Aws Cloud Administrator
Technovert
AWS Cloud Admin Data Science Team We are seeking an experienced AWS Cloud Admin to join our Data Science Team. The ideal candidate will have 5 to 8 years of experience in managing AWS cloud infrastructure. The AWS Cloud Admin will be responsible for ensuring the reliability, security, and performance of our cloud environment to enable us to efficiently analyze and derive insights from large datasets. Key Responsibilities: Manage and monitor AWS services, including EC2, S3, RDS, and Redshift. Implement and maintain security best practices for AWS environments. Troubleshoot and resolve issues related to AWS infrastructure. Collaborate with data scientists and engineers to optimize AWS resources for data processing and analysis. Implement automation and scripting solutions to streamline AWS administration tasks. Stay up-to-date on AWS best practices and new features to continuously improve our cloud infrastructure. Qualifications: Experience: 4+ years of experience in cloud infrastructure management, with at least 2 years focusing on AWS services. In-depth knowledge of AWS services including EC2, S3, Lambda, RDS, SQS, SNS, IAM, CloudWatch, Redshift, and SageMaker. Strong experience in automation and configuration management tools such as Terraform, CloudFormation, or Ansible. Knowledge of cloud security best practices, including managing IAM roles and policies, encryption, and data protection in the cloud. Proficiency in Python, Bash, or other scripting languages for automation tasks. Experience with AWS CloudWatch, CloudTrail, and other monitoring tools for analyzing logs, alerts, and resource performance. Nice to Have: Experience on Azure DevOps.
Senior/lead Data Engineer
Qualcomm
General Summary: Qualcomm is at the forefront of technological innovation, leveraging data-driven insights to power business decisions. We are seeking a Senior/Lead Data Engineer to design, develop, and implement advanced data solutions to support Qualcomm s business goals. This role will involve building scalable data pipelines, integrating large datasets, and collaborating with cross-functional teams to unlock the value of data. As a key technical leader, you will help shape Qualcomm s data infrastructure and work closely with data scientists, analysts, and business stakeholders to ensure the delivery of reliable and high-quality data solutions. Key Responsibilities: Design and implement scalable data pipelines and ETL processes for structured and unstructured data. Develop and optimize data lake, data warehouse, and real-time data processing solutions. Collaborate with data scientists, analysts, and product teams to understand data requirements and translate them into robust data solutions. Ensure data quality, reliability, and security across all data systems and pipelines. Build and maintain data models that support business intelligence and advanced analytics needs. Optimize data workflows for performance, scalability, and cost-efficiency. Provide technical leadership and mentorship to junior data engineers. Stay up to date with emerging technologies and recommend solutions to improve data architecture. Minimum Qualifications: Bachelor s or Master s degree in Computer Science, Information Systems, Engineering, or related field. 5+ years of experience in data engineering or related roles. Proficiency in Python, SQL, and Scala, with experience in building scalable ETL pipelines. Strong experience with big data technologies (e.g., Hadoop, Spark, Kafka). Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Redshift, BigQuery, Snowflake). Solid understanding of data modeling, data architecture, and real-time data processing. Experience with CI/CD, containerization (Docker, Kubernetes), and DevOps practices. Preferred Qualifications: Knowledge of machine learning pipelines and working with data science teams. Experience with streaming data frameworks (e.g., Apache Flink, Spark Streaming). Strong understanding of data governance, compliance, and security best practices. Excellent problem-solving, communication, and team collaboration skills. Why Join Qualcomm? At Qualcomm, you ll work on cutting-edge projects, collaborating with global teams to solve challenging problems. We offer: Continuous learning and growth opportunities. Flexible working arrangements and a supportive work culture. The chance to work with innovative technologies and industry leaders.
Big Data Platform Automation Engineer/senior Software Engineer
Hsbc
About HSBC If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you're aiming to reach the top or seeking an exciting new direction, HSBC offers opportunities, support, and rewards to take you further. As one of the largest banking and financial services organizations globally, with operations across 64 countries and territories, HSBC is committed to enabling businesses to thrive, economies to prosper, and ultimately, helping people fulfill their ambitions. The Role We are seeking an experienced Senior Software Engineer to join our team. You will become part of HSBC s Data Provisioning Technologies team, responsible for managing and working on the cutting edge of CDP (Cloudera Data Platform) and ODP (Open Data Platform) platforms. As part of one of the largest Big Data estates in the banking industry, you will be instrumental in creating engineering solutions for Hadoop platform pipelines and utilizing industry-leading cloud technologies. Responsibilities Contribute to Hadoop Engineering tasks, developing solutions for data pipeline management on CDP/ODP platforms. Work with Python, Ansible, and Kubernetes to create scalable, efficient solutions within a Big Data environment. Collaborate with the Data/Analytics teams to ensure the smooth operation of data systems and platforms. Design and implement technical solutions while adhering to best practices for CI/CD, DevOps, and GitOps methodologies. Develop and support solutions utilizing cloud technologies, ensuring the scalability and robustness of platforms. Contribute to debugging, troubleshooting, and maintaining the high-quality performance of data systems. Utilize Shell scripting, YAML, and modern automation tools to improve deployment and operational efficiency. Work with GitHub, Jenkins, Ansible for version control, continuous integration, and deployment. Requirements To be successful in this role, you should meet the following requirements: 3-6 years of experience in Hadoop Engineering with practical expertise in Python, Ansible, and DevOps methodologies. Strong knowledge of HDP (Hadoop Distribution), CDP, Linux, Python, Ansible, and Kubernetes. Proficient in Shell scripting, YAML, and technical design. Strong understanding of CI/CD concepts and hands-on experience with tools like GitHub, Jenkins, and Ansible. Familiarity with Test automation tools such as JUnit, Selenium, and Cucumber. Experience with industry-leading Cloud technologies and hands-on development in cloud environments. Working knowledge of GitOps and DevSecOps principles. Knowledgeable in Agile methodologies and ideally, certified in one of the frameworks. Strong communication and networking skills, with the ability to collaborate across teams. Ability to work autonomously, take accountability, and drive results in a high-pressure environment. A strong commitment to high-quality standards, and ownership of individual contributions. You ll have the opportunity to work on innovative projects at the forefront of the banking industry. A global platform with exposure to diverse teams and technologies. Join a company committed to professional development and career growth. Achieve more when you join HSBC. Qualification : 3-6 Years Experience in Hadoop Engineering with working experience on Python, Ansible DevOps methodologies.
Engineer- Ml/compiler
Qualcomm
Job Overview Qualcomm is a leading technology innovator, driving digital transformation to enable smarter, connected experiences for all. As a Software Engineer within the LLVM Tools Group, you will work on the LLVM toolchain for various architectures like ARM, Hexagon, and RISCV. This toolchain includes a range of tools such as compilers, linkers, debuggers, and profilers. As part of the QA and Support team, your primary role will be to ensure that software products are reliable, functional, and meet the required quality standards. You will collaborate with development teams and customers to address issues and improve software throughout the development lifecycle. Key Responsibilities Test Planning: Develop comprehensive test plans and test cases based on software requirements and specifications. Test Execution: Perform manual and automated testing to identify defects and ensure software functionality. Bug Reporting: Analyze test failures/regressions and report bugs to the development team, ensuring timely tracking and resolution. Collaboration: Work closely with developers and customers to understand software design, provide feedback on improvements, and actively participate in process improvement efforts. Documentation: Maintain detailed documentation of test procedures, results, and issues encountered during the testing process. Quality Assurance: Ensure the final product meets Qualcomm s quality standards and customer expectations. Minimum Qualifications Education: Bachelor s or Master s degree in Engineering, Information Systems, Computer Science, or a related field. Experience: 2-5 years of experience in software quality assurance or software customer support. Programming Skills: Experience with programming languages such as C, C++, Python, etc. Preferred Qualifications Embedded Systems/Kernel Testing: Experience with software development and testing on embedded systems, Linux kernel, or firmware. Testing Toolchain: Hands-on experience testing compilers and embedded software development toolchains. Automation: Experience in software refactoring, test automation, and machine learning. Tools: Proficiency in tools like Perl, Python, shell scripting, make, cmake, and git. Command-Line: Experience working on both Windows and Linux environments. Development Tools: Knowledge of compilers, assemblers, linkers, and simulators used in software development. Test Automation: Experience in architecting and developing test automation tools (web, embedded systems). Problem Solving: Expert-level analysis, diagnosis, and troubleshooting abilities. Communication: Strong presentation and communication skills to effectively share insights with cross-functional teams. Qualification : Bachelors or Masters degree in Engineering, Information Systems, Computer Science, or a related field.
Software Developer _ Ai/ml
Ibm India
Introduction At IBM, work is more than a job it s a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you ve never thought possible. Are you ready to lead in this new era of technology and solve some of the world s most challenging problems? If so, lets talk. Your Role and Responsibilities We re looking for software development candidates that want to turn ideas into reality, focus on innovation and development in our modernization journey. Our Strategic Product Development team creates and delivers exciting product features that impact the business to be successful. You ll work alongside global and local multidisciplinary teams of Developers, Architects and Analysts focused on the next generation of solutions. Do you enjoy working and thrive in a Challenging yet collaborative team environment? Passionate about technology and software? You have extremely strong analytical, problem-solving and troubleshooting skills? If so, you ll fit right in with our team. You employ creative thinking and collaboration as the foundation of your daily approach towards our Product development team. At IBM, job is more than work! It offers you thrive on career as well as on skills to be latest with a perfect work-life balance. Required Technical and Professional Expertise 2 10 years of relevant industry experience in Artificial Intelligence and Machine Learning Platforms with specialization in Generative AI. Solid experience of Python Programming Language. Experience with Large Language Models and Natural Language Processing Familiarity with the Pytorch framework Experience with software development lifecycle Excellent problem determination skills Excellent written and oral communication skills Excellent organizational skills Preferred Technical and Professional Expertise Design experience for supporting new requirements. Willingness to learn new skills and technologies. Experience using git and github Familiarity with Node.js and creating VS Code extensions Flexible to work between development/test/support roles. Knowledge on other programming languages (C/C++, Java, Open-Source Programming Languages) is added advantage.
1 - 20 of 320 Data Processing in Hyderabad jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted
1 - 20 of 320