Apache Hbase Jobs in Hyderabad
54 Jobs Found
Ai Solution Architect
Zl Tech
AI Solution Architect Full-Time | Hyderabad, India Department: Engineering Experience: 10+ years in AI/ML Location: On-site | Hyderabad, Telangana Salary: Competitive, based on experience About the Role We are looking for an experienced and visionary AI Solutions Architect to design, build, and scale advanced AI/ML solutions as part of our cutting-edge ZL Platform. This role requires deep technical expertise in machine learning, large language models (LLMs), model deployment, and a strong understanding of customer-driven product development. You'll collaborate with cross-functional teams Engineering, Product, Sales to translate business needs into impactful AI systems. Key Responsibilities Architect and lead the development of scalable AI/ML solutions integrated with the ZL Platform. Partner with Engineering, Product, and Sales teams to deliver PoC (proof of concept) demos and ensure successful customer adoption. Take ownership of AI and machine learning components, ensuring high quality, maintainability, and performance. Collaborate directly with customers and stakeholders to understand business problems and deliver technically sound solutions. Stay current with AI research and industry trends including model quantization, transformers, and vector databases and integrate advancements into platform architecture. Fine-tune and deploy LLMs (Large Language Models) using frameworks like PyTorch and Hugging Face Transformers. Provide mentorship to engineering teams and contribute to a culture of technical excellence and innovation. Optimize models for deployment in real-world environments with a focus on latency, scalability, and resource efficiency. Translate business problems into AI opportunities and present solutions to internal and external stakeholders. Preferred Skills & Expertise Strong background in deep learning, natural language processing (NLP), and LLMs. Experience with PyTorch, transformers, and AI model quantization and deployment. Production-level experience in deploying ML models in enterprise SaaS environments. Working knowledge of vector databases and semantic search optimization. Proven experience in PoC development, technical solution design, and delivering enterprise AI solutions. Familiarity with cloud platforms (e.g., Azure AI, AWS, GCP) for model hosting and orchestration. Qualitative Expectations Strong ownership mindset you own problems end-to-end and proactively fill knowledge gaps to deliver solutions. Thrive in fast-paced, evolving environments with loosely defined problems and multiple priorities. Excellent communicator with the ability to present technical concepts to both technical and non-technical audiences. Passionate about learning and sharing findings with peers; an enthusiastic self-starter and collaborator. Strong track record of innovation and continuous improvement. Education & Experience Master s or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related discipline. 10+ years of professional experience in AI/ML, with hands-on experience designing, deploying, and scaling machine learning systems in production. Work at the forefront of enterprise AI and LLM innovation. Collaborate with world-class engineering, research, and product teams. Contribute to the development of AI products used by global enterprises. Competitive compensation and professional growth opportunities. Apply now to join us as an AI Solution Architect in Hyderabad. Qualification : Masters or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related discipline.
Senior Data Engineer
Blend360 India
Senior Data Engineer Hyderabad (On-site, Full-time) Location: Hyderabad, Telangana Work Type: On-site, Full-time Experience: 5+ Years Industry: AI & Data Science Company: Blend About Blend: Blend is a leading AI services company focused on solving real-world problems through the fusion of artificial intelligence, data science, and human ingenuity. We believe in co-creating meaningful impact by aligning top-tier talent with cutting-edge technology. Our goal is to deliver transformative solutions that unlock value for our clients and enrich the work and lives of our people. Job Overview: We are seeking a highly skilled Senior Data Engineer with strong experience in AWS, Databricks, Python, SQL, and Apache Spark/PySpark. You will be responsible for designing, developing, and maintaining scalable data architectures and pipelines to support analytics, machine learning, and business intelligence efforts across the organization. Key Responsibilities: Design and build scalable data pipelines using AWS services (Glue, Lambda, S3, EMR) and Databricks Notebooks & Workflows. Develop and manage robust ETL/ELT workflows using Python and SQL to handle structured and semi-structured data. Implement distributed data processing using Apache Spark or PySpark. Create and maintain data lakes in AWS Databricks. Collaborate with data scientists, analysts, and cross-functional teams to provide high-quality, accessible datasets. Ensure adherence to data governance, quality, and security best practices. Monitor, troubleshoot, and optimize the performance of data systems. Conduct code reviews and enforce engineering best practices. Mentor junior engineers and support their technical growth. Required Qualifications: Bachelor's or Master s degree in Computer Science, Engineering, or related field. 5+ years of experience in Data Engineering, with 2+ years working in AWS Databricks environments. Strong programming skills in Python for data processing and workflow automation. Advanced expertise in SQL for data transformation and querying large datasets. Proficient in distributed data processing using Apache Spark/PySpark. Solid understanding of data modeling, data warehousing, and performance optimization techniques. Hands-on experience with AWS services such as Glue, S3, Lambda, and EMR. Familiarity with version control tools like Git or CodeCommit. Experience with workflow orchestration tools like Airflow or AWS Step Functions (preferred but not mandatory). Be part of a forward-thinking, AI-driven organization. Work with cutting-edge cloud technologies and data platforms. Thrive in a culture of innovation, mentorship, and continuous learning. Enjoy opportunities to grow technically and professionally while driving real-world impact. Apply Now to join Blend as a Senior Data Engineer and help build data infrastructure that powers intelligent decision-making. Qualification : Bachelor's or Masters degree in Computer Science, Engineering, or related field.
Senior Data Engineer
Zessta Software Services Pvt.ltd.
Job Title: Senior Data Engineer Company Name: Zessta Job Type: Full-time Responsibilities: Analyze customer data to enhance customer experience and provide actionable insights. Build and maintain integrations to support advanced data science workflows, ensuring seamless interaction with the Product API. Actively participate in onboarding and training clients on how to use the product effectively. Provide insights into client-to-business interactions, ensuring that the data can be leveraged for strategic decisions. Act as a liaison between the client and the organization, ensuring both parties' needs and expectations are met. Identify opportunities for clients to expand their usage of the product, driving engagement and long-term value. Address customer complaints and requests, offering product support to improve overall satisfaction and experience. Skills and Experience: Excellent communication and interpersonal skills to work effectively with clients and internal teams. Strong understanding of data modeling and architecture. Hands-on experience with data integrations and data pipelining tools to connect systems and enable smooth data flow. Proficiency in programming languages, preferably Python or R, to process and analyze data. Experience with container orchestration platforms like Docker and Kubernetes. Familiarity with distributed computing frameworks such as Spark, Hadoop, and Dask to handle large-scale data processing. Experience with version control software such as Git to manage code and collaborate with teams. Knowledge of project management tools such as JIRA to track and manage project progress and tasks. Familiarity with tools like Figma and Mixpanel is a plus. Education and Experience: Bachelor s or Master s degree from premier institutes (preferred). 4-12 years of relevant experience in data engineering, data science, or related fields. What We Offer: Competitive salary and benefits package. Opportunities for career growth and skill development. The chance to work on cutting-edge technologies and impactful projects. If you have a passion for data engineering and improving customer experience, and you're ready to take on new challenges, we'd love to hear from you. Apply now to join our team at Zessta and contribute to driving innovation and business success! Qualification : Bachelors or Masters degree from premier institutes (preferred).
Kafka Developer
Wilco Source Technologies Pvt. Ltd
Job Requirements What You Will Do Design and develop high-volume, low-latency applications for mission-critical systems, ensuring high availability and performance. Drive the design, development, and delivery of cutting-edge features for Kafka on Confluent / Apache Kafka. Develop programs using Kafka APIs and Kafka Streams API. Define partitioning strategies and configure brokers, topics, producers, consumers, schema registry, and KSQL. Optimize and tune Kafka performance to ensure efficiency and scalability. Implement kStream applications in Java, including handling grouping, aggregation, and more. Demonstrate scaling expertise in managing kStream applications. Ensure designs comply with specifications and best practices. Contribute to all phases of the development lifecycle, from requirement analysis to deployment and maintenance. Apply knowledge and experience with cloud technologies to support scalable and resilient Kafka deployments.
Php Developer With Cms
Yagna Technologies Private Limited
Job Description: We are looking for PHP Developers who are passionate about technology and want to be part of an innovative and growth-oriented information technology company. If you're excited to work on cutting-edge projects and improve your skills, we'd love to hear from you. Key Responsibilities: PHP Development: Write clean, logical, well-documented, and reusable code. Develop and maintain web applications using PHP 5 and OOP principles. WordPress Development: Extensive experience in building WordPress CMS websites. Create custom WordPress plugins/widgets to extend website functionality. Integrate themes/templates (from Photoshop layouts through HTML/CSS to a custom theme). WordPress Network (Multisite): Experience with WordPress Multisite (optional but advantageous). Multilingual Websites: Exposure to creating multi-lingual websites is a plus. Skills & Experience Required: PHP Development: Strong knowledge of PHP 5 and Object-Oriented Programming (OOP). WordPress Development: Good experience with building WordPress CMS websites. Ability to create plugins/widgets and work with themes. Theme/Template Integration: Experience in integrating designs from Photoshop through HTML/CSS to custom WordPress themes. Optional Skills: WordPress Multisite knowledge is a plus. Exposure to multilingual websites is advantageous. Opportunities for Trainees: For Freshers: If you're a fresher with a good knowledge of PHP and CMS, we are open to giving you an opportunity to work with us based on your eligibility.
Performance Test Engineer
Zl Tech
Performance Test Engineer Full-Time | Hyderabad, India Department: Engineering Experience: 4 to 6 Years Location: On-site | Hyderabad, Telangana Work Hours: Flexibility to support US time zone Salary: Competitive, based on experience Job Summary We are hiring a skilled and analytical Performance Test Engineer to lead and execute performance testing initiatives for our enterprise-grade applications. This role is ideal for someone with hands-on experience in load testing, scalability analysis, and performance bottleneck resolution using tools like JMeter or LoadRunner. You'll collaborate with cross-functional teams to optimize system performance and ensure a seamless user experience at scale. Key Responsibilities Design and implement comprehensive performance test plans, including load, stress, and scalability testing. Identify and diagnose performance bottlenecks in backend systems, APIs, and databases. Collaborate with software developers, DevOps, and QA engineers to resolve performance issues and optimize infrastructure. Execute performance test scenarios using tools such as Apache JMeter, LoadRunner, or similar performance testing frameworks. Write and maintain performance test scripts and automation tools as required. Analyze test results, generate reports, and provide actionable insights and recommendations for system improvements. Advocate for performance engineering best practices across teams. Contribute to system architecture and capacity planning by offering data-driven insights. Stay up to date on emerging trends, tools, and methodologies in performance engineering and testing. Provide regular updates and performance metrics reports to leads and stakeholders. Required Skills & Qualifications Bachelor s degree in Computer Science, Engineering, or related discipline. 4 6 years of experience in software testing, with at least 2+ years of dedicated performance testing experience. Proficient in tools like JMeter, LoadRunner, or similar performance testing platforms. Strong scripting and debugging skills experience in Java or Python is a plus. Excellent understanding of SQL queries and database concepts for backend performance testing. Strong knowledge of SDLC and STLC, including test planning, test case creation, defect tracking, and reporting. Solid problem-solving skills with the ability to think critically and troubleshoot complex systems. Strong interpersonal and communication skills for collaboration with global teams. Ability to work during US time zones, when required. Preferred/Bonus Skills (Good to Have) Hands-on experience with Azure or other cloud platforms. Exposure to CI/CD pipelines and performance testing within DevOps workflows. Knowledge of additional scripting languages (e.g., Shell, PowerShell, Bash). Experience with monitoring tools like Grafana, New Relic, or Dynatrace. Work on high-scale enterprise platforms with real performance challenges. Collaborate with talented engineers across multiple geographies. Flexible work hours supporting US-based clients. Competitive salary and growth-oriented culture. Apply today to join us as a Performance Test Engineer in Hyderabad and help us scale our applications to the next level of performance and reliability!
Senior Search Engineer
Zl Tech
Senior Search Engineer Full-Time | Hyderabad, India Department: Engineering Location: Hyderabad (On-site) Experience: 5+ Years Industry: Enterprise Software / Search Technology Employment Type: Full-Time Salary: Competitive & Based on Experience Job Summary We are seeking a highly experienced and technically proficient Senior Search Engineer with deep expertise in Apache Lucene and related search technologies. In this role, you will architect, develop, and optimize complex search functionalities within our enterprise platform. Your work will directly impact search scalability, performance, and accuracy across high-throughput, data-driven applications. Key Responsibilities Design, build, and maintain robust search infrastructure using Lucene and Lucene-based frameworks. Integrate Lucene search features into large-scale, enterprise-grade applications and manage ongoing system upgrades. Tune indexing strategies and optimize search algorithms for performance, accuracy, and efficiency. Conduct comprehensive performance testing and profiling to identify system bottlenecks and implement improvements. Create and manage custom analyzers, tokenizers, and filters to meet advanced business search requirements. Troubleshoot and resolve complex search-related issues across systems and environments. Monitor and evaluate emerging trends in search engines, text processing, and machine learning-based ranking. Work closely with cross-functional engineering teams and product owners to define and implement search-related features. Required Qualifications Bachelor's or Master s degree in Computer Science, Software Engineering, or a related technical field. 5+ years of hands-on experience in software engineering with a strong emphasis on search technologies. Deep knowledge and production-level experience with Apache Lucene. Proficiency in associated technologies such as Elasticsearch, Solr, or other Lucene-based libraries. Strong understanding of search algorithms, indexing mechanisms, and query optimization techniques. Solid foundation in data structures, algorithms, and object-oriented design principles. Experience working with high-throughput systems and scalable, distributed architectures. Preferred Skills (Nice to Have) Experience integrating search capabilities in cloud environments (e.g., Azure, AWS, or GCP). Familiarity with natural language processing (NLP), semantic search, and vector search technologies. Exposure to machine learning models for relevance tuning and personalized search. Background in performance benchmarking tools and profiling techniques. Lead the development of mission-critical search and indexing features used by enterprise customers. Be part of a collaborative team solving cutting-edge search performance challenges. Work in an environment that encourages innovation and continuous learning. Competitive compensation, modern tech stack, and ample growth opportunities. Qualification : Bachelor's or Masters degree in Computer Science, Software Engineering, or a related technical field.
Principal Engineer - Java
Kanerika Software
Job Title: Principal Engineer Java Location: Hyderabad, India About Kanerika Kanerika Inc. is a leading global software products and services company focused on empowering data-driven enterprises. Co-founded by Wharton alumni, we specialize in helping organizations achieve digital transformation through innovative, custom-built solutions that optimize operations, enhance customer experiences, and fuel business growth. Awards & Recognitions Best Place to Work 2022 Great Place to Work Top 10 Most Recommended RPA Startups 2022 RPA Today Technology Innovation Award 2021 Frost & Sullivan India Recognized for data security excellence with ISO 27701, SOC 2, and GDPR compliance Position Overview We are looking for a highly skilled Principal Engineer Java to join our dynamic team in Hyderabad. In this role, you will lead the design, architecture, and development of scalable enterprise applications. You ll collaborate with cross-functional teams to deliver high-quality, mission-critical software that meets business goals. What You ll Do Architect, design, and implement complex enterprise-grade applications using Java and related technologies. Build and maintain RESTful APIs using Spring Boot, Spring Framework, and Spring DI/AOP. Work with databases such as Oracle, PostgreSQL, MySQL, or SQL Server. Integrate real-time messaging systems (e.g., Apache Kafka) for scalable event-driven architecture. Develop and deploy microservices in containerized environments. Utilize cloud platforms (AWS, Azure) for scalable application hosting. Apply Agile methodologies with a strong focus on code quality, testing, and standards. Manage source control and CI/CD pipelines using GitLab, Jenkins, and other DevOps tools. Mentor junior engineers and contribute to technical leadership and decision-making. What You ll Bring Bachelor s degree in Computer Science, Engineering, or related field. 5+ years of experience in Java/J2EE development with increasing levels of responsibility. Strong hands-on experience with: Spring Boot and Microservices architecture Real-time integration using Kafka or equivalent frameworks RDBMS like Oracle, SQL Server, or PostgreSQL Working knowledge of cloud services, containers, and DevOps tooling. Excellent problem-solving skills, high EQ and IQ, and the ability to lead by example. We re more than just a workplace we re a community where innovation, diversity, and professional growth are valued. Employee Benefits Culture & Work Environment Open Door Policy & Flat Hierarchies Collaborative Open Office Layout Flexible Working Hours Biannual Performance Appraisals Employee Referral Program Health & Wellness Health & Life Insurance (GMC, Term, Disability) Wellness Initiatives and Support Family & Parental Support Generous Parental and Family Medical Leave Company-Sponsored Family Events Time-Off & Perks Generous Paid Time Off (above industry average) Paid Sick Days, Holidays & Bereavement Leave Gratuity and Provident Fund Regular Team Outings Learning & Development Access to FLEX Enterprise Learning Repository Mentorship & Career Growth Programs Professional Certification Reimbursements Strong "Promote from Within" Culture Join Us Become part of a company that is redefining enterprise solutions. At Kanerika, your ideas matter, your growth is nurtured, and your contributions create lasting impact. Qualification : Bachelors degree in Computer Science, Engineering, or related field.
Data Engineering Manager
Kanerika Software
Job Title: Data Engineering Manager Location: Hyderabad About Kanerika Kanerika Inc. is a leading global software products and services company dedicated to empowering data-driven enterprises. We help businesses accelerate digital transformation and maximize impact by delivering innovative, custom data solutions that optimize operations, enhance customer experiences, and fuel growth. Our Accolades Best Place to Work 2022 Great Place to Work Top 10 Most Recommended RPA Startups 2022 RPA Today Technology Innovation Award 2021 Frost & Sullivan India for Kompass composable solution Recognized for strong data privacy and security standards: ISO 27701, SOC2, GDPR compliant With a 4.5/5 Glassdoor rating, Kanerika fosters an inclusive, growth-oriented culture where employees thrive. We offer: Flexible working hours and generous parental leave Mandatory training on a safe and inclusive work environment Mentorship, professional development, and certification support Company-sponsored outings and work-life balance initiatives Join a vibrant, diverse community where your contributions truly matter. The Role We are looking for an experienced Data Engineering Manager to lead and inspire our data engineering team in Hyderabad. Partnering closely with Data Architects, you ll drive the design and development of scalable, cloud-based data pipelines and models, ensuring data quality, security, and performance. What You ll Do Lead and mentor a high-performing data engineering team, driving productivity and accountability. Collaborate with architects and development leads to build scalable, enterprise-grade data solutions. Oversee agile workflows, manage escalations, and coordinate hiring and resource planning. Use data-driven insights to guide team priorities and continuous improvement. Support pre-sales activities and work cross-functionally with sales and recruitment teams. Foster a culture of innovation, quality-first mindset, and customer focus. Who You Are A proactive leader with experience managing mid to large-sized teams and complex projects. An effective communicator, both verbally and in writing, with a knack for visually presenting ideas and core values. Results-oriented with a proven track record of delivering successful projects and publishing customer case studies. A process-driven, independent thinker who thrives under pressure and embraces continuous learning. Passionate about inclusivity and committed to contributing authentically to a diverse team environment.
Data Engineering Support Engineer - Sima
Syren Technologies
Data Engineering Support Engineer SIMA (5+ Years) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience: 5+ Years Industry: Data Engineering / Cloud Support Job Overview We are seeking an experienced Data Engineering Support Engineer with a strong background in maintaining and optimizing data pipelines, ensuring platform reliability, and supporting cloud data infrastructure. This role is critical to sustaining smooth data operations for the SIMA platform in Hyderabad. Key Responsibilities Maintain and support data pipelines and transformations on Azure cloud platforms. Ensure platform stability and reliability through proactive monitoring and issue resolution. Manage scheduling and monitoring using Azure Data Factory (ADF) triggers, Azure Monitor, and Log Analytics (KQL). Handle data ingestion and validation workflows via ADF, Event Hub, APIs, and PySpark, including managing schema drift. Manage CI/CD pipelines using Azure DevOps YAML, deploying solutions for ADF, Synapse, and Databricks. Optimize data transformations and performance using PySpark and Delta Lake techniques like partitioning and caching. Implement and maintain security best practices using Azure RBAC, Key Vault, NSGs, and Integration Runtime configuration. Conduct Root Cause Analysis (RCA), document findings, maintain disaster recovery playbooks, and implement proactive alerting. Required Skills 5+ years of hands-on experience in data engineering support roles. Expertise in Azure Data Factory (ADF) scheduling, triggers, and monitoring. Proficient with PySpark for data transformations and performance optimization. Experience with Delta Lake optimizations including partitioning and caching. Skilled in CI/CD practices using Azure DevOps for deploying data workflows. Strong knowledge of Azure security features: RBAC, Key Vault, Network Security Groups (NSGs). Ability to perform detailed Root Cause Analysis (RCA) and develop disaster recovery strategies. Familiarity with data ingestion tools like Event Hub and API integrations. Experience with Kusto Query Language (KQL) for Log Analytics queries. Join a dynamic team maintaining critical data infrastructure supporting business operations. Work with advanced Azure data services and cloud-based data platforms. Competitive salary and comprehensive benefits. Opportunity for growth and skill development in cloud data engineering. Apply Now If you are a detail-oriented data engineering professional with expertise in Azure platform support, apply today to become a vital part of our Hyderabad-based SIMA team!
Senior Data Engineer
Wallero Technologies
Job Title: Senior Data Engineer Location: Hyderabad, Telangana, India Job Type: Full-Time | Permanent Experience Required: 6+ Years Open Positions: 2 About the Role: We are seeking a highly skilled and experienced Data Engineer to join our team in Hyderabad. As a key member of our data engineering unit, you will be responsible for designing and optimizing end-to-end data pipelines using Python, PySpark, and Databricks. This role requires strong technical expertise, a passion for solving complex data challenges, and the ability to lead best practices within the Supply Chain data domain. Key Responsibilities: Develop and maintain scalable data pipelines using Python, PySpark, and Databricks for complex data transformation within Supply Chain operations. Implement advanced data engineering solutions that support real-time and batch data processing for analytics and business intelligence. Analyze, optimize, and refactor existing data workflows to improve performance and reliability. Collaborate with cross-functional teams to understand data requirements and translate them into robust technical solutions. Take ownership of projects and deliver high-quality outcomes with minimal supervision. Provide leadership and guidance on coding standards, design patterns, and data engineering best practices. Clearly communicate technical ideas and solutions to both technical and non-technical stakeholders. Required Skills & Qualifications: 6+ years of hands-on experience in data engineering. Proficient in Python, PySpark, and Databricks for building and maintaining data pipelines. Strong problem-solving skills with a proven ability to create innovative solutions for complex data challenges. Excellent communication and interpersonal skills; able to work effectively with cross-functional teams. Experience leading and mentoring team members on technical best practices and architecture decisions. Ability to work independently, manage priorities, and drive projects to completion with minimal oversight. Perks & Benefits: Competitive compensation package Exposure to cutting-edge technologies in cloud-based data engineering Opportunity to work on large-scale Supply Chain data solutions Collaborative, innovation-driven work environment Career growth and mentorship opportunities
Senior Data Engineer
Omniwyse Technologies
Job Description We are looking for a passionate engineer interested in working at an early-stage startup building innovative cloud-native data protection solutions. The ideal candidate must be comfortable learning and scoping business requirements to develop effective solutions. This is a great opportunity for engineers who are eager to step out of their comfort zone and solve impactful modern data security concerns. Desired Background and Experience: Must be a problem solver with the ability to think critically and creatively. Minimum of 8 years of experience building products using Java and/or Python. Prior experience in startups is a huge plus. Comfortable with rapid prototyping and implementation of products in an agile team environment. Data engineering experience with implementation of data ingestion, ETL, data pipeline/workflows. Experience implementing database views and UDFs to control access to data using row and column filters. Working experience in databases and data warehouses. Proficient in one or more of the following: AWS RDS, AWS Data Lake, Redshift, Athena, Databricks, and Snowflake. Experience implementing data solutions using Spark. Ability to write and tune complex SQL queries.
Data Engineer
Wallero Technologies
Job Description Location: Hyderabad, Telangana, India Job Type: Permanent (full-time) Experience: 6+ years No. of Openings: 2 Key Responsibilities: Tech Stack Expertise: Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. Innovative Problem-Solving: Demonstrate technical expertise by thinking creatively and providing innovative solutions to complex data-related challenges, pushing boundaries in Supply Chain data analytics. Communication Skills: Exceptional communication abilities to effectively convey technical concepts, collaborate with cross-functional teams, and articulate solutions to non-technical stakeholders. Autonomous Work: Ability to work independently and proactively, taking ownership of projects, and delivering high-quality solutions with minimal supervision. Guidance and Best Practices: Lead the team by setting coding standards, advocating for reusable and modularized code, implementing design patterns, and guiding on best practices in data engineering. Perks and Benefits: Strong expertise in Python, Pyspark, and Databricks, with hands-on experience in developing and optimizing data pipelines for complex data transformations. Exceptional problem-solving skills, with a demonstrated ability to think creatively and develop innovative solutions for data-related issues. Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders. Self-driven and autonomous work style, capable of taking ownership of projects and delivering high-quality results independently. Experience in guiding and mentoring teams on coding standards, design patterns, and best practices in data engineering.
Big Data Platform Automation Engineer/senior Software Engineer
Hsbc
About HSBC If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you're aiming to reach the top or seeking an exciting new direction, HSBC offers opportunities, support, and rewards to take you further. As one of the largest banking and financial services organizations globally, with operations across 64 countries and territories, HSBC is committed to enabling businesses to thrive, economies to prosper, and ultimately, helping people fulfill their ambitions. The Role We are seeking an experienced Senior Software Engineer to join our team. You will become part of HSBC s Data Provisioning Technologies team, responsible for managing and working on the cutting edge of CDP (Cloudera Data Platform) and ODP (Open Data Platform) platforms. As part of one of the largest Big Data estates in the banking industry, you will be instrumental in creating engineering solutions for Hadoop platform pipelines and utilizing industry-leading cloud technologies. Responsibilities Contribute to Hadoop Engineering tasks, developing solutions for data pipeline management on CDP/ODP platforms. Work with Python, Ansible, and Kubernetes to create scalable, efficient solutions within a Big Data environment. Collaborate with the Data/Analytics teams to ensure the smooth operation of data systems and platforms. Design and implement technical solutions while adhering to best practices for CI/CD, DevOps, and GitOps methodologies. Develop and support solutions utilizing cloud technologies, ensuring the scalability and robustness of platforms. Contribute to debugging, troubleshooting, and maintaining the high-quality performance of data systems. Utilize Shell scripting, YAML, and modern automation tools to improve deployment and operational efficiency. Work with GitHub, Jenkins, Ansible for version control, continuous integration, and deployment. Requirements To be successful in this role, you should meet the following requirements: 3-6 years of experience in Hadoop Engineering with practical expertise in Python, Ansible, and DevOps methodologies. Strong knowledge of HDP (Hadoop Distribution), CDP, Linux, Python, Ansible, and Kubernetes. Proficient in Shell scripting, YAML, and technical design. Strong understanding of CI/CD concepts and hands-on experience with tools like GitHub, Jenkins, and Ansible. Familiarity with Test automation tools such as JUnit, Selenium, and Cucumber. Experience with industry-leading Cloud technologies and hands-on development in cloud environments. Working knowledge of GitOps and DevSecOps principles. Knowledgeable in Agile methodologies and ideally, certified in one of the frameworks. Strong communication and networking skills, with the ability to collaborate across teams. Ability to work autonomously, take accountability, and drive results in a high-pressure environment. A strong commitment to high-quality standards, and ownership of individual contributions. You ll have the opportunity to work on innovative projects at the forefront of the banking industry. A global platform with exposure to diverse teams and technologies. Join a company committed to professional development and career growth. Achieve more when you join HSBC. Qualification : 3-6 Years Experience in Hadoop Engineering with working experience on Python, Ansible DevOps methodologies.
Software Developer _ Ai/ml
Ibm India
Introduction At IBM, work is more than a job it s a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you ve never thought possible. Are you ready to lead in this new era of technology and solve some of the world s most challenging problems? If so, lets talk. Your Role and Responsibilities We re looking for software development candidates that want to turn ideas into reality, focus on innovation and development in our modernization journey. Our Strategic Product Development team creates and delivers exciting product features that impact the business to be successful. You ll work alongside global and local multidisciplinary teams of Developers, Architects and Analysts focused on the next generation of solutions. Do you enjoy working and thrive in a Challenging yet collaborative team environment? Passionate about technology and software? You have extremely strong analytical, problem-solving and troubleshooting skills? If so, you ll fit right in with our team. You employ creative thinking and collaboration as the foundation of your daily approach towards our Product development team. At IBM, job is more than work! It offers you thrive on career as well as on skills to be latest with a perfect work-life balance. Required Technical and Professional Expertise 2 10 years of relevant industry experience in Artificial Intelligence and Machine Learning Platforms with specialization in Generative AI. Solid experience of Python Programming Language. Experience with Large Language Models and Natural Language Processing Familiarity with the Pytorch framework Experience with software development lifecycle Excellent problem determination skills Excellent written and oral communication skills Excellent organizational skills Preferred Technical and Professional Expertise Design experience for supporting new requirements. Willingness to learn new skills and technologies. Experience using git and github Familiarity with Node.js and creating VS Code extensions Flexible to work between development/test/support roles. Knowledge on other programming languages (C/C++, Java, Open-Source Programming Languages) is added advantage.
Senior Python Developer
Effiasoft
Job Title: Senior Python Developer Location: Hyderabad (Onsite) Experience: 5+ Years Job Type: Full-Time Openings: 2 Category: IT Job Summary We are seeking an experienced Senior Python Developer with deep technical expertise in designing scalable, secure, and high-performance backend systems particularly within the travel and tourism industry. The ideal candidate will be proficient in Python frameworks (Django, Flask, FastAPI), capable of handling complex third-party API integrations, and demonstrate leadership in ensuring robust, compliant, and efficient backend infrastructure. Roles & Responsibilities Core Development Architect, build, and maintain scalable applications using Python and frameworks such as Django, Flask, and FastAPI. Integrate and optimize third-party travel APIs (e.g., GDS, CRS, OTA, airline APIs) for real-time booking, availability, and pricing data. Develop RESTful APIs, GraphQL, and asynchronous services for seamless frontend-backend communication. Data & Architecture Design and manage high-throughput data pipelines and ETL processes for structured and unstructured data. Work with SQL/NoSQL databases like PostgreSQL and MongoDB, and streaming tools like Apache Kafka or Apache Spark. Build modular microservices to enable independent scaling and deployment. Performance, Security & Compliance Optimize for performance, scalability, and reliability with efficient load balancing and low-latency design. Implement secure coding practices, ensure data encryption, and maintain compliance with PCI DSS, GDPR, and other relevant standards. DevOps & Automation Set up and maintain CI/CD pipelines (Jenkins, GitLab CI), automate testing and deployment. Leverage Docker and Kubernetes for containerization and orchestration. Use monitoring tools to ensure system health and proactive issue resolution. Collaboration Work closely with frontend teams, designers, and stakeholders to align backend systems with business requirements. Participate in code reviews, documentation, sprint planning, and continuous improvement. Required Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or related field. Minimum 5 years of experience in backend development with at least 3 years in Django, Flask, or FastAPI. Hands-on experience in RESTful API, GraphQL, and asynchronous programming. Deep knowledge of PostgreSQL, MongoDB, and streaming/big data tools like Kafka, Spark. Experience in cloud platforms (AWS, Azure, GCP). Experience with Docker, Kubernetes, and CI/CD tools. Familiarity with testing frameworks such as PyTest, Selenium, and SonarQube. Travel domain knowledge experience integrating GDS/CRS, booking systems, and payment gateways. Key Competencies Strong problem-solving and analytical thinking. Ability to work in a fast-paced, high-pressure environment. Excellent communication and collaboration skills. Self-motivated with a proactive attitude and leadership qualities.
Azure Data Engineer (mid)
Syren Technologies
Azure Data Engineer (Mid-Level) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience Level: 5+ Years Industry: Information Technology / Cloud Data Engineering Job Overview We are hiring an experienced Azure Data Engineer (Mid-Level) to join our team in Hyderabad. In this role, you will work closely with business stakeholders, analysts, and IT teams to design, implement, and manage scalable, high-performance data solutions on the Azure Cloud Platform. Your expertise in data modeling, ETL development, and cloud-based data warehousing will be critical in supporting data-driven decision-making across the organization. Key Responsibilities Analyze large datasets and deliver clear, actionable reports using statistical techniques. Design and implement data pipelines, data collection systems, and analytics strategies that enhance operational efficiency. Develop and maintain data systems, ensuring high data quality, consistency, and integrity. Collaborate with business stakeholders, analysts, and developers to translate business requirements into technical solutions. Design, build, and manage distributed data systems and applications on the Azure Cloud. Lead and execute ETL development, including data extraction, transformation, and loading using tools like Informatica or SSIS. Conduct technical design reviews, performance tuning, and testing of data workflows. Adapt to changing priorities and contribute as an individual contributor or team leader depending on project scope. Required Qualifications & Skills Bachelor s degree in Computer Science, Information Systems, or a related field. Minimum 5+ years of experience in data engineering, data analysis, or database design. Proficient in SQL and T-SQL for querying and managing relational databases. Hands-on experience with ETL frameworks such as Informatica or SSIS. Strong understanding of data modeling, data mining, and segmentation techniques. Experience working with structured and unstructured data sources. Proficient in statistical tools and packages (Excel, SSIS, SAS, etc.). Strong analytical mindset with excellent attention to detail and data accuracy. Preferred Skills (Good to Have) Experience with Python and Apache Spark for data manipulation and automation. Experience with modern data platforms: Azure Synapse Analytics Azure Databricks Amazon Redshift Prior experience in developing automation solutions using Python or similar scripting languages. Knowledge of Enterprise Data Warehousing (EDW) concepts and solutions. Competitive compensation package with benefits. Work with cutting-edge cloud technologies in real-world environments. Collaborative, fast-paced, and innovation-driven workplace. Career development support with continuous learning opportunities. A chance to make a tangible impact on enterprise-level data systems. Apply Now If you are a data-driven professional with a strong command of Azure and ETL tools, and you re looking to advance your career in data engineering, apply now and become part of a forward-thinking tech team based in Hyderabad! Qualification : Bachelors degree in Computer Science, Information Systems, or a related field.
Data Engineer-data Platforms
International Business Machines Corporation
Introduction In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients globally. Our centers provide locally-based skills and technical expertise to drive innovation and the adoption of new technologies. A career at IBM Consulting involves building long-term relationships and collaborating closely with clients across industries. You'll work alongside visionaries to help them on their hybrid cloud and AI journeys, enhancing the value and impact of some of the most innovative companies in the world. With access to IBM s strategic partner ecosystem and cutting-edge technology platforms, including IBM Software and Red Hat, you will be empowered to accelerate client transformations and create meaningful change. Curiosity and a constant quest for knowledge serve as the foundation for success at IBM. In your role, you'll be encouraged to challenge the status quo, explore ideas beyond your current role, and come up with creative solutions that will make a significant impact across a wide network of clients. Our culture of evolution and empathy is centered on long-term career growth and development opportunities in an environment that celebrates your unique skills and experience. Your Role and Responsibilities As a Data Engineer at IBM, you will be a critical player in designing and developing applications, while also providing guidance to project teams on complex coding, troubleshooting, and execution. Your key responsibilities include: Solution Design and Construction: Lead the design and construction of new data solutions using the latest technologies, ensuring business value and meeting user requirements. Continuous Improvement: Advocate for continuous improvement by testing solutions and working within an Agile framework to enhance and iterate the developed solutions. Innovation: Stay current with the latest technology trends, discovering and implementing creative solutions to solve business problems. Collaboration: Work with diverse teams to deliver impactful data solutions while ensuring scalability, quality, and performance. Required Education Bachelor s Degree in a relevant field Required Technical and Professional Expertise Apache Spark (PySpark): In-depth knowledge of Spark s architecture, core APIs, and using PySpark for distributed data processing. Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts. Proficiency in Python: Expertise in Python programming, particularly focused on data processing and manipulation. Data Processing Frameworks: Experience with Pandas, NumPy, and other data processing libraries. SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation. Cloud Platforms: Experience working with cloud platforms such as AWS, Azure, or GCP, including working with cloud storage systems. Preferred Technical and Professional Experience Architecture Strategy: Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring of data solutions. Cross-Team Collaboration: Partnering with technology teams, including application development, enterprise architecture, testing services, and network engineering. Security: Familiarity with detection and prevention tools for company products and customer-facing platforms. How You ll Grow At IBM, we offer opportunities for career development and provide an environment where you are encouraged to continuously grow, learn, and expand your expertise. Working with cutting-edge technologies and a diverse set of clients, you will be able to stay ahead of industry trends and make meaningful contributions that have a real impact. About IBM Consulting IBM Consulting helps organizations tackle their most pressing challenges through innovative and agile solutions. By partnering with clients, we drive technology transformations, helping them optimize their operations and leverage new technologies like AI, cloud, and data. Our team s expertise spans across many industries, delivering solutions that enable clients to navigate digital transformations. This role offers an exciting opportunity to work with leading technologies while contributing to client success in a highly dynamic environment. If you re passionate about solving complex data problems and delivering impactful solutions, IBM Consulting is the place to grow your career. Qualification : Bachelors Degree in a relevant field
Principal Engineer - Linux & Infrastructure
Arcesium
Principal Engineer - Infrastructure Development Company Overview Arcesium is a global financial technology firm that solves complex data-driven challenges faced by some of the world s most sophisticated financial institutions. We constantly innovate our platform and capabilities to meet tomorrow s challenges, anticipate the risks our clients encounter, and design advanced solutions to help our clients achieve transformational business outcomes. Financial technology is a high-growth industry as change and innovation continue to disrupt the status-quo and prompt major transformation. Arcesium is at a particularly interesting time in our own growth as we look to leverage our successfully established market position and expand operations in pursuit of strategic new business opportunities. We value intellectual curiosity, proactive ownership, and collaboration with colleagues, and we empower you to meaningfully contribute from day one and accelerate your professional development. Arcesium seeks a talented and motivated Principal Engineer to join our Infrastructure Development team. This person will work and coordinate internal projects and support Engineering Managers. The successful candidate will be responsible for a variety of critical initiatives that will help Arcesium achieve its strategic goals and growth. The Infrastructure Development team is responsible for multiple functional areas which include Access & Identity Management, Linux Compute, Discovery, Networking, Observability, SDLC, and Storage, built on top of AWS, which provide the foundation upon which our customer-facing financial technology platform builds and runs. Infrastructure is a high-impact engineering team that builds new services, automates systems, integrates cloud & open-source software, and operates critical systems depending on the needs of the firm. What you'll do: Help build the next generation of IT infrastructure e.g. containers infrastructure using Docker & Kubernetes cluster create, manage and upgrade. Create, consult on and review architectural decisions of infrastructure projects/products. Build and maintain the firm s critical IT infrastructure such as Linux, Windows, Git, DNS, Kerberos, Syslog, Apache, Perl, Python, E-mail, Ansible, ELK. Safeguard the firm s and its customers data. Minimize the risk of system failures and ensure that controls are in place to detect failures. Work with tech teams to ensure infrastructure scales dynamically based on the usage pattern. Collaborate with internal teams to develop messaging to senior stakeholders. Build and maintain relationships and create trust with internal stakeholders and Application Engineering teams. Communicate with all stakeholders, prepare project plans, release notes and conduct regular governance meetings. What you'll need: 10-20 years of experience in system administration/software engineering. Strong programming experience in Python/C/Go/Haskell. Good knowledge of Unix system, web technologies, and AWS. Experience with tools and processes that will help you manage, understand, and debug large, complex distributed systems. Attention to detail and quality, and the ability to work well in and across teams. The ability to be self-motivated and to think independently while being a team player. Exceptional verbal and written communication skills. Ability to multitask and manage multiple deliverables paired with a can-do attitude.
Senior Python Developer
Blend360 India
Role Overview: We are looking for a Software Engineer to play a key role in migrating our workflow orchestration system from Azkaban to Apache Airflow. This is a high-impact opportunity to contribute to modernizing our data processing infrastructure, working on a critical migration project that will enhance the performance and scalability of our systems. Key Responsibilities: Migration Strategy: Design, develop, and execute the migration strategy from Azkaban to Apache Airflow, ensuring a smooth transition and minimal disruption to ongoing operations. Automation: Develop Python scripts and automation tools to support the migration process and automate various tasks such as calling APIs and performing database interactions. Testing and Data Validation: Implement best practices for testing and data validation to ensure the accuracy and reliability of the migrated workflows. Process Automation: Collaborate with the development team to automate several manual processes related to release, upgrades, and deployments, improving operational efficiency. Collaboration: Work closely with platform owners and data teams to ensure that workflows continue to operate with the same performance and reliability post-migration. Optimization: Optimize Airflow DAGs for efficiency, modularity, and maintainability, ensuring scalable and high-performance data pipelines. DevOps Practices: Leverage previous DevOps experience focusing on continuous deployment and monitoring, ensuring the smooth and continuous operation of the migration process. Qualifications: Education: Bachelor s degree in Computer Science, Software Engineering, or a related field. Programming Languages: Proficiency in Python for writing automation scripts, including calling APIs and interacting with databases. Kubernetes Ecosystem: Experience creating YAMLs and Helm charts for managing Kubernetes resources. DevOps Experience: Hands-on experience with DevOps practices, particularly focusing on continuous deployment and monitoring. Orchestration System: Proficiency with Apache Airflow or any orchestration system; experience in creating DAGs to run custom workflows is a plus. Jupyter Notebooks: Familiarity with Jupyter notebooks for data processing and analysis is a plus. Qualification : Bachelors degree in computer science, Software Engineering, or a related field.
1 - 20 of 54 Apache Hbase in Hyderabad jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted
1 - 20 of 54