Apache Hadoop Jobs in Noida

Job Summary: We are seeking a skilled Data Engineer with 2-5 years of industry experience to join our dynamic team. The ideal candidate will have a strong background in data engineering and a keen interest in the drug safety or pharmacovigilance domain. You will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data-driven initiatives. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Optimize and tune data processing systems for performance and scalability. Implement data governance and security best practices. Work with large datasets from various sources, including clinical trials, adverse event reports, and other pharmacovigilance data. Develop and maintain documentation for data engineering processes and systems. Qualifications: Bachelor s degree in computer science, Engineering, or a related field. 2-5 years of experience in data engineering or a related role. Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, Oracle RDBMS). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with data warehousing solutions (e.g., Redshift, Big Query). Strong programming skills in Python, Java, or Scala. Experience with cloud platforms (e.g., AWS, Azure, GCP). Knowledge of data modeling, ETL processes, and data integration. Experience in the drug safety or pharmacovigilance domain is a plus. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Qualification : Bachelors degree in computer science, Engineering, or a related field.

Apache NiFi Developer Noida 3+ Years Experience Full-Time Location: Noida Experience Required: 3+ years Job Type: Full-Time Openings: 2 Job Overview: We are hiring a skilled and experienced Apache NiFi Developer to join our data engineering team. The ideal candidate will have hands-on expertise in developing and managing robust, scalable data pipelines using Apache NiFi, along with a strong background in system administration, data flow optimization, and secure data integration. Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache NiFi. Manage the daily operations of Apache NiFi environments, ensuring high availability and performance. Set up, configure, and maintain new NiFi environments across development, testing, and production. Monitor system health, troubleshoot issues, and ensure security and compliance. Implement and manage user access control, SSL, and LDAP integration. Optimize data flows and NiFi processors for maximum performance and reliability. Integrate NiFi with databases (SQL/NoSQL), cloud storage (S3, Azure Blob), Kafka, and SNS. Handle structured data formats like JSON, XML, CSV, Avro, and use tools like Jolt Transform. Develop and maintain backup and disaster recovery plans for NiFi environments. Document configurations, processes, troubleshooting steps, and best practices. Required Skills and Qualifications: 3+ years of experience with Apache NiFi development and administration. Deep understanding of NiFi architecture, processors, flow files, and controllers. Proficiency in designing and deploying data flows across complex systems. Experience with NiFi Toolkit, NiFi Registry, and NiFi Reporting Tasks. Familiarity with MiNiFi, shell scripting, Linux/Unix environments, and monitoring tools like Prometheus and Grafana. Working knowledge of REST APIs, SQL, and cloud platforms like AWS or Azure. Strong written and verbal communication skills. Experience with other data integration technologies like Apache Kafka or Apache Spark is a plus.

Position Title: DevOps Engineer Location: Noida Experience: 4 8 Years Employment Type: Full-Time Must-Have Skills: AWS, Azure, Jenkins, Docker About DPD Technologies QueueBuster QueueBuster , developed by DPD Technologies, is India s leading Mobile POS Solution, built to simplify business operations across sectors. From large format retailers to small kiosks and carts, our Android-based platform supports Billing, Inventory, CRM, Loyalty, Online Store, and more all from one centralized system. Trusted by over 75,000+ merchants, QueueBuster helps businesses scale smartly and efficiently. At DPD, we foster a collaborative, innovative, and empowering work culture, where teams thrive and grow together. Role Overview: DevOps Engineer We are looking for an experienced DevOps Engineer who will work closely with our software development teams to automate, optimize, and streamline our infrastructure and deployment processes. You ll play a critical role in ensuring system reliability, performance, and scalability across production and staging environments. Key Responsibilities Collaborate with developers to deploy and operate scalable, secure, and resilient systems. Automate and manage CI/CD pipelines using Jenkins or equivalent tools. Build and maintain tools for deployment, monitoring, and infrastructure automation. Manage containerized applications using Docker and container orchestration. Monitor infrastructure health, perform root cause analysis, and resolve production issues quickly. Administer and optimize Linux/Unix servers and ensure system uptime and performance. Set up and manage web servers including Nginx and Apache, including load balancing and multi-site hosting. Implement robust backup and recovery strategies for high-availability environments. Work with AWS and Azure cloud services to manage infrastructure, networking, and application hosting. Maintain and optimize relational and non-relational databases including MySQL, PostgreSQL, MongoDB, Cassandra, Redis, and Elasticsearch. Ensure robust log management, monitoring, and alerting for applications and infrastructure. Maintain security best practices across environments (firewall configs, access management, SSL, etc.). Required Skills & Qualifications 4 8 years of experience in Linux system administration, cloud platforms (AWS, Azure), and DevOps practices. Strong experience in virtualization, containers, and container orchestration. Proficient with CI/CD tools such as Jenkins, Git, and shell scripting. Experience deploying and managing applications built on Node.js, PHP/LAMP, WordPress, and Java (J2EE) stacks. Solid knowledge of web server configuration, DNS, SSL, and load balancing. Familiar with infrastructure-as-code (IaC) and high-availability architecture. Strong grasp of networking concepts, firewalls, and security configurations. Hands-on experience with system and application monitoring tools. Strong troubleshooting and performance tuning skills. Bachelor s or Master s degree in Computer Science, Engineering, or a related field. Good to Have Experience with container orchestration tools like Kubernetes. Exposure to infrastructure automation tools such as Terraform, Ansible, or Puppet. Familiarity with SOA, microservices architecture, and serverless deployments. Be part of a fast-growing tech product impacting thousands of businesses. Work with cutting-edge DevOps tools and cloud infrastructure. Thrive in a startup environment with ownership, learning, and flexibility. Collaborate with a talented and passionate team focused on innovation and scale.

Data Engineer Location: Noida Experience: 2 5 Years Employment Type: Full Time About Times Internet Times Internet is India s largest digital products company, building premium digital platforms across diverse sectors like News, Sports, Fintech, and Enterprise Solutions. Our brands such as TOI, ET, Cricbuzz, Times Prime, Willow TV, and Whatshot reach millions and are designed to simplify and enrich everyday experiences. We take pride in fostering an inclusive, innovative workplace. As an equal opportunity employer, we ve maintained gender pay parity (independently verified by Aon Hewitt) and are committed to building a diverse and equitable team. About the Business Unit ET B2B The Economic Times B2B Verticals (ETB2B) is a leading business media platform, delivering insightful content, newsletters, and premium conferences across 23+ sectors including Auto, Energy, Pharma, Retail, and HR. With a monthly reach of over 8 million professionals, ETB2B powers business decision-making and industry learning through platforms like ET Masterclass, vConfex, and the ET B2B Intent Signal Platform a cutting-edge initiative leveraging behavioral data, enrichment tools, and event-driven insights. Role Overview As a Data Engineer, you will work on building scalable data pipelines, deploying machine learning models, and extracting actionable buyer intent signals using a variety of data sources and advanced ML/NLP techniques. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines to process large-scale structured and unstructured data (web behavior, CRM, third-party APIs, etc.). Build predictive models to extract buyer intent signals, leveraging NLP, behavioral analytics, and pattern recognition. Use modern ML and NLP tools: spaCy, Transformers, Scikit-learn, TensorFlow, PyTorch, and OpenAI APIs. Collaborate with product managers, backend engineers, and data scientists to deploy models into production and optimize performance. Ensure data pipeline reliability, compliance (GDPR, SOC 2), and freshness through robust monitoring and alerting systems. Enhance pipeline and model inference efficiency for near real-time scoring applications. Document workflows, model performance, and pipeline architecture for internal transparency and reproducibility. Required Skills & Qualifications Strong experience in Python for data engineering, ML pipelines, and model integration. Proficiency with ETL tools (Airflow, Prefect), data processing frameworks (Pandas, Dask), and workflow orchestration. Knowledge of machine learning and NLP techniques (entity extraction, sentiment analysis, text classification). Familiarity with ML model deployment via Docker, Kubernetes, and cloud ML services (AWS SageMaker, GCP AI Platform, Azure ML). Experience with relational databases (PostgreSQL, MySQL) and cloud data warehouses (BigQuery, Redshift, Snowflake). Strong grasp of version control (Git), CI/CD pipelines, and agile collaboration tools. Ability to interpret, visualize, and communicate model insights effectively working alongside analysts or through dashboards. Education & Experience Bachelor s or Master s degree in Computer Science, Data Science, Statistics, or a related technical field. 2 5 years of hands-on experience in data engineering, applied ML, or software development, ideally in SaaS, Martech, or B2B analytics domains. Be part of India s largest digital ecosystem. Work on impactful, high-scale products with real-world value. Collaborate with top minds in data, AI, and product development. Enjoy a culture of innovation, inclusion, and continuous growth. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Statistics, or a related technical field

DevOps Engineer (Fresher) Location: Noida Experience: Fresher Job Type: Full Time Roles & Responsibilities: Gain a basic understanding of Linux/Unix operating systems. Learn and use scripting languages such as Bash, Python, or Shell. Familiarize yourself with version control systems like Git. Understand CI/CD concepts and tools such as Jenkins or GitLab CI. Explore cloud platforms such as AWS, Azure, or Google Cloud. Develop problem-solving skills and a willingness to learn new technologies. Work effectively in a team environment, demonstrating good communication skills. Required Skills: Basic knowledge of Linux/Unix systems. Familiarity with scripting languages (Bash, Python, Shell). Understanding of CI/CD tools and processes. Basic knowledge of cloud platforms (AWS, Azure, Google Cloud). Strong problem-solving skills and eagerness to learn. Good communication and teamwork abilities. Ideal Candidate: A fresher interested in starting a career in DevOps and cloud technologies. Quick learner with a keen interest in working with cutting-edge technologies. Team-oriented, with a proactive approach to learning and growth. Strong interest in understanding CI/CD pipelines, scripting for automation, and cloud infrastructure. This is a fantastic opportunity for a fresh graduate looking to kickstart their career in DevOps and cloud technologies. You'll be joining a dynamic team, working on various cloud platforms and DevOps tools while gaining hands-on experience in the field.

Company Overview: ITSWS Technologies Pvt. Ltd. is an innovative company aimed at transforming business enterprises through the digital revolution. We specialize in providing high-tech, end-to-end solutions for mobile app and web development, focusing on technologies like PHP, Ajax, Javascript, and Web 2.0. We are constantly evolving to keep up with the latest technological advancements and are seeking dynamic professionals to join our growing team. Job Description: We are looking for a talented Software Developer with a strong understanding of PHP, MySQL, HTML, and CSS to join our team. The ideal candidate should have experience working with CMS platforms like Magento, WordPress, or Joomla, and be familiar with version control systems such as GitHub and Bitbucket. Additionally, experience in AWS, continuous deployment/integration, and REST APIs will be an added advantage. Key Responsibilities: Develop and maintain web applications using PHP, CSS, and HTML. Design and manage MySQL databases. Build and integrate RESTful APIs for web applications. Work with CMS platforms like Magento, WordPress, and Joomla (experience with any is a plus). Version control management using tools like GitHub or Bitbucket. Write and maintain unit test cases for reliable and high-quality code. Collaborate with cross-functional teams to ensure high performance and functionality. Work on continuous deployment/integration processes, especially with AWS. Ensure code quality, scalability, and maintainability. Required Skills: Proficiency in PHP, CSS, HTML, and MySQL. Experience with CMS (Magento, WordPress, Joomla). Knowledge of database design and REST API development. Experience with version control systems such as GitHub and Bitbucket. Strong communication skills in English. AWS, continuous deployment/integration experience is a plus. Ability to write and maintain unit tests to ensure code quality. Additional Qualifications: Strong problem-solving and troubleshooting skills. Ability to work independently and as part of a team. Adaptability to changing project requirements and timelines. Qualification : Any Graduate / Post Graduation

General Purpose: RxLogix Corporation is a niche multinational software company headquartered in Princeton, NJ, USA. We have multiple offices present across US, Europe, Japan and India. RxLogix s enterprise software applications are used by world s Top 10 pharma companies like Merck, Johnson & Johnson, Novartis,etc. RxLogix is seeking experienced technical architects who will be responsible for the overall productarchitecture and design. Selected candidates will have an opportunity to architect, design and driveour products meant to ensure patient safety around the world.The ideal candidate should have good understanding of the wider enterprise landscape and strong experience of architecting and designing enterprise grade solutions. The candidate should have extensive experience in software development and architecture, design patterns, databases,integration, usage of third-party libraries and tools. Essential Duties & Responsibilities Excellent understanding of systems and application architecture, high availability, reliability, scalability, layered security, cloud architecture, Micro-Services Framework etc. Define the overall technical architecture for the system for functional and non-functional requirements Implement using latest design patterns with the objective of ZERO maintenance and high performance Hands-on approach in performance tuning, debugging, framework setup, refactoring and supporting the team during the development phase. Preparing technical solution and architecture documents, lead POCs and product certification initiatives. Providing hardware sizing and deployment topology recommendations based on needs of client. Enforce sound development practices and ensure quality delivery of enterprise solutions. Ability to multitask and be able to work in fast paced dynamic environment. Lead the development across a variety of technologies including: Java, jQuery, JavaScript, Grails, Groovy, Spring, Hibernate Cloud solutions in AWS o Oracle database Big data technologies o Business Intelligence tools Minimum Requirements University degree, preferably B-Tech/MS/MTech . Overall 8-10+ years of experience with minimum 5+ years on Product technical design and architecture for enterprise grade solutions. Strong experience utilizing J2EE architecture and design. Experience with Oracle or another major RDBMS. Experience in AWS technologies. Knowledge and experience of architecting/designing enterprise applications following Micro Services framework model. Knowledge and experience with aspects of identity management and security. Knowledge of big data technologies including Hadoop, NoSQL data stores and diverse analytics areas. Knowledge and working experience of following frameworks & technologies is a big plus: Docker, Kubernetes, Kafka, Redis, Hazelcast, Kibana, RabbitMQ. Experience applying agile development methodologies and associated tools. Experience with Atlassian stack (Jira/Confluence etc.). Experience with DevOps concepts and tools. Work with geographically distributed development teams. Experience as Solution Architect in Health and Life Science environments is a plus Interpersonal skills Demonstrated ability to meet commitments, build consensus, negotiate resolutions, and garner respect from other teams. Needs to have strong experience on integration and should have an excellent ability to see the big picture. Must be detail-oriented with strong organizational skills and possess the ability to work well under deadlines in a changing environment. Qualification : University degree, preferably B-Tech/MS/MTech .

Job Summary: As a Senior DevOps Engineer, you will be responsible for maintaining and enhancing the CI/CD pipelines, developing deployment scripts, and troubleshooting deployment problems on the Hadoop platform. This role requires a deep understanding of DevOps principles, automation, and CI/CD tools such as Jenkins and Ansible. You will work closely with external teams to align DevOps practices, assist with maintaining OpenShift Kubernetes clusters, and contribute to the automation of testing and deployment processes. Strong communication skills are essential, as this is a team assignment and will involve collaboration with international teams. Key Responsibilities: CI/CD Pipeline Management: Maintain and develop continuous integration/continuous deployment (CI/CD) pipelines using Jenkins. Develop and manage Ansible deployment scripts to automate infrastructure provisioning and application deployment. Collaborate with External Teams: Act as the main point of contact when discussing DevOps-related needs with external teams. Kubernetes Cluster Management: Help maintain OpenShift Kubernetes clusters, ensuring smooth deployment and scaling of applications. Troubleshooting and Debugging: Troubleshoot deployment problems on the Hadoop platform to ensure seamless operation. Development of Utilities: Develop small utilities and tools to assist with the CI/CD pipeline, improving overall automation efficiency. Knowledge Sharing: Share knowledge about the DevOps mindset and solutions through internal training sessions, demos, and presentations. Required Knowledge and Experience: CI/CD Expertise: Strong experience with Jenkins or other CI/CD automation suites, enabling robust build, test, and deployment pipelines. Linux Expertise: Very good knowledge of Linux systems, with strong skills in scripting for automation (e.g., Bash, Python). Kubernetes and Containerization: Basic understanding of Kubernetes and Linux containers to manage and deploy applications. Scripting and Programming: Basic programming skills in Python, Go, or Ruby for automating tasks and developing small utilities. Agile Environment Experience: Familiarity with working in an agile setup with international teams. Nice to Have: Hadoop Ecosystem Knowledge: Familiarity with the Hadoop ecosystem is a plus, as the project involves working with data lakes built on Hadoop technologies. Additional Responsibilities: Customer Experience & KPI Management: Ensure positive customer experience (CSAT) by achieving First Call Resolution and minimizing Reopen Cases and Average Handling Time (AHT). Adhere to defined KPIs, processes, ITIL delivery and quality standards, and regulatory requirements. Support and Documentation: Maintain high login efficiency and availability for customers, documenting identified risks, issues, and mitigation plans. Contribute to the execution of BCP/DR plans. Value-Adding Activities: Participate in knowledge base updates and self-development activities to stay current with new technologies and industry best practices. Ideal Candidate Profile: The ideal candidate will have a strong DevOps background, particularly in automation and CI/CD pipelines, as well as a solid understanding of Kubernetes, Linux, and scripting. The role requires a proactive approach to troubleshooting, collaborating with cross-functional teams, and continuously improving the automation and deployment processes to support the company's ecosystem, particularly around Nordea s Enterprise Data Lake. Strong communication and a collaborative mindset are key for success in this position.