Hadoop Jobs in Noida

Data Engineer Location: Noida Experience: 2 5 Years Employment Type: Full Time About Times Internet Times Internet is India s largest digital products company, building premium digital platforms across diverse sectors like News, Sports, Fintech, and Enterprise Solutions. Our brands such as TOI, ET, Cricbuzz, Times Prime, Willow TV, and Whatshot reach millions and are designed to simplify and enrich everyday experiences. We take pride in fostering an inclusive, innovative workplace. As an equal opportunity employer, we ve maintained gender pay parity (independently verified by Aon Hewitt) and are committed to building a diverse and equitable team. About the Business Unit ET B2B The Economic Times B2B Verticals (ETB2B) is a leading business media platform, delivering insightful content, newsletters, and premium conferences across 23+ sectors including Auto, Energy, Pharma, Retail, and HR. With a monthly reach of over 8 million professionals, ETB2B powers business decision-making and industry learning through platforms like ET Masterclass, vConfex, and the ET B2B Intent Signal Platform a cutting-edge initiative leveraging behavioral data, enrichment tools, and event-driven insights. Role Overview As a Data Engineer, you will work on building scalable data pipelines, deploying machine learning models, and extracting actionable buyer intent signals using a variety of data sources and advanced ML/NLP techniques. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines to process large-scale structured and unstructured data (web behavior, CRM, third-party APIs, etc.). Build predictive models to extract buyer intent signals, leveraging NLP, behavioral analytics, and pattern recognition. Use modern ML and NLP tools: spaCy, Transformers, Scikit-learn, TensorFlow, PyTorch, and OpenAI APIs. Collaborate with product managers, backend engineers, and data scientists to deploy models into production and optimize performance. Ensure data pipeline reliability, compliance (GDPR, SOC 2), and freshness through robust monitoring and alerting systems. Enhance pipeline and model inference efficiency for near real-time scoring applications. Document workflows, model performance, and pipeline architecture for internal transparency and reproducibility. Required Skills & Qualifications Strong experience in Python for data engineering, ML pipelines, and model integration. Proficiency with ETL tools (Airflow, Prefect), data processing frameworks (Pandas, Dask), and workflow orchestration. Knowledge of machine learning and NLP techniques (entity extraction, sentiment analysis, text classification). Familiarity with ML model deployment via Docker, Kubernetes, and cloud ML services (AWS SageMaker, GCP AI Platform, Azure ML). Experience with relational databases (PostgreSQL, MySQL) and cloud data warehouses (BigQuery, Redshift, Snowflake). Strong grasp of version control (Git), CI/CD pipelines, and agile collaboration tools. Ability to interpret, visualize, and communicate model insights effectively working alongside analysts or through dashboards. Education & Experience Bachelor s or Master s degree in Computer Science, Data Science, Statistics, or a related technical field. 2 5 years of hands-on experience in data engineering, applied ML, or software development, ideally in SaaS, Martech, or B2B analytics domains. Be part of India s largest digital ecosystem. Work on impactful, high-scale products with real-world value. Collaborate with top minds in data, AI, and product development. Enjoy a culture of innovation, inclusion, and continuous growth. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Statistics, or a related technical field

Job Summary: We are seeking a skilled Data Engineer with 2-5 years of industry experience to join our dynamic team. The ideal candidate will have a strong background in data engineering and a keen interest in the drug safety or pharmacovigilance domain. You will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data-driven initiatives. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Optimize and tune data processing systems for performance and scalability. Implement data governance and security best practices. Work with large datasets from various sources, including clinical trials, adverse event reports, and other pharmacovigilance data. Develop and maintain documentation for data engineering processes and systems. Qualifications: Bachelor s degree in computer science, Engineering, or a related field. 2-5 years of experience in data engineering or a related role. Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, Oracle RDBMS). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with data warehousing solutions (e.g., Redshift, Big Query). Strong programming skills in Python, Java, or Scala. Experience with cloud platforms (e.g., AWS, Azure, GCP). Knowledge of data modeling, ETL processes, and data integration. Experience in the drug safety or pharmacovigilance domain is a plus. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Qualification : Bachelors degree in computer science, Engineering, or a related field.

General Purpose: RxLogix Corporation is a niche multinational software company headquartered in Princeton, NJ, USA. We have multiple offices present across US, Europe, Japan and India. RxLogix s enterprise software applications are used by world s Top 10 pharma companies like Merck, Johnson & Johnson, Novartis,etc. RxLogix is seeking experienced technical architects who will be responsible for the overall productarchitecture and design. Selected candidates will have an opportunity to architect, design and driveour products meant to ensure patient safety around the world.The ideal candidate should have good understanding of the wider enterprise landscape and strong experience of architecting and designing enterprise grade solutions. The candidate should have extensive experience in software development and architecture, design patterns, databases,integration, usage of third-party libraries and tools. Essential Duties & Responsibilities Excellent understanding of systems and application architecture, high availability, reliability, scalability, layered security, cloud architecture, Micro-Services Framework etc. Define the overall technical architecture for the system for functional and non-functional requirements Implement using latest design patterns with the objective of ZERO maintenance and high performance Hands-on approach in performance tuning, debugging, framework setup, refactoring and supporting the team during the development phase. Preparing technical solution and architecture documents, lead POCs and product certification initiatives. Providing hardware sizing and deployment topology recommendations based on needs of client. Enforce sound development practices and ensure quality delivery of enterprise solutions. Ability to multitask and be able to work in fast paced dynamic environment. Lead the development across a variety of technologies including: Java, jQuery, JavaScript, Grails, Groovy, Spring, Hibernate Cloud solutions in AWS o Oracle database Big data technologies o Business Intelligence tools Minimum Requirements University degree, preferably B-Tech/MS/MTech . Overall 8-10+ years of experience with minimum 5+ years on Product technical design and architecture for enterprise grade solutions. Strong experience utilizing J2EE architecture and design. Experience with Oracle or another major RDBMS. Experience in AWS technologies. Knowledge and experience of architecting/designing enterprise applications following Micro Services framework model. Knowledge and experience with aspects of identity management and security. Knowledge of big data technologies including Hadoop, NoSQL data stores and diverse analytics areas. Knowledge and working experience of following frameworks & technologies is a big plus: Docker, Kubernetes, Kafka, Redis, Hazelcast, Kibana, RabbitMQ. Experience applying agile development methodologies and associated tools. Experience with Atlassian stack (Jira/Confluence etc.). Experience with DevOps concepts and tools. Work with geographically distributed development teams. Experience as Solution Architect in Health and Life Science environments is a plus Interpersonal skills Demonstrated ability to meet commitments, build consensus, negotiate resolutions, and garner respect from other teams. Needs to have strong experience on integration and should have an excellent ability to see the big picture. Must be detail-oriented with strong organizational skills and possess the ability to work well under deadlines in a changing environment. Qualification : University degree, preferably B-Tech/MS/MTech .

Job Summary: As a Senior DevOps Engineer, you will be responsible for maintaining and enhancing the CI/CD pipelines, developing deployment scripts, and troubleshooting deployment problems on the Hadoop platform. This role requires a deep understanding of DevOps principles, automation, and CI/CD tools such as Jenkins and Ansible. You will work closely with external teams to align DevOps practices, assist with maintaining OpenShift Kubernetes clusters, and contribute to the automation of testing and deployment processes. Strong communication skills are essential, as this is a team assignment and will involve collaboration with international teams. Key Responsibilities: CI/CD Pipeline Management: Maintain and develop continuous integration/continuous deployment (CI/CD) pipelines using Jenkins. Develop and manage Ansible deployment scripts to automate infrastructure provisioning and application deployment. Collaborate with External Teams: Act as the main point of contact when discussing DevOps-related needs with external teams. Kubernetes Cluster Management: Help maintain OpenShift Kubernetes clusters, ensuring smooth deployment and scaling of applications. Troubleshooting and Debugging: Troubleshoot deployment problems on the Hadoop platform to ensure seamless operation. Development of Utilities: Develop small utilities and tools to assist with the CI/CD pipeline, improving overall automation efficiency. Knowledge Sharing: Share knowledge about the DevOps mindset and solutions through internal training sessions, demos, and presentations. Required Knowledge and Experience: CI/CD Expertise: Strong experience with Jenkins or other CI/CD automation suites, enabling robust build, test, and deployment pipelines. Linux Expertise: Very good knowledge of Linux systems, with strong skills in scripting for automation (e.g., Bash, Python). Kubernetes and Containerization: Basic understanding of Kubernetes and Linux containers to manage and deploy applications. Scripting and Programming: Basic programming skills in Python, Go, or Ruby for automating tasks and developing small utilities. Agile Environment Experience: Familiarity with working in an agile setup with international teams. Nice to Have: Hadoop Ecosystem Knowledge: Familiarity with the Hadoop ecosystem is a plus, as the project involves working with data lakes built on Hadoop technologies. Additional Responsibilities: Customer Experience & KPI Management: Ensure positive customer experience (CSAT) by achieving First Call Resolution and minimizing Reopen Cases and Average Handling Time (AHT). Adhere to defined KPIs, processes, ITIL delivery and quality standards, and regulatory requirements. Support and Documentation: Maintain high login efficiency and availability for customers, documenting identified risks, issues, and mitigation plans. Contribute to the execution of BCP/DR plans. Value-Adding Activities: Participate in knowledge base updates and self-development activities to stay current with new technologies and industry best practices. Ideal Candidate Profile: The ideal candidate will have a strong DevOps background, particularly in automation and CI/CD pipelines, as well as a solid understanding of Kubernetes, Linux, and scripting. The role requires a proactive approach to troubleshooting, collaborating with cross-functional teams, and continuously improving the automation and deployment processes to support the company's ecosystem, particularly around Nordea s Enterprise Data Lake. Strong communication and a collaborative mindset are key for success in this position.