Hadoop Jobs in Ahmedabad

Job Description We are looking for a highly skilled AI Engineer with expertise in Large Language Models (LLMs), machine learning, data engineering, and product development. The ideal candidate will drive the development of intelligent, scalable, and ethical AI solutions while leveraging cutting-edge technologies to solve complex challenges. Required Qualifications Expertise in LLMs, machine learning, and data engineering. Knowledge of transformer architectures and deep learning models like CNNs and RNNs. Strong in Python and JavaScript; familiarity with C++ and Java is a plus. Experience with TensorFlow, PyTorch, and Keras for AI model development. Proficient in building scalable data pipelines and performing data preprocessing. Familiarity with AWS, Google Cloud, or Azure for scalable deployments. Understanding of CI/CD practices for automating AI workflows. Awareness of AI ethics, including bias mitigation and fairness principles. Strong analytical and problem-solving skills with adaptability to new technologies. Roles and Responsibilities Develop and fine-tune LLMs for tasks like retrieval-augmented generation (RAG). Build and deploy machine learning models using frameworks like TensorFlow, PyTorch, and Keras. Create scalable data pipelines using Apache Spark, Hadoop, and SQL. Conduct data preprocessing, including cleaning, transformation, and feature engineering. Leverage agentic frameworks such as LangGraph, CrewAI, and AutoGen to design advanced AI workflows. Deploy AI models on cloud platforms (AWS, Google Cloud, Azure) and implement CI/CD practices. Develop generative models like GANs for synthetic data generation and analysis. Ensure ethical AI design by mitigating bias and promoting fairness. Troubleshoot and optimize AI systems for performance and scalability.

Job Title: Data Engineer Location: Ahmedabad, Gujarat Job Type: Full-Time About the Role We re seeking a talented Data Engineer with hands-on experience in Azure-based data solutions. If you excel at building scalable data pipelines and have a strong command of Azure Data Factory, Databricks, PySpark, and Python, we want to hear from you. Experience with Azure Synapse Analytics, Microsoft Fabric, or Power BI will be a strong advantage. What You ll Do Design and implement scalable ETL/ELT pipelines using Azure Data Factory and Databricks. Process and transform large datasets using PySpark and Python. Build and maintain data lakes and data warehouses on the Azure Cloud. Collaborate with data architects, analysts, and business stakeholders to develop effective data solutions. Ensure high standards of data quality, consistency, and reliability. Optimize pipeline performance and manage cloud costs efficiently. Apply best practices for data security, governance, and monitoring. Document workflows and contribute to architectural decisions. 3 5 years of hands-on experience in Data Engineering. Proficiency with: Azure Data Factory (ADF) Azure Databricks Azure SQL Python and PySpark Azure Storage (Blob, Data Lake Gen2) Experience with data lakehouse or modern data warehouse architecture. Familiarity with Delta Lake, MLflow, and Unity Catalog is a plus. Strong SQL skills and experience with performance tuning. Understanding of CI/CD processes in Azure. Excellent analytical and problem-solving abilities. Bonus Skills (Preferred but not required) Experience with Azure Synapse Analytics. Knowledge of Microsoft Fabric. Power BI experience for dashboards and reporting. Exposure to DevOps and Infrastructure as Code (IaC). Understanding of data governance and security frameworks. Relevant certifications (e.g., Databricks Certified Data Engineer Associate/Professional).

Job Title: AI/ML Developer Experience: 2-3 Years Positions: 2 Location: Rajkot, Gujarat Job Type: Full-Time Job Overview: We are looking for skilled and motivated AI/ML Developers with 2-3 years of experience to join our innovative team in Rajkot. The ideal candidates will have a strong background in building AI and machine learning solutions, leveraging deep learning, natural language processing, and generative AI technologies to drive business value and product excellence. Key Responsibilities: Develop and deploy AI/ML models using programming languages like Python, C++, R, or Scala. Build and optimize machine learning and deep learning models using frameworks such as TensorFlow, PyTorch, scikit-learn, Spark MLlib, OpenCV, nltk, transformers, and LangChain. Apply deep learning, computer vision, NLP, and generative AI techniques to solve complex problems. Work with Large Language Models (LLMs) including training on custom datasets and integrating third-party APIs like OpenAI API. Perform data preprocessing, feature engineering, exploratory data analysis (EDA), model selection, hyperparameter tuning, and model evaluation. Analyze and visualize data, creating dashboards and visual aids to support decision-making. Utilize SQL and NoSQL databases such as MySQL, PostgreSQL, and MongoDB for data storage and retrieval. Collaborate with cross-functional teams in an Agile environment and adopt DevOps practices for continuous integration and deployment. Stay updated with emerging AI/ML trends and technologies, implementing them into products and services. Communicate technical concepts effectively to stakeholders. Participate in designing scalable AI/ML solutions and contribute to the overall architecture. Bonus skills: Experience with Python web frameworks (Django, Flask, FastAPI), ML Ops, and cloud platforms. Qualifications: Bachelor s or Master s degree in Computer Science, Data Science, Statistics, Mathematics, or related fields. Minimum 2 years of professional experience in AI/ML development. Strong programming skills in Python, C++, R, or Scala. Hands-on experience with machine learning libraries and frameworks. Solid understanding of machine learning algorithms: supervised, unsupervised, and reinforcement learning. Knowledge of LLMs, generative AI models, and integration of AI APIs. Experience in data preprocessing, feature engineering, model tuning, and evaluation. Good grasp of SQL and NoSQL databases. Strong analytical, problem-solving, and communication skills. Experience with Agile methodologies and DevOps is a plus. Personal Attributes: Eager learner with a passion for AI/ML innovations. Proactive, self-motivated, and able to work independently or as part of a team. Excellent collaboration and stakeholder management skills. Opportunity to work on cutting-edge AI/ML projects. Collaborative work environment in Rajkot fostering innovation. Continuous learning and professional growth opportunities. Apply now to be part of our AI-driven future and contribute to building intelligent solutions that make an impact! Qualification : Bachelors or Masters degree in Computer Science, Data Science, Statistics, Mathematics, or related fields.

AI Developer Key Responsibilities: AI Development & Integration: Develop and enhance AI-driven solutions using platforms such as Claude.ai, Perplexity.ai, and other Anthropics-powered tools. Integrate AI features into EdTech platforms, supporting personalized learning, adaptive content, and intelligent tutoring systems. EdTech Solutions Development: Design AI applications tailored for the education sector, including virtual tutors, automated assessments, and recommendation engines. Collaborate with educators and curriculum designers to align AI functionalities with educational objectives. Model Training & Fine-Tuning: Train and fine-tune large language models (LLMs) to ensure they meet the specific needs of the education sector. Apply transfer learning to adapt general-purpose models for educational applications. AI Tool Utilization: Utilize Claude.ai, Perplexity.ai, and other emerging Anthropics technologies to develop interactive learning solutions and data-driven insights. Experiment with new AI features to continuously enhance platform capabilities. Research & Innovation: Stay updated on AI and EdTech trends to implement cutting-edge solutions. Conduct research to identify how advanced AI tools can address educational challenges and improve learning outcomes. Collaboration & Stakeholder Engagement: Work closely with product managers, UX designers, and other development teams to deliver AI-powered features for EdTech platforms. Communicate complex AI concepts to both technical and non-technical stakeholders in a clear and concise manner. Requirements: Education: Bachelor s or Master s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field. A Ph.D. is a plus. Technical Skills: Extensive experience with Claude.ai, Perplexity.ai, and other Anthropics systems. Strong proficiency in Python and familiarity with AI frameworks such as TensorFlow, PyTorch, and Hugging Face. Solid understanding of natural language processing (NLP), transformer-based models, and large language models (LLMs). Experience with API integrations and deploying AI/ML models in production environments. EdTech Experience: Proven track record of developing AI solutions for educational platforms. Familiarity with challenges in EdTech, including data privacy (e.g., FERPA, GDPR), accessibility, and scalability. Soft Skills: Strong analytical and problem-solving abilities. Excellent communication skills to explain AI concepts to both technical and non-technical audiences. Collaborative mindset with a passion for leveraging AI to improve education. Preferred Experience: Experience with adaptive learning systems, gamification, or AI-powered chatbots in education. Familiarity with cloud platforms such as AWS, GCP, or Azure. Experience working on projects that involve real-time AI integrations. Qualification : Bachelors or Masters degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field. A Ph.D. is a plus.

Data Scientist Roles and Responsibilities: Data Mining & Extraction: Extract valuable, usable data from various data sources to support business objectives and analytic systems development. Machine Learning & Model Optimization: Utilize machine learning techniques to select relevant features, build, and optimize classifiers for data analysis. Data Preprocessing & Cleansing: Perform preprocessing tasks on both structured and unstructured data to prepare it for in-depth analysis, ensuring its quality and accuracy. Enhancing Data Collection: Improve data collection procedures to capture all necessary information, enabling the development of robust analytic systems. Data Validation & Integrity: Cleanse and validate data to ensure its integrity, making it suitable for analysis and predictive modeling. Pattern Analysis & Solution Development: Analyze large datasets to identify patterns and develop insights, helping to solve complex business problems. Prediction & Algorithm Development: Design and develop predictive systems and machine learning algorithms to deliver actionable insights and support decision-making. Result Presentation: Communicate findings and insights clearly to both technical and non-technical stakeholders, ensuring understanding and adoption. Solution Proposal & Strategy Development: Propose innovative solutions and strategies to tackle business challenges, driving data-driven decisions. Collaboration with Teams: Work closely with Business and IT teams to align data science initiatives with organizational goals and ensure seamless integration with existing systems. Requirements: Educational Background: Bachelor s or Master s degree in Computer Science, Engineering, or a related field. Experience & Leadership: Proven experience leading data architecture projects and teams, with a strong track record of delivering data-driven solutions. Communication & Collaboration Skills: Excellent communication, collaboration, and interpersonal skills, with the ability to effectively convey technical concepts to various audiences. Adaptability: Ability to thrive in a fast-paced, dynamic environment, managing multiple priorities and deadlines effectively. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field.

Job Title: Data Mining Executive Job Summary We are seeking a highly analytical Data Mining Executive to join our team. The ideal candidate will be responsible for gathering, analyzing, and extracting valuable insights from various datasets to support business decision-making. This role involves using advanced data mining techniques, conducting secondary research, and leveraging tools such as LinkedIn Sales Navigator to drive business opportunities. You will work closely with clients and internal teams to ensure accurate and actionable data is provided. Key Responsibilities Data Mining: Gather and analyze large datasets to extract meaningful insights and patterns to inform business strategies. Secondary Research: Conduct thorough secondary research to gather relevant data, industry trends, and competitor analysis to drive business decisions. Client Communication: Communicate effectively with clients to understand their data requirements and provide them with valuable insights and reports. Spreadsheet Management: Maintain and update spreadsheets to organize data, track project progress, and monitor deadlines. Outreach: Use LinkedIn Sales Navigator and other tools to support business outreach, gather client-specific data, and assist in client acquisition. Reporting and Analysis: Prepare detailed reports based on data mining and analysis to present findings to clients or senior management. Skills Required Data Mining: Experience in extracting and analyzing large sets of structured and unstructured data. Secondary Research: Strong research skills to gather relevant data from various sources. LinkedIn Sales Navigator: Proficiency in using LinkedIn Sales Navigator for client outreach and data collection. Spreadsheet Management: Expertise in managing and analyzing data using Excel or Google Sheets. Market Research: Ability to analyze market trends and competitor data to support business goals. Qualifications Any Graduate (Preferably in Business, Marketing, or related fields). Qualification : Any Graduate (Preferably in Computer Science or related field).

Job Title: Data Engineer Position Overview: We are seeking a Data Engineer to join our team and work on developing and maintaining our Python-based applications. The Data Engineer will be responsible for designing, developing, testing, and maintaining code for new features while fixing bugs in the existing codebase. The role requires experience with ETL/ELT tools, SQL, Python, and PowerBI to deliver high-quality data integration and reporting solutions. Key Responsibilities Collaborate with the source application team and Data Champions to build and maintain the ETL/ELT pipelines for various source systems across the organization. Utilize applicable tools (e.g., SSIS, APIs) to qualify, extract, standardize/normalize, optimize, and import data from source to target data marts. Demonstrated experience working with Microsoft SQL Server Integration Services (SSIS) to create and deploy ETL packages. Write and optimize complex SQL queries, stored procedures, views, and functions for data extraction and transformation. Work on data analysis projects and continuous improvement programs to support internal projects. Use data visualization and reporting tools like Power BI/SSRS to create and publish reports. Write high-quality, clean, and maintainable code. Collaborate with cross-functional teams to define, design, and ship new features. Identify and fix bugs in existing code and optimize the performance of our applications. Ensure proper documentation for all tasks and deliverables. Requirements 3 to 5 years of experience in ETL/ELT tools, SQL, SSIS, Python, and PowerBI. Solid Python development skills, particularly for data manipulation or back-end API/framework development. Experience with SSIS and Business Objects Data Services, including data governance, master data management, data cleansing, Slowly Changing Dimensions, and Change Data Capture. Experience developing ETL pipelines using Python and SSIS to support data warehouse and data pipeline automation. Proven ability to write complex SQL queries and optimize them for performance. Experience managing production support for ETL projects and handling deployment activities. Tools and Activities Experience Data Integration and Management Tools: SQL Server Integration Services (SSIS), APIs, Python, SQL Server. Databases: SQL Server, MySQL, DB2. Data Visualization Tools: Microsoft Power BI, SSRS. Cloud: Azure (preferred). Skill Sets: Python, SQL Server, PowerBI, Azure (plus). Desired Skills Strong analytical skills with the ability to write and optimize SQL queries effectively. Excellent problem-solving and troubleshooting skills, particularly in a production support environment. Ability to work independently and manage multiple projects simultaneously. Strong written and verbal communication skills for reporting and collaborating across teams.

Roles and Responsibilities Data mining or extracting usable data from valuable data sources Using machine learning tools to select features, create and optimize classifiers Carrying out preprocessing of structured and unstructured data Enhancing data collection procedures to include all relevant information for developing analytic systems Processing, cleansing, and validating the integrity of data to be used for analysis Analyzing large amounts of information to find patterns and solutions Developing prediction systems and machine learning algorithms Presenting results in a clear manner Propose solutions and strategies to tackle business challenges Collaborate with Business and IT teams Requirements Bachelor's or Master's degree in Computer Science, Engineering, or related field. Proven track record of success in leading Data architecture projects and teams. Excellent communication, collaboration, and interpersonal skills. Ability to thrive in a fast-paced, dynamic environment and manage multiple priorities effectively. Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Position: Data Science Architect Job Summary: We are seeking an experienced Data Science Architect to lead our data-driven initiatives, design scalable architectures, and drive AI/ML strategies. The ideal candidate will have deep expertise in data science, machine learning, cloud technologies, and big data frameworks. Key Responsibilities: Design and implement scalable data science architectures to support advanced analytics, AI, and ML models. Lead the end-to-end data pipeline development, including data ingestion, transformation, feature engineering, and model deployment. Collaborate with engineering, product, and business teams to define data strategies and align them with business goals. Provide thought leadership on best practices, emerging technologies, and AI/ML trends. Optimize and scale AI/ML models for real-time and batch processing use cases. Ensure compliance with data governance, security, and regulatory standards. Develop and mentor a team of data scientists and engineers to enhance overall capability and efficiency. Required Skills and Qualifications: Strong programming skills in Python. Experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn, etc.). Knowledge of MLOps, CI/CD, and Model Deployment. Experience with Databases (SQL, NoSQL) and Data Warehouses (Redshift, BigQuery, Snowflake, etc.). Excellent problem-solving and analytical skills. Strong communication and stakeholder management abilities. Ability to lead and mentor teams. If you are a skilled Data Science Architect passionate about driving AI/ML initiatives and building scalable data solutions, we invite you to apply and join our innovative team! Qualification : BE/B.Tech/M.Tech

Job Title: AI/ML Engineer Location: Ahmedabad, India Job Type: Full-time Job Overview: As a progressive company deeply invested in artificial intelligence, we hold innovation as a guiding principle. In line with our commitment to advancing this domain, we're searching for a seasoned Machine Learning Engineer to refine our existing systems and architect new AI models. This role will involve a rich blend of tasks, including collaborating intensively with stakeholders and domain specialists to help develop AI models capable of tackling intricate business problems. Key Responsibilities: Collaborate with Cross-functional Teams: Work closely with domain experts, data scientists, and software engineers to develop and implement machine learning models and algorithms that solve business problems. Data Analysis and Insights: Analyze large, complex datasets to extract actionable insights, identify patterns, and improve the performance of machine learning models. ML Pipeline Development: Develop and maintain end-to-end machine learning pipelines, including data preprocessing, feature extraction, model training, and evaluation. Model Deployment and Monitoring: Deploy machine learning models into production environments, monitor their performance, and ensure their continued effectiveness. Stay Current with Advancements: Keep up to date with the latest industry advancements in machine learning and artificial intelligence. Apply relevant techniques and technologies to continuously improve existing models and systems. Contribute to Best Practices: Contribute to the development of best practices, guidelines, and standards for machine learning engineering within the organization. Write Clean Code: Maintain high-quality, maintainable, and efficient code that adheres to industry best practices. Required Qualifications: Education: Tertiary degree in Computer Science, Software Engineering, or a related field, with a focus on machine learning or artificial intelligence. Experience: 3+ years of experience as a Machine Learning Engineer or in a similar role. Programming Skills: Advanced skills in programming languages such as Python, Rust, and related frameworks. Machine Learning Frameworks: Hands-on experience with machine learning frameworks such as PyTorch and libraries like NumPy, Pandas, or Keras. Problem-Solving: Excellent problem-solving and analytical skills, with the ability to approach complex challenges with a clear and effective strategy. Collaboration and Communication: Strong communication and collaboration abilities, with the capacity to work well in cross-functional teams. Independence: Ability to work independently when needed, demonstrating initiative and accountability. Preferred Qualifications: Microservices and Containerization: Experience with microservices architecture, Docker, Kubernetes, and Linux. Big Data Tools: Experience with big data processing tools (e.g., Hadoop, Spark) and data storage systems (e.g., SQL, NoSQL). Technical Design Skills: Demonstrated technical design, problem-solving, coding, and debugging skills. Distributed Systems: Experience with distributed systems design and implementation. Innovation: Be part of a team that is shaping the future of artificial intelligence. Career Growth: Continuous learning and growth opportunities in the AI/ML domain. Impact: Work on real-world projects that drive meaningful business outcomes. Dynamic Environment: Thrive in a fast-paced, innovative environment that encourages creativity and collaboration. If you are passionate about AI/ML, have the skills to develop cutting-edge solutions, and are eager to work with a talented team, we d love to have you onboard at Rapidops! Qualification : Tertiary degree in Computer Science, Software Engineering, or a related field, with a focus on machine learning or artificial intelligence.

Technical Skills: Strong experience in Python, R, or Scala for data analysis and modeling. Proficiency in machine learning frameworks like TensorFlow, PyTorch, or Scikit-learn. Strong command on NLP domain models. Hands-on expertise with time-series forecasting techniques (e.g., ARIMA, LSTM, GRU), building CICD pipeline and model monitoring system. Experience working with large datasets and distributed computing tools (Hadoop, Spark). Optimize and fine-tune models for performance, accuracy, and scalability. Experience in reinforcement learning or online learning techniques. Expertise in handling large-scale datasets, using tools like Pandas, NumPy, and SQL. Knowledge of cryptocurrency markets, blockchain, and financial modeling. Proficiency in cloud platforms like AWS, GCP, or Azure for deploying machine learning models.

Job Title: Data Scientist Experience: 4+ Years Educational Qualification: B.Tech/M.Tech (CS/IT), M.Sc. (CS/IT) from a recognized university Role Description We are seeking a skilled Data Scientist to join our team. The ideal candidate will identify valuable data sources, automate data collection processes, and analyze large datasets to uncover trends and patterns. This role involves building predictive models and machine-learning algorithms, collaborating with cross-functional teams, and proposing data-driven solutions to business challenges. Key Responsibilities Identify, collect, and automate data acquisition from valuable sources. Pre-process structured and unstructured data for analysis. Analyze large datasets to discover patterns and trends. Develop and implement predictive models and machine-learning algorithms. Combine multiple models using ensemble modeling techniques. Visualize data and present findings through dashboards and reports. Propose innovative solutions and strategies to address business challenges. Collaborate with engineering and product development teams for seamless integration of data solutions. Required Skills & Experience 4+ years of experience as a Data Scientist or Data Analyst with hands-on data mining experience. Proficiency in business intelligence tools (e.g., Power BI) and data frameworks (e.g., Hadoop). Experience querying databases and using statistical programming languages: Python, SQL, etc.; familiarity with Scala, Java, or C++ is a plus. Strong understanding of statistical and data mining techniques such as GLM/Regression, Random Forest, Boosting, Tree-based models, and text mining. Expertise in advanced machine learning algorithms: regression, clustering, simulation, scenario analysis, decision trees, neural networks, etc. Solid foundation in machine learning, operations research, and advanced statistical methods. Strong analytical mindset with business acumen and problem-solving capabilities. Excellent project management and organizational skills. Nice-to-Have Skills Strong math skills (e.g., statistics, algebra). Experience working in dynamic, cross-functional environments with diverse teams. Ability to work with data and analytics experts to enhance the functionality of data systems. Qualification : B.Tech/M.Tech (CS/IT), M.Sc. (CS/IT) from a recognized university