Apache Kafka Jobs in Cochin

Senior Data Engineer AWS Big Data & API Integration Expert Location: Cochin Experience Required: 5+ years in Data Engineering Job Purpose We are hiring a Senior Data Engineer to lead the development of a scalable and efficient data ingestion framework and ensure high standards of data quality and validation. This role involves designing and implementing robust APIs for seamless data integration and working with modern AWS-based big data technologies. The ideal candidate thrives in complex environments and is passionate about scalable, automated, and high-performance data systems. Key Responsibilities Data Ingestion Framework: Architect, build, and maintain ETL pipelines using services such as AWS Glue, Lambda, EMR, Step Functions, ECS, and EC2. Data Quality & Validation: Implement automated validation checks, monitoring tools, and alerting mechanisms to ensure data accuracy, completeness, and integrity. API Development: Design and develop secure, scalable, and high-performance RESTful APIs with robust documentation and best practices in security, versioning, and performance optimization. Agile Collaboration: Collaborate with stakeholders, analysts, and data scientists to understand business requirements and deliver actionable data solutions. Participate in agile ceremonies and code reviews. DevOps & CI/CD: Contribute to the development of CI/CD pipelines using tools like GitLab, ensuring automated, test-driven deployments. Required Qualifications 5+ years of hands-on experience in data engineering and analytical platform development. Proficient in Python, PySpark, and SQL for large-scale ETL processes. Extensive knowledge of AWS services such as Glue, Lambda, S3, Step Functions, EMR, and ECS. Experience with big data frameworks (e.g., Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, PostgreSQL, Redshift. Skilled in building and integrating secure RESTful APIs for internal and external systems. Familiar with CI/CD, automated testing, and agile project management tools. Strong analytical thinking, communication skills, and problem-solving mindset. Preferred Qualifications Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field. Experience with AWS Kinesis, Firehose, SQS, and modern data lakehouse architectures. Prior experience with data quality frameworks and large-scale API-driven data integration in distributed systems. Familiarity with information security standards and adherence to ISMS policies. Qualification : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.

Job Title: Data Engineer Location: Rajkot, Gujarat, India Company: IBM Consulting Introduction A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for some of the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio, including Software and Red Hat. At IBM, curiosity and a constant quest for knowledge serve as the foundation for success. You'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions that make groundbreaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experiences. In this role, you ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients. Our delivery centers provide locally based skills and technical expertise to drive innovation and adoption of new technologies. Your Role and Responsibilities As a Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in developing data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform. Key Responsibilities: Data Pipeline Development: Build data pipelines to ingest, process, and transform data from files, streams, and databases. Process the data using Spark, Python, PySpark, Scala, and Hive, HBase, or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS. Software Code Development: Develop efficient software code for multiple use cases leveraging Spark Framework, using Python or Scala and Big Data technologies for various use cases built on the platform. Streaming Pipelines: Develop streaming pipelines to process real-time data. Cloud Data Solutions: Work with Hadoop/ AWS ecosystem components to implement scalable solutions to meet the increasing data volumes using big data/cloud technologies like Apache Spark, Kafka, etc. Big Data/Cloud Technologies: Build scalable solutions on AWS, including tools like AWS EMR, AWS Glue, DataBricks, AWS Redshift, DynamoDB, and other cloud technologies. Required Education Bachelor's Degree in Computer Science, Engineering, or a related field. Required Technical and Professional Expertise 5 - 7+ years of experience in Data Management (DW, DL, Data Platform, Lakehouse) and Data Engineering skills. Minimum 4+ years of experience in Big Data technologies with extensive experience in Spark, Python, or Scala. Minimum 3 years of experience on Cloud Data Platforms (preferably AWS). Exposure to streaming solutions and message brokers like Kafka technologies. Proficiency in SQL. Experience with AWS EMR, AWS Glue, DataBricks, AWS Redshift, DynamoDB. Preferred Technical and Professional Experience Certification in AWS, Data Bricks, or Cloudera Spark Certified Developers. About IBM Consulting IBM Consulting is IBM s consulting and global professional services business, with market-leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners, and the planet. Qualification : Bachelor's Degree in Computer Science, Engineering, or a related field.q

Data Engineer About the Role We are looking for an experienced and resilient Data Engineer to join our growing team of analytic experts. The ideal candidate will be eager to learn and tackle bigger challenges in the field of data engineering. In this role, you will work closely with product and engineering teams to design, build, and maintain scalable data pipelines that empower key business decisions. What You Will Do Collaborate with product and engineering teams to understand the domains, features, and metrics needed for data processing. Design and build scalable data pipelines to handle data from various sources efficiently. Extract data using ETL tools and load it to the data warehouse (AWS Redshift / Google BigQuery). Implement batch processing for both structured and unstructured data. Analyze data and create visualizations using tools like Tableau, Metabase, or Google Data Studio to support business decision-making. Be part of the core data team responsible for designing and maintaining the data warehouse. Troubleshoot and resolve issues in data processing and pipelines. Anticipate potential problems and develop proactive processes to avoid them. Quickly learn and adapt to new technologies as needed. Set up CI/CD pipelines for data integration and automation. What Makes You a Great Fit Proficiency in database design and writing SQL queries. Experience with data warehouse solutions such as AWS Redshift, Google BigQuery, or Snowflake. Knowledge of platforms like Segment, HevoData, Stitch, Amplitude, or Clevertap. Hands-on experience with technologies like Apache Spark, Python, R, Hadoop, and Kafka. Familiarity with working with connectors (REST / SOAP, etc.). Experience with BI platforms such as Metabase, Power BI, Tableau, or Google Data Studio. Competitive salary and benefits package. Opportunities for career growth and learning in a dynamic and challenging environment. Work with a passionate and innovative team focused on solving impactful data problems.

Backend Engineer About the Role We are looking for a talented Backend Engineer to join our team and work in a fast-paced environment, tackling complex challenges. You will be responsible for building and maintaining scalable and efficient backend systems. If you are passionate about solving global problems and want to work with some of the most experienced software architects, this is the perfect opportunity for you. What Makes You a Great Fit Strong fundamentals in Computer Science, along with excellent programming skills. Proficiency in one or more backend programming languages such as Scala, Java, Python, Go Lang, or Node.js. Experience with TDD (Test-Driven Development) and understanding Design Patterns. Strong knowledge of algorithms, data structures, and problem-solving techniques. Experience with Django and Flask for building robust backend systems. Familiarity with Amazon Web Services (AWS) or Google Cloud Platform (GCP). Experience with at least one SQL-based database (e.g., PostgreSQL, MySQL) and one NoSQL-based database (e.g., MongoDB, Cassandra). What You Get Invaluable opportunities to solve global problems with your skills and talents. Work with some of the most experienced software architects in the Indian IT industry. Mentorship from industry experts, allowing for both professional and personal growth. Exposure to cutting-edge technologies and the chance to make a significant impact in your field.

We are looking for a skilled Python Developer with a background in Artificial Intelligence (AI) / Machine Learning (ML) to join our team. The ideal candidate will be proficient in Python programming, with expertise in handling advanced topics such as synchronization, threading, and multiprocessing. Experience with modern databases and API development is also essential. Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or related field. 5+ years of experience in Python development, with a focus on AI/ML projects. Experience in any of the LLM framework Hands-on experience with Python synchronization, threading, and multiprocessing. Strong experience in FastAPI or other similar frameworks for API development. Proficiency in Relational Databases (RDBMS) and NoSQL Databases Experience working with Vector Databases such as Pinecone, Qdrant, Milvus, Chroma DB, or Elasticsearch. Solid understanding of Rest API design and implementation. Experience with unit testing using PyTest. Key Responsibilities: Develop, maintain, and deploy AI/ML models using Python. Implement efficient synchronization programs using Python. Experience in modern quantization, model maintenance, and fine-tuning techniques. Work on Python threading and multiprocessing strategies for performance optimization. Develop and integrate APIs, particularly REST APIs, using frameworks like FastAPI. Design, implement, and optimize data storage solutions using Relational (RDBMS), NoSQL, and Vector Databases (such as Pinecone, Qdrant, Milvus, Chroma DB, Elasticsearch). Ensure quality and reliability of code through unit testing with PyTest. Collaborate with cross-functional teams to gather and define system requirements. Write clean, scalable, and well-documented code following best practices. Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or related field.

PHP Developer Location: Cochin Experience: 2+ Years Qualification: MCA / B.Tech in Computer Science, Engineering, or a related field Job Summary: We are seeking a skilled PHP Developer to join our dynamic team, responsible for developing and maintaining high-performance web applications and websites. You ll be involved in the entire software development lifecycle from planning to deployment and work on modern technologies and frameworks. Key Responsibilities: Participate in project planning, development, testing, and implementation. Contribute to all phases of the development lifecycle. Develop and deploy new features and tools to support business operations. Maintain and update existing web applications. Follow industry best practices for coding and development. Collaborate with a team of developers for continuous improvement. Requirements: 2+ years of hands-on experience in PHP development. Strong knowledge of open-source platforms like Joomla, Drupal, or Magento. Proficient in HTML, CSS, JavaScript, AJAX, and related web technologies. Solid understanding of relational databases and version control tools. Experience with third-party APIs (Google, Facebook, etc.). Proficiency in at least one PHP framework such as CodeIgniter or Yii. Familiarity with payment gateway integration is a plus. Qualification : MCA / B.Tech in Computer Science, Engineering, or a related field

Laravel Developer Experience: 2+ years Location: Cochin Employment Type: Full-time Job Summary We are looking for a talented and experienced Laravel Developer to join our team in Cochin. The ideal candidate will have a strong foundation in PHP and Laravel, with a passion for building robust, scalable, and secure web applications. This role requires a deep understanding of backend development along with the ability to integrate front-end technologies and databases. Key Responsibilities Develop and maintain dynamic web applications using Laravel. Design and implement RESTful APIs for internal and external use. Create and manage database schemas that support business processes. Integrate data from various back-end services and databases. Collaborate with front-end developers to connect user-facing elements with server-side logic. Ensure high performance, responsiveness, and security of applications. Maintain code quality, organization, and automation. Required Skills 2+ years of hands-on experience with PHP and Laravel framework. Strong understanding of MVC design patterns and OOP in PHP. Familiarity with SQL/NoSQL databases and proficient in writing optimized queries. Working knowledge of JavaScript, HTML5, and CSS3. Experience with RESTful API creation and integration. Understanding of the synchronous behavior of PHP and Laravel-specific best practices. Familiarity with the limitations of PHP and Laravel and effective workarounds. Nice to Have Experience with Git or other version control systems. Exposure to Agile/Scrum methodologies. Familiarity with DevOps practices and deployment processes.

As a Full-Stack Developer/Senior Developer, you will play a key role within our technology team. Your primary focus will be on both backend and frontend development, working extensively on the client application. You will collaborate closely with the Solution Architect to develop, refactor, and configure the application to meet architectural standards. This role demands a deep passion for coding, a thorough understanding of application architecture, and the ability to contribute innovative solutions that enhance the product's performance and functionality. REQUIRED COMPETENCIES 5+ years of experience in Microsoft Technologies, particularly .NET Core (Webforms), C#, and OOPS concepts Proficiency in frontend development using Vue.js is preferred, though experience with React.js will also be considered Strong expertise in database technologies such as MSSQL Proven experience with Web APIs Solid experience with JavaScript frameworks including jQuery, HTML, and CSS Familiarity with Agile methodologies Strong understanding of SOLID principles and design patterns Experience with API design patterns and architecture Knowledge of integration with ecosystems such as Office 365, G-Suite, SAP, and Oracle Experience with Microsoft Graph API and G-Suite Dev API is a plus WHAT WILL YOU DO: You will be responsible for both backend and frontend development, refactoring, and configuring the client application in alignment with architectural requirements Contribute to project deliveries and provide timely resolutions to business queries Demonstrate excellent problem-solving, analytical, and debugging skills, and a willingness to learn quickly Work effectively within a team in a diverse and multi-stakeholder environment Document code and database changes for code reviews and audits Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or a related field

We are looking for a skilled Python Developer with a background in developing scalable backend for applications to join our team. The ideal candidate will be proficient in Python programming and have expertise in advanced topics such as threading, multiprocessing and deployment. Experience with PostgreSQL database and API development is also essential. Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or related field. 5+ years of professional experience in Python development Strong proficiency with Django and Django Rest Framework. Experience with PostgreSQL and Elasticsearch. Familiarity with Firebase and third-party CRM integrations (e.g., HubSpot). Proficient in using Redis and Celery for task management and caching. Solid understanding of Rest API design and implementation. Experience with unit testing Experience with GCP deployment and management. Strong understanding of software development best practices, including version control (Git). Excellent problem-solving skills and the ability to work independently and as part of a team. Strong communication skills and a passion for mentoring others. Key Responsibilities: Design, develop, and maintain scalable backend systems using Python, Django, and Django Rest Framework. Implement unit tests to ensure code quality and reliability. Design and optimize PostgreSQL databases, ensuring efficient data storage and retrieval. Utilize Elasticsearch for efficient data indexing and search functionality. Implement caching strategies using Redis to improve application performance. Utilize Celery and schedulers to manage background tasks and asynchronous job processing. Manage deployment processes in Google Cloud Platform (GCP), ensuring applications are reliable and scalable. Provide guidance and mentorship to junior developers, fostering their growth and development. Collaborate with cross-functional teams to gather and define system requirements. Write clean, scalable, and well-documented code following best practice Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or related field.

We are seeking an experienced .NET Lead to oversee our team in designing and developing high-quality web-based applications. The ideal candidate will have over 8 years of experience in .NET development, with a strong foundation in C#, .NET Core, and ASP.NET, and will be proficient in building scalable, secure applications. This role involves collaborating closely with cross-functional teams to deliver solutions that meet business objectives and adhere to best coding practices. Key Responsibilities: Develop, test, and deploy high-quality code using .NET programming languages, with a focus on clean, maintainable, and efficient solutions. Collaborate on architectural design and technical specifications with team members and senior leads. Perform code reviews, troubleshoot issues, and refine existing code for performance and quality improvement. Deploy fully functional applications, ensuring seamless integration with existing systems. Continuously improve applications by upgrading current programs and integrating new features as required. Prepare and maintain technical documentation, outlining development and operational procedures. Mentor and guide junior developers in best practices and advanced .NET techniques. Minimum 8+ years in .NET development, with at least 5 years working with .NET Framework using C#. Strong knowledge in .NET Core, ASP.NET, MVC, REST, Web API, and SQL Server. Front-end experience with JavaScript, HTML5, CSS, and frameworks such as Angular or Vue.js. Expertise in Object-Oriented Programming (OOP) concepts, including dependency injection, asynchronous programming, and unit testing. Familiarity with microservices, containerization (Docker, Kubernetes), and DevOps practices. Experience working in agile environments with cross-functional teams. Strong troubleshooting abilities to identify, analyze, and resolve technical issues effectively. Excellent communication and interpersonal skills for collaboration and mentorship. Preferred Skills: Proven experience in leading a team and handling project timelines. Knowledge of cloud platforms and deployment strategies. Familiarity with AI and machine learning concepts, with experience in integrating AI/ML models into applications, is a plus. Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or a related field

Requirements: Must have worked in .NET Framework using C# for at least 5 years. Experience in .Net/.Net Core, ASP.NET, C#, SQL Server, MVC, REST, Web API ,JavaScript, HTML5, CSS, Angular/Vue JS. Proficiency in building web-based applications In-depth knowledge of OOPs concepts, , including dependency injection, asynchronous programming, and unit testing. Awareness of microservice architecture, DevOps practices, and containerization concepts (Docker, Kubernetes) Familiarity with agile environments Troubleshooting abilities Good communication skills Responsibilities: Write clean, testable code using .NET programming languages Develop technical specifications and architecture with support of lead Test and debug various .NET applications Review and refactor code Deploy fully functional applications Upgrade existing programs Document development and operational procedures Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or a related field