Kafka Jobs in Chennai

Job Title: Data Engineer Location: Chennai (Work from Office) Job Type: Full-time Experience: 2 to 4 years Job Description Blackstraw Technologies Pvt Ltd is seeking a skilled Data Engineer to join our dynamic team. You will play a crucial role in transforming raw data into actionable insights by designing and maintaining robust data pipelines and systems. Your work will ensure alignment between data infrastructure and business goals, helping to drive efficiency and scalability. You will leverage your analytical skills and proficiency in various programming languages to integrate, process, and optimize data from diverse sources. You will also collaborate closely with data scientists and end-users to support data-driven decision-making. Key Responsibilities Design, build, and integrate data pipelines from multiple sources for analytics and operational purposes. Perform data integration and troubleshoot production and development issues. Develop, automate, and optimize ETL pipelines and workflows. Work with big data technologies including Hive, Spark, and Hadoop; optimize performance for large-scale data processing. Write and maintain efficient Spark/PySpark or Spark/Scala programs. Utilize strong SQL skills for querying and database design. Develop shell scripts (Unix/Linux) to automate data processing tasks. Collaborate with data scientists and various business teams to understand and fulfill data needs. Maintain and deploy ETL code following Agile methodologies. Handle service delivery tickets and provide support related to ETL tools. Participate in root cause analysis and problem resolution for data pipeline issues. Required Skills & Qualifications Bachelor s degree in Computer Science, Information Technology, or related field; Master s degree is a plus. 2 to 4 years of hands-on experience in data engineering or related roles. Strong expertise in ETL development and data integration tools. Proficiency in Spark (PySpark or Scala), Hive, and Hadoop ecosystem. Advanced SQL skills and experience with relational database management systems (RDBMS). Experience with shell scripting in Unix/Linux environments. Familiarity with Java, Python, or Scala programming languages is desirable. Knowledge of Cloud platforms (Azure preferred) is a plus. In-depth understanding of Retail domain data and business processes is advantageous. Excellent analytical, organizational, and communication skills. Experience with Agile project management and teamwork. About Blackstraw Technologies Pvt Ltd Founded in 2015 and fully operational since 2018, Blackstraw Technologies is a global software products and services company specializing in Artificial Intelligence (AI) and Machine Learning (ML) solutions. Our AI platform accelerates data labeling, model training, and deployment across cloud and on-premise environments. Our 250+ member team boasts over 900 years of combined experience, focusing on areas such as computer vision, natural language processing, and deep learning annotation tools. We enable enterprises worldwide to rapidly adopt AI in a cost-effective, plug-and-play manner. Headquartered in Florida, USA, Blackstraw has operations across Canada, the USA, and India. Qualification : Bachelors degree in Computer Science, Information Technology, or related field. Masters degree is a plus.

Backend Developer SE 2 Location: Chennai (Work from Office) Job Type: Full-Time Roles & Responsibilities Write reusable, testable, and efficient backend code. Design and implement low-latency, user-friendly web and mobile applications. Develop software solutions that automate industry processes effectively. Participate in design reviews, code discussions, and cross-functional collaboration. Follow and enforce strict security protocols and best practices. Implement and maintain DevOps pipelines, ensuring CI/CD integration across projects. Drive and contribute to backend architecture and scalability strategies. Preferred Candidate Profile Strong programming experience in Python and Django. Familiarity with Angular and other JavaScript frameworks/libraries. Hands-on experience with MySQL, PostgreSQL, or similar RDBMS systems. Understanding of web application security and secure coding practices. Excellent analytical thinking and problem-solving skills. Comfortable with Git and modern collaboration tools. Ability to work within a distributed, diverse team of developers and researchers. Excellent communication skills in English (written and verbal). Strong foundation in Data Structures and Algorithms. Self-motivated with a high degree of innovation and ownership.

Backend Developer SDE 3 Location: Chennai (Work from Office) Job Type: Full-Time Experience: 5+ Years Job Summary We are seeking an experienced Software Development Engineer Level 3 (SDE 3) to lead the backend development of robust web and mobile applications. This role is ideal for a technical leader with a strong grasp of backend architecture, microservices, and team mentoring. You will play a pivotal role in delivering high-quality, scalable solutions and driving a culture of technical excellence. Key Responsibilities Architect and implement server-side solutions for web and mobile applications using Python (Django/Flask). Lead the backend team in developing high-performing, enterprise-grade software. Convert user stories into scalable and maintainable software components. Proactively identify and resolve issues in backend frameworks and architecture. Establish and drive Agile best practices within the team. Deliver scalable solutions in both monolithic and microservices architectures. Participate in hiring and mentoring SDE 1, SDE 2, and Junior Developers. Collaborate with cross-functional teams including QA, frontend, and DevOps. Perform regular code reviews and ensure best practices in unit testing, code coverage, and documentation. Lead design discussions and own critical architectural decisions. Act as a thought leader in technical strategy, code quality, and team growth. Ensure secure coding practices and application security compliance. Maintain technical documentation and contribute to the internal knowledge base. Required Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or a related field. 5+ years of experience in backend development with a focus on Python/Django. Proven leadership in delivering production-grade software systems. Experience in RESTful API design, data modeling, and backend architecture. Knowledge of web application security principles and secure coding practices. Proficient in RDBMS (e.g., MySQL, PostgreSQL) and Git-based collaboration workflows. Familiarity with frontend frameworks such as Angular or React.js is a plus. Strong analytical thinking, debugging, and problem-solving capabilities. Excellent communication and team collaboration skills. Strong understanding of CI/CD, unit testing frameworks, and code deployment workflows. Preferred Skills Experience managing or mentoring a technical team. Familiarity with containerization (Docker) and DevOps principles. Knowledge of emerging technologies and enthusiasm for innovation. Experience with hiring processes and technical interviews. Ability to work independently and take ownership of critical technical decisions. Join us in building cutting-edge software that impacts industries at scale. Lead a talented team, make bold decisions, and shape the future of backend engineering. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field.

Java Developer Experience: 3+ Years Job Type: Full-time About the Role We are seeking a talented Java Developer with 3+ years of experience in Java web application development to join our dynamic team. The ideal candidate will have expertise in Core Java, Spring Framework, and modern web technologies. You will be responsible for hands-on development of Java-based applications, working with frameworks such as Spring Boot and Spring MVC, and building robust web services. The role will also involve collaborating in an agile environment and ensuring the quality and scalability of applications. Technical Skills Core Java (JDK 11+) and J2EE (Java EE8) Spring Framework 5+: Core, MVC, Spring Boot, Spring Batch Vert.x 3.5.1 and JavaFx (OpenJFX 11) Databases: SQL, PostgreSQL, MySQL, H2DB Web Servers: Tomcat, Apache Development Tools: Spring Tool Suite 5, Eclipse, Maven, SVN/GIT, Nexus, Jenkins, Gradle Frontend: HTML, CSS, JavaScript, jQuery, Vue.js, Kendo UI Qualifications & Experience 3+ years of experience in Java web application development. Proven experience working with Spring Framework (Spring MVC, Spring Boot). Strong knowledge of web technologies including HTML, CSS, JavaScript, and jQuery. Experience in building RESTful web services using Spring Boot, Spring WS, etc. Solid understanding of J2EE architecture, JVM internals, and design patterns. Good exposure to SQL, PostgreSQL, MySQL, and other databases. Strong knowledge of build and deployment processes using CI/CD tools like Jenkins. Experience working in an Agile environment and across the full development lifecycle of a project. Good communication and presentation skills. Role & Responsibilities Develop and maintain Spring MVC and Spring Boot based JEE applications. Perform server-side development with Java and J2EE, focusing on scalability and performance. Work on client-side development using HTML, CSS, JavaScript, and frameworks like jQuery and Angular (v8 and above). Build and maintain RESTful services and APIs with Spring Boot and Spring WS. Utilize JVM internals and J2EE architecture/design patterns for scalable application design. Perform data modeling, object-oriented design, and integration using SOA principles. Work with version control systems like Git for code management and deployment processes. Participate in the build and deployment processes using CI/CD tools like Jenkins or similar. Work within a fast-paced Agile environment to deliver high-quality software solutions. Optionally, build automated testing suites using tools like Selenium and Galen. Experience with cloud deployment, particularly in Azure or AWS environments, is preferred. Competitive salary and benefits package. Opportunities for career growth and professional development. A dynamic and collaborative work environment.

Job Overview Senior Engineer - Data Engineering in the Automotive domain with 3-7 years of experience Extensive expertise in pyspark, hadoop, and gcp for designing and implementing data pipelines Proficient in tensorflow, python, and SQL for automation, data quality, and optimization Skilled in big data technologies like numpy, pandas, and data manipulation Responsible for architecting scalable data pipelines, data transformation, performance optimization, monitoring, and collaboration with cross-functional teams Bachelor's degree in Computer Science or equivalent; preferred certifications include Professional Data Engineer and Google Cloud Certified - Professional Data Engineer Good to have experience with CI/CD practices, data processing libraries, data quality, Pub/Sub architectures, and Tekton pipelines management Roles & Responsibilities Architect and Develop Data Pipelines: Lead the design, development, and maintenance of scalable and efficient data pipelines using GCP services like Pub/Sub for real-time data ingestion and BigQuery for storage and analysis. Data Transformation and Processing: Implement data transformation processes to cleanse, enrich, and aggregate raw data from diverse sources, ensuring data quality and consistency. Performance Optimization: Fine-tune data pipelines and queries to enhance performance, reduce latency, and ensure timely data access for stakeholders. Monitoring and Maintenance: Implement monitoring solutions for tracking pipeline performance, addressing issues proactively, and conducting regular maintenance tasks to uphold data infrastructure reliability. Collaboration: Collaborate with Data Scientists, Software Engineers, and Business Analysts to understand data requirements and provide technical solutions to meet business needs. Documentation: Document data pipelines, processes, and best practices to facilitate knowledge sharing and maintain a comprehensive understanding of data architecture. Our ideal candidate Extensive knowledge and proficiency in pyspark, hadoop, and gcp Advanced skills in designing and implementing data pipelines, data modeling, and data warehousing solutions Proficiency in tensorflow and python for automation scripts and data quality Strong SQL skills for querying and optimizing data warehouse operations Expertise in big data technologies like numpy, pandas, and libraries for data manipulation and analysis Monitoring data processes, utilizing GCP services, and implementing data engineering best practices Prioritizing skills in GCP, BigQuery, Python, Data Modeling, SQL, and Data Warehousing Bachelor of Technology (B.Tech) or Bachelor of Engineering (B.E) in Computer Science or Information Technology, or a Master of Technology (M.Tech) in Data Science or Big Data Analytics Certifications such as Professional Data Engineer and Google Cloud Certified - Professional Data Engineer preferred Company overview Altimetrik delivers outcomes for our clients by rapidly enabling digital business & culture and infuse speed and agility into enterprise technology and connected solutions. We are practitioners of end-to-end business and technology transformation. We tap into an organization s technology, people, and assets to fuel fast, meaningful results for global enterprise customers across financial services, payments, retail, automotive, healthcare, manufacturing, and other industries. Founded in 2012 and with offices across the globe, Altimetrik makes industries, leaders and Fortune 500 companies more agile, empowered and successful.Altimetrik helps get companies get unstuck . We re a technology company that lives organizations a process and context to solve problems in unconventional ways. We re a catalyst for organization s talent and technology, helping teams push boundaries and challenge traditional approaches. We make delivery more bold, efficient, collaborative and even more enjoyable. Qualification : Bachelor of Technology (B.Tech) or Bachelor of Engineering (B.E) in Computer Science or Information Technology, or a Master of Technology (M.Tech) in Data Science or Big Data Analytics

Job Title: Python Developer Company: Blackstraw.ai Location: Chennai (Work from Office) Job Type: Full-time Experience: 3 to 7 years Job Summary Blackstraw.ai is looking for a skilled and motivated Python Developer to join our growing engineering team. In this role, you will be responsible for server-side logic development, system integration, and ensuring high performance and responsiveness to requests from the front-end. A strong command of Python and its frameworks, along with familiarity with front-end technologies, will be essential. You ll work closely with front-end developers, data scientists, and DevOps to build and scale enterprise-grade AI and web-based applications. Key Responsibilities Develop and maintain robust, scalable backend systems using Python and relevant web frameworks (e.g., Django, Flask). Integrate multiple data sources and databases into unified systems. Implement data storage solutions and create efficient database schemas. Write reusable, testable, and efficient code while following best coding practices and quality standards. Collaborate with front-end developers to integrate user-facing elements using server-side logic. Ensure the security, accessibility, and compliance of applications. Manage authentication and authorization across multiple systems and environments. Optimize application performance for different delivery platforms (desktop, mobile, etc.). Work with version control tools like Git and follow Agile/Scrum methodologies. Promote knowledge sharing within the team and contribute to documentation. Debug, profile, and unit-test code to ensure reliability and maintainability. Required Skills 3 7 years of hands-on Python development experience. Proficiency with one or more Python web frameworks (Django, Flask, etc.). Experience with ORM libraries (e.g., SQLAlchemy, Django ORM). Strong understanding of RESTful APIs, server-side templating (e.g., Jinja2), and multi-threading/multi-processing. Familiarity with front-end technologies such as JavaScript, HTML5, and CSS3. Understanding of user authentication/authorization protocols (OAuth, JWT). Ability to work with Git, Mercurial, or SVN version control systems. Knowledge of scalable application design and event-driven programming in Python. Excellent problem-solving, organizational, and communication skills. Preferred Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or related field. 5+ years of experience in building web, mobile, or ML-based applications. Experience with: JavaScript (ES6), React, Node.js MongoDB, Elasticsearch Docker, Kubernetes, Azure Microservices architecture Redis, Kafka, SQS, or similar tools Exposure to Big Data technologies (e.g., Hadoop) is a plus. Strong understanding of scalable software systems and system design principles. About Blackstraw.ai Founded in 2015 and operational since 2018, Blackstraw Technologies Pvt Ltd is a global leader in AI and ML solutions. We specialize in simplifying AI adoption for enterprises through a proprietary platform that accelerates data labeling, model training, and deployment. With offices across the USA, Canada, and India, and a 250+ strong team with over 900 years of collective experience, we deliver cutting-edge solutions in Computer Vision, Natural Language Processing, and AI Data Annotation. Our mission is to make AI adoption faster, easier, and more cost-effective for enterprises around the world. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or related field.

Job Title:Lead Consultant - API Integration Career Level - E Introduction to role Accountabilities Lead the team in developing and maintaining scalable and secure API and messaging solutions. Collaborate with cross-functional teams to ensure seamless integration of API and messaging services. Define and implement best practices for API and message streaming, focusing on security, scalability, and performance optimization. Oversee the development and maintenance of comprehensive API documentation. Manage the lifecycle of API and messaging services, including versioning, deprecation, and migration strategies. Monitor and analyze performance, identifying areas for improvement. Stay informed about industry trends and advancements in API and messaging technologies. Provide leadership and mentorship to team members. Essential Skills/Experience Bachelor s degree in Computer Science, Information Technology, or a related field; advanced degree preferred. Experience in API development, message streaming, and integration services. Understanding of API management platforms (e.g., Apigee, AWS API Gateway, Azure API Management). Experience with message streaming technologies (e.g., Kafka, RabbitMQ, AWS Kinesis). Leadership and team management skills. Problem-solving and analytical skills. Strong communication and interpersonal skills. Desirable Skills/Experience Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Knowledge of microservices architecture and containerization technologies (e.g., Docker, Kubernetes). Familiarity with DevOps practices and tools (e.g., CI/CD pipelines, Jenkins, Git). Qualification : Bachelors degree in Computer Science, Information Technology, or a related field; advanced degree preferred.