Real Time Data Processing Jobs in Nagpur

Data Engineer Big Data Job Location: Nagpur Experience Required: 5 to 7 years Positions Open: 3 Shift: Rotational Shift Job Overview: We are looking for a talented Data Engineer with expertise in Big Data technologies to join our growing team. As a Data Engineer, you will be responsible for expanding and optimizing our data pipeline architecture. You will work closely with software developers, database architects, data analysts, and data scientists to ensure the seamless flow of data across various systems. This role requires proficiency in Hadoop, Hive, Spark, and other big data technologies, as well as solid experience in data transformation and ETL processes. If you are passionate about building and optimizing data systems, this is the role for you! Key Responsibilities: Data Pipeline Architecture: Expand and optimize the architecture for data flow and collection across various teams. Big Data Technologies: Work with Hadoop ecosystem tools such as Hive, Sqoop, and Spark to process large datasets. SQL Optimization: Craft and optimize complex SQL queries for data transformation, aggregation, and analysis. Python Programming: Use Python (including libraries like Pandas and NumPy) to process and manipulate data efficiently. ETL Processes: Ensure smooth data movement and transformation by applying industry best practices in ETL. Data Warehousing: Apply knowledge of data warehousing concepts to optimize data storage and retrieval. Data Quality Management: Troubleshoot data-related issues, ensuring the quality, consistency, and integrity of data. Collaboration: Work closely with cross-functional teams, translating complex technical concepts to non-technical stakeholders. Cloud Integration: Use cloud platforms (e.g., AWS, Azure, GCP) to integrate data systems and services. Automation: Write and maintain shell scripts or other automation tools for efficient data processing. Documentation: Create clear, concise technical documentation to facilitate knowledge sharing and communication across teams. Required Skills and Qualifications: 5 to 7 years of experience in Data Engineering, with a focus on Big Data technologies. Proficiency in SQL for data manipulation and analysis. Strong programming skills in Python (Pandas, NumPy) for data processing and manipulation. Hands-on experience with big data tools such as Hadoop, Hive, Sqoop, and Spark. In-depth understanding of ETL processes and data transformation methodologies. Experience in designing data models and optimizing data storage in data warehouses. Knowledge of cloud platforms (e.g., AWS, Azure, GCP) and their data engineering services is a plus. Ability to write shell scripts or other automation scripts for data processing. Ability to troubleshoot data-related issues and ensure data quality and consistency. Strong collaboration skills in a cross-functional team environment. Ability to communicate complex technical concepts to non-technical stakeholders. Preferred Skills (Good to Have): Experience with Data Lake architecture and integration. Familiarity with Stream Processing and related technologies. Knowledge of Cloud platforms (AWS, Azure, GCP) and their data services. Experience with Big Data frameworks and data modeling.

Data Architect Nagpur Full-Time Experience Required: 12+ Years Job Location: Nagpur Open Positions: 2 Job Overview: We are seeking a highly experienced Data Architect to join our team. The ideal candidate will collaborate with business stakeholders to understand their data integration requirements and translate them into effective technical solutions. You will be responsible for designing architectural solutions, optimizing ETL workflows, and ensuring seamless data integration across various systems within the bank. The role requires strong expertise in ETL products, data modeling, data warehousing, and real-time data streaming. As a Data Architect, you will also lead data integration projects, ensuring that solutions meet performance, security, and regulatory standards. Key Responsibilities: Collaborate with business stakeholders to understand data integration needs and translate them into technical specifications. Design architectural solutions that align with the bank's overall IT strategy, focusing on performance, scalability, and security. Possess in-depth knowledge of ETL tools and leverage their capabilities for data integration. Implement real-time data streaming architecture using ETL tools to enhance the bank's data ecosystem. Address data quality and consistency issues during the data integration process. Optimize ETL workflows to ensure efficient data flow and improved performance. Implement security measures to protect sensitive data during integration processes and ensure compliance with relevant data protection and privacy regulations. Work with cross-functional IT teams (DBAs, developers, infrastructure teams) to design and deploy integrated data solutions. Create and maintain comprehensive documentation for all data integration solutions. Lead and manage data integration projects, ensuring they are delivered on time, within budget, and meet all project goals and deliverables. Stay updated on the latest advancements in ETL technologies and industry best practices. Required Skills and Qualifications: 12+ years of experience in Data Architecture and integration within large-scale environments. Strong hands-on experience in ETL products and tools for data integration. Expertise in Data Warehousing (DWH) concepts, including dimensional modeling, schema design, and data integration patterns. Strong proficiency in SQL for data manipulation and optimization. Solid understanding of real-time data streaming architecture and the ability to implement it using ETL tools. Experience with data quality management, ensuring accurate and consistent data across systems. Proven ability to work under pressure and meet tight deadlines in a competitive environment. Strong analytical, problem-solving, and decision-making skills. Excellent communication and time management skills. Proficiency in MS Office for documentation, reporting, and project management. Ability to lead and manage complex data integration projects, collaborating with both technical and business teams. Preferred Qualifications: Familiarity with emerging data technologies and architectures. Experience with large-scale data systems and real-time data processing. Cloud platform experience (AWS, Azure, or Google Cloud) is a plus. If you have extensive experience in data architecture, ETL processes, and data integration, we invite you to apply for the Data Architect role. Help us build the next generation of data-driven solutions for the bank!

Senior Data Engineer AWS/Azure (5 8 Years) Nagpur, Pune, Bangalore Full-Time Job Type: Full-Time Location: Nagpur / Pune / Bangalore Experience Required: 5 to 8 years Work Shift: Rotational Open Positions: 4 Job Overview: We are hiring experienced Data Engineers with expertise in AWS and Azure cloud platforms for our offices in Nagpur, Pune, and Bangalore. Ideal candidates will be responsible for building and optimizing data pipelines, managing large-scale data solutions, and collaborating with cross-functional teams. If you are passionate about cloud data architecture, real-time processing, and analytics, this role is for you. Key Responsibilities: For AWS Data Engineer: Lead data engineering initiatives and mentor junior developers. Collaborate with product, application, and support teams for seamless data integration. Develop scalable data infrastructure using AWS services: S3, Glue, Lambda, SNS, SQS, Redshift, and RDS. Write optimized SQL queries for large datasets and handle complex data transformations. Build and manage ETL pipelines using Spark, PySpark, and Hadoop ecosystem. For Azure Data Engineer: Build, test, and maintain optimal data pipelines and data lake architectures on Microsoft Azure. Assemble large, complex data sets to meet functional and non-functional business requirements. Improve data reliability and pipeline performance by automating manual processes. Collaborate with analytics and data science teams to deliver meaningful insights and BI solutions. Work with Azure Data Factory, Spark, Kafka, Hive, Sqoop, MapReduce, and Spark Streaming. Required Skills: AWS Data Engineer: Strong hands-on experience with AWS cloud services: S3, Glue, SNS, SQS, Lambda, Redshift, RDS. Proficient in Python programming and SQL query optimization. Familiar with Spark, PySpark, Hadoop, Hive, and Spark-SQL. Azure Data Engineer: Hands-on experience with Azure data services and data architecture. Skilled in Big Data tools: Spark, Hive, Sqoop, Kafka, MapReduce. Experience with stream processing frameworks: Spark Streaming, Storm, etc. Join our cloud data engineering team and help shape intelligent, scalable data solutions! Apply now for the Data Engineer (AWS/Azure) position in Nagpur, Pune, or Bangalore.

Job Title: Operations Associate Company Overview: KC Overseas Education is a leading EdTech company focused on empowering students worldwide to access premier education opportunities. By connecting international students, study abroad partners, and academic institutions, we simplify the entire study abroad process from application to visa processing. With a network of over 850 universities across 33 countries, we have helped more than 575,000 students pursue higher education in key destinations such as the USA, Canada, the UK, Australia, and more. Our innovative platform, Coursefinder.ai, enhances the application journey for students and partners alike, enabling the efficient management of over 100,000 courses and universities. Founded 26 years ago, KC Overseas Education employs approximately 850 professionals globally and operates in over 65 offices across South Asia, Southeast Asia, and Africa. Job Overview: The Operations Associate will oversee the management of student applications, ensuring all submissions to universities are processed accurately and on time. The role involves close communication with partners, maintaining application progress, and ensuring all necessary documentation is submitted and verified. Attention to detail, organizational skills, and cross-functional teamwork are essential for success in this position. Key Responsibilities: Process student applications and upload required documents. Regularly update application statuses on the ATS platform. Respond to partner queries regarding course availability, entry requirements, and fees. Verify information on university websites to ensure platform details are accurate. Review academic documents, test scores, and work experience for completeness. Follow up with partners to resolve pending documentation or issues. Maintain detailed records of application progress and status updates. Job Requirements: Bachelor s degree or equivalent experience in a related field. 0-2 years of work experience. Strong oral and written communication skills. Excellent interpersonal skills with a compassionate approach. Strong problem-solving and logical thinking abilities. High level of confidentiality and professionalism. Join a dynamic and growing global team that s transforming the study abroad experience. At KC Overseas Education, we offer a collaborative, technology-driven environment that fosters continuous learning and professional development. Qualification : Bachelors degree or equivalent experience in a related field.

Data Engineer Snowflake (5-7 Years) Nagpur Full-Time Location: Nagpur Experience Required: 5-7 years Job Type: Full-Time Open Positions: 3 Job Overview: We are seeking a highly skilled Data Engineer with expertise in Snowflake and ETL processes to join our dynamic team. The successful candidate will help optimize and expand our data pipeline architecture, ensuring efficient data flow for cross-functional teams. This is an exciting opportunity for those who love building scalable data systems from scratch and optimizing existing ones. You will collaborate with software developers, data architects, data analysts, and data scientists to ensure seamless data delivery and contribute to the next generation of our products and data initiatives. Key Responsibilities: Design and optimize data pipelines and architecture for improved data flow and efficiency. Collaborate with software developers, data analysts, and data scientists to support data initiatives. Build and optimize ETL workflows using Snowflake and other technologies. Craft and optimize complex SQL queries and stored procedures for data transformation, aggregation, and analysis. Develop and maintain Snowflake data models, ensuring scalability and optimal performance. Utilize Snowpark for data processing within the Snowflake platform. Integrate Snowflake with AWS S3 for efficient data storage and retrieval. Implement DBT (Data Build Tool) for data modeling and transformation within Snowflake. Work on API integrations, particularly with AWS Lambda, to facilitate data workflows. Utilize Git for version control and collaborative code management. Troubleshoot and resolve data issues to ensure data consistency and quality within the Snowflake ecosystem. Create clear and comprehensive technical documentation for data processing and system designs. Support cross-functional teams by optimizing data systems and architectures for future growth. Required Skills and Qualifications: Proficiency in crafting complex SQL queries and Stored Procedures for data transformation and analysis within the Snowflake platform. Strong experience with Snowflake cloud data warehousing service, including data loading, querying, and administration. Expertise in ETL processes and methodologies, specifically leveraging Snowflake's capabilities. Familiarity with DBT (Data Build Tool) for data transformation and modeling. In-depth knowledge of AWS S3 integration with Snowflake for data storage and retrieval. Expertise in Snowpark for processing data within Snowflake. Experience with API integrations, particularly AWS Lambda, for efficient data workflows. Strong knowledge of Git for version control and collaborative development. Ability to troubleshoot data issues and ensure high data quality and consistency in the Snowflake ecosystem. Excellent documentation skills to create and maintain clear technical documentation. Solid experience with Python for data manipulation and analysis in the Snowflake environment. Experience in creating and maintaining data integration and transformation workflows using DBT. If you're passionate about data architecture, Snowflake, and building scalable, high-performance data systems, apply now for the Data Engineer Snowflake position in Nagpur or Pune!

Job Title: PHP / Laravel Developer Location: Nagpur Experience: 4 - 5 Years Position Overview: We are seeking a skilled PHP / Laravel Developer responsible for designing, developing, and maintaining scalable web applications, APIs, and backend systems using Laravel and related technologies. The ideal candidate will have a strong understanding of modern PHP practices, database optimization, and application performance tuning. Key Responsibilities: Web Application Development: Develop, test, and deploy web applications using the Laravel Framework (v8/v9/10) and PHP 7/8. Clean Code Practices: Write clean, maintainable, and reusable code, adhering to best practices like SOLID, OOP, and MVC. API Development: Build and maintain RESTful APIs for web and mobile applications, ensuring seamless integration and performance. Database Management: Work with MySQL/PostgreSQL databases design efficient schemas, write optimized queries, and handle migrations. Third-Party Integrations: Integrate third-party services and APIs (e.g., payment gateways, messaging APIs, OAuth, etc.). Queue Management & Job Scheduling: Implement background processing and queue management systems like Redis, Horizon, and RabbitMQ. Security & Performance: Ensure application security (e.g., XSS, CSRF, SQL Injection prevention) and optimize performance. Collaboration & Code Reviews: Participate in code reviews, testing, debugging, and deployment processes. Version Control: Maintain version control with Git (GitHub, GitLab, Bitbucket). Required Skills: PHP & Laravel Expertise: Strong proficiency in PHP 7/8 and Laravel framework (v8/v9/10). Database Management: Experience with MySQL, query optimization, and Eloquent ORM. API Development: Hands-on experience with REST APIs, JSON, AJAX, and API authentication (JWT, Passport, Sanctum). Frontend Basics: Good understanding of HTML, CSS, and JavaScript basics. Laravel Ecosystem: Familiarity with Composer, Artisan commands, and other Laravel ecosystem tools. Caching & Queues: Knowledge of caching (Redis, Memcached), queues, and task scheduling. Problem-Solving Skills: Strong debugging and problem-solving abilities. Preferred Skills (Good to Have): Containerization: Experience with Docker and Kubernetes for containerized deployments. CI/CD Pipelines: Familiarity with Continuous Integration/Continuous Deployment processes. Microservices: Knowledge of microservices architecture for scalable systems. Frontend Frameworks: Experience with Vue.js or React for frontend development. Cloud Platforms: Exposure to cloud platforms like AWS, GCP, or Azure. Innovative Work: Work on cutting-edge web applications with a focus on performance and scalability. Learning & Growth: Continuous opportunities to learn new technologies and expand your skillset. Collaborative Environment: Be part of a dynamic team where your contributions matter and your ideas are heard.