Azure Data Engineer Job in Speridian Technologies

Azure Data Engineer

Location: Kochi, India

Experience: 8-12 Years

About the Role

We are seeking a highly skilled Azure Data Engineer to design, build, and maintain scalable data solutions in a cloud-based environment. This role requires expertise in Azure data platforms, PySpark, SQL, Python, and Databricks to develop robust ETL/ELT processes and data architectures.

As an integral part of our Data Engineering team, you will work with large-scale datasets, optimize performance, and ensure data integrity across various platforms, including Oracle ERP, ERP Fusion, and Salesforce.

Key Responsibilities

Data Engineering & Architecture

• Design, build, and maintain scalable and high-performance data management systems.
• Develop and implement Azure-based data architectures across multiple projects while adhering to best practices.
• Leverage PySpark and Databricks within the Azure ecosystem to process and manipulate large datasets efficiently.
• Design and implement data schemas, models, and database architectures based on business requirements.

ETL/ELT Development & Data Processing

• Develop complex ETL/ELT processes for large-scale data migration and transformation across enterprise systems.
• Extract data from various sources like APIs, JSONs, and relational databases to feed analytics pipelines.
• Optimize Azure-based database systems for performance, reusability, reliability, and scalability.
• Ensure all data processing activities comply with data governance, security, and privacy regulations.

Performance Optimization & Troubleshooting

• Evaluate and enhance Azure-based database performance using best practices.
• Lead initiatives for data integrity, normalization, and standardization within Azure environments.
• Troubleshoot and resolve complex data-related issues, providing expert guidance to the team.

Required Qualifications & Skills

Education & Experience

• Bachelor s degree in Computer Science, Information Technology, Engineering, or a related field.
• 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure Data Engineer.

Technical Expertise

• Programming Languages: Expertise in Python, SQL, and PySpark.
• Big Data & Analytics: Proficient in Databricks or similar big data solutions.
• Cloud Technologies: Extensive experience with Azure cloud data platforms, including:
  • Azure Data Factory (ADF)
  • Azure SQL Data Warehouse
  • Azure Databricks
• Data Architecture & ETL/ELT: Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.
• Enterprise Systems: Experience integrating Oracle ERP, ERP Fusion, and Salesforce into cloud-based data pipelines.
• Data Extraction: Ability to extract data from multiple sources, including APIs, JSONs, and databases.

Soft Skills

• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Ability to work independently and in a team-oriented environment.

Why Join Us?

• Exciting & Challenging Work Work with large-scale datasets and cutting-edge Azure technologies.
• Career Growth Opportunities for upskilling, training, and career advancement.
• Collaborative Environment Work alongside industry experts in a dynamic and innovative culture.
• Comprehensive Benefits Competitive salary, health benefits, and flexible work policies.

Join Our Team & Shape the Future of Data!

If you are passionate about Azure-based data engineering and thrive in a fast-paced environment, we encourage you to apply!

Apply Now!