BriefCase
BriefCase

Senior Python Developer Job in Blend360 India

Senior Python Developer

Blend360 India 4+ weeks ago
Apply Now
Job Summary

Role Overview:

We are looking for a Software Engineer to play a key role in migrating our workflow orchestration system from Azkaban to Apache Airflow. This is a high-impact opportunity to contribute to modernizing our data processing infrastructure, working on a critical migration project that will enhance the performance and scalability of our systems.

Key Responsibilities:

  • Migration Strategy: Design, develop, and execute the migration strategy from Azkaban to Apache Airflow, ensuring a smooth transition and minimal disruption to ongoing operations.
  • Automation: Develop Python scripts and automation tools to support the migration process and automate various tasks such as calling APIs and performing database interactions.
  • Testing and Data Validation: Implement best practices for testing and data validation to ensure the accuracy and reliability of the migrated workflows.
  • Process Automation: Collaborate with the development team to automate several manual processes related to release, upgrades, and deployments, improving operational efficiency.
  • Collaboration: Work closely with platform owners and data teams to ensure that workflows continue to operate with the same performance and reliability post-migration.
  • Optimization: Optimize Airflow DAGs for efficiency, modularity, and maintainability, ensuring scalable and high-performance data pipelines.
  • DevOps Practices: Leverage previous DevOps experience focusing on continuous deployment and monitoring, ensuring the smooth and continuous operation of the migration process.

Qualifications:

  • Education: Bachelor s degree in Computer Science, Software Engineering, or a related field.
  • Programming Languages: Proficiency in Python for writing automation scripts, including calling APIs and interacting with databases.
  • Kubernetes Ecosystem: Experience creating YAMLs and Helm charts for managing Kubernetes resources.
  • DevOps Experience: Hands-on experience with DevOps practices, particularly focusing on continuous deployment and monitoring.
  • Orchestration System: Proficiency with Apache Airflow or any orchestration system; experience in creating DAGs to run custom workflows is a plus.
  • Jupyter Notebooks: Familiarity with Jupyter notebooks for data processing and analysis is a plus.

Qualification :
Bachelors degree in computer science, Software Engineering, or a related field.
Experience Required :

Fresher

Vacancy :

2 - 4 Hires

Apply Now
Similar Jobs for you