Data Architect Job in Kloud9

Roles & Responsibilities

• Build High level technical design both for Streaming and batch processing systems
• Design and build reusable components, frameworks and libraries at scale to support analyticsdataproducts
• Perform POCs on new technology, architecture patterns
• Design and implement product features in collaboration with business and Technology stakeholders
• Anticipate, identify and solve issues concerningdatamanagement to improvedataquality
• Clean, prepare and optimizedataat scale for ingestion and consumption
• Drive the implementation of newdatamanagement projects and re-structure of the currentdataarchitecture
• Implement complex automated workflows and routines using workflow scheduling tools
• Build continuous integration, test-driven development and production deployment frameworks
• Drive collaborative reviews of design, code, test plans and dataset implementation performed by otherdataengineers in support of maintainingdataengineering standards
• Analyze and profiledatafor the purpose of designing scalable solutions
• Troubleshoot complexdataissues and perform root cause analysis to proactively resolve product and operational issues
• Lead, Mentor and develop other Sr.DataEngineers andDataengineers in adopting best practices and deliverdataproducts.
• Partner closely with product management to understand business requirements, breakdown Epics,
• Partner with Engineering Managers to define technology roadmaps, align on design, architecture and enterprise strategy

Experience & Skills Fitment

• Expert level expertise in building bigdatasolutions
• Hands-on experience building cloud scalable, real time and high-performancedatalake solutions using AWS, EMR, S3, Hive & Spark, Athena
• Hands-on experience in delivering batch and streaming jobs
• Expertise in an agile and iterative model
• Expert level expertise relational SQL
• Experience with scripting languages such as Shell, Python
• Experience with source control tools such as GitHub and related dev process
• Experience with workflow SC
• Scheduling tools like Airflow
• In-depth understanding of micro services architecture
• Strong understanding of developing complexdatasolutions
• Experience working on end-to-end solution design
• Able to lead others in solving complexDataand Analytics problems
• Strong understanding ofdatastructures and algorithms
• Strong hands-on experience in solution and technical design
• Has a strong problem solving and analytical mindset
• Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
• Able to quickly pick up new programming languages, technologies, and frameworks