Associate Data Architect Job in Fifthgen Tech Solution

Spark Streaming experience is mandatory along with Kafka. Technology Stack: Spark Streaming Kafka Spark, Flink AWS (Good to have) Java/Python/Scala Microservices Architecture Exposure to API Management Architectural experience with Spark, AWS and Big Data (Hadoop Cloudera Mapr Hortonworks). Strong knowledge on optimizing workloads developed using Spark SQL/Data Frame. Proficiency with Data Processing: Hadoop, Hive, Spark, Scala, Python, PySpark. Experience in at least one popular programming language python/Scala/Java Strong analytic skills related to working with structured, semi structured and unstructured datasets. Expertise in at least one popular cloud provider preferably AWS is a plus. Good to have knowledge on data bricks Cloud. Good knowledge of any RDBMS/NoSQL database with strong SQL writing skills Experience on Datawarehouse tools like Snowflake, redshift is a plus. Experience with any one ETL tool is a plus Good at ETL architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption. Experience in Deployment and migration of various workloads to Cloud services from traditional infrastructure or other Clouds. Familiarity with DevOps framework Understanding of Software Development Lifecycle, source code management, code reviews, etc. Strong analytical and problem-solving capability Excellent verbal and written communications skills Ability to collaborate effectively across global teams 3+ years experience leading workstreams or small teams Understanding of the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design, data modelling, reporting process metadata, and ETL processes. Client facing skills: Solid experience working with clients directly, to be able to build trusted relationships with stakeholders