Data Engineer-pyspark,aws Glue-kinesis Job in Fifthgen Tech Solution
Data Engineer-pyspark,aws Glue-kinesis
- Pune, Pune Division, Maharashtra
- Not Disclosed
- Full-time
Below is the questionnaire for candidates to be asked while screening the profiles & this questionnaire to be pasted in CV's for respective candidates : Strong understanding of Spark, File files (Avro/Parquet), file partitioning patterns : Yes or No .If yes, how many years : Exposure to Lake formation and tables pattern : Sound knowledge of real time design patterns : Should have exposure to end-to-end implementation (Data Ingestion to Consumption) Exposure to Batch and Real time data Ingestion (Experience in AWS Kinesis) : Hands on experience on AWS Glue (CLI mode), Airflow, Roles in AWS, Athena, delta tables : Sound understanding of Data Modelling (Star and snowflake schema, Fact and Dimension) Data warehousing concepts

