Data Engineer Job in Programming

We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in Python, and AWS services such as DynamoDB, Athena, and Glue Data Catalog, Airflow, and Spark.

Key Responsibilities: Develop and maintain data pipelines to collect, transform, and load data into various data storage systems. Utilize AWS services such as DynamoDB, Athena, and Glue Data Catalog to manage and query data effectively. Implement and manage data workflows using Apache Airflow for automation and scheduling. Perform data cleansing, transformation, and enrichment to ensure data quality and consistency. Collaborate with data scientists and analysts to understand data requirements and provide the necessary data infrastructure and support. Optimize data processing and query performance using Spark. Monitor and troubleshoot data pipeline issues and ensure data availability and reliability. Skills and Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field. 5+ years of relevant experience in data engineering. Proficiency in Python for data manipulation and scripting. Strong knowledge and hands-on experience with AWS services, including DynamoDB, Athena, and Glue Data Catalog. Familiarity with Apache Airflow for data workflow orchestration. Experience with Spark for data processing and analysis. Strong SQL skills for data querying and manipulation. Good understanding of data modeling and ETL processes. Excellent problem-solving skills and attention to detail. Strong communication and teamwork abilities.