Data Engineer Job in Simform
Core skills we are looking for,
- Python and SQL
- Advance knowledge of ETL process
- Big Data space experience
- Design Data model and Data Warehouse
- Able to work on cloud platforms like Snowflake, Azure Data Bricks, AWS, Google Cloud etc
Job Description
Category
Requirement
Title
Design
Must Have
Able to design Technology and Vendor Agnostic Data Strategy
Design
Must Have
Able to analyze raw data, define data architecture & design model
Design
Must Have
Able to build complex data pipelines in a large-scale data environment
Design
Should Have
Able to build the infrastructure for a scalable pipeline for processing data from many different sources
Design
Should Have
Should have knowledge of Workflow Management and Schedulers
Programming
Must Have
Must be able to optimize data pipelines for maximum scalability
Programming
Must Have
Must have minimum 3 years experience in developing production-ready data ingestion and processing pipelines
Programming
Must Have
Must have programming knowledge in Python, Java, Scala
ETL
Must Have
Able to Evaluate, parse, and clean datasets
ETL
Should Have
Working knowledge of ETL tools
SQL
Must Have
Proper knowledge of Data Warehousing & Data Lake
SQL
Must Have
Hands-on experience with SQL database design
SQL
Should Have
Proper knowledge in Relational and non-relational database theory and practice
SQL
Should Have
Having knowledge of Database clustering techniques
Cloud
Must Have
Knowledge of - Real-time processing frameworks - Hadoop, Apache Storm, Flink, Docker, Kubernetes, MapReduce
Cloud
Should Have
Expertise with AWS, Microsoft Azure and Google Cloud providers
Cloud
Nice to have
Experience using Snowflake or Data Bricks is a plus
Self-Learning
Must Have
Explore ways to enhance data quality and reliability
Self-Learning
Must Have
Conduct Research
Self-Learning
Nice to have
Finished or Pursuing Data engineering certification from one of Snowflake, Data Bricks, Azure, AWS, Google Cloud, IBM is a plus
Teamwork
Should Have
Your 4 Step Guide to Career Success
