Senior Data Engineer Job in Cloudcover

What you will do

• You'll design and develop scalable, reliable, secure and fault tolerant data systems and work on improving to deliver next gen systems
• You ll work 100% in the public cloud (AWS, GCP, Azure)
• You'll build readable, concise, reusable, extensible code that avoids re-inventing solutions to problems that you solved
• You will be migrating massive datasets from high-growth startups from one cloud to another or on-prem to cloud
• You'll be part of discovery sessions with clients and will build state of the art data architectures
• You ll research new technologies and tools that enable building the next generation systems
• You ll use the knowledge you ve learned from client projects to develop and improve our internal products.

The Role

• At least 5 years of experience as a Data Engineer or Software engineer
• Strong coding skills in one of the following: Python, Java or Scala
• Experience with Spark or Beam
• Experience with SQL databases as well as NoSQL data stores
• Experience in SQL with an in-depth understanding of query optimization. You should also understand DDL very well.
• Excellent understanding of building data models for the target data warehouse
• Hands-on experience in any of the cloud platforms and having a thorough understanding of the cloud concepts are required.
• Experience with any orchestration tool - Airflow, Kubeflow, Oozie, Luigi, Azkaban, Step Functions...
• Any big data or data engineering certification on any of the clouds
• Must have an inherent talent of understanding data and its interpretation for end business users
• Ability to drive initiatives and work independently
• Good communication skills to be able to express one s point to client concisely

Nice-To-Have

• Experience building large-scale, high throughput, 24x7 data systems
• Exposure to machine learning algorithms with implementation in practice
• Experience with legacy big data systems (ex: Hadoop)