Senior Data Engineer Job in Cygnet Infotech

Experience:- 4 to 8 years

Description:

• Build, maintain, and support large-scale collections and processing systems.
• Be part of a Scrum team that designs, swarms, and pairs together
• Implement and improve deployment, monitoring, testing, operational and foundational tools.
• Be an excellent problem solver and be willing to roll up sleeves to tackle any issue thrown your way

Experience We Want to See:

• Some hands on experience with large-scale distributed systems
• S. or higher in Computer Science or equivalent training and experience
• Familiarity with one or more of the public clouds like AWS, GCP or Azure.
• Familiarity with Python, Java, Spark, Ruby and/or Node.js
• Experience with source control. Github is preferred.
• Experience with Linux and cloud-based environments
• Familiarity with Infrastructure as Code such as Terraform or CloudFormation
• Ability to communicate with management, software architects, and developers about project status, APIs and overall systemhealth.
• Working knowledge of modern web technologies including cloud based APIs and protocols (REST, JSON)

Nice to Have:

• Data Science background or experience
• Amazon Web Services (AWS) experience with EC2, ECS and S3
• Infrastructure as code provisioning tools such as Terraform/CloudFormation, etc.
• Participation in a technical community is a major plus: e.g., contributions to open-source projects, published works, presentations in academic conferences or industry circles
• AWS networking such as VPC and security groups
• AWS Analytics such as Athena, Glue, Sagemaker, Kinesis
• Here is what you will be working with!
• Python
• js ES6
• Ruby
• Java, Scala
• HBase/EMR clusters, Riak, Redis/Elasticache, MySQL
• AWS Services
• Thousands of servers