Big Data Engineer Job in Firminiq

Technical Skills:

Minimum experience required: 4+ years

Big Data Engineer Responsibilities

As a Big Data Engineer, you ll be responsible for designing and building high performance, scalable solutions for large volume data ingestion, clean-up, and processing that meet the needs of our enterprise customers. You ll design, develop, and test robust, scalable data pipelines, microservices, Spark Streaming Applications, and RESTful web services. You ll work with a variety of teams and individuals to come up with innovative solutions. You ll be a self-organized member of a team of talented engineer and should be able to collaborate with product managers and designers to help implement and execute new products and features.

Big Data Engineer Requirements

• Experience working on High Availability distributed systems
• 4+ years of experience: building business logic layers and back-end systems for high-volume data pipelines and backend applications.
• Experienced in evaluating and benchmarking new technologies/products.
• Experienced in java/scala/python
• Current experience using SQL/no SQL platforms, and Apache products (kafka, Spark, Hadoop, Cassandra, Druid, HBase)
• Experience developing and deploying on linux/unix platforms
• Experience with DevOps tools (GitHub, Jira) and methodologies (Agile, Scrum, Kanban, Test Driven Development)
• Basic understanding of Security (Kerberos, LDAP, TLS)
• Exposure to any public cloud (AWS, GCP) will be a plus.