Data Engineer Job in Teksystems, Inc.

Job Summary Data Engineer: This Project falls under Big data Technology, the role involves creating the data pipelines and dashboard. What will you get to learn? You will get opportunity to work and learn, GCP (as they are migration from on prem to GCP cloud), Devops pipelines. Skills Required (Mandatory): 5+ years experience as a Data engineer. Python (Pandas, Pyarrow, beautifulsoup4 etc) Hadoop and big data technologies (Hive and Spark). Linux and Shell scripting A strong background in data engineering, with experience in deploying complex cloud data and big data systems. Understanding in applying data engineering methods to the cyber security domain An ability to communicate complex and technical issues to diverse audiences, orally and in writing, in an easily understood, authoritative and actionable manner. Good to have experience into Git and code scanning tools, DQ packages, GCP (Biq Query, Data Proc, Pub/Sub), Docker and K8. Experience: 5+ Years Job Location: Hyderabad and Pune. Work Timings: UK shift (Flexible) Roles and Responsibilities: Will be responsible in Driving the design, development, implementation, and maintenance of production ready Data pipielines. Should contribute innovative ideas, identify new features, and propel them from design to deployment. Responsible for Data literacy, know about structured and unstructured data, Big Data technologies, Data Models and best practices in building Data Pipelines Should be able to deal with different formats and volumes of data (json, orc, parquet, csv etc) Will be involved in usage of DevOps Tools in Data Engineering - Data Testing, code scanning, enforcing coding and release standard.