Data Engineer Job in Citta Solutions Private Limited

Data Engineer

We are looking for a Data Engineer to build and implement functional programs. You will work with other Developers and Product Managers throughout the software development life cycle. In this role, you should be a team player with a keen eye for detail and problem-solving skills. If you also have experience in Agile frameworks and popular coding languages we d like to meet you.

Roles & Responsibilities

• Be actively involved with the team to design and build new data solutions - OLAP and OLTP
• Develop a variety of data workflows, pipelines, and ETL processes using cloud platform products and Indeed s internal infrastructure and tools
• Use Airflow or other scheduling tools to build workflows DAGs and schedule jobs
• Developing stream-processing systems, using frameworks such as Spark-Streaming or Kafka
• Develop data quality and governance automations to insure the accuracy and quality of the data through inspection, validation, processing, anomaly detection and auto-corrections
• Provide documentation, training, and consulting for our users

Requirements

• Programming (Python, Scala)
• Development in a Linux environment
• Big data platforms (Hadoop, GCP, AWS, Azure)
• Advanced SQL scripting
• Database Management Systems (for example, Oracle, MySQL or SQLServer)
• Data transformation tools
• Hands-on data processing and data modeling experience in a big data environment
• Knowledge of algorithms and data structures
• Understanding the basics of distributed systems
• Strong communication and collaboration skills
• Experience with Agile methodologies
• Bachelor s degree or equivalent work experience in Computer Science