Senior Data Engineer Big Data Job in Indium Software

Senior Data Engineer Big Data

Job Description

• In-depth knowledge of Hadoop, Spark, and similar frameworks.
• Ability to design, build and unit test the application in Spark/Pyspark.
• Ability to understand existing ETL graph & logic to convert into Spark/PySpark/ Spark SQL.
• Good implementation experience of oops concepts.
• Knowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec.
• Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.
• Experience working with CI-CD process.
• Knowledge of the agile methodology for delivering projects.