Big Data Engineers And Leads Job in Gspann Technologies, Inc

Role and Responsibilities:

• Participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support.
• Solve complex business problems by utilizing a disciplined development methodology.
• Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
• Analyze sourceandtarget system data. Map the transformation that meets the requirement.
• Interact with clientsand onsite teams during different phases of a project.
• Coordinate and collaborate withbusinessstakeholders, architects,and other teams.
• Conduct performance and scalability tuning.

Skills and Experience

• Experience in developing relevantBigData/ETL data warehouse and building cloud-native data pipelines.
• Prior experience in developing Agile/Scrum applications using Jira.
• Sound knowledge of Hive, Spark, Scala/Java/Python, and SQL.
• Prior experience in Object and Functional programming using Python.
• Good understanding of REST and SOAP-based APIs to extract data for data pipelines.
• Expertise in Hadoop and related processing frameworks, such as Spark, Hive, Sqoop, etc.
• Prior experience in workingin a public cloud environment, i.e.,GCP,AWS, orAzure.
• Hands-on experience in working with real-time data streams and Kafka platform.
• Good knowledge of workflow orchestration tools, such as Apache Airflow design and deploy Directed Acyclic Graphs (DAGs).