Data Engineer Job in Blackstraw Simplify Ai

Job Title: Data Engineer

Location: Chennai (Work from Office)

Job Type: Full-time

Experience: 2 to 4 years

Job Description

Blackstraw Technologies Pvt Ltd is seeking a skilled Data Engineer to join our dynamic team. You will play a crucial role in transforming raw data into actionable insights by designing and maintaining robust data pipelines and systems. Your work will ensure alignment between data infrastructure and business goals, helping to drive efficiency and scalability.

You will leverage your analytical skills and proficiency in various programming languages to integrate, process, and optimize data from diverse sources. You will also collaborate closely with data scientists and end-users to support data-driven decision-making.

Key Responsibilities

• Design, build, and integrate data pipelines from multiple sources for analytics and operational purposes.
• Perform data integration and troubleshoot production and development issues.
• Develop, automate, and optimize ETL pipelines and workflows.
• Work with big data technologies including Hive, Spark, and Hadoop; optimize performance for large-scale data processing.
• Write and maintain efficient Spark/PySpark or Spark/Scala programs.
• Utilize strong SQL skills for querying and database design.
• Develop shell scripts (Unix/Linux) to automate data processing tasks.
• Collaborate with data scientists and various business teams to understand and fulfill data needs.
• Maintain and deploy ETL code following Agile methodologies.
• Handle service delivery tickets and provide support related to ETL tools.
• Participate in root cause analysis and problem resolution for data pipeline issues.

Required Skills & Qualifications

• Bachelor s degree in Computer Science, Information Technology, or related field; Master s degree is a plus.
• 2 to 4 years of hands-on experience in data engineering or related roles.
• Strong expertise in ETL development and data integration tools.
• Proficiency in Spark (PySpark or Scala), Hive, and Hadoop ecosystem.
• Advanced SQL skills and experience with relational database management systems (RDBMS).
• Experience with shell scripting in Unix/Linux environments.
• Familiarity with Java, Python, or Scala programming languages is desirable.
• Knowledge of Cloud platforms (Azure preferred) is a plus.
• In-depth understanding of Retail domain data and business processes is advantageous.
• Excellent analytical, organizational, and communication skills.
• Experience with Agile project management and teamwork.

About Blackstraw Technologies Pvt Ltd

Founded in 2015 and fully operational since 2018, Blackstraw Technologies is a global software products and services company specializing in Artificial Intelligence (AI) and Machine Learning (ML) solutions. Our AI platform accelerates data labeling, model training, and deployment across cloud and on-premise environments.

Our 250+ member team boasts over 900 years of combined experience, focusing on areas such as computer vision, natural language processing, and deep learning annotation tools. We enable enterprises worldwide to rapidly adopt AI in a cost-effective, plug-and-play manner.

Headquartered in Florida, USA, Blackstraw has operations across Canada, the USA, and India.