Senior Data Engineer Job in Experion Technologies (india) Private Limited

Senior Data Engineer AWS Big Data & API Integration Expert

Location: Cochin

Experience Required: 5+ years in Data Engineering

Job Purpose

We are hiring a Senior Data Engineer to lead the development of a scalable and efficient data ingestion framework and ensure high standards of data quality and validation. This role involves designing and implementing robust APIs for seamless data integration and working with modern AWS-based big data technologies. The ideal candidate thrives in complex environments and is passionate about scalable, automated, and high-performance data systems.

Key Responsibilities

• Data Ingestion Framework: Architect, build, and maintain ETL pipelines using services such as AWS Glue, Lambda, EMR, Step Functions, ECS, and EC2.
• Data Quality & Validation: Implement automated validation checks, monitoring tools, and alerting mechanisms to ensure data accuracy, completeness, and integrity.
• API Development: Design and develop secure, scalable, and high-performance RESTful APIs with robust documentation and best practices in security, versioning, and performance optimization.
• Agile Collaboration: Collaborate with stakeholders, analysts, and data scientists to understand business requirements and deliver actionable data solutions. Participate in agile ceremonies and code reviews.
• DevOps & CI/CD: Contribute to the development of CI/CD pipelines using tools like GitLab, ensuring automated, test-driven deployments.

Required Qualifications

• 5+ years of hands-on experience in data engineering and analytical platform development.
• Proficient in Python, PySpark, and SQL for large-scale ETL processes.
• Extensive knowledge of AWS services such as Glue, Lambda, S3, Step Functions, EMR, and ECS.
• Experience with big data frameworks (e.g., Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, PostgreSQL, Redshift.
• Skilled in building and integrating secure RESTful APIs for internal and external systems.
• Familiar with CI/CD, automated testing, and agile project management tools.
• Strong analytical thinking, communication skills, and problem-solving mindset.

Preferred Qualifications

• Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field.
• Experience with AWS Kinesis, Firehose, SQS, and modern data lakehouse architectures.
• Prior experience with data quality frameworks and large-scale API-driven data integration in distributed systems.
• Familiarity with information security standards and adherence to ISMS policies.