Sr. Data Engineer Job in Trellissoft Engineering Services Pvt Ltd

Job Title: Data Engineer

Location: Bengaluru, Karnataka

Experience: 5 to 8 Years

Work Modality: Full-time (Work from office)

Job Description:

We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines.

Key Responsibilities:

• ETL/ELT Pipeline Development:
  • Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes.
• Data Warehouse & Data Lake Optimization:
  • Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations.
• Collaboration & Data Requirements:
  • Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency.
• Database Structure & Schema Management:
  • Develop and maintain database structures and schemas to ensure efficient data storage and retrieval.
• Data Workflow Optimization:
  • Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency.
• Data Security & Compliance:
  • Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards.
• Pipeline Monitoring & Troubleshooting:
  • Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing.
• Process Automation:
  • Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow.

Required Qualifications:

• Experience:
  • 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer.
• Technical Skills:
  • Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc.
  • Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS.
  • Exposure to Python, Java, or Scala for data processing is a plus.
  • Experience with big data technologies such as Apache Spark, Hadoop, or Kafka.
  • Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery.
  • Strong knowledge of data modeling, warehousing concepts, and data architecture best practices.
• Soft Skills:
  • Excellent communication skills with the ability to collaborate effectively across teams.
  • Strong problem-solving skills and the ability to work with large, complex datasets.

What We Offer:

• Competitive Salary:
  • Attractive salary based on experience and expertise.
• Collaborative Work Environment:
  • Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration.
• Growth Opportunities:
  • Opportunities to enhance your skills and career growth in the data engineering field.
• Comprehensive Benefits:
  • Benefits package designed to support work-life balance and overall employee well-being.