Data Engineer Job in Indium Software
Data Engineer
- Bengaluru, Bangalore Urban, Karnataka
- Not Disclosed
- Full-time
Data Engineer
Role Overview
We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs.
This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows.
Key Responsibilities
Data Pipeline Development & Optimization
- Design and build scalable ETL/ELT processes for structured and unstructured data.
- Develop and maintain data ingestion frameworks to handle large datasets efficiently.
- Ensure data integrity, consistency, and security across multiple sources.
Database & Data Warehouse Management
- Develop, optimize, and maintain relational and NoSQL databases.
- Implement data modeling best practices for performance and scalability.
- Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery).
Big Data & Cloud Technologies
- Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing.
- Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions.
- Develop real-time and batch processing workflows.
Collaboration & Documentation
- Work closely with data scientists, engineers, and business teams to understand data requirements.
- Document data pipelines, architecture, and workflows for scalability and maintenance.
Required Qualifications & Skills
Technical Expertise:
- Strong experience with SQL and Python for data processing.
- Proficiency in ETL/ELT frameworks and data integration techniques.
- Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka).
Cloud & Database Management:
- Expertise in cloud data platforms (Azure, AWS, GCP).
- Experience with data warehousing solutions (Snowflake, Redshift, BigQuery).
- Understanding of data governance, security, and compliance.
Performance Optimization & Troubleshooting:
- Ability to optimize SQL queries and improve data processing efficiency.
- Experience troubleshooting complex data pipeline issues.
Apply Now & Be Part of an Innovative Data Team!
Your 4 Step Guide to Career Success
