Data Engineer Job in Digital Aptech
Job Summary
Job Title: Data Engineer
Location: Kolkata
Employment Type: Full-time
Experience: 3+ years
Salary: INR 10 - 15 LPA
Notice Period: 30 Days
Role & Responsibilities:
- Participate in technical and functional design discussions for sprints, modules, or projects
- Design and implement end-to-end data solutions involving storage, integration, processing, and visualization using Azure
- Ingest data from multiple sources such as SQL Server, Oracle, Excel, SQL Azure, etc., into Azure Data Factory and Azure Data Lake Storage (ADLS)
- Extract data from one database and load it into another, ensuring data integrity and performance
- Build scalable data architecture for ingestion, processing, and surfacing large-scale data for applications
- Utilize various scripting languages to integrate systems effectively, understanding their nuances
- Research and implement innovative methods to acquire data and leverage existing data for new applications
- Collaborate with data architects, analysts, and scientists to prepare datasets for analysis and interpretation
- Perform statistical analysis and fine-tune data processes based on test results
- Develop and extend libraries and frameworks to support data workflows
- Create design documents and provide technical solutions aligned with business requirements
Preferred Candidate Profile:
- Strong understanding of database management, OLAP, and ETL frameworks
- Minimum 3 years experience working with Azure, Azure Data Factory, and .NET technologies
- Proficient in creating manual and auto-trigger pipelines in Azure Data Factory
- Experience in managing ETL jobs in Azure Synapse Analytics, including creating, updating, editing, and deleting jobs
- Ability to replicate existing application logic within Azure Data Lake, Data Factory, SQL Database, and SQL Data Warehouse environments
- Solid knowledge of SQL queries, SQL Server Reporting Services (SSRS), and SQL Server Integration Services (SSIS)
- Proven initiative and innovative mindset
- Strong analytical and problem-solving skills
Similar Jobs for you
Help us improve JobGrin
Need Help? Contact us