Data Engineer Job in Piramal Enterprises Ltd.
Data Engineer
- Vadodara, Gujarat
- Not Disclosed
- Full-time
Description
Did you know:Piramal Glassis a trailblazer in the use of digital technology in glassmaking and has recently been recognised as India 100 Best Companies to work for by #GreatPlaceToWork.
Click below to read more about our digital accomplishments:
Purposeof the Job
The Data Engineer extracts data andimplements machine learning models into production by utilizing state of theart tools/algorithms and methodologies following DevOps and a test-drivendevelopment process. Data Engineering is the key role for bridging the gapbetween insight and actions. Data Engineers work in close collaborations withthe data scientists and guide them to focus not only on model performance butalso delivery stability, reproducibility and scalability of a software product.
The Data Engineerbelieves in anon-hierarchical culture of collaboration, transparency, safety, and trust.Working with a focus on value creation, growth and serving customers with fullownership and accountability. Delivering exceptional customer and businessresults
Responsibilities
- Collaborate with Data Scientists to testand scale new algorithms through pilots and later industrialize the solutionsat scale to the comprehensive fashion network of the Group
- Influence, build and maintain thelarge-scale data infrastructure required for the AI projects,andintegrate with external IT infrastructure/service to provide an e2esolution
- Leverage an understanding of softwarearchitecture and software design patterns to write scalable, maintainable,well-designed and future-proof code
- Design, develop and maintain theframework for analytical pipeline
- Develop common components to address painpoints in machine learning project, like model lifecycle management, featurestore and data quality evaluation
- Provide input and help implementframework and tools to improve data quality
- Work in cross-functional agile teams ofhighly skilled software/machine learning engineers, data scientists, designers,product managers and others to build the AI ecosystem within the Group
- Deliver on time, demonstrating strongcommitment to deliver on the team mission and agreed backlog
Qualification :
Qualifications
Industry
Any (prefer Manufacturing, Logistics); willingness to learn manufacturing systems (OT systems and data stores)
Education
Bachelors or masters in Computer Science or Engineering, BCA / MCA / B.Sc / M.Sc
Work experience
~2+ years of industry exposure in Data Engineering projects
Skills & Competencies required
- Ability to transform proof of concept machine learning models into scalable solutions
- Well versed with data handling techniques - Data cleansing and feature scaling
- Ability to apply software development best practice into machine learning project, including unit test, DevOps integration, release management, test driven development, etc.
- Ability to automate development process of machine learning project by leverage state of art tools and technology like container, continuous integration and delivery, orchestration tools etc.
- Familiar with at least one of major cloud solutions, preferably Azure. Able to recommend and select right services available in cloud to address technical problem
- Good understanding and experience with software design principle and design pattern
- Good understanding of Agile and scrum methodology, keep team focus on deliver business value
Functional Knowledge
- DevOps and continuous integration
- Agile wow and test-driven development
- Distributed computing
- Linux
- Spark and Hadoop eco system
- Software development best practices
- Python/Scala/Java
- Docker, Kubernetes
- Experience with Azure
- Data structure and algorithm
- RDBMS and NoSQL databases, good skill with SQL
Your 4 Step Guide to Career Success
