Senior Data Engineer Job in Suma Soft Private Limited

Job Description:

Data mining using state-of-the-art methods and data orchestration platforms like AirFlow
Extending the company s data with third-party sources of information when needed
Enhancing data collection procedures to include information that is relevant for building
analytic systems
Processing, cleansing, and verifying the integrity of data used for analysis
Server-side development on data ingestion engine
Map data properties between ingress and egress layers
Build integration strategies between exposed APIs
Apply data security, archival, and redundancy techniques to protect data integrity
Optimize process, procedures, code for performance, stability, and scalability
Code reviews pull requests
Our qualifications
Bachelor s degree in computer/data science or related field or equivalent experience
5+ years of experience in a development environment with a full SDLC process
Proficient in the Python programming language
Excellent understanding of machine learning techniques and algorithms
Experience with common data science toolkits
Experience with data visualization tools
Experience with data orchestration platforms and microservices architectures
Experience with JSON data structures and the JavaScript programming language
Experience with Node.js and MongoDB query language
Deep knowledge and hands-on work with API integrations
Proven ability to work with cloud-based infrastructure: AWS, Heroku, Lambda
Must be able to adapt and adjust to highly agile development methodologies
Working knowledge of event-driven architecture, domain driven design, service-oriented
architecture, and microservices.
Our preferred skills (exposure/knowledge)
Insurance Industry (InsurTech experience)
Logistical exposure in transportation data
Apache AirFlow
BI/Analytics platform
Kafka Connect

Industry: IT-Software / Software Services

Functional Area:IT Software Other

Role Category: Programming & Design

Role: Software Developer