Technology - Solution Architect - Big Data Job in Netscribes
Technology - Solution Architect - Big Data
Netscribes
4+ weeks ago
- Mumbai, Maharashtra
- Not Disclosed
- Full-time
Job Summary
The solution architect will have end to end ownership for design, architecture and performance of new applications that will be used for high volume data collection from online sources (ecommerce marketplaces, social media, registries, government portals, corporate websites etc) as well as from client databases. The solution architect will own the entire data journey from collection, ingestion, cleansing, structuring, storage and integration with other applications. The candidate will work with our team of data scientists for analysis and visualization. This role will include:
Qualification : Graduation degree in computer science, engineering or other technical streams.
The solution architect will have end to end ownership for design, architecture and performance of new applications that will be used for high volume data collection from online sources (ecommerce marketplaces, social media, registries, government portals, corporate websites etc) as well as from client databases. The solution architect will own the entire data journey from collection, ingestion, cleansing, structuring, storage and integration with other applications. The candidate will work with our team of data scientists for analysis and visualization. This role will include:
- Being the principal point of contact for all architecture aspects of the solution.
- Being able to address and integrate the: Business Process, Data, Application, Technical and Information Security aspects of the solution.
- Ability to understand the business requirements and translate them into a technology solution.
- Provide technical guidance and mentoring to the development team in order for them to build the system successfully.
- Deal with complex end to end data extraction and transformation projects consisting of heterogeneous applications leveraging disparate products , integration patterns and tools on both on premise and cloud platforms.
- Independently drive end to end technical solutioning, response and estimation on opportunities.
- Continuously keep pace with the latest technological developments and evaluate various services for data extraction, parsing and data storage and processing and utilise these for technical solutioning.
- At least 5+ years of experience in architecture and design of big data systems
- 10+ years in software development
- Comfort with cloud deployments (AWS, Google Cloud,Azure)
- An understanding of programming languages (R,Python,React, Angular, C#, Node.js, jQuery, ASP .NET, HTML5, CSS3)
- Experience of working with MS SQL, My SQL,Distributed storage, NoSQL storage and Graph database
- Experience with containerized applications using Docker, Kubernetes or other similar tooling
- Extensive understanding of web scraping and crawling tools and methodologies like Requests, Beautiful soup, Selenium, Scrapy, Apify, portia, Parsehub, Octoparse etc
- Experience with big data systems like Hadoop, Spark, Elasticsearch, Cassandra etc will be an added advantage
- Strong written and verbal communication, ability to interact with clients directly
- Must have the ability to work independently with minimal supervision in an unstructured environment
- Ambitious, motivated individuals who can drive growth in partnerships with operations and sales
- Ability to communicate technical subject matter to non-technical people effectively.
Qualification : Graduation degree in computer science, engineering or other technical streams.
Similar Jobs for you
Your 4 Step Guide to Career Success
Apply for jobs
Create Profile
Schedule Interview
Get Hired
Help us improve JobGrin
Need Help? Contact us