Big Data_bangalore/pune Job in Sigma Allied Services Private Limited
Big Data_bangalore/pune
Sigma Allied Services Private Limited
4+ weeks ago
- Pune, Pune Division, Maharashtra
- Not Disclosed
- Full-time
- Permanent
Job Summary
Bachelor s/Master s Degree in Computer Science or a related engineering field.
Strong analytical, verbal and written communication skills
StrongSQLknowledge
Exposure and experience with relational, NoSQL and Cloud based databases/datastores. Exposure and experience with Snowflake, Elasticsearch, MongoDB is an added advantage
Excellent hands-on coding skills on programming languages, such as Python and Scala
Experience in building scalable, robust data pipeline using Apache Airflow, Apache Nifi or similar technologies
Demonstrable experience with large scale batch processing systems based on Spark, Spark-SQL, Hadoop or similar allied technologies
Demonstrable experience building large scale stream processing solutions based on Kafka, Spark Streaming or similar technologies
Experience building and managing Data lakes, Big Data warehouse.
Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks
Willingness to explore new alternatives or options to solve complex data ingestion/mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done
Knowledge of GitLab, & CI/CD processes
Integrating ML Models to Data pipelines is an added advantage
Experience working in public cloud environments like AWS, GCP is an added advantage
Exposure in creating RESTful services and knowledge of containers like Docker, Kubernetes is an added advantage
Roles and Responsibilities
" 5 10 years of recent experience in data engineering.Bachelor s/Master s Degree in Computer Science or a related engineering field.
Strong analytical, verbal and written communication skills
StrongSQLknowledge
Exposure and experience with relational, NoSQL and Cloud based databases/datastores. Exposure and experience with Snowflake, Elasticsearch, MongoDB is an added advantage
Excellent hands-on coding skills on programming languages, such as Python and Scala
Experience in building scalable, robust data pipeline using Apache Airflow, Apache Nifi or similar technologies
Demonstrable experience with large scale batch processing systems based on Spark, Spark-SQL, Hadoop or similar allied technologies
Demonstrable experience building large scale stream processing solutions based on Kafka, Spark Streaming or similar technologies
Experience building and managing Data lakes, Big Data warehouse.
Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks
Willingness to explore new alternatives or options to solve complex data ingestion/mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done
Knowledge of GitLab, & CI/CD processes
Integrating ML Models to Data pipelines is an added advantage
Experience working in public cloud environments like AWS, GCP is an added advantage
Exposure in creating RESTful services and knowledge of containers like Docker, Kubernetes is an added advantage
Experience Required :
5 to 10 Years
Vacancy :
2 - 4 Hires
Similar Jobs for you
Help us improve JobGrin
Need Help? Contact us