Sr Data Engineer- Hadoop Job in Litmus7 Systems Consulting Ltd

6 to 8 years of Big Data experience 5+ years of experience in building data processing applications using Hadoop, Spark and NoSQL DB and Hadoop streaming. Expertise in one or more programming languages like Java, Scala or Python and in unix scripting. Expertise in using query languages such as SQL, Hive, Sqoop and SparkSQL. Expertise in storage and process optimization techniques in Hadoop and Spark. Experience in using tools like Jenkins for CI, Git for version Control and Exposure to Google Cloud (GCP) data components such as Cloud Data Flow, Cloud Data Proc, BigQuery and BigTable is preferred Experience on Petabyte scale Hadoop Eco system to ingest raw data and transform it into a usable and consumable information for various operational and advanced analytics purpose. Build, test & maintain enterprise data lake and data pipelines Work with analytics partners to deploy scalable data pipelines for analytical needs Nice to have: Experience around predictive modeling , personalization and recommendation algorithms, natural language processing and text mining Retail domain experience ( customer engagement /supply chain chain optimization).