Aws With Pyspark | 4 To 6 Years | Mumbai & Pune Job in Capgemini

• Must have hands on experience implementing AWS Big data lake using EMR and Spark
• Working experience with Spark Hive Message Queue or Pub Sub Streaming technologies for 3 years
• Experience developing data pipelines using mix of languages Python Scala SQL etc and open source frameworks to implement data ingest processing and analytics technologies
• Experience leveraging open source big data processing frameworks such as Apache Spark Hadoop and streaming technologies such as Kafka
• Hands on experience with newer technologies relevant to the data space such as Spark Airflow Apache Druid Snowflake or any other OLAP databases
• Experience developing and deploying data pipelines and real time data streams within a cloud native infrastructure preferably AWS

• AWS
• PySpark

• Experience in using CI CD pipeline Gitlab
• Experience in Code Quality implementation
• Used Pep8 Pylint tools or any other code quality tool
• Experience of Python Plugins operators like FTP Sensor Oracle Operator etc

Ref:

509479

Posted on:

September 9, 2020

Experience level:

Experienced

Contract type:

Permanent

Location:

Mumbai

Business units:

I and D Global Practice

Department:

Cloud