Python Pyspark Developer Job in Smartek21

Company Description

SmarTek21 is a global leader in Intelligent Technology Transformation as a Service. We accelerate digital business for Fortune 500 clients and industry-leading enterprises across the world. Our technology services have accelerated billions in revenue for our clients in Telecoms, Retail and eCommerce, Insurance, Banking, Technology, and Healthcare.

Job Description

Hands on expertise over Apache Spark ( specifically Spark-SQL) and Hadoop framework.

Hands on PySpark or Scala spark libraries .

A decent understanding of Relational Databases and can write SQL Codes .

Well versed with Non Relational databases (No-SQL) and have good experience on MongoDb, Cassandra, Hive, HBase etc.

Understanding of Subscriber and publisher messageing pattern with good grasp onKafkaQueue or anyother streaming services.

Well versed with Event drivenand asynchrounous progragamming paradigm.

Have experience in writing enterprise grade codes, which is secure,efficient and unit tested.

Well versed with coding practices and command over Unit testing framework for the respective technology stack.

Develop scalable data and analytics solutions leveraging standard platforms, frameworks, patterns and full stack development skills

Analyze, characterize and understand data sources, participate in design discussions and provide guidance related to database technology best practices.

Collaborte well with for various scrum ceremonies and be a Team Player .

Well vesed with standard Change management practives and should have worked on git and knows about various git-patterns.

Working knowledge of amazon web services (specifically EC2, S3, SQS, SNS,RDS, Lambda etc)

Responsibilities

Individual contribution for writing quality Python,Spark,Pyspark code.

Collaborate with all the stake holders and work towards common goals.

Understand requirements and participate in developing quality code.

Familiarity with leveraging and modifying open-source libraries to build custom frameworks.

Desired Candidate profile:

Should have experience working with Agile methodology

• Demonstrated ability to learn and apply new technologies and frameworks quickly.

Should be self-motivated and Smart working

Candidate should have excellent communication skills both oral and written

Should be willing to learn

Should be B.E, B.Tech, MCA, M.Sc. qualified

Primary Technical Skills:Apache Spark,Pyspark, Hadoop framework, EMR/Spark, SQL/NoSQL/MPP