Sr Data Engineer Job in Birlasoft Limited

v Develops and maintains scalable datapipelines and builds out new API integrations to support continuing increasesin data volume and complexity.

v Collaborates with analytics andbusiness teams to improve data models that feed business intelligence tools,increasing data accessibility and fostering data-driven decision making acrossthe organization.

v Implements processes and systems tomonitor data quality, ensuring production data is always accurate and availablefor key stakeholders and business processes that depend on it.

v Writes unit/integration tests,contributes to engineering wiki, and documents work.

v Performs data analysis required totroubleshoot data related issues and assist in the resolution of data issues.

v Works closely with a team of frontendand backend engineers, product managers, and analysts.

v Defines company data assets (datamodels), Pyspark, spark SQL, jobs to populate data models.

v Designs data integrations and dataquality framework.

v Works closely with all business unitsand engineering teams to develop strategy for long term data platformarchitecture.

Qualifications / Skills:

v Experience with Agile SoftwareDevelopment methodologies

v Experience with dev-ops and CI/CD

v Experience with Data Modeling andDimensional Modeling

v Experience in writing data pipelinesusing Python, pySpark, Spark SQL

v Excellent problem solving andtroubleshooting skills

v Process oriented with greatdocumentation skills

v Excellent oral and writtencommunication skills with a keen sense of customer service

v Knowledge of best practices and IToperations in an always-up, always-available service

v Experience with cloud-based echo systemlike AWS/GCP

v Knowledge of machine leaning and AI

v Knowledge of Palantir tool is plus

Experience Requirements:

v BTech or master's degree in computerscience or a related technical field

v 5+ years of Python and pysparkdevelopment experience

v 7+ years of SQL experience (No-SQLexperience is a plus)

v 7+ years of experience with schemadesign and dimensional data modeling

v Ability in managing and communicatingdata warehouse/data lake plans to internal/external clients

v Experience designing, building, and maintainingdata processing systems