Senior Software Engineer Data Job in Deepintent

What You ll Do: Establish formal data practice for the organisation. Build & operate scalable and robust data architectures. Create pipelines for the self-service introduction and usage of new data Implement DataOps practices Design, Develop, and operate Data Pipelines which support Data scientists and machine learning Engineers. Build simple, highly reliable Data storage, ingestion, and transformation solutions which are easy to deploy and manage. Collaborate with various business stakeholders, software engineers, machine learning engineers, and analysts. Who You Are: Experience in designing, developing and operating configurable Data pipelines serving high volume and velocity data. Experience working with public clouds like GCP/AWS. Good understanding of software engineering, DataOps, data architecture, Agile and DevOps methodologies. Experience building Data architectures that optimize performance and cost, whether the components are prepackaged or homegrown Proficient with SQL, Python or JVM-based language, Bash. Experience with any of Apache open source projects such as Spark, Druid, Beam, Airflow etc. and big data databases like BigQuery, Clickhouse, etc Good communication skills with the ability to collaborate with both technical and non-technical people. Ability to Think Big, take bets and innovate, Dive Deep, Bias for Action, Hire and Develop the Best, Learn and be Curious