BriefCase
BriefCase

Senior Engineer - Data Engineering Job in Altimetrik

Senior Engineer - Data Engineering

Altimetrik 4+ weeks ago
Apply Now
Job Summary Job Overview Senior Engineer - Data Engineering in the Automotive domain with 3-7 years of experience Extensive expertise in pyspark, hadoop, and gcp for designing and implementing data pipelines Proficient in tensorflow, python, and SQL for automation, data quality, and optimization Skilled in big data technologies like numpy, pandas, and data manipulation Responsible for architecting scalable data pipelines, data transformation, performance optimization, monitoring, and collaboration with cross-functional teams Bachelor's degree in Computer Science or equivalent; preferred certifications include Professional Data Engineer and Google Cloud Certified - Professional Data Engineer Good to have experience with CI/CD practices, data processing libraries, data quality, Pub/Sub architectures, and Tekton pipelines management Roles & Responsibilities Architect and Develop Data Pipelines: Lead the design, development, and maintenance of scalable and efficient data pipelines using GCP services like Pub/Sub for real-time data ingestion and BigQuery for storage and analysis. Data Transformation and Processing: Implement data transformation processes to cleanse, enrich, and aggregate raw data from diverse sources, ensuring data quality and consistency. Performance Optimization: Fine-tune data pipelines and queries to enhance performance, reduce latency, and ensure timely data access for stakeholders. Monitoring and Maintenance: Implement monitoring solutions for tracking pipeline performance, addressing issues proactively, and conducting regular maintenance tasks to uphold data infrastructure reliability. Collaboration: Collaborate with Data Scientists, Software Engineers, and Business Analysts to understand data requirements and provide technical solutions to meet business needs. Documentation: Document data pipelines, processes, and best practices to facilitate knowledge sharing and maintain a comprehensive understanding of data architecture. Our ideal candidate Extensive knowledge and proficiency in pyspark, hadoop, and gcp Advanced skills in designing and implementing data pipelines, data modeling, and data warehousing solutions Proficiency in tensorflow and python for automation scripts and data quality Strong SQL skills for querying and optimizing data warehouse operations Expertise in big data technologies like numpy, pandas, and libraries for data manipulation and analysis Monitoring data processes, utilizing GCP services, and implementing data engineering best practices Prioritizing skills in GCP, BigQuery, Python, Data Modeling, SQL, and Data Warehousing Bachelor of Technology (B.Tech) or Bachelor of Engineering (B.E) in Computer Science or Information Technology, or a Master of Technology (M.Tech) in Data Science or Big Data Analytics Certifications such as Professional Data Engineer and Google Cloud Certified - Professional Data Engineer preferred Company overview Altimetrik delivers outcomes for our clients by rapidly enabling digital business & culture and infuse speed and agility into enterprise technology and connected solutions. We are practitioners of end-to-end business and technology transformation. We tap into an organization s technology, people, and assets to fuel fast, meaningful results for global enterprise customers across financial services, payments, retail, automotive, healthcare, manufacturing, and other industries. Founded in 2012 and with offices across the globe, Altimetrik makes industries, leaders and Fortune 500 companies more agile, empowered and successful.Altimetrik helps get companies get unstuck . We re a technology company that lives organizations a process and context to solve problems in unconventional ways. We re a catalyst for organization s talent and technology, helping teams push boundaries and challenge traditional approaches. We make delivery more bold, efficient, collaborative and even more enjoyable.
Qualification :
Bachelor of Technology (B.Tech) or Bachelor of Engineering (B.E) in Computer Science or Information Technology, or a Master of Technology (M.Tech) in Data Science or Big Data Analytics
Experience Required :

3 to 7 Years

Vacancy :

2 - 4 Hires

Apply Now
Similar Jobs for you