Data Engineer-data Platforms Job in International Business Machines Corporation

Introduction

In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients globally. Our centers provide locally-based skills and technical expertise to drive innovation and the adoption of new technologies.

A career at IBM Consulting involves building long-term relationships and collaborating closely with clients across industries. You'll work alongside visionaries to help them on their hybrid cloud and AI journeys, enhancing the value and impact of some of the most innovative companies in the world. With access to IBM s strategic partner ecosystem and cutting-edge technology platforms, including IBM Software and Red Hat, you will be empowered to accelerate client transformations and create meaningful change.

Curiosity and a constant quest for knowledge serve as the foundation for success at IBM. In your role, you'll be encouraged to challenge the status quo, explore ideas beyond your current role, and come up with creative solutions that will make a significant impact across a wide network of clients. Our culture of evolution and empathy is centered on long-term career growth and development opportunities in an environment that celebrates your unique skills and experience.

Your Role and Responsibilities

As a Data Engineer at IBM, you will be a critical player in designing and developing applications, while also providing guidance to project teams on complex coding, troubleshooting, and execution.

Your key responsibilities include:

• Solution Design and Construction: Lead the design and construction of new data solutions using the latest technologies, ensuring business value and meeting user requirements.
• Continuous Improvement: Advocate for continuous improvement by testing solutions and working within an Agile framework to enhance and iterate the developed solutions.
• Innovation: Stay current with the latest technology trends, discovering and implementing creative solutions to solve business problems.
• Collaboration: Work with diverse teams to deliver impactful data solutions while ensuring scalability, quality, and performance.

Required Education

Bachelor s Degree in a relevant field

Required Technical and Professional Expertise

• Apache Spark (PySpark): In-depth knowledge of Spark s architecture, core APIs, and using PySpark for distributed data processing.
• Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools.
• Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
• Proficiency in Python: Expertise in Python programming, particularly focused on data processing and manipulation.
• Data Processing Frameworks: Experience with Pandas, NumPy, and other data processing libraries.
• SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
• Cloud Platforms: Experience working with cloud platforms such as AWS, Azure, or GCP, including working with cloud storage systems.

Preferred Technical and Professional Experience

• Architecture Strategy: Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring of data solutions.
• Cross-Team Collaboration: Partnering with technology teams, including application development, enterprise architecture, testing services, and network engineering.
• Security: Familiarity with detection and prevention tools for company products and customer-facing platforms.

How You ll Grow

At IBM, we offer opportunities for career development and provide an environment where you are encouraged to continuously grow, learn, and expand your expertise. Working with cutting-edge technologies and a diverse set of clients, you will be able to stay ahead of industry trends and make meaningful contributions that have a real impact.

About IBM Consulting

IBM Consulting helps organizations tackle their most pressing challenges through innovative and agile solutions. By partnering with clients, we drive technology transformations, helping them optimize their operations and leverage new technologies like AI, cloud, and data. Our team s expertise spans across many industries, delivering solutions that enable clients to navigate digital transformations.

This role offers an exciting opportunity to work with leading technologies while contributing to client success in a highly dynamic environment. If you re passionate about solving complex data problems and delivering impactful solutions, IBM Consulting is the place to grow your career.