Staff Data Engineer Job in Intuit

Intuit is a global leader in financial technology, dedicated to helping individuals and businesses thrive. Our suite of products, including TurboTax, Credit Karma, QuickBooks, and Mailchimp, serves approximately 100 million customers worldwide. At Intuit, we believe in providing everyone with the tools and resources they need to achieve financial success. We are constantly innovating to make financial empowerment a reality for all.

Job Overview

Join the Intuit Data Platform (IDP) team as a Staff Engineer and help us transform the way we handle big data! The IDP team is responsible for the Intuit Analytics Platform, which powers real-time data ingestion, cataloging, analytics, and machine learning across the entire organization. As Intuit s customer base grows, so does the volume of data we process. Our engineering excellence ensures that we can scale and leverage this data to drive machine learning and product innovations.

We re in the process of building the next-generation real-time and batch ingestion engine, capable of indexing, cataloging, and organizing data and metadata. We are passionate about using open-source technologies to solve challenges and contributing back to the community. If you're excited about building a platform that will directly impact data scientists and analysts and have a desire to shape the future of data at Intuit, then come join us!

Key Responsibilities

• Architect & Design: Build fault-tolerant and scalable big-data platforms using open-source technologies to handle massive datasets.
• Data Solutions: Create architecture solutions that address complex use cases like data normalization, lineage, governance, ontology, and discoverability.
• Cross-Team Collaboration: Work with analysts and data scientists to understand data requirements for building operational propensity models and gaining deep customer insights.
• Hands-On Coding: Lead development efforts within the Hadoop ecosystem using technologies such as Java MapReduce, Spark, Scala, HBase, and Hive to build and optimize data pipelines for both real-time and batch applications.
• Database Management: Work with NoSQL, SQL, and in-memory databases to design high-performance data systems.
• Code Reviews: Ensure code quality, consistency, and adherence to best practices through regular code reviews.
• Architectural Alignment: Ensure alignment between enterprise architecture and business requirements.
• Prove Feasibility: Conduct proof-of-concept (POC) experiments for new technologies or approaches and drive them to production.
• Collaboration with Data Cataloging Team: Work closely with data catalog teams and architects to index and catalog all data sources at Intuit.
• Agile Leadership: Lead fast-paced development teams using agile methodologies and promote best practices in software development, testing, and incident response.
• Design & Model: Build dimension models suited for customer business use cases and ensure seamless integration of business and technical requirements.

Qualifications

• Experience: 12+ years of relevant experience, with at least 5+ years specializing in the big data domain.
• Big Data Architecture: Proven experience in architecting end-to-end ecosystems for big data and analytics platforms.
• Expert Knowledge: Deep expertise in building fault-tolerant, scalable big data solutions, especially using the Hadoop ecosystem (Hive, HBase, Spark, Kafka, MapReduce, etc.).
• Programming Expertise: Mastery of Java and Scala, with a focus on building high-throughput data services.
• Machine Learning: Knowledge of machine learning principles and AI applications in big data.
• Big-Data Technologies: Familiarity with tools such as HDFS, Storm, Zookeeper, Cassandra, Redshift, GraphDB, and others. Understanding both real-time and batch processing in the Hadoop ecosystem.
• Communication: Strong communication skills, with an ability to explain complex technical topics to both technical and non-technical audiences.
• Programming Skills: Intermediate experience in Python or R for data processing.
• Education: BE/BTech/MS in Computer Science or a related field (or equivalent experience).
• Collaboration: Demonstrated ability to work cross-functionally and lead change through influence and example.

Why Join Intuit?

At Intuit, you ll be part of a talented, passionate team working on innovative solutions that shape the future of data analytics and machine learning. As a Staff Engineer, you ll have the chance to work with cutting-edge technologies, build scalable systems, and help revolutionize how Intuit leverages data to drive product innovation. If you're looking for a dynamic environment where you can have a meaningful impact, come join us at Intuit!