Data Sources Integration Jobs in Bengaluru
1333 Jobs Found
Analytics Engineer
Postman
Analytics Engineer Location: Bengaluru Work Type: Full-Time About Postman Postman is the world s leading API platform, used by over 40 million developers and 500,000 organizations, including 98% of the Fortune 500. Our mission is to build an API-first world, simplifying every step of the API lifecycle and enabling teams to create better APIs, faster. Founded in Bengaluru, Postman is headquartered in San Francisco, with offices in Boston, New York, and Bengaluru. We are privately held, backed by Battery Ventures, BOND, Coatue, CRV, Insight Partners, and Nexus Venture Partners. The Opportunity We are seeking an Analytics Engineer to join our Data Team and help strengthen the foundation of our modern data stack. In this role, you will own critical transformation pipelines, design scalable data models, and ensure that our analytics environment is performant, reliable, and future-ready. You will operate with a high degree of independence, driving projects from design through production, while implementing best practices in dbt, semantic layers, medallion architecture, and lakehouse paradigms. Key Responsibilities Take ownership of large portions of our dbt project (3k+ models), ensuring scalability, maintainability, and adherence to best practices. Design and implement robust data models, including dimensional modeling, incremental strategies, and Slowly Changing Dimensions (SCDs). Establish and enforce dbt test coverage, automated quality checks, and CI/CD pipeline standards using GitHub Actions. Profile and optimize SQL queries and warehouse performance for efficiency and cost reduction. Build and refine our semantic layer, ensuring consistent business logic across Looker, Redash, and downstream tools. Collaborate with analysts and business partners to define metrics and deliver self-serve data assets. Document models, lineage, and transformation logic to make data discoverable and usable across the company. Contribute to shaping team standards and playbooks, collaborating with analysts on modeling and transformation best practices. Stay ahead of modern data stack innovations, including dbt metrics layer, universal semantic layers, data contracts, and observability. Enabling Self-Serve Analytics & AI Build transformations that empower business stakeholders and analysts to explore data confidently. Ensure metric definitions are consistent, discoverable, and reusable across BI tools. Prepare clean, structured, and accessible datasets for AI-driven initiatives like conversational analytics and anomaly detection. Partner with Data Science & ML teams to provide reliable pipelines that accelerate experimentation and AI/ML deployment. About You 3 5 years of experience in analytics engineering roles. Advanced SQL skills (query optimization, performance tuning). Strong proficiency in dbt Core: models, macros, snapshots, sources, and custom materializations. Solid background in data modeling techniques (Kimball, SCD handling, incremental pipelines). Practical experience with semantic layers and BI integration (LookML, dbt metrics, or equivalent). Familiarity with Medallion architecture and modern lakehouse approaches. Hands-on experience with Redshift; exposure to Databricks is a plus. Proficiency with GitHub and CI/CD pipelines for analytics code. Strong fundamentals in data quality, governance, and lineage tracking. Flexible schedule with a hybrid work model. Full medical coverage, flexible PTO, wellness reimbursement, and monthly lunch stipend. Access to wellness programs, team-building events, and donation-matching initiatives. An inclusive, collaborative culture where everyone can thrive and grow. Our Values Curiosity: Explore and innovate fearlessly. Transparency: Communicate openly about successes and failures. Focus: Set clear goals aligned with a bold vision. Inclusion: Every voice matters. Excellence: Deliver the best products and experiences together.
Architect
Fampay
Architect Bengaluru | Engineering | Full-Time About Fam (formerly FamPay) Fam is India s first payments app designed for everyone aged 11 and above. With FamApp, users can make seamless online and offline payments via UPI and FamCard. Our mission is to empower over **250 million young Indians** to start their financial journey early with confidence and awareness. Founded in 2019 by IIT Roorkee alumni, Fam is backed by top-tier investors including Elevation Capital, Y-Combinator, Peak XV (Sequoia Capital India), Venture Highway, and angels such as Kunal Shah and Amrish Rao. About This Role We re seeking a **high-impact Architect** to join Fam s engineering leadership team. In this role, you will **own and evolve the backend architecture** powering our core product experiences. You ll collaborate closely with founders, product managers, and engineering leaders to build backend systems that enable rapid innovation while ensuring **scalability, reliability, and security**. This is more than just designing services you ll **shape how Fam builds products** by establishing frameworks, patterns, and architectural decisions that empower engineers to move fast without sacrificing robustness. If you have **10+ years of experience** building and scaling backend systems for fast-growing products, and the ability to be a force multiplier across multiple teams, we want to hear from you. What You ll Do Define and continuously evolve Fam s backend architecture, including APIs, services, data models, and integrations. Partner with Product and Engineering leads to translate business goals into scalable, reliable backend solutions. Lead architecture for critical product areas like payments, onboarding, user engagement, growth, and monetization. Create frameworks and reusable patterns that accelerate developer velocity, experimentation, and feature rollouts. Make informed trade-offs balancing speed, cost, security, and user experience in system design decisions. Mentor senior engineers and foster strong architectural thinking across teams. Collaborate with infrastructure, data, and security teams to ensure compliance, observability, and cost efficiency. Stay updated on emerging backend technologies, patterns, and best practices. Drive key architecture decisions on build vs. integrate, synchronous vs. asynchronous, schema vs. event-driven models. Must-Haves 10+ years engineering experience, with 3+ years in Staff/Principal Engineer or Architect roles. Proven track record designing and scaling backend systems for high-growth, user-facing products. Deep expertise in API design, distributed systems, and service-oriented architectures. Strong command of backend stacks (Node.js, Java, Go, Python), databases (PostgreSQL, Redis), and messaging/event systems. Experience leading large technical decisions across product teams. **Systems thinker** with a product-first mindset balancing speed, robustness, and user experience. Excellent collaboration and communication skills to align product and engineering stakeholders. Experience in fintech or regulated environments is a plus. Nice to Have Experience working in early-stage or hyper-growth product companies. Familiarity with experimentation frameworks, feature flagging, and rapid iteration at scale. Knowledge of domain-driven design (DDD), event-driven and asynchronous architectures. Experience with real-time systems, payments infrastructure, or growth-focused platforms. Contributions to open source, public talks, or thought leadership in architecture. Lead strategic backend architecture powering fintech innovation for 250M+ Gen Z users. Influence technical direction and engineering culture across the organization. Work with a modern stack on meaningful scale challenges with freedom to innovate. Join a mission-driven company shaping India s first payments product specifically for teens and young adults. Collaborate directly with founders and senior leadership, including Sambhav (Co-founder) and Chirag (Head of Engineering). Backed by world-class investors and surrounded by top-tier talent. Perks That Go Beyond the Paycheck Relocation assistance for a smooth transition. Free office meals (lunch & dinner). Generous leave policies (birthday, period, parental support, and more). Salary advances and loan support programs. Quarterly rewards, recognition, and referral incentives. Access to the latest gadgets and tools. Comprehensive health insurance including mental health support. Tax benefits with food coupons, phone allowances, and leasing options. Retirement benefits: PF contribution, leave encashment, and gratuity. About FamApp FamApp is revolutionizing payments and financial inclusion for the next generation, providing UPI and card payments for users 11 years and older. Our flagship FamX Spending Account integrates UPI and card payments seamlessly, enabling users to manage, save, and learn about money with ease. With over **10 million users**, FamApp is changing how young Indians transact no more carrying cash, plus fully customizable FamX cards with personalized doodles for added fun. Join Our Dynamic Team At Fam, we prioritize people with generous leave policies, flexible work schedules, comprehensive health benefits, and free mental health sessions. You ll work alongside some of the most passionate, talented, and fun professionals in the startup ecosystem.
Platform Engineer
Colortokens
Platform Engineer Location: Bengaluru, Karnataka, India Full-time partially remote About ColorTokens At ColorTokens, we empower businesses to stay operational and resilient in an increasingly complex cybersecurity landscape. Breaches happen but with our cutting-edge ColorTokens Xshield platform, companies can minimize the impact of breaches by preventing the lateral spread of ransomware and advanced malware. We enable organizations to continue operating while breaches are contained, ensuring critical assets remain protected. Our innovative platform provides unparalleled visibility into traffic patterns between workloads, OT/IoT/IoMT devices, and users, allowing businesses to enforce granular micro-perimeters, swiftly isolate key assets, and respond to breaches with agility. Recognized as a Leader in the Forrester Wave : Microsegmentation Solutions (Q3 2024), ColorTokens safeguards global enterprises and delivers significant savings by preventing costly disruptions. Our culture We foster an environment that values customer focus, innovation, collaboration, mutual respect, and informed decision-making. We believe in alignment and empowerment so you can own and drive initiatives autonomously. Self-starters and high-motivated individuals will enjoy the rewarding experience of solving complex challenges that protect some of world s impactful organizations be it a children s hospital, or a city, or the defense department of an entire country. Position Overview: Colortokens is looking for a Junior Platform Administrator to assist in managing, maintaining, and optimizing our NextGen Security Information and Event Management (SIEM) platform. The ideal candidate will support the day-to-day operations, help onboard customer log sources, troubleshoot integration issues, and provide technical assistance to the security operations team. This role is ideal for a motivated professional with 3+ years of experience in SIEM administration, security operations, or log management. Key Responsibilities: SIEM Platform Administration Assist in deploying, configuring, and maintaining the NextGen SIEM platform (e.g., Stellar Cyber, Splunk, Sentinel, QRadar, Chronicle, Exabeam). Perform basic updates and patches to ensure platform security and functionality. Monitor SIEM health, performance, and uptime under the guidance of senior administrators. Log Source Management Onboard new log sources and validate data ingestion. Help troubleshoot log ingestion, parsing, and formatting issues. Maintain log retention policies for compliance. Rule and Use Case Management Support the development and deployment of detection rules, correlation use cases, and alerts. Tune existing use cases to minimize false positives. Work closely with security analysts to refine alerting strategies. Integration and Automation Assist in integrating SIEM with other security tools (e.g., EDR, microsegmentation, vulnerability scanners). Work on basic automation tasks using scripting (Python, PowerShell) to enhance SIEM efficiency. Platform Security and Compliance Support role-based access control (RBAC) and platform security policies. Help ensure SIEM adheres to compliance standards like SOC2, ISO 27001. Participate in periodic security audits. Network Debugging & Troubleshooting Have a basic understanding of TCP/IP, networking concepts, and protocols. Assist in debugging network connectivity issues related to SIEM log ingestion. Use basic network troubleshooting tools. Collaboration and Support Work alongside SOC analysts, threat hunters, and security engineers. Provide basic technical support for SIEM users. Assist in training and documentation for security teams. Performance Monitoring and Optimization Monitor storage and indexing performance to ensure optimal operations. Report any performance issues to senior administrators. Contribute to platform health reports and alerting metrics. Incident Support Assist SOC teams in log analysis, incident response, and forensic investigations. Ensure log data is readily available for security incidents. Education and Certifications: Bachelor s degree in Computer Science, Information Security, or a related field. Certifications (Preferred but not mandatory): Splunk Certified User/Admin Microsoft Certified: Security Operations Analyst Associate QRadar Certification Any SIEM-related certification Experience: 3+ years of experience in SIEM administration, security operations, or log management. Hands-on experience with at least one SIEM platform (e.g., Stellar Cyber, Splunk, Sentinel, Chronicle, Exabeam). Basic knowledge of log ingestion, rule creation, and data parsing. Exposure to scripting (Python, PowerShell) for automation. Basic understanding of TCP/IP networking concepts and network debugging. Technical Skills: Understanding of log formats, Syslog, JSON, XML, and data pipelines. Basic knowledge of querying languages (KQL, SPL, AQL). Familiarity with SIEM integration with security tools like EDR, SOAR, NDR. Awareness of MITRE ATT&CK, NIST, or CIS security frameworks. Basic experience with network troubleshooting tools (ping, traceroute, netcat (nc)). Soft Skills: Strong problem-solving and troubleshooting abilities. Good verbal and written communication skills. Ability to work collaboratively in a security operations environment. Preferred Skills: Basic understanding of cloud-based security solutions (AWS, Azure, Google Cloud). Exposure to SOAR tools (e.g., Cortex XSOAR, Splunk Phantom). Interest in machine learning-based anomaly detection for SIEM. Key Metrics for Success: Successful onboarding of log sources. Improvement in log ingestion and parsing accuracy. Contribution to fine-tuning detection rules. Timely resolution of SIEM-related support requests. Ability to identify and troubleshoot basic network connectivity issues.
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Business Technology Data Engineer
Samsara Inc
Position: Business Technology Data Engineer Location: Bengaluru, India (Hybrid 3 days onsite) Company: Samsara Technologies India Pvt. Ltd. About Samsara Samsara (NYSE: IOT) is a leader in the Connected Operations Cloud, enabling businesses across industries like transportation, logistics, manufacturing, and field services to harness IoT data for safety, efficiency, and sustainability improvements. Samsara helps organizations digitize physical operations at scale, improving outcomes that impact global infrastructure. Role Overview Samsara is seeking a Business Technology Data Engineer to join its Data & Analytics team within the Business Technology division. In this role, you will design, build, and optimize end-to-end data pipelines and infrastructure for various business-critical systems across CRM, marketing, support, and product platforms. You'll collaborate with teams across the company to build reliable and scalable data solutions that power reporting, automation, and analytics. This hybrid role requires working 3 days per week from the Bengaluru office and 2 days remotely, with working hours aligned to India Standard Time (IST). Key Responsibilities Data Engineering & Platform Development Design and maintain ETL/ELT pipelines that integrate and transform data across business systems. Build scalable data infrastructure to support advanced analytics and real-time reporting needs. Write Python and SQL scripts for data ingestion, transformation, and validation. Data Integration & Enablement Work with diverse data sources: CRM, product telemetry, marketing automation, support ticketing, and order flow systems. Develop and support data lake and data warehouse solutions using Snowflake, Redshift, Databricks, or BigQuery. Ensure interoperability between applications and data layers. Performance & Quality Monitor and optimize pipeline performance, implement observability and alerting. Improve data quality, lineage, and governance across systems. Partner with internal stakeholders (e.g., Sales Ops, Marketing Ops, Analytics) to deliver reliable data products. Minimum Qualifications Bachelor s degree in Computer Science, Data Engineering, or related field. 5+ years of professional experience in data engineering. 3+ years experience building and maintaining end-to-end pipelines in a modern data stack. Strong in SQL and Python. Hands-on experience with: ETL tools: Fivetran, dbt Cloud: AWS (preferred), GCP, or Azure Databases: MySQL, PostgreSQL, Oracle, or similar Data Warehouses: Snowflake, Redshift, BigQuery, Databricks Preferred Qualifications Familiarity with API-based ingestion, serverless architecture (Lambda, API Gateway, SQS, etc.). Experience with monitoring tools (DataDog, CloudWatch, Splunk). Comfortable engaging stakeholders to translate business needs into data solutions. Proficiency in Docker, Kubernetes, or AWS Fargate is a plus. Qualification : Bachelors degree in Computer Science, Data Engineering, or related field
Software Design & Labview
Cynlr - Cybernetics H.i.v.e
Job Title: Software Design & LabVIEW Engineer Location: Bengaluru Overview: Join CynLr s Product Design and Algorithm Team as a Software Design & LabVIEW Engineer, where you will be instrumental in developing LabVIEW code for advanced algorithms and experiments, optimizing performance, and supporting the software development lifecycle with strong architectural discipline. You will also provide critical interface and support for hardware-in-the-loop validation and customer implementation. Key Responsibilities: LabVIEW Development & Experimentation Translate concepts and algorithms from Design and Algorithm teams into well-structured LabVIEW code and experiments. Optimize LabVIEW code for timing and memory performance. Build custom data visualizations and user-friendly UI elements to accelerate experimental workflows. Enhance Lab experiment applications for usability and efficiency. Code Refactoring & Architecture Understand and apply established LabVIEW design patterns and coding standards (including STQ). Refactor legacy spaghetti code to comply with architecture and design guidelines. Document and maintain code quality and design consistency. Software Development Lifecycle Integration Implement and maintain source and version control using GIT or equivalent tools. Integrate evolving C++ DLL libraries seamlessly into LabVIEW codebases without disruption. Verification & Validation (V&V) Develop test cases and execute validation tests for C++ and LabVIEW code. Perform hardware-in-the-loop testing to validate algorithm functionality and performance. Customer Interface & Support Assist in application implementation and provide technical support to customers. Serve as a LabVIEW knowledge resource for the Algorithm and Design engineers and onboard new team members. Job Requirements: Programming Fundamentals Strong understanding of Data Flow programming paradigm and parallel programming in LabVIEW. Experience with dynamic thread management and service spawning. Software Design & Development Proven involvement in the full software development lifecycle, including distributed development with source/version control (GIT). Expertise in State Machine architecture and familiarity with other design patterns applied in LabVIEW. UI/UX Skills Proficient in building custom controls, data visualizations, and UI elements (experience with XControls is a plus). Strong knowledge of subpanels, resolution reflow, and splitter management for UI design. LabVIEW IDE Expertise Deep knowledge of VI Server (methods and attributes) and VI scripting (preferred). Mastery of LabVIEW project and environment settings, including front panel customization, function palettes, debugging, VI properties, and productivity features. Connectivity & Hardware Interface Experience integrating .dll libraries and C++ header files into LabVIEW applications. Familiarity with registry coding is advantageous. Hands-on experience with communication protocols including Ethernet (UDP, TCP), RS232/485, and industrial protocols like Modbus, CAN, etc.
Data Engineer
Cognite
Data Engineer Location: Bengaluru Department: Global Strategic Services Data Engineering EMEA Type: Full-Time | Hybrid About Cognite Cognite is a global SaaS company at the forefront of industrial digital transformation. Our core platforms Cognite Data Fusion (CDF) and Cognite Atlas AI leverage AI and data to solve complex challenges across oil & gas, chemicals, pharma, manufacturing, and energy sectors. Recognized globally for innovation, Cognite helps businesses improve efficiency, reduce costs, and operate more sustainably. Our Values Impact: We focus on outcomes that truly make a difference. Ownership: We take responsibility and work inclusively to deliver success. Relentless: We are persistent problem-solvers who view challenges as growth opportunities. About the Team You ll join Cognite s Global Customer Success (GCS) organization spanning offices in Oslo, Austin, Houston, Tokyo, and now Bengaluru. The GCS team includes Project Managers, Data Engineers, Data Scientists, and Solution Architects, all working on high-impact industrial use cases across regions including MENA and SEA. About the Role As a Data Engineer, you'll play a key role in solving real-world industrial problems by designing, building, and optimizing scalable data architectures. You ll create robust pipelines to integrate and contextualize data using Cognite Data Fusion, working closely with cross-functional teams. This is also a growth role with the opportunity to step into a Tech Lead position. Key Responsibilities Design and implement scalable data solutions using Cognite Data Fusion. Integrate data sources using Cognite connectors, SQL, Python/Java, and REST APIs. Develop custom data models for cleansing, discovery, and mapping. Work with data scientists, architects, and PMs to deliver client outcomes. Conduct code reviews and apply best practices in maintainability and quality. Support customers and partners with data engineering tasks and challenges. Collaborate with Engineering and Product teams to influence product roadmap. What You ll Bring Bachelor's or Master s in Computer Science or related field. 3 5 years of experience in data-focused, customer-facing roles. Strong experience with Python, SQL, and REST APIs for production-grade pipelines. Familiarity with data from industrial domains like oil & gas or manufacturing is a plus. Experience with Kubernetes, Azure/GCP, and modern DevOps practices. Comfortable with Git, CI/CD, and cloud-native deployment workflows. A proactive, collaborative mindset with a passion for problem-solving and learning. Join a diverse global team with 70+ nationalities and a strong commitment to DEI. Work in a modern hybrid environment at our Bengaluru office (Rathi Legacy, Hoodi). Be part of a flat, transparent culture with direct access to leadership. Build cutting-edge solutions and influence how industries evolve digitally. Learn from top engineers and contribute to ambitious, high-impact projects. Enjoy a respectful, fun, and collaborative workplace where your voice matters. If you re excited to build data infrastructure that powers real change in heavy industries, Cognite offers you a platform to grow, lead, and innovate. We welcome candidates from all backgrounds and identities apply today and be part of something meaningful. Qualification : Bachelor's or Masters in Computer Science or related field.
Genai Engineer
Rubrik
GenAI Engineer Location: Bangalore, India About the Team Rubrik s IT team is at the forefront of AI-powered transformation, focused on building intelligent automation and scalable data solutions to support the company s mission. As part of the newly established IT AI team, you ll help develop AI agents and workflows to unlock the full potential of generative AI in data engineering. About the Role We re seeking a GenAI Engineer to join our Data Engineering team, specializing in the development and deployment of AI agents and workflows powered by large language models (LLMs). You ll be responsible for integrating data sources, developing MCP clients/servers, and collaborating with cross-functional teams to drive GenAI adoption across the organization. Key Responsibilities Design and implement data integrations using MCP protocols or traditional data extraction methods Build scalable data pipelines for GenAI model training and deployment using tools like Snowflake Cortex, Gemini Agentspace, and Databricks LLM (Mosaic AI, RAG, Model Serving) Ensure high standards of data quality, integrity, and scalability for both structured and unstructured AI workloads Collaborate with business, data engineering, and application development teams to create AI-enabled products Integrate pipelines into existing infrastructure for seamless data flow and analytics Support high-quality data products tailored for AI and machine learning workflows Required Experience 1+ years building AI Agents or working with platforms like Snowflake Cortex, Gemini Agentspace, or similar open-source frameworks 3+ years in data engineering with a focus on AI/ML workloads 5+ years in data analytics using Snowflake or Databricks Strong programming skills in Python, Java, or Scala Familiarity with data storage, APIs, and cloud configurations Experience with data governance and scalable system design Solid understanding of LLMs, transformers, and frameworks such as LangChain Strong analytical and problem-solving skills in a dynamic environment Preferred Qualifications Proven experience building AI Agents and agentic workflows Understanding of MCP and Agent2Agent protocols Knowledge of generative model architectures and applications in data engineering Familiarity with data security and governance best practices in GenAI Experience with Agile methodologies and tools such as Jira and GitHub Join Us in Securing the World s Data Rubrik (NYSE: RBRK) is committed to delivering Zero Trust Data Security. Our ML-powered platform protects data across enterprise, cloud, and SaaS applications, helping organizations stay resilient against cyberattacks and disruptions.
GenAI Engineer
Rubrik
GenAI Engineer Location: Bangalore, India Office About the Team Rubrik's IT team is driving AI-powered transformation to enable smarter automation and scalable data solutions that protect and empower the company's mission. As part of the newly formed IT AI team, you'll be instrumental in developing AI agents and workflows to unlock the potential of generative AI in data engineering. About the Role We are seeking an experienced GenAI Engineer to join our Data Engineering team, focusing on building and deploying AI agents and workflows powered by large language models (LLMs). You will integrate data sources and develop MCP clients/servers to support LLM-based bots, collaborating closely with data scientists, engineers, and business teams to enhance GenAI adoption and deliver advanced data solutions. Key Responsibilities Design and develop data integrations using MCP protocols or traditional extraction methods. Build scalable data pipelines for GenAI model training and deployment using tools like Snowflake Cortex, Gemini Agentspace, and Databricks LLM (Mosaic AI, RAG, Model Serving). Ensure data quality, integrity, and scalability for AI workloads involving both structured and unstructured data. Collaborate with business teams, data engineers, and application developers to create products that streamline processes and drive growth. Integrate data pipelines with existing infrastructure to enable seamless data flow and analytics. Support the data engineering team in producing high-quality data products for AI workloads. Experience You'll Need 1+ year of experience building AI agents or using Snowflake Cortex, Gemini Agentspace, or similar open-source tools. 3+ years of experience in data engineering focused on AI/ML workloads. 5+ years of experience in data analytics with Snowflake or Databricks platforms. Strong programming skills in Python, Java, or Scala. Familiarity with data storage solutions (Snowflake, Databricks) and APIs. Experience with cloud configuration and data governance. Knowledge of large language models (transformers) and frameworks like LangChain. Strong problem-solving skills and ability to thrive in a fast-paced environment. Preferred Qualifications Experience building AI agents and agentic workflows. Knowledge of MCP and Agent2Agent protocols. Understanding of generative models and their applications in data engineering. Familiarity with data governance and security best practices for GenAI workloads. Experience with Agile methodologies and collaboration tools like Jira and GitHub. Join Us in Securing the World's Data Rubrik (NYSE: RBRK) is dedicated to securing the world's data with Zero Trust Data Security.Our platform, powered by machine learning, protects data across enterprise, cloud, and SaaS applications, helping businesses stay resilient against cyberattacks and operational disruptions.
Private Markets Data Extraction, Aladdin Data, Director
Blackrock
Private Markets Data Extraction, Aladdin Data Director Location: Bengaluru, Karnataka Team: Data Science Company: BlackRock About the Role We are seeking a tech-savvy leader to head our Private Markets Data Extraction team within the Aladdin Data group. This role involves driving the strategic direction of data initiatives by leveraging cutting-edge technologies like Large Language Models, AI Orchestration Frameworks (e.g., LangChain), Spring, GIT/ADO, Solr, Cassandra, and more. You will work closely with Data, Product, and Technology teams to ensure our data products exceed client expectations in quality and scope, while gaining deep exposure to finance domains such as risk management, valuations, and operations. What You ll Do Develop strategies for automated extraction of data from semi-structured and unstructured sources (e.g., regulatory documents) to build scalable, reusable pipelines. Architect and build extensible data ingestion and extraction platforms accessible to internal teams and customers. Own technical architecture, design principles, and application governance. Manage diverse, global teams of engineers, data scientists, and other tech professionals. Collaborate with cross-office and international teams. Provide expert technical guidance on software design and implementation. Mentor and support career growth for junior team members. What You Need B.S. / M.S. in Computer Science, Engineering, or related field. 12+ years of professional experience with proven leadership. Strong ability to communicate technical strategies clearly. Hands-on experience with Java and Python, object-oriented programming. Experience designing/building APIs and microservices. Expertise with open-source technologies: Spring/SpringBoot, Apache Solr, Protocol Buffers, LangChain, Docker. Experience with relational and NoSQL databases (e.g., Apache Cassandra). Agile team experience with strong problem-solving and rapid learning capabilities. Excellent interpersonal, communication, and presentation skills. Experience mentoring junior engineers. Good to Have Cloud-native development experience (Kubernetes, Docker) and Microsoft Azure. Familiarity with Apache Kafka or other pub-sub frameworks. Experience with Large Language Models (OpenAI LLMs), AI app frameworks, vector databases, NLP. Finance and financial services domain expertise. Benefits & Work Model Comprehensive benefits including retirement plans, tuition reimbursement, healthcare, family support, and Flexible Time Off (FTO). Hybrid work: typically 4 days in-office, 1 day remote with some flexibility depending on business needs. Collaborative culture fostering learning and innovation. About BlackRock BlackRock s mission is to help more people experience financial well-being globally. We invest in our employees to create a welcoming, valued, and supportive environment that encourages growth and impact. Qualification : B.S. / M.S. in Computer Science, Engineering, or related field.
Data Engineer, Product Analytics
Meta Careers
Data Engineer, Product Analytics Location: Bangalore, India Full Time Company: Meta Meta is looking for an experienced Data Engineer to join our Product Analytics team. In this role, you will work on some of the most extensive data sets in the world, crafting experiences for billions of people and millions of businesses. Your technical expertise and analytical mindset will help shape data solutions across Meta to drive user experience optimization, growth, and strategy. You'll work alongside software engineers, data scientists, and product managers to tackle the most interesting data challenges at a scale few companies can match. Key Responsibilities: Conceptualize and own the data architecture for multiple large-scale projects, balancing design and operational cost-benefit tradeoffs. Design and contribute to frameworks that improve logging data efficacy, working with data infrastructure teams to resolve issues. Collaborate with engineers, product managers, and data scientists to understand data needs and represent insights meaningfully. Define and manage Service Level Agreements (SLAs) for all data sets in allocated areas of ownership. Implement and maintain security models based on privacy requirements and ensure safeguards are followed to ensure data quality. Design, build, and launch sophisticated data models and visualizations that support multiple use cases across various products. Address complex data integration challenges using optimal ETL patterns, frameworks, and techniques from structured and unstructured data sources. Optimize existing processes, pipelines, dashboards, and systems to enhance the development of data artifacts. Influence product and cross-functional teams to identify data opportunities that will drive impact. Mentor junior team members by providing constructive feedback and receiving feedback to grow as a team. Minimum Qualifications: Bachelor s degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience. 4+ years of experience in roles focused on data engineering, data analysis, or similar positions, working with SQL, ETL, data modeling, and programming languages (e.g., Python, C++, Scala). Experience with SQL, ETL processes, and data modeling, along with at least one programming language (e.g., Python, C++, C#, Scala). Preferred Qualifications: Master's or Ph.D. degree in a STEM field (Science, Technology, Engineering, Mathematics). About Meta: Meta builds technologies that help people connect, find communities, and grow businesses. Since launching Facebook in 2004, we have revolutionized how people connect. Our apps, including Messenger, Instagram, and WhatsApp, empower billions worldwide. Now, Meta is moving beyond 2D screens towards immersive experiences like augmented and virtual reality, building the next evolution in social technology. When you join Meta, you help shape the future of digital connection, taking us beyond screens, distance, and even the rules of physics. Equal Employment Opportunity: Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based on race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. Qualification : Bachelors degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience.
Data Engineer-dataiku/python
Infocepts
Data Engineer (Python/Dataiku/Spark/SAS DI) Location: Bangalore Type of Employment: Full-Time Experience Required: 3 to 5 years Job Overview: We are looking for a passionate Data Engineer with expertise in Python, Dataiku, Spark, or SAS DI to join our dynamic team. In this role, you will collaborate with clients to build data pipelines that support their Data and Analytics journey. As a member of our team, you will be responsible for driving data engineering initiatives, developing and implementing ETL solutions, and optimizing data workflows for efficiency and scalability. Key Responsibilities: Data Engineering Initiatives: Collaborate with clients to define and implement data engineering initiatives based on business needs. ETL Development: Design and develop data integration solutions using tools like Python, Dataiku, Spark, and SAS DI. Develop and maintain automated data pipelines for real-time and batch data ingestions. Performance Tuning: Conduct performance tuning and optimize queries and data models to enhance performance and scalability. Database Design: Design and implement database objects such as tables, views, schemas, and stored procedures. Ensure data quality and consistency across the data warehouse. Collaboration: Work closely with cross-functional teams to translate business requirements into technical solutions and communicate effectively with clients across multiple regions. Troubleshooting: Troubleshoot and resolve data-related issues while ensuring the quality and integrity of the data. Project & Technical Leadership: Act as the technical lead or single point of contact (SPOC) for the client and internal teams, ensuring smooth project delivery. Essential Skills: Data Engineering Tools: Experience with Python, Dataiku, Spark, and SAS DI. SQL Proficiency: Strong SQL experience for extracting data from various databases and performing data analysis. ETL Development: Expertise in designing and developing ETL processes to integrate data from diverse sources into a data mart layer. Data Modeling: Understanding of data modeling concepts, including relational and dimensional modeling. BI Knowledge: Basic understanding of Business Intelligence (BI) tools and analytics needs. Communication Skills: Excellent communication skills to understand business requirements and translate them into technical solutions. Desirable Skills: Data Analysis: Strong analytical skills to perform data analysis, especially for banking products data. BI Tools: Experience with MicroStrategy or Power BI for reporting and dashboarding. Qualifications: 3+ years of experience designing and developing scalable data integration solutions. Familiarity with data analytics and reporting needs. Technical certifications that align with your continuous learning aspirations. Qualities: Strong problem-solving skills with a systematic approach to resolving issues. Ability to influence and implement change confidently. Excellent team player who works effectively in cross-functional teams. Strong communication and presentation skills, capable of interacting with clients and presenting ideas persuasively. Fluent in English, both written and spoken, for effective communication. Opportunity to work with cutting-edge data engineering tools and technologies. Be a key player in building and optimizing data pipelines for clients data and analytics needs. Competitive salary, benefits, and a dynamic, innovative work culture.
Senior Ui/ux Engineer
Cloud Software Group
Job Title: Senior UI/UX Engineer Location: Bengaluru, Karnataka, India About Us: Cloud Software Group is one of the world's largest cloud solution providers, serving over 100 million users globally. We are at the forefront of cutting-edge technologies such as Secure Private Access and Zero Trust Network Access. At Cloud Software Group, we empower individuals, the original mobile device, to help shape and innovate the way work gets done from anywhere. Our team values passion for technology and courage to take risks. We are poised for significant growth, and now is the perfect time to bring your expertise to the cloud! About This Team: We are looking for a Senior Front End Engineer who will join a dynamic team of engineers dedicated to developing and maintaining high-performance web applications. The ideal candidate will be an experienced UI/UX Engineer with a deep passion for delivering seamless user experiences and is proficient in building applications using React and Angular frameworks. You'll be responsible for designing, implementing, and optimizing user interfaces, ensuring an excellent user experience, while embracing innovative technologies and development practices. Job Description/Responsibilities: Develop and Maintain Applications: Create cloud-based web applications using React and Angular frameworks, ensuring performance, scalability, and responsiveness. Collaborate with Teams: Work closely with cross-functional teams (including back-end engineers, product managers, and designers) to define, design, and implement new features. UI/UX Feasibility: Ensure the technical feasibility of UI/UX designs and optimize for maximum user experience. Code Quality: Write clean, maintainable, and efficient code, following industry standards and best practices. Code Reviews: Conduct code reviews to ensure code quality and provide constructive feedback to other team members. Troubleshoot & Debug: Investigate issues, debug problems, and implement improvements to enhance application performance and user experience. Stay Current with Trends: Stay up-to-date with the latest UI/UX trends, technologies, and tools. Design Collaboration: Contribute to design-first thinking, collaborating with designers to integrate different end-user personas into the design process. Agile Methodologies: Embrace Agile development methodologies (SCRUM, Kanban, etc.), ensuring fast and iterative development cycles. Required Experience/Skills: Proficient in React or Angular: At least 5 years of experience in front-end development with hands-on experience in React or Angular frameworks. Back-End Programming Knowledge: Familiarity with back-end programming languages such as GoLang, Java, or C# to work collaboratively with back-end teams. Testing & Automation: Experience with automated testing systems and libraries such as Jest, TestNG, or JUnit to ensure application reliability. Version Control: Good understanding of Git and CI/CD deployment pipelines for services running in Kubernetes environments. Cloud Environments: Experience working with cloud platforms such as AWS, Azure, or Google Cloud Platform. Integration Skills: Ability to integrate multiple data sources and databases into a unified system. Communication & Teamwork: Strong communication skills and the ability to collaborate effectively with cross-functional teams. Educational Background: Typically requires a University Degree (or equivalent experience) and a minimum of 5 years of relevant experience. Alternatively, a Master s degree with 3 years of relevant experience. Innovative and Dynamic Environment: Work with a forward-thinking team that thrives on innovation and cutting-edge technologies. Make an Impact: Your work will directly shape the design and delivery of products used by millions globally. Growth Opportunities: Leverage ample opportunities for professional growth and skill development in a rapidly evolving tech space. Cutting-Edge Tools: Work with the latest development tools and technologies to create top-tier, cloud-based products. Empowering Culture: Be part of a team where everyone is empowered to learn, dream, and build the future of work. Equal Opportunity Employer: Cloud Software Group is an Equal Employment Opportunity (EEO) employer and complies with all applicable federal, state, and local laws prohibiting employment discrimination. We encourage all qualified applicants to apply, irrespective of age, race, gender, sexual orientation, gender identity, ethnicity, or other protected characteristics.
Senior Sap Fico Consultant
Castaliaz Technologies Pvt. Ltd
Senior SAP FICO Consultant Job Description Castaliaz is looking for an experienced Senior SAP FICO (Finance and Controlling) Consultant to join our dynamic team. In this role, you will be responsible for implementing, configuring, and maintaining the SAP Financials and Controlling (FICO) modules, ensuring that they align with our clients' business needs. You will collaborate closely with clients to understand their requirements, offer expert guidance on SAP FICO best practices, and deliver high-quality solutions to optimize financial processes. Role and Responsibilities: Functional Expertise: Understand the functional requirements of accounting processes including General Ledger (GL), Accounts Receivable (AR), Accounts Payable (AP), banks, and fixed assets. Costing and Reporting: Knowledge of Product Costing and CO-PA (Profitability Analysis). Understand the basic CO reporting framework, cost allocation, and settlement cycles. SAP Process Flows: Deep understanding of the SAP process flow for FI, including master data setup and configuration. Cross-Module Integration: Proficient in various master data elements and configurations for FI, as well as cross-module integration with MM (Materials Management) and SD (Sales and Distribution). User Support: Address end-user issues related to day-to-day operations and provide effective solutions to ensure smooth operations. Business Blueprinting: Independently develop Business Blueprints for SAP FICO projects and user requirements, and conceptualize optimal solutions. Testing: Conduct unit testing and facilitate end-user testing to ensure all system configurations work as intended. Taxation Knowledge: Familiarity with India's taxation systems, including Excise, Service Tax, and TDS (Tax Deducted at Source). Revenue Recognition: Experience in handling revenue recognition processes. Special Tasks: Manage special tasks related to SAP FI and CO functionalities. SAP TRM: Exposure to SAP Treasury and Risk Management (TRM) is preferred. Education and Qualifications: Bachelor's Degree in Commerce or a related field. Preferred: MBA in Finance. Work Experience: 3+ years of relevant experience in SAP FICO implementations and support. Location: Bangalore (onsite) About Castaliaz: Castaliaz has been at the forefront of implementing SAP applications across SMEs and large enterprises for over a decade. We are recognized as one of the Top 10 SAP implementation partners in India. With expertise in a variety of SAP solutions, including SAP Cloud, Rise with SAP, S/4HANA, Fiori, Ariba, and Digital Compliance (GST, E-Invoicing, E-way Bill), we help businesses navigate the full lifecycle of SAP implementations and management. Our proven implementation approach has earned the trust and loyalty of our clients across India. Qualification : Bachelor's Degree in Commerce or a related field. Preferred: MBA in Finance.
Primary Market Research Senior Consultant
Iqvia
Job Description: Primary Market Research Senior Consultant Join a global organization with 82000+ employees around the world, as a Primary Market Research Senior Consultant based in Bangalore/ Gurugram/ Pune which helps life sciences companies to accelerate innovation to make greater impact on human health. Our transformative technologies harness intelligence, integrate industry-leading data and analytics. About the team The role is within the Research & Intelligence Team (R&I), whose aim is to deliver market research solutions, comprising mainly of PMR (Primary Market Research) along with inputs from SDR (Secondary Desk Research) to generate relevant insights for clients. Our team: Effectively combines different sources of data and using leading edge PMR techniques and capabilities to generate research, which is actionable, going beyond insight generation to show how to understand and influence prescriber and patient behavior. Role Summary Experience in market research: 7-10 years Manage multiple PMR projects under tight timelines interfacing with global clientele and prioritize requests based on the criticality and business need as agreed with the stakeholders. Responsibilities: Manage multiple PMR (qual and quant) projects under tight timelines interfacing with global clientele and prioritize requests based on the criticality and business need as agreed with the stakeholders. Write questionnaires and discussion guides for diverse stakeholders like physicians, patients, caregivers, payers etc. Create custom market research solutions for clients by thinking through their business issue, and adding the right context to the request (therapy area, methodology etc.). Deliver in depth, comprehensive, regular PMR reports and support ad hoc queries in the areas of indication-based pipeline landscapes, competitor company/ asset profile, competitor launch timelines and key event timelines, newsletters etc. Analyze secondary data sources and reports to provide information on overall market landscapes, market sizing and a range of ad hoc business questions. These analyses may include reporting of the competitive and scientific landscape both in terms of the current position and the predicted future state. Responsible for continuous process improvement in developing content for various PMR deliverables across indications/therapy areas. Demonstrate excellence as an individual contributor with minimal support from peers/team lead, together with the ability to mentor a team of analysts/ACs, driving high productivity/ efficiency, and creating appropriate performance reviews and capability development plan. Quality control and overview and to ensure deliverables are client ready. Project types: Market assessment and sizing, pipeline assessments, patient/consumer journey, brand tracking, go-to-market strategy. What we re looking for: Relevant experience of 7-10 years with master s degree (M.Pharm/MSc in Pharmacy, Biotechnology, life sciences). Exceptional communication skills both at the written and oral level. Excellent knowledge of English and of the main Microsoft Office tools (Word, Excel, PowerPoint). High skills of interpretation and analysis (quantitative, qualitative and integration of different sources of data assets) - This would include thinking through the client business issue, adding the right context to the request (therapy area, business issue etc.) and developing a tailored, innovative solution to address the clients business objectives. The preferred candidate will be creative, client/objective focused, open minded, autonomous and at the same time have great team spirit. Should be aware of free to use online resources like WHO, USFDA, CDC, CMS, PubMed, UNSD, Eurostats, NORD, FDA warning letters, etc.
Junior Data Scientist
Louis Dreyfus Company
Data Scientist - Global Sugar and Ethanol Production Company Description: Louis Dreyfus Company is a leading merchant and processor of agricultural goods, active across the entire value chain from farm to fork. We operate a broad range of business lines, leveraging our global reach and extensive asset network to serve customers and consumers worldwide. As a matrix organization spanning six geographical regions and ten platforms, we are present in over 100 countries and employ approximately 18,000 people globally. Job Description: We are seeking an experienced Data Scientist to join our team, focusing on managing and analyzing global Sugar and Ethanol production data. This role involves integrating large datasets, applying statistical estimation methods, and developing interactive dashboards to support data-driven decision-making. You will work closely with cross-functional teams to generate insights that enhance business strategies and identify risks in production trends. Main Responsibilities: Manage and estimate global Sugar and Ethanol production and associated risks. Integrate large datasets from various sources and perform feature engineering to improve data quality and usability. Apply statistical methods and estimation techniques to analyze production trends and assess risks. Develop and maintain interactive dashboards to visualize key metrics and insights. Present findings and recommendations to stakeholders through detailed reports and presentations. Collaborate with cross-functional teams to ensure data-driven decision-making across the organization. Experience: Minimum of 3 years of experience in data science, preferably within the commodities sector. Advanced proficiency in Python programming, with expertise in libraries such as Pandas, NumPy, and Scikit-learn. Strong understanding of data integration and feature engineering techniques. Experience in statistical analysis and modeling. Proficiency in data visualization tools such as Dash. Excellent communication and presentation skills. Ability to work independently and as part of a team. Qualifications: Master s degree in economics, applied statistics, or a related field. A Ph.D. is a plus. Fluency in English, both oral and written. Experience working in a commodities-related field is preferred. Qualification : Masters degree in economics, applied statistics, or a related field. A Ph.D. is a plus.
Senior Analyst - Fusion Hcm Technical Consultant
Oracle
Job Title: Customer Success Services - Oracle SaaS/HCM/Cloud Analyst - Lead Career Level: IC3 Position Overview: As a member of Oracle s Support organization, you will be responsible for providing post-sales support and solutions to Oracle customers. Your focus will be on resolving complex, non-technical customer inquiries, as well as providing technical troubleshooting for Oracle's Electronic Support Services. Acting as a primary point of contact for customers, you will manage customer relationships and offer assistance to internal Oracle teams regarding customer situations and escalated issues. Key Responsibilities: Customer Support: Act as the primary contact for Oracle customers, assisting them with complex technical and functional queries related to Oracle Fusion HCM products, including Core HR, Absence, Benefits, Extracts, HDL Loader, Workflow, BI Publisher, and Oracle Integration Cloud. Incident Management: Track, diagnose, replicate, and resolve critical and complex cases, ensuring total resolution of service incidents. Customer Success: Advise customers on the complex use of Oracle products, providing tailored solutions and resolving critical issues. Situation Management: Take ownership of highly sensitive and critical customer issues, working directly with customers and consulting with management to drive resolution. Knowledge Sharing: Share your knowledge with teammates by delivering formal training sessions, creating and reviewing Knowledge Articles, and mentoring others to promote technical and professional development. Collaboration: Work closely with internal teams to address escalated customer issues and contribute to improving internal processes and solutions. Qualifications: Must-Have Skills: 6-10 years of experience in the implementation, support, or upgrade of Oracle SaaS HCM products, with at least one implementation experience in Core HR, Absence, Benefits, Extracts, HDL Loader, Workflow, BI Publisher, and Oracle Integration Cloud. Hands-on configuration experience with at least three or more tools: HCM Extracts HCM Data Loader (HDL) Payroll Batch Loader (PBL) Workflow BI Publisher Fast Formula Personalization PL/SQL Strong knowledge of Fusion Cloud architecture, setup manager, and activities. Experience with FBDI and OTBI report development. Knowledge of integrating external data sources into Oracle Fusion Applications. Familiarity with localizations and security setup is a plus. Nice-to-Have Skills: Experience with Oracle Core HR, Absence, Benefits, and Payroll in Release 12.1.3.x / 12.2.x. Experience working in L1/L2/L3 support environments. Ability to analyze and decipher software logs and trace files to troubleshoot issues. Hands-on experience with XML, Java, J2EE, Oracle ADF, SOA, and Web Services. Strong functional/product expertise, with the ability to relate Oracle s functionality to business processes. Additional Skills: Effective analytical and organizational skills. Strong verbal and written communication skills in English; multilingual skills are a plus. A proactive learning orientation, staying up-to-date with emerging business models, processes, and Oracle product solutions. Experience in Managed Services, including client relationship management, offshore delivery management, project/program management, and successful delivery of KPIs. Ability to work in rotational shifts, manage a large team, and ensure SLAs are met for both EBS and Cloud/SaaS customers. Education & Experience: B.S. (Computer Science), BE, or equivalent preferred. Other qualifications with adequate experience may also be considered. Qualification : B.S. (Computer Science), BE, or equivalent preferred.
Staff Data Engineer
Intuit
Intuit is a global leader in financial technology, dedicated to helping individuals and businesses thrive. Our suite of products, including TurboTax, Credit Karma, QuickBooks, and Mailchimp, serves approximately 100 million customers worldwide. At Intuit, we believe in providing everyone with the tools and resources they need to achieve financial success. We are constantly innovating to make financial empowerment a reality for all. Job Overview Join the Intuit Data Platform (IDP) team as a Staff Engineer and help us transform the way we handle big data! The IDP team is responsible for the Intuit Analytics Platform, which powers real-time data ingestion, cataloging, analytics, and machine learning across the entire organization. As Intuit s customer base grows, so does the volume of data we process. Our engineering excellence ensures that we can scale and leverage this data to drive machine learning and product innovations. We re in the process of building the next-generation real-time and batch ingestion engine, capable of indexing, cataloging, and organizing data and metadata. We are passionate about using open-source technologies to solve challenges and contributing back to the community. If you're excited about building a platform that will directly impact data scientists and analysts and have a desire to shape the future of data at Intuit, then come join us! Key Responsibilities Architect & Design: Build fault-tolerant and scalable big-data platforms using open-source technologies to handle massive datasets. Data Solutions: Create architecture solutions that address complex use cases like data normalization, lineage, governance, ontology, and discoverability. Cross-Team Collaboration: Work with analysts and data scientists to understand data requirements for building operational propensity models and gaining deep customer insights. Hands-On Coding: Lead development efforts within the Hadoop ecosystem using technologies such as Java MapReduce, Spark, Scala, HBase, and Hive to build and optimize data pipelines for both real-time and batch applications. Database Management: Work with NoSQL, SQL, and in-memory databases to design high-performance data systems. Code Reviews: Ensure code quality, consistency, and adherence to best practices through regular code reviews. Architectural Alignment: Ensure alignment between enterprise architecture and business requirements. Prove Feasibility: Conduct proof-of-concept (POC) experiments for new technologies or approaches and drive them to production. Collaboration with Data Cataloging Team: Work closely with data catalog teams and architects to index and catalog all data sources at Intuit. Agile Leadership: Lead fast-paced development teams using agile methodologies and promote best practices in software development, testing, and incident response. Design & Model: Build dimension models suited for customer business use cases and ensure seamless integration of business and technical requirements. Qualifications Experience: 12+ years of relevant experience, with at least 5+ years specializing in the big data domain. Big Data Architecture: Proven experience in architecting end-to-end ecosystems for big data and analytics platforms. Expert Knowledge: Deep expertise in building fault-tolerant, scalable big data solutions, especially using the Hadoop ecosystem (Hive, HBase, Spark, Kafka, MapReduce, etc.). Programming Expertise: Mastery of Java and Scala, with a focus on building high-throughput data services. Machine Learning: Knowledge of machine learning principles and AI applications in big data. Big-Data Technologies: Familiarity with tools such as HDFS, Storm, Zookeeper, Cassandra, Redshift, GraphDB, and others. Understanding both real-time and batch processing in the Hadoop ecosystem. Communication: Strong communication skills, with an ability to explain complex technical topics to both technical and non-technical audiences. Programming Skills: Intermediate experience in Python or R for data processing. Education: BE/BTech/MS in Computer Science or a related field (or equivalent experience). Collaboration: Demonstrated ability to work cross-functionally and lead change through influence and example. At Intuit, you ll be part of a talented, passionate team working on innovative solutions that shape the future of data analytics and machine learning. As a Staff Engineer, you ll have the chance to work with cutting-edge technologies, build scalable systems, and help revolutionize how Intuit leverages data to drive product innovation. If you're looking for a dynamic environment where you can have a meaningful impact, come join us at Intuit! Qualification : BE/BTech/MS in Computer Science (or equivalent)
Sr. Engineering Manager
Ness Digital Engineering
Job Title: Sr. Engineering Manager - Data Engineering Level: L5 Experience: 13-16 years Overview We are seeking an experienced Engineering Manager with a strong background in Data Engineering, including ETL/ELT processes and cloud-based data platforms such as Snowflake. The ideal candidate will lead and mentor a team of data engineers, drive data architecture initiatives, and work closely with cross-functional stakeholders to ensure our data infrastructure supports evolving business needs. Key Responsibilities Team Leadership: Lead, mentor, and develop a high-performing data engineering team, fostering a culture of collaboration, innovation, and continuous learning. Data Pipeline Development: Oversee the design, development, and maintenance of robust ETL/ELT pipelines to ingest, transform, and process data at scale. Cloud Data Infrastructure: Drive the architecture and implementation of cloud-based data solutions, especially leveraging Snowflake, ensuring scalability, security, and reliability. Cross-Functional Collaboration: Partner with product managers, analysts, data scientists, and other business stakeholders to gather requirements and prioritize engineering efforts that deliver the most impact. Architecture and Design: Develop and enforce data architecture standards for high-performance data warehousing, ensuring seamless data integration across diverse sources. Performance Optimization: Identify and resolve performance bottlenecks, focusing on query optimization, cost management, and resource efficiency. Data Quality & Governance: Define and implement data quality frameworks and governance practices, ensuring data consistency and reliability across all pipelines. Innovation & Strategy: Stay informed on emerging data technologies and industry best practices, continuously improving processes and aligning solutions with long-term data strategies. Required Skills 8+ years of hands-on experience in data engineering, including 5+ years in a leadership role. Strong expertise in ETL/ELT processes and hands-on experience with tools like Talend, Informatica, or similar platforms. Deep proficiency in Snowflake or comparable cloud data platforms such as Redshift or BigQuery. Advanced SQL skills, including query optimization, performance tuning, data modeling, and schema design. Hands-on experience with Python or Java for data processing and automation. Knowledge of data governance, compliance standards, and data security best practices. Excellent communication and project management skills, with the ability to prioritize and manage multiple projects in parallel. Preferred Skills Exposure to Big Data technologies such as Spark, Hadoop, Databricks, Synapse, etc. Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions. Familiarity with CI/CD pipelines and DevOps practices within data engineering. Experience working with BI tools like Tableau or Power BI, and reporting integrations.
Data Engineer
Indium Software
Data Engineer Role Overview We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs. This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows. Key Responsibilities Data Pipeline Development & Optimization Design and build scalable ETL/ELT processes for structured and unstructured data. Develop and maintain data ingestion frameworks to handle large datasets efficiently. Ensure data integrity, consistency, and security across multiple sources. Database & Data Warehouse Management Develop, optimize, and maintain relational and NoSQL databases. Implement data modeling best practices for performance and scalability. Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery). Big Data & Cloud Technologies Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing. Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions. Develop real-time and batch processing workflows. Collaboration & Documentation Work closely with data scientists, engineers, and business teams to understand data requirements. Document data pipelines, architecture, and workflows for scalability and maintenance. Required Qualifications & Skills Technical Expertise: Strong experience with SQL and Python for data processing. Proficiency in ETL/ELT frameworks and data integration techniques. Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka). Cloud & Database Management: Expertise in cloud data platforms (Azure, AWS, GCP). Experience with data warehousing solutions (Snowflake, Redshift, BigQuery). Understanding of data governance, security, and compliance. Performance Optimization & Troubleshooting: Ability to optimize SQL queries and improve data processing efficiency. Experience troubleshooting complex data pipeline issues. Apply Now & Be Part of an Innovative Data Team!
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted