Cloud Data Warehouse Jobs in Bengaluru
804 Jobs Found
Data Engineering Lead
Fampay
Data Engineering Lead Bengaluru | Engineering | Full-Time About Fam (formerly FamPay) Fam is India s first payments app designed for everyone aged 11 and above. FamApp enables seamless online and offline payments through UPI and FamCard. Our mission is to empower over **250 million young Indians** to start their financial journey early, becoming financially aware and confident. Founded in 2019 by IIT Roorkee alumni, Fam is backed by top-tier investors including Elevation Capital, Y-Combinator, Peak XV (Sequoia Capital India), Venture Highway, and angels like Kunal Shah and Amrish Rao. About the Role We re looking for a visionary **Data Engineering Lead** to take **end-to-end ownership** of Fam s data ecosystem from data ingestion and storage to processing and delivering actionable insights. You ll **define the data strategy and architecture** that supports both batch and **real-time** use cases, ensuring scalability, reliability, and governance across the organization. You will be instrumental in enabling accurate, complete, and trusted data flow that powers business intelligence, analytics, and product decision-making. This role involves **leadership, strategic thinking**, and hands-on problem solving. What You ll Do Own the full data lifecycle: ingestion, organization, storage, processing, and presentation. Define and execute **data architecture and strategy** aligned with operational and analytical goals. Build **scalable, reliable, and observable data systems** supporting batch and near real-time processing. Ensure **data quality, governance, and compliance**, proactively resolving discrepancies. Collaborate with product, engineering, and business teams to define, track, and optimize key metrics. Anticipate data-related challenges and implement preventive solutions. Lead, mentor, and grow the data engineering team, fostering innovation and accountability. Must-Haves 10+ years experience in data engineering, including proven leadership of teams or projects. Expertise designing, building, and scaling end-to-end data pipelines and systems. Deep understanding of the data lifecycle, from ingestion through business reporting. Strong communication skills and ability to collaborate across technical and business teams. Solid knowledge of **data governance, quality assurance, and compliance standards**. Experience with observability and proactive monitoring for data systems. Proficiency in Python and SQL; familiarity with Scala or Java. Hands-on experience with streaming and batch data frameworks. Experience designing large-scale data lakes and warehouses with best practices for schema evolution and partitioning. Strong background with **cloud platforms (AWS, GCP, or Azure)**. Fintech or regulated industry experience is a plus. Good to Have Fintech-specific data experience, including regulatory compliance and reporting. Deployment experience with **real-time analytics** and event-driven architectures. Familiarity with containerization and infrastructure tools like Docker, Kubernetes, Terraform. Knowledge of data observability tools (Monte Carlo, Databand, etc.). Exposure to **ML pipelines** and model deployment. Solve challenging problems at the intersection of big data, real-time processing, and fintech. Lead impactful data initiatives at a rapidly growing startup. Collaborate with a world-class team of engineers, data scientists, and product leaders. Competitive compensation, equity, and benefits. Clear career growth opportunities in leadership and innovation. Perks That Go Beyond the Paycheck Relocation assistance for a smooth move. Free office meals (lunch & dinner). Generous leave policies (birthday, period, parental support, and more). Salary advances and loan policies for financial support. Quarterly rewards, recognition, and referral incentives. Access to the latest gadgets and tools. Comprehensive health insurance with mental health support. Tax benefits like food coupons, phone allowances, and leasing options. Retirement benefits including PF contribution, leave encashment, and gratuity. About FamApp FamApp focuses on financial inclusion for the next generation by offering UPI and card payments to users aged 11+. Our flagship product, FamX, integrates UPI and card payments seamlessly, helping users manage, save, and learn about their finances effortlessly. With over **10 million users**, FamApp is revolutionizing how young Indians transact eliminating the need to carry cash and offering customizable FamX cards with personal doodles for a fun, unique payment experience. Join Our Dynamic Team At Fam, we foster a people-first culture with flexible work schedules, generous leave, comprehensive health benefits, and mental health support. You ll be part of a passionate, talented, and fun team shaping the future of fintech for India s youth.
Senior Data Engineer
Okta
Senior Data Engineer Enterprise Data Platform Location: Bengaluru Department: Business Technology Data Engineering Experience: 5+ Years Employment Type: Full-Time About Okta Okta is The World s Identity Company. We empower people to securely use any technology, anywhere, on any device. Through our Okta and Auth0 platforms, we provide secure access, authentication, and automation placing identity at the center of security and growth for thousands of organizations. We value diverse perspectives and lifelong learners. We re not looking for someone who checks every box we re looking for someone who will make us better with their unique experiences. Team: Business Technology Data Engineering The Data Engineering team at Okta supports cross-functional partners by building scalable, secure, and high-performing platforms. These platforms power decision-making and business processes across sales, marketing, engineering, finance, product, and operations. As part of this team, you ll contribute to data solutions that fuel Okta s hyper-growth. You will have the opportunity to work with cutting-edge technologies in cloud infrastructure, data lakes, automation, and CI/CD pipelines. The Role: Senior Data Engineer As a Senior Data Engineer, you will design, build, and manage modern data pipelines, infrastructure, and automation frameworks. You ll help scale our enterprise data platform using tools such as Snowflake, dbt, Airflow, Databricks, and AWS, while ensuring security, observability, and performance. You ll also contribute to CI/CD pipelines, infrastructure as code (IaC), and secure development lifecycle practices, enabling consistent, efficient, and secure delivery of data solutions. Key Responsibilities Platform Development & Infrastructure Design and maintain scalable data pipelines and platforms using Snowflake, AWS, Databricks, dbt, and Airflow. Manage infrastructure with Terraform, enabling repeatable and consistent deployments. Develop and maintain robust CI/CD pipelines using GitHub Actions, GitLab, or Jenkins. Containerize data services using Docker for better scalability and portability. Security & Compliance Implement and enforce secure development lifecycle practices, integrating tools like DAST, SAST, SCA, and Secret Scanning into pipelines. Conduct vulnerability scanning and apply patches to ensure system integrity. Ensure data security and compliance with industry standards and regulations. Collaboration & Innovation Collaborate with data engineers, data scientists, and analysts across business units to ensure data availability and integrity. Identify opportunities for automation and optimization within the data platform. Stay updated on emerging technologies and drive adoption of best practices. Must-Have Skills Bachelor s degree in Computer Science, Engineering, or a related technical field. 5+ years of experience in data engineering, including: Advanced SQL and ETL development with Airflow and dbt. Experience with data warehouses such as Snowflake, Redshift, or BigQuery. Strong hands-on experience with AWS (S3, Lambda, EC2, EMR, EKS). 2+ years of experience managing CI/CD pipelines using tools like GitHub Actions, GitLab, Jenkins, or ArgoCD. Experience with Terraform and Docker. Proficiency in backend languages such as Python, Java, or Go. Preferred Skills Experience with lakehouse architectures like Databricks, including knowledge of Delta Lake and Apache Iceberg. Background in infrastructure security, vulnerability management, and observability tooling. High Impact: Help build and scale the data platform that powers Okta s global business. Cutting-Edge Stack: Work with best-in-class technologies like AWS, Snowflake, dbt, Terraform, and Databricks. Collaborative Culture: Join a diverse, inclusive, and globally distributed team that values knowledge sharing and continuous learning. Career Growth: Shape the future of Okta s data engineering practice while expanding your technical and leadership skills. Bring your passion for data, cloud, and automation and let s shape the future of secure, scalable enterprise data platforms together. Qualification : Bachelors degree in Computer Science, Engineering, or a related technical field
Data Engineer
Capital One
Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field
Manager - Data Analytics, Credit Card Portfolios
Zeta
Job Title: Manager - Data Analytics, Credit Card Portfolios Location: Bangalore Employment Type: Full-time About Zeta: Zeta is a next-gen banking technology company empowering banks and fintechs to build the future of financial products. Founded in 2015 by Bhavin Turakhia and Ramki Gaddipati, Zeta s flagship platform Zeta Tachyon is a cloud-native, fully API-enabled banking stack powering issuance, processing, lending, core banking, fraud & risk, and more. Over 20 million cards have been issued globally through our platform. With 1,700+ employees across the US, EMEA, and Asia and 70%+ in R&D, Zeta is backed by SoftBank, Mastercard, and others, having raised $330M at a $2B valuation in 2025. We work with leading banks and fintechs worldwide to transform multi-million card portfolios. Role Overview: We are looking for a strategic and experienced Manager - Data Analytics to lead business intelligence and enterprise reporting for global fintech portfolios including Credit Cards, Deposits, and other financial products. This role involves managing a team of analysts, leveraging multiple data lakes and warehouses, and building a scalable, comprehensive reporting framework for diverse markets including the US, UK, and India. Key Responsibilities: Enterprise Reporting & Data Architecture: Design and maintain end-to-end reporting across the customer lifecycle: acquisition, activation, usage, delinquency, collections, retention, operations, and support. Deliver accurate analysis of key financial KPIs: revenue, profitability, credit risk, defaults, acquisition cost. Build dashboards, self-service BI tools, and automated pipelines using Apache Superset, Metabase, Tableau. Optimize data storage and reporting for scalability and cost-efficiency. Data Integration & Analytics Execution: Collaborate with vendors and internal engineering to integrate data from credit bureaus, open banking, core banking, card and payment processors, loan origination, CCaaS, and aggregators into a centralized Data Lake. Business Intelligence & Growth: Lead analytics projects to uncover user behavior, optimize acquisition channels, underwriting, and portfolio performance via segmentation, cohort, and funnel analyses. Partner with Product and Marketing teams to evaluate experiments (A/B testing) and guide roadmap decisions. Leadership: Build, mentor, and lead a high-performing team of BI analysts and data visualization experts. Data Governance: Establish and enforce data governance best practices, ensuring compliance and data security. Skills & Experience: Expert in BI tools such as Apache Superset, Metabase, Tableau; strong SQL skills. Familiarity with cloud data platforms like Snowflake, Redshift, BigQuery. Deep knowledge of credit and fintech KPIs: acquisition, credit decisioning, delinquency, repayment, charge-offs, profitability, RoA, CLTV, etc. Proven leadership experience managing analytics teams and scaling reporting infrastructures. Excellent communication skills with the ability to translate complex data into business strategies. Knowledge of data governance, privacy, and security in financial services. Qualifications: 10+ years in Business Intelligence/Analytics with 3+ years in the credit card industry. 3+ years managing teams of analysts or data professionals. Bachelor s degree in Computer Science, Engineering, Statistics, or a related field. Equal Opportunity: Zeta celebrates diversity and is an equal opportunity employer. We are committed to fostering an inclusive environment and encourage candidates from all backgrounds to apply. Qualification : Bachelors degree in Computer Science, Engineering, Statistics, or a related field
Data Architect
Acqueon
Position Title: Data Architect Department: R&D Engineering Location: Bangalore Experience: 15+ Years Industry: SaaS / Conversational Engagement / Customer Experience Technology About Acqueon: Acqueon is a leading provider of conversational engagement software that enables customer-centric enterprises to proactively engage with their customers across voice, messaging, and email channels. By leveraging a powerful data platform, predictive models, and intelligent workflows, we help brands enhance customer experience, improve collections, and drive revenue growth. With over 200 global clients, Acqueon is at the forefront of AI-powered customer engagement. Role Overview: We are seeking a visionary and technically hands-on Data Architect to lead the development of enterprise-scale data platforms and engineering solutions. You will work closely with Product Owners, Engineering Leadership, and cross-functional teams to define and execute a strategic technology roadmap aligned with Acqueon s business goals. As a key member of our R&D team, you ll lead the design and development of highly scalable, low-latency, fault-tolerant data systems, while mentoring top-tier engineering talent and driving high-impact product features. Key Responsibilities: Architect & Lead: Design and lead development of scalable data architectures and solutions supporting real-time and batch processing, analytics, and enterprise applications. Strategic Ownership: Define and implement the data strategy, technology roadmap, and long-term architecture vision for Acqueon s platforms. Leadership: Manage and mentor a team of senior developers and engineers, fostering innovation, ownership, and delivery excellence. Cross-functional Collaboration: Work with Product, Sales, Engineering, and Customer teams to align on feature development and delivery strategy. Project Management: Oversee the end-to-end delivery of complex features, ensuring adherence to timelines, scalability, and quality standards. System Design: Review architecture and design for robustness, performance, and fault tolerance, including multi-region, high-availability setups. R&D Enablement: Collaborate with international R&D teams and align development efforts across global product initiatives. Innovation & Optimization: Drive architectural decisions, recommend performance improvements, and ensure best practices for enterprise-scale data solutions. Required Skills & Experience: Education: Bachelor s or Master s in Computer Science, IT, or related field. Experience: 15+ years in software development and data architecture, with leadership experience in managing engineering teams. Architecture Expertise: Proven experience in designing scalable, concurrent, distributed, and highly available data systems. Database Proficiency: Strong in SQL/NoSQL databases Experience with MS SQL, Aerospike, DynamoDB, Snowflake In-depth knowledge of micro-partitions, cluster keys, warehouse cloning, time travel in Snowflake Strong in writing and tuning complex stored procedures ETL & Pipelines: Experience in building ETL pipelines and integrating data from S3, Kinesis Streams, APIs Cloud & DevOps: Strong understanding of Docker, AWS, and cloud-native deployment architectures Setting up multi-region resilience, disaster recovery strategies Technologies: Elasticsearch, AWS data services, container orchestration Big Data & Analytics: Exposure to analytical processing and statistical modeling is a plus Leadership: Strong project management skills, stakeholder engagement, and team mentoring experience Preferred Qualifications: Background in customer engagement, VDI, Cybersecurity, or Secure Access technologies Previous experience working with distributed R&D and product teams Knowledge of Acqueon, Citrix, VMware, Omnissa platforms is a plus Certifications in AWS, Snowflake, or similar technologies are an advantage Soft Skills & Behavioral Traits: Strong verbal and written communication skills Strategic thinking with hands-on execution ability High accountability and ownership mindset Ability to work in a fast-paced, dynamic, startup-like environment Comfortable with ambiguity and context-switching Team player with the ability to lead by influence and collaboration Be a part of a fast-growing, AI-driven SaaS company disrupting the customer engagement space Work on cutting-edge technologies with global product teams Ownership of end-to-end solutions and ability to shape the data platform of the future A culture that promotes innovation, agility, and career growth
Product Manager Data Warehouse & Business Intelligence
Mahindra First Choice
Product Manager Data Warehouse & Business Intelligence Location: Bangalore Company: Mahindra First Choice About Mahindra First Choice Mahindra First Choice is a pioneer in India s multi-brand used car segment. With a strong focus on innovation, data-driven decision-making, and cutting-edge technology, we are transforming the automotive ecosystem and delivering seamless customer experiences. Our commitment to excellence fuels our drive to create scalable, impactful solutions across the value chain. Role Overview We are looking for a strategic and technically strong Product Manager to lead our Data Warehouse and Business Intelligence (BI) initiatives. Based in Bangalore, this role will own the vision, development, and optimization of enterprise-wide data products. You will play a critical role in enabling data-led decisions, working closely with engineering, analytics, and business teams to drive measurable outcomes. Key Responsibilities 1. Product Strategy & Roadmap Define the vision, strategy, and long-term roadmap for Data Warehouse and BI products. Align product goals with overall business strategy through collaboration with senior leadership. Stay abreast of emerging technologies and industry trends to drive innovation in data architecture and analytics. 2. Development & Execution Partner with engineering, data science, and analytics teams to build scalable, high-performance data platforms. Prioritize product features and enhancements based on impact, feasibility, and business value. Lead cross-functional teams to ensure timely and efficient delivery of data solutions. 3. Business Intelligence & Analytics Oversee the development of interactive BI dashboards, reports, and self-service tools to empower business users. Collaborate with business stakeholders to identify critical metrics and create meaningful data visualizations. Champion data quality, consistency, governance, and accessibility across all platforms. 4. Stakeholder Management Serve as the single point of contact for data needs across Sales, Marketing, Operations, Finance, and other departments. Communicate roadmaps, progress updates, and outcomes clearly and effectively to stakeholders at all levels. Gather continuous feedback to refine products and enhance user experience. 5. Performance Monitoring & Optimization Define and track KPIs to assess product adoption, usage, and business impact. Analyze system performance and user engagement to identify areas for improvement. Drive initiatives to increase data platform efficiency and reliability. Qualifications & Skills Required Bachelor s degree in Computer Science, Engineering, Business, or a related field (Master s preferred). 7+ years of experience in product management, specifically in data warehousing, business intelligence, or analytics. Deep understanding of data architecture, ETL processes, and data modeling. Hands-on experience with BI tools like Tableau, Power BI, or Looker. Strong SQL skills and familiarity with cloud platforms (AWS, Azure, GCP). Proven track record of managing complex, cross-functional data projects in fast-paced environments. Ability to translate business needs into scalable, data-driven solutions. Preferred Experience in automotive, mobility, or e-commerce domains. Familiarity with machine learning concepts and advanced analytics techniques. Soft Skills Strong communication, presentation, and stakeholder engagement skills. Analytical mindset with a focus on delivering business value through data. Effective leadership and cross-functional collaboration. High attention to detail and ability to manage multiple priorities. At Mahindra First Choice, you ll join a fast-growing, innovation-led organization at the forefront of transforming the used car market in India. This is a unique opportunity to shape our data landscape and make a real impact on business outcomes. If you're passionate about unlocking the power of data, we d love to meet you. Qualification : Bachelors degree in Computer Science, Engineering, Business, or a related field (Masters preferred)
Snowflake Data Engineer
Growtharc Technologies
Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.
Data Architect
Growtharc Technologies
Position: Data Architect Location: Remote/Hybrid | Bengaluru, IND We're searching for a highly skilled and experienced Data Architect to join our team. If you have a deep understanding of big data technologies and extensive experience with Hadoop, Python, Snowflake, and Databricks, you're the ideal candidate. You'll be responsible for designing, implementing, and managing complex data architectures that support our critical business needs and objectives. What You'll Do: Design & Architecture Leadership: Design scalable and efficient data architecture solutions that meet current and future business data needs. Lead the development of data models, schemas, and databases, ensuring alignment with business requirements. Architect and implement robust data solutions on leading cloud platforms (AWS, Azure, or GCP). Data Management & Governance: Develop and maintain robust data pipelines and ETL processes using Hadoop, Databricks, and other essential tools. Oversee data integration and quality efforts to ensure consistency and reliability across the organization. Implement data governance best practices, focusing on data security, privacy, and compliance. Collaboration & Mentorship: Work closely with data engineers, data scientists, and business stakeholders to translate data requirements into effective technical solutions. Provide technical leadership and mentorship to junior data engineers and architects. Collaborate with cross-functional teams to ensure data solutions align perfectly with overall business goals. Optimization & Innovation: Optimize existing data architectures for peak performance, scalability, and cost-efficiency. Monitor and troubleshoot data systems to ensure high availability and reliability. Continuously evaluate and recommend new tools and technologies to improve our data architecture. What You'll Bring: Experience: 10+ years in data architecture, data engineering, or a related field. Big Data Expertise: Proven experience with Hadoop ecosystems (HDFS, MapReduce, Hive, HBase). Programming Prowess: Strong programming skills in Python for data processing and automation. Data Platform Mastery: Hands-on experience with Snowflake for data warehousing and Databricks for analytics. Cloud Fluency: Extensive experience with cloud platforms (AWS, Azure, GCP) and their data services. Data Modeling: Familiarity with data modeling tools and methodologies. Core Skills: Deep understanding of big data technologies and distributed computing. Strong problem-solving skills to design solutions for complex data challenges. Excellent communication skills, able to explain complex technical concepts clearly to diverse audiences. Proficient in SQL and database performance tuning. Experience with CI/CD pipelines and automation in data environments. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Advanced Degree: A Master's degree in a related field. Cloud Certifications: Certifications like AWS Certified Data Analytics, Google Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate. Additional Languages: Experience with other programming languages like Java or Scala. Machine Learning Integration: Knowledge of machine learning frameworks and their integration with data pipelines.
Business Technology Data Engineer
Samsara Inc
Position: Business Technology Data Engineer Location: Bengaluru, India (Hybrid 3 days onsite) Company: Samsara Technologies India Pvt. Ltd. About Samsara Samsara (NYSE: IOT) is a leader in the Connected Operations Cloud, enabling businesses across industries like transportation, logistics, manufacturing, and field services to harness IoT data for safety, efficiency, and sustainability improvements. Samsara helps organizations digitize physical operations at scale, improving outcomes that impact global infrastructure. Role Overview Samsara is seeking a Business Technology Data Engineer to join its Data & Analytics team within the Business Technology division. In this role, you will design, build, and optimize end-to-end data pipelines and infrastructure for various business-critical systems across CRM, marketing, support, and product platforms. You'll collaborate with teams across the company to build reliable and scalable data solutions that power reporting, automation, and analytics. This hybrid role requires working 3 days per week from the Bengaluru office and 2 days remotely, with working hours aligned to India Standard Time (IST). Key Responsibilities Data Engineering & Platform Development Design and maintain ETL/ELT pipelines that integrate and transform data across business systems. Build scalable data infrastructure to support advanced analytics and real-time reporting needs. Write Python and SQL scripts for data ingestion, transformation, and validation. Data Integration & Enablement Work with diverse data sources: CRM, product telemetry, marketing automation, support ticketing, and order flow systems. Develop and support data lake and data warehouse solutions using Snowflake, Redshift, Databricks, or BigQuery. Ensure interoperability between applications and data layers. Performance & Quality Monitor and optimize pipeline performance, implement observability and alerting. Improve data quality, lineage, and governance across systems. Partner with internal stakeholders (e.g., Sales Ops, Marketing Ops, Analytics) to deliver reliable data products. Minimum Qualifications Bachelor s degree in Computer Science, Data Engineering, or related field. 5+ years of professional experience in data engineering. 3+ years experience building and maintaining end-to-end pipelines in a modern data stack. Strong in SQL and Python. Hands-on experience with: ETL tools: Fivetran, dbt Cloud: AWS (preferred), GCP, or Azure Databases: MySQL, PostgreSQL, Oracle, or similar Data Warehouses: Snowflake, Redshift, BigQuery, Databricks Preferred Qualifications Familiarity with API-based ingestion, serverless architecture (Lambda, API Gateway, SQS, etc.). Experience with monitoring tools (DataDog, CloudWatch, Splunk). Comfortable engaging stakeholders to translate business needs into data solutions. Proficiency in Docker, Kubernetes, or AWS Fargate is a plus. Qualification : Bachelors degree in Computer Science, Data Engineering, or related field
Product Manager
Themathcompany
Job Title: Product Manager Location: Bengaluru, Karnataka, India Department: Product Engineering Experience: 5 8 years About TheMathCompany TheMathCompany (MathCo ) is a global Enterprise AI and analytics firm trusted by Fortune 500 and Global 2000 companies to deliver impactful, data-driven decision-making. We create custom-built AI solutions through a powerful blend of human expertise and our proprietary platform, NucliOS. At MathCo, we empower our people known as Mathemagicians to innovate, take ownership, and drive transformation at scale. About the Role As a Product Manager at MathCo, you will be at the helm of a high-impact portfolio of custom-built, self-service products designed for some of the world s leading enterprises. These products span domains like performance monitoring, analytics enablement, and digital transformation some already delivering 3x 5x ROI within their first year. You'll lead cross-functional teams of engineers, data scientists, designers, and business analysts through the full product lifecycle from 0-to-1 ideation to production rollout. This is a rare opportunity to build highly customized solutions while contributing to the development of our proprietary platform that powers all of MathCo s AI-driven products. If you're someone who thrives at the intersection of business strategy and technology and has a knack for building solutions from the ground up this role is for you. Key Responsibilities Product Development & Lifecycle Ownership Drive the end-to-end product lifecycle from ideation to launch. Lead the development of self-service applications tailored to client needs, ensuring innovation, scalability, and usability. Collaborate closely with engineering, data science, design, and DevOps teams to deliver robust features and solutions. Stakeholder & Project Management Own client relationships and manage stakeholder expectations with clarity and accountability. Define and prioritize product roadmaps, sprint backlogs, and feature releases using Agile methodologies and tools like JIRA. Drive conversations with Fortune 500 clients to align business goals with product strategies. Research & UX Conduct market and user research to validate features and prioritize user-centric design. Partner with design teams to develop high-impact UI/UX prototypes that elevate the product experience. Technical Oversight Guide custom product development, including architecture, design, and deployment on cloud platforms like AWS, Azure, or GCP. Oversee data pipelines, warehousing, and transformation strategies for data-driven applications. Lead discussions on DevOps strategies and CI/CD best practices. Work with QA to ensure quality, testing, and production readiness of the product. Must-Have Skills & Experience 5 8 years of experience building and managing digital products. Proven ability to own the P&L and ROI of tech products, preferably in the enterprise or B2B domain. Hands-on familiarity with: Frontend technologies: HTML, CSS, React (or similar) Backend technologies: Python, REST APIs Cloud services: AWS / Azure / GCP Strong understanding of Agile development methodologies, project tracking (e.g., JIRA), and DevOps processes. Excellent problem-solving and cross-functional leadership skills. Clear and persuasive communication, with the ability to align technical and non-technical teams. Be part of a fast-scaling tech organization working on cutting-edge enterprise AI solutions. Shape the next generation of AI-enabled products with end-to-end ownership and autonomy. Collaborate with a diverse team of innovators, each empowered to leave a mark. Enjoy a culture that s flat, inclusive, and focused on learning and impact. Excited to build transformational products from scratch? Let s talk. Apply now to be a part of MathCo s product innovation journey.
Senior Developer SQL & Snowflake
Thoughtfocus
Job Title: Senior Developer SQL & Snowflake Location: Bangalore, India Experience: 7+ Years (Minimum 3+ years in Snowflake) Employment Type: Full-Time Job Overview: We are seeking a highly skilled Senior Snowflake Developer to join a global financial services project for a client operating in public/private loans, CLOs, and long/short credit. The ideal candidate will bring expertise in Snowflake, SQL, Coalesce, and Fivetran, with a strong background in data integration and cloud-based data warehousing. You will be instrumental in driving forward key data initiatives and delivering innovative, scalable data solutions in a fast-paced, agile environment. Key Responsibilities: Design, develop, and optimize Snowflake objects including databases, schemas, tables, views, and stored procedures. Build and maintain Snowflake data pipelines utilizing tools like SnowSQL, SnowPipe, Streams, and Tasks. Implement data loading strategies using COPY, PUT, GET, LIST, and REMOVE commands for batch and bulk data movement. Ensure seamless migration and integration of data from Azure Cloud to Snowflake with high attention to performance and data integrity. Define and manage Snowflake roles, custom role hierarchies, masking policies, and network policies for enhanced security and governance. Use Coalesce and Fivetran for designing and managing ETL/ELT workflows that extract and transform data from MS SQL Server. Write complex T-SQL queries, stored procedures, triggers, and functions for data transformation and reporting. Collaborate closely with cross-functional teams to understand requirements and translate them into technical solutions. Participate in Agile sprints, offering technical guidance, solution design, and timely issue resolution. Required Skills & Qualifications: 8+ years of total IT experience with at least 3+ years of Snowflake development experience. In-depth understanding of Snowflake architecture, utilities, and performance optimization techniques. Strong expertise in MS SQL Server with proficiency in writing advanced T-SQL scripts. Hands-on experience with ETL tools like Coalesce and Fivetran. Proficiency in Azure Data Integration strategies and tools. Excellent problem-solving and communication skills. Experience working in an Agile development environment. Preferred Skills: Prior exposure or high-level understanding of hedge funds, private equity, or private debt domains. Familiarity with data governance and compliance requirements in financial institutions. What s on Offer: Competitive and above-market salary. Hybrid work model with flexibility. Opportunity to work on cutting-edge technology in global financial markets. Collaborative, innovation-driven team culture. Education: Bachelor s degree in Computer Science, Information Technology, Finance, Economics, or a related discipline.
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Data Architect
Camsdata Technologies India Pvt. Ltd.
Data Architect Bangalore, India Location: Bangalore (Bengaluru) Experience: 10 to 15 Years Industry: IT & Data Systems Job Summary: We are seeking an experienced Data Architect with a strong background in designing and implementing enterprise-scale data solutions. The ideal candidate will have expertise in building data lakes, warehouses, and pipelines, with deep knowledge of cloud platforms, data management, and industry best practices. Key Responsibilities: Design, develop, and maintain complex data architectures including data lakes, data warehouses, data marts, and efficient schema design Build and optimize scalable data pipelines for extraction, transformation, and loading (ETL/ELT) processes Apply Agile methodologies in project delivery and collaborate within cross-functional teams Perform data profiling, cleansing, conversion, and ensure high-quality data management for both structured and unstructured data Implement CI/CD and Infrastructure as Code (IaC) practices using tools like GitHub, Jenkins, CloudFormation, and Azure Resource Manager Manage database systems and tools such as PostgreSQL, Oracle, Snowflake, Teradata, MongoDB, Hadoop, and others Utilize data modeling tools like Erwin, Power Designer, and Toad for effective data architecture design Leverage cloud platforms including AWS and Microsoft Azure, with hands-on experience in services like AWS Glue, DMS, Lambda, Azure Data Factory, Synapse, and Data Lake Storage Work with programming and scripting languages including SQL, PL/SQL, Python, Spark, YAML, and JSON Use containerization and automation tools such as Docker, Ansible, and NodeJS for efficient deployment Ensure compliance with cybersecurity principles and frameworks such as NIST Lead data governance initiatives and enforce best practices in data quality and security Preferred Qualifications: ITIL certification and experience with Agile methodology Knowledge of code review and version control best practices, especially in GitHub Familiarity with data science tools and AI/ML frameworks like R, Keras, or TensorFlow Experience with natural language processing (NLP) and machine learning concepts Background in regulated industries, with pharma manufacturing experience highly preferred Exposure to multi-site, global IT projects and manufacturing operations Lead innovative data architecture projects within a dynamic and fast-paced environment Work with cutting-edge cloud technologies and big data ecosystems Collaborate with global teams on impactful enterprise solutions Access to professional growth opportunities in data governance, AI, and cloud technologies
Senior Analyst - Data Engineering
Latentview Analytics
Role: Senior Analyst Data Engineering Location: Bengaluru, Karnataka, India Experience: 3 6 Years Employment Type: Permanent, Full-Time About the Role We are looking for a results-driven Senior Data Engineer to join our high-performing data team in Bengaluru. The ideal candidate will have 3 6 years of experience in data engineering, AI/ML implementation, and working with large-scale databases like Snowflake and Teradata. If you're passionate about driving data-powered insights, building scalable solutions, and applying advanced machine learning and AI techniques, we want to hear from you. Key Responsibilities Design, develop, and implement machine learning models to solve complex business challenges. Apply AI techniques, including generative AI, NLP, and computer vision, to improve analytics capabilities. Use Tableau, Power BI, and other tools to develop insightful, interactive data dashboards. Manage and optimize large datasets using platforms like Snowflake, Teradata, and SQL/NoSQL databases. Collaborate with business and technical teams to translate requirements into robust data engineering solutions. Guide junior data professionals and foster a culture of learning and innovation. Communicate analytical findings clearly to non-technical stakeholders. Stay current with the latest in data science, machine learning, cloud platforms, and big data technologies. Key Skills & Technologies Machine Learning & AI Techniques: Supervised & unsupervised learning, deep learning, neural networks Reinforcement learning, decision trees, random forests, clustering NLP, computer vision, GANs, transfer learning Data Visualization Tools: Tableau, Power BI, Matplotlib, Seaborn, Plotly Programming Languages & Libraries: Python (essential), R, SQL TensorFlow, PyTorch, scikit-learn, pandas, NumPy, Keras, SciPy Databases & Data Management: Snowflake, Teradata, SQL/NoSQL, ETL, data lakes, data warehousing Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP) Big Data Technologies: Apache Spark, Hadoop
Director / Sr Manager - Platforms
Eightfold
Job Title: Director / Sr Manager - Platforms Location: Bangalore, Karnataka, India Job Type: Full-Time (Hybrid Work Model) Experience Level: 10+ Years About Eightfold.ai: At Eightfold.ai, we are revolutionizing how organizations manage talent by leveraging the power of artificial intelligence. Our cutting-edge AI platform is transforming the way businesses hire, develop, and retain talent. By utilizing AI to understand individual skills and potential, we re solving the fundamental problem of matching people with the right opportunities. We are looking for a visionary engineering leader to drive the growth of our Core Infrastructure Team in India, shaping the foundation of our AI platform. About the Core Infrastructure Team: The Core Infrastructure Team at Eightfold is the backbone of the organization, responsible for the architecture, maintenance, and enhancement of critical infrastructure elements that support our entire technology stack. Our team builds and maintains systems for Search, Databases, Machine Learning Infrastructure, Data Warehouses, Developer Platforms, and Application Infrastructure. We ensure the scalability, security, and reliability of these services, which underpin every product that we offer to our users and customers. What You ll Own & Drive: As the Director / Sr Manager - Platforms, you will lead the technical direction for Eightfold's infrastructure, security, and analytics platforms, ensuring they meet the needs of our growing enterprise-scale business. Vision & Roadmap: Lead the strategy, roadmap, and execution of the Infrastructure, Security, and Analytics platforms. Team Building: Hire, mentor, and lead a high-performing engineering team, fostering a culture of innovation, excellence, and autonomy. Cross-Functional Collaboration: Partner with Product, Data, and DevOps teams to build secure, scalable systems that support business growth. Infrastructure Scaling: Ensure reliability, availability, and performance across both cloud (AWS, GCP) and on-prem environments. Security Leadership: Define and enforce security protocols, including threat modeling, vulnerability management, and compliance frameworks (SOC2, ISO27001, etc.). Operational Excellence: Champion modern engineering practices, including CI/CD, observability, and cost optimization. Analytics Platform Development: Lead the creation and scaling of an end-to-end Analytics Product stack including data warehouse, query engine, and dashboards. Ownership & Impact: Take ownership of the full product/technology lifecycle from vision, architecture, and deployment, ensuring long-term impact and success. What You Bring: Required Skills & Experience: 10+ Years of Engineering Experience: Significant experience in engineering with at least 3+ years in a leadership role leading teams at scale. Expertise in Cloud Infrastructure: Deep expertise in cloud-native infrastructure (AWS, GCP, etc.) and DevSecOps principles. Proven Success in Platform Scaling: A track record of building and scaling secure, reliable platforms at an enterprise level. Security Expertise: Leadership in security initiatives, including threat modeling, vulnerability management, and compliance. Excellent Communication: Strong communication skills, with the ability to influence and collaborate across engineering and business teams. Bonus Experience: Exposure to scaling analytics stacks (Snowflake, dbt, Airflow, Looker, etc.) is a plus. Leadership & Culture Building: Demonstrated success in building high-caliber teams and cultivating a thriving engineering culture. Impactful Leadership: Take on a high-leverage leadership role that shapes the foundation of Eightfold's AI platform and directly impacts the company s growth and success. Innovative Environment: Work with cutting-edge technologies and collaborate with brilliant minds to solve complex engineering challenges. Career Growth: As a leader at Eightfold, you will have the autonomy to drive strategic initiatives while building and scaling high-performing teams. Hybrid Work Model: Enjoy a flexible hybrid work model with the ability to work remotely while maintaining a strong in-office presence for team collaboration starting February 1, 2024. Comprehensive Benefits: Competitive salary, comprehensive family medical coverage, and eligibility for equity awards and discretionary bonuses or commissions. How to Apply: If you're a visionary engineering leader with a passion for building scalable, secure platforms and leading high-performing teams, we want to hear from you. Join Eightfold.ai and help us redefine how companies build, hire, and retain their workforce using AI-powered talent intelligence. Equal Opportunity Employer: Eightfold.ai is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, or disability.
Ai Platform Architect
Adobe
AI Platform Architect Location: Bangalore, Karnataka, India Employment Type: Full-Time About Adobe Adobe is changing the world through digital experiences. Whether you're an emerging artist or a global brand, our tools empower creativity and innovation across every screen. From powerful imaging and video solutions to immersive web and app design, Adobe s mission is to help people and businesses deliver exceptional digital experiences. We are committed to creating an inclusive workplace where everyone is respected and given equal opportunity. Innovation can come from anywhere and the next big idea could be yours. Job Description We are looking for a visionary AI Platform Architect with deep expertise in building and scaling cloud-native, AI-powered platforms. The ideal candidate will have experience deploying large-scale, customer-facing AI solutions and a deep understanding of modern cloud architecture, data systems, MLOps, and LLMOps. Responsibilities Design and develop scalable AI/ML platforms and pipelines across AWS, Azure, and GCP. Architect end-to-end LLM pipelines including model training, fine-tuning, serving, inference APIs, and monitoring. Lead cross-functional teams in delivering AI solutions from experimentation to production. Implement MLOps and LLMOps best practices using tools like MLFlow, SageMaker, Langchain, and LangGraph. Design GPU-optimized architectures for training and inference of LLMs using DeepSpeed, vLLM, and other modern frameworks. Support infrastructure automation and container orchestration with Kubernetes, Docker, and CI/CD pipelines. Collaborate with internal stakeholders and clients to understand requirements, evangelize platform solutions, and ensure successful delivery. Key Skills and Expertise Cloud and DevOps: Expertise in AWS, Azure, GCP especially VPC design, cloud databases, and serverless architecture. Certified in AWS Professional Solution Architect, AWS ML Specialty, or Azure Solutions Architect Expert (preferred). Proficient with Kubernetes, Docker, FluentD, Kibana, Grafana, Prometheus. Data and Streaming: Experience with OLTP/OLAP databases and cloud-native data warehouses like BigQuery, Aurora, Spanner. Hands-on with Kafka, Apache Flink, Spark, Airflow, Databricks, Apache Iceberg, Presto. AI/ML & LLM Expertise: In-depth understanding of LLMs (GPT, Gemini, Claude, Mixtral, Llama, Hugging Face OSS models). LLMOps frameworks: Langchain, Langgraph, Langflow, Flowise, LLamaIndex. ML lifecycle tools: MLFlow, SageMaker, Vertex AI, Azure AI, AWS Bedrock. Proven experience in model optimization, fine-tuning, and high-throughput inference systems. Programming Languages: Proficient in Python, SQL, and JavaScript. Preferred Qualifications 10+ years in cloud and AI/ML platform architecture roles. Experience delivering AI solutions for enterprise-scale clients. Hands-on experience with GPU architecture and parallel/distributed training. Strong communication skills with ability to influence technical and business stakeholders. Work on cutting-edge AI technologies and shape future product experiences used by millions. Collaborate with world-class engineers and scientists in a diverse, inclusive culture. Be part of a company that values creativity, innovation, and employee well-being. Adobe is proud to be an Equal Opportunity Employer. We welcome and encourage candidates from all backgrounds to apply.
Cloud Data Engineer - AWS Big Data
Infocepts
Position: Cloud Data Engineer AWS Big Data Location: Bangalore, India Employment Type: Full-time Experience Required: 5 to 8 years Purpose of the Position: Join the Infocepts Cloud Data Architect Team as a Cloud Data Engineer and help design and implement cutting-edge big data solutions on AWS. You will leverage your expertise in EMR, Athena, PySpark, S3, AWS Lambda, and SQL to develop robust and scalable data platforms. Key Responsibilities: Technology Assessment and Design: Assess existing technology landscape and data integration frameworks. Design complex Big Data use cases using AWS services under guidance of the Architect. Support architectural decision-making by evaluating trade-offs in cost, performance, and durability. Recommend optimizations to existing data infrastructure. Documentation and Stakeholder Communication: Create project documentation adhering to quality and delivery standards. Collaborate closely with Architects and Project Managers for scoping, estimation, and planning. Present design decisions to technical and business stakeholders clearly. Conduct PoCs and design review sessions. Process Improvement and Automation: Identify and suggest opportunities for automation and process enhancements. Mentor junior engineers and support technical problem solving. Training and Knowledge Sharing: Prepare and deliver internal training on AWS and Big Data topics. Lead client knowledge sharing sessions and contribute to case studies. Essential Skills: In-depth experience with AWS services: S3, EC2, EMR, Athena, Glue, Lambda Familiarity with MPP databases like Redshift, Snowflake, or SingleStore Proficiency in Apache Spark and Databricks Strong programming skills in Python Experience building data pipelines using AWS and Databricks Knowledge of Big Data file formats such as Delta Lake Advanced SQL skills for large-scale data manipulation Hands-on experience with Apache Airflow or similar orchestration tools Strong understanding of ETL workflows and data warehousing concepts Desirable Skills: Cloud databases: AWS Aurora, Snowflake Experience with Hadoop and Hive AWS Certifications (Associate or Professional level) are a plus Qualifications: Bachelor s degree in Computer Science, Engineering, or related field (Master s preferred) Overall 5+ years of IT experience with at least 3 years in AWS Big Data projects Ongoing learning and technical certifications are strongly encouraged Key Qualities: Strong problem-solving and analytical thinking Self-driven with a passion for emerging data technologies Excellent communication and client presentation skills Ability to work in cross-functional, agile teams Apply now to be part of a high-impact data transformation team working on large-scale cloud data projects! Qualification : Bachelors degree in Computer Science, Engineering, or related field (Masters preferred)
Data Engineer - Snowflake And Dbt
Infocepts
Position: Data Integration Developer (Snowflake & DBT) Location: Bangalore Employment Type: Full-time Experience Required: 5 to 7 years Purpose of the Position: This role seeks candidates who are passionate about data and motivated to address the organization's analytics challenges. As a Data Integration Developer (Snowflake & DBT), you will play a crucial role in assisting our clients with their data and analytics journey. Your responsibilities will include building robust data pipelines, enhancing data consistency, and developing the necessary infrastructure to support analytics platforms. Key Responsibilities: Technical Expertise: Develop and optimize ETL processes using Snowflake capabilities. Build and maintain advanced data models and ETL processes using DBT (Data Build Tool). Ensure efficient data transformation and integration within the data warehouse. Collaboration: Work closely with data analysts, engineers, and stakeholders to understand business requirements and translate them into technical solutions. Facilitate effective communication and collaboration across teams. Quality Assurance: Implement and oversee data quality checks and testing procedures. Ensure data accuracy, consistency, and compliance with governance policies. Documentation and Reporting: Create and maintain comprehensive documentation for ETL processes and project workflows. Provide regular updates and reports on project progress and performance metrics. Compliance and Security: Ensure all data engineering activities comply with data governance and security policies. Implement measures to protect data integrity and confidentiality. Essential Skills: Proficient in SQL: Skilled in writing efficient queries on large datasets, including CTE and database table design. Snowflake Expertise: Experience with Snowflake or other database technologies, including SQL tuning. ETL Development: Skilled in developing and optimizing ETL processes using Snowflake and other tools. DBT Experience: Familiar with DBT Core/DBT Cloud and fundamental data modeling concepts (3NF, Star, Snowflake). Data Analysis and Profiling: Experienced in data analysis and profiling tasks. Qualifications: Overall Work Experience: More than 5 years of experience, with at least 2-3 years of experience in Snowflake and DBT. Education: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus). Key Qualities: Decision Making: Ability to influence and implement change with confidence and sound decisions. Problem-Solving: Tackles problems head-on with a logical, systematic, and practical approach; follows up with developers. Communication: Ability to consult, write, and present persuasively. Team Collaboration: Works effectively in self-organized, cross-functional teams. Apply now and become an integral part of our innovative team working on cutting-edge data integration solutions! Qualification : Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus).
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Data Engineer: Data Warehouse
International Business Machines Corporation
Job Title: Application Developer - ETL and Data Management Introduction: In this role, you ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we provide deep technical and industry expertise to a wide range of public and private sector clients globally. Our delivery centers leverage locally-based skills to help clients drive innovation and the adoption of new technologies. A career in IBM Consulting is built on long-term relationships and close collaboration with clients across the world. You will work with leaders across industries to improve the hybrid cloud and AI journeys for some of the most innovative and valuable companies worldwide. Your ability to make a meaningful impact for clients is enabled by our strategic partner ecosystem and robust technology platforms, including Software and Red Hat. Curiosity and a constant quest for knowledge are key to success in IBM Consulting. In your role, you ll be encouraged to challenge the norm, explore new ideas, and come up with creative solutions that result in groundbreaking impact for a wide network of clients. Our culture is built on evolution and empathy, focusing on long-term career growth and development in an environment that values your unique skills and experience. Your Role and Responsibilities: ETL Workflow Development: Develop and implement ETL workflows by creating ETL jobs, and data models in datamarts using technologies such as Snowflake, DBT, Unix, and SQL. Batch Processing Redesign: Redesign Control M Batch processing for ETL job builds to run efficiently in a production environment. System Evaluation and Improvement: Study the existing system to evaluate its effectiveness and design new systems to improve workflow efficiency. Business Program Analysis & Support: Perform requirements identification, business program analysis, testing, and system enhancements while providing production support. Agile Environment: Work effectively in an Agile environment and gain familiarity with tools such as JIRA and SharePoint. Client Interaction: Good written and verbal communication skills are essential as you will interact directly with client counterparts to understand requirements and provide solutions. Required Technical and Professional Expertise: Experience: A minimum of 3 years of experience in developing ETL applications, implementing workflows, and creating data models using Snowflake, DBT, Unix, and SQL technologies. Agile Environment: Strong understanding of working in an Agile environment and proficiency in tools like JIRA and SharePoint. Problem-Solving Skills: Ability to manage change and proven time management skills. Strong interpersonal skills to contribute effectively to team efforts. Continuous Learning: Stay up-to-date with technical knowledge by attending educational workshops and reviewing relevant publications. Preferred Technical and Professional Expertise: ETL Development: Experience in developing triggers, functions, and stored procedures to support ETL workflows. Impact Analysis: Assist with impact analysis of changing upstream processes on the Data Warehouse and reporting systems. ETL & Reporting Support: Participate in the design, testing, support, and debugging of new and existing ETL and reporting processes. Data Profiling & Troubleshooting: Perform data profiling and analysis using a variety of tools, troubleshoot and support production processes, and maintain documentation. Innovation: Be part of a team that drives global change and leverages cutting-edge technologies to solve complex problems. Growth: Gain access to continuous learning and career development opportunities to further your expertise in data management and cloud technologies. Collaboration: Work with a diverse team in a collaborative environment that values new ideas and creative solutions. Global Impact: Your work will contribute to improving business operations and technological advancements for clients around the world. If you're passionate about driving innovative solutions, working with a variety of clients, and continuously evolving your skills, IBM Consulting is the perfect place for you to advance your career.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted