Data Transformation Jobs in Bengaluru
1142 Jobs Found
Analytics Engineer
Postman
Analytics Engineer Location: Bengaluru Work Type: Full-Time About Postman Postman is the world s leading API platform, used by over 40 million developers and 500,000 organizations, including 98% of the Fortune 500. Our mission is to build an API-first world, simplifying every step of the API lifecycle and enabling teams to create better APIs, faster. Founded in Bengaluru, Postman is headquartered in San Francisco, with offices in Boston, New York, and Bengaluru. We are privately held, backed by Battery Ventures, BOND, Coatue, CRV, Insight Partners, and Nexus Venture Partners. The Opportunity We are seeking an Analytics Engineer to join our Data Team and help strengthen the foundation of our modern data stack. In this role, you will own critical transformation pipelines, design scalable data models, and ensure that our analytics environment is performant, reliable, and future-ready. You will operate with a high degree of independence, driving projects from design through production, while implementing best practices in dbt, semantic layers, medallion architecture, and lakehouse paradigms. Key Responsibilities Take ownership of large portions of our dbt project (3k+ models), ensuring scalability, maintainability, and adherence to best practices. Design and implement robust data models, including dimensional modeling, incremental strategies, and Slowly Changing Dimensions (SCDs). Establish and enforce dbt test coverage, automated quality checks, and CI/CD pipeline standards using GitHub Actions. Profile and optimize SQL queries and warehouse performance for efficiency and cost reduction. Build and refine our semantic layer, ensuring consistent business logic across Looker, Redash, and downstream tools. Collaborate with analysts and business partners to define metrics and deliver self-serve data assets. Document models, lineage, and transformation logic to make data discoverable and usable across the company. Contribute to shaping team standards and playbooks, collaborating with analysts on modeling and transformation best practices. Stay ahead of modern data stack innovations, including dbt metrics layer, universal semantic layers, data contracts, and observability. Enabling Self-Serve Analytics & AI Build transformations that empower business stakeholders and analysts to explore data confidently. Ensure metric definitions are consistent, discoverable, and reusable across BI tools. Prepare clean, structured, and accessible datasets for AI-driven initiatives like conversational analytics and anomaly detection. Partner with Data Science & ML teams to provide reliable pipelines that accelerate experimentation and AI/ML deployment. About You 3 5 years of experience in analytics engineering roles. Advanced SQL skills (query optimization, performance tuning). Strong proficiency in dbt Core: models, macros, snapshots, sources, and custom materializations. Solid background in data modeling techniques (Kimball, SCD handling, incremental pipelines). Practical experience with semantic layers and BI integration (LookML, dbt metrics, or equivalent). Familiarity with Medallion architecture and modern lakehouse approaches. Hands-on experience with Redshift; exposure to Databricks is a plus. Proficiency with GitHub and CI/CD pipelines for analytics code. Strong fundamentals in data quality, governance, and lineage tracking. Flexible schedule with a hybrid work model. Full medical coverage, flexible PTO, wellness reimbursement, and monthly lunch stipend. Access to wellness programs, team-building events, and donation-matching initiatives. An inclusive, collaborative culture where everyone can thrive and grow. Our Values Curiosity: Explore and innovate fearlessly. Transparency: Communicate openly about successes and failures. Focus: Set clear goals aligned with a bold vision. Inclusion: Every voice matters. Excellence: Deliver the best products and experiences together.
Business Technology Data Engineer
Samsara Inc
Position: Business Technology Data Engineer Location: Bengaluru, India (Hybrid 3 days onsite) Company: Samsara Technologies India Pvt. Ltd. About Samsara Samsara (NYSE: IOT) is a leader in the Connected Operations Cloud, enabling businesses across industries like transportation, logistics, manufacturing, and field services to harness IoT data for safety, efficiency, and sustainability improvements. Samsara helps organizations digitize physical operations at scale, improving outcomes that impact global infrastructure. Role Overview Samsara is seeking a Business Technology Data Engineer to join its Data & Analytics team within the Business Technology division. In this role, you will design, build, and optimize end-to-end data pipelines and infrastructure for various business-critical systems across CRM, marketing, support, and product platforms. You'll collaborate with teams across the company to build reliable and scalable data solutions that power reporting, automation, and analytics. This hybrid role requires working 3 days per week from the Bengaluru office and 2 days remotely, with working hours aligned to India Standard Time (IST). Key Responsibilities Data Engineering & Platform Development Design and maintain ETL/ELT pipelines that integrate and transform data across business systems. Build scalable data infrastructure to support advanced analytics and real-time reporting needs. Write Python and SQL scripts for data ingestion, transformation, and validation. Data Integration & Enablement Work with diverse data sources: CRM, product telemetry, marketing automation, support ticketing, and order flow systems. Develop and support data lake and data warehouse solutions using Snowflake, Redshift, Databricks, or BigQuery. Ensure interoperability between applications and data layers. Performance & Quality Monitor and optimize pipeline performance, implement observability and alerting. Improve data quality, lineage, and governance across systems. Partner with internal stakeholders (e.g., Sales Ops, Marketing Ops, Analytics) to deliver reliable data products. Minimum Qualifications Bachelor s degree in Computer Science, Data Engineering, or related field. 5+ years of professional experience in data engineering. 3+ years experience building and maintaining end-to-end pipelines in a modern data stack. Strong in SQL and Python. Hands-on experience with: ETL tools: Fivetran, dbt Cloud: AWS (preferred), GCP, or Azure Databases: MySQL, PostgreSQL, Oracle, or similar Data Warehouses: Snowflake, Redshift, BigQuery, Databricks Preferred Qualifications Familiarity with API-based ingestion, serverless architecture (Lambda, API Gateway, SQS, etc.). Experience with monitoring tools (DataDog, CloudWatch, Splunk). Comfortable engaging stakeholders to translate business needs into data solutions. Proficiency in Docker, Kubernetes, or AWS Fargate is a plus. Qualification : Bachelors degree in Computer Science, Data Engineering, or related field
Senior Developer SQL & Snowflake
Thoughtfocus
Job Title: Senior Developer SQL & Snowflake Location: Bangalore, India Experience: 7+ Years (Minimum 3+ years in Snowflake) Employment Type: Full-Time Job Overview: We are seeking a highly skilled Senior Snowflake Developer to join a global financial services project for a client operating in public/private loans, CLOs, and long/short credit. The ideal candidate will bring expertise in Snowflake, SQL, Coalesce, and Fivetran, with a strong background in data integration and cloud-based data warehousing. You will be instrumental in driving forward key data initiatives and delivering innovative, scalable data solutions in a fast-paced, agile environment. Key Responsibilities: Design, develop, and optimize Snowflake objects including databases, schemas, tables, views, and stored procedures. Build and maintain Snowflake data pipelines utilizing tools like SnowSQL, SnowPipe, Streams, and Tasks. Implement data loading strategies using COPY, PUT, GET, LIST, and REMOVE commands for batch and bulk data movement. Ensure seamless migration and integration of data from Azure Cloud to Snowflake with high attention to performance and data integrity. Define and manage Snowflake roles, custom role hierarchies, masking policies, and network policies for enhanced security and governance. Use Coalesce and Fivetran for designing and managing ETL/ELT workflows that extract and transform data from MS SQL Server. Write complex T-SQL queries, stored procedures, triggers, and functions for data transformation and reporting. Collaborate closely with cross-functional teams to understand requirements and translate them into technical solutions. Participate in Agile sprints, offering technical guidance, solution design, and timely issue resolution. Required Skills & Qualifications: 8+ years of total IT experience with at least 3+ years of Snowflake development experience. In-depth understanding of Snowflake architecture, utilities, and performance optimization techniques. Strong expertise in MS SQL Server with proficiency in writing advanced T-SQL scripts. Hands-on experience with ETL tools like Coalesce and Fivetran. Proficiency in Azure Data Integration strategies and tools. Excellent problem-solving and communication skills. Experience working in an Agile development environment. Preferred Skills: Prior exposure or high-level understanding of hedge funds, private equity, or private debt domains. Familiarity with data governance and compliance requirements in financial institutions. What s on Offer: Competitive and above-market salary. Hybrid work model with flexibility. Opportunity to work on cutting-edge technology in global financial markets. Collaborative, innovation-driven team culture. Education: Bachelor s degree in Computer Science, Information Technology, Finance, Economics, or a related discipline.
Lead Consultant Data Engineer
Thoughtworks Technologies (india) Pvt Ltd.
Lead Data Engineer | ThoughtWorks | Bangalore, India Location: Bangalore, India Employment Type: Full-time, Regular Industry: Information Technology About ThoughtWorks At ThoughtWorks, we're a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. For over 30 years, we've worked alongside our clients to deliver solutions that challenge the status status quo. With a diverse and inclusive team, we empower each other to grow through shared learning, fostering an environment where innovation thrives. Our commitment to a cultivation culture is key to our success, and we re looking for a Lead Data Engineer to join our Bangalore team and lead transformative projects. Job Overview As a Lead Data Engineer at ThoughtWorks, you will be responsible for designing, developing, and operating modern data architectures that meet client business objectives. You will lead and manage data engineering projects end-to-end, from strategic planning to hands-on coding, ensuring the delivery of scalable and efficient data solutions. Working with cutting-edge technologies, you ll collaborate with stakeholders, clients, and cross-functional teams to implement data-driven strategies that address complex business challenges. Key Responsibilities Project Leadership: Lead and manage data engineering projects from inception to completion, including goal-setting, scope definition, and ensuring on-time delivery in collaboration with cross-functional teams. Data Architecture & Solution Design: Collaborate with clients to design modern data architecture and implement end-to-end solutions that meet key business objectives. Create intricate data processing pipelines to address complex business problems. Stakeholder Collaboration: Work closely with stakeholders to understand business objectives and identify opportunities to leverage data and data quality improvements. Data Modeling & Governance: Develop data models using modern modeling techniques and implement them using appropriate technologies. Ensure compliance with data governance, security, and privacy requirements. Scalable Implementations: Partner with data scientists to design scalable implementations of their models, ensuring the solutions are robust and efficient. Clean, Iterative Code: Write clean, modular code based on TDD (Test-Driven Development) and implement continuous delivery practices to support and operate data pipelines. Technology Guidance: Advise clients on distributed storage and computing technologies, selecting the best options to fit their business needs. Data Quality Strategy: Define and incorporate data quality strategies into daily work processes to ensure high standards and compliance. Job Qualifications Technical Skills: Proven experience in data engineering and system design, with a focus on building Big Data architecture and data pipelines within distributed systems. Deep knowledge of data modeling and hands-on experience with modern data engineering tools and platforms. Strong programming skills, with expertise in building scalable, high-quality data pipelines using languages like Python, Java, Scala, or others. Experience with distributed storage platforms (e.g., Hadoop, Amazon S3, etc.) and distributed processing platforms (e.g., Spark, Flink). Experience working with SQL, NoSQL, data lakes, and other data storage technologies. Familiarity with data visualization techniques and ability to communicate insights effectively across varying audiences. Professional Skills: Stakeholder Management: Strong ability to liaise between clients and other key stakeholders, ensuring trust and buy-in throughout projects. Adaptability & Resilience: Comfortable handling ambiguity and finding innovative solutions to complex challenges. Leadership & Mentorship: Experienced in coaching and mentoring team members, fostering a culture of professional growth and accountability. Risk & Conflict Management: Skilled in managing risks and resolving conflicts, driving projects forward despite challenges. Relationship Building: Natural at cultivating strong relationships with clients, stakeholders, and internal teams to create new opportunities. What You Bring to the Team Leadership: A proven track record in leading high-performance teams and supporting colleagues in their professional development. Curiosity & Innovation: A passion for data and technology and a willingness to continually learn and push the boundaries of what's possible. Collaboration: Ability to work closely with cross-functional teams and stakeholders to design and implement innovative data solutions. At ThoughtWorks, we believe in giving you the autonomy to carve out your unique career path, while providing support through development programs and a vibrant culture of learning. You ll work on exciting projects with a diverse team, solve complex challenges, and make an impact at a global scale. Join ThoughtWorks and be part of a global community of innovators. Together, we turn curiosity into action and creativity into impactful solutions.
Analytics Lead/architect
Oracle India
Analytics Lead/Architect Location: Bengaluru, Karnataka, India Job Category: Consulting Job Type: Regular Employee Role: Individual Contributor Job Description: As a BI Architect, you will work on both offshore and onsite client projects. Your responsibilities will involve working with Oracle BI Applications, OAC (Oracle Analytics Cloud), and ODI (Oracle Data Integrator) implementations. You will engage with clients to understand their requirements, lead technical designs, and oversee system and integration testing using Oracle methodologies. You will also contribute to PreSales, the creation of Go-to-Market (GTM) strategies, and take the lead in developing IP/solution accelerators. Additionally, you will be responsible for owning the technical delivery of large, complex projects. Responsibilities: Lead Oracle BI Applications, OAC, and ODI implementations. Interact with clients to understand and gather business requirements. Oversee technical design, development, and system/integration testing. Contribute to PreSales activities and the creation of Go-to-Market (GTM) strategies. Lead the development of IP/solution accelerators. Own the technical delivery of large and complex projects. Required Skills: BI (Business Intelligence) expertise. Experience with Oracle Data Integrator (ODI). This position offers the opportunity to work on cutting-edge analytics technologies and deliver impactful solutions in a collaborative and dynamic environment. If you have significant experience in Oracle BI and ODI implementations, and enjoy leading large, complex projects, we would love to hear from you.
Data Integration Developer- Talend
Infocepts
Position: Data Integration Developer Talend Location: Bangalore Employment Type: Full-time Experience Required: 4 to 7 years Overview: We are seeking a Data Integration Developer with strong expertise in Talend to join our growing data engineering team. This role is ideal for professionals who are passionate about designing and building robust, scalable ETL/ELT pipelines and integrating enterprise data across cloud and on-premise platforms. You will work closely with data architects, business analysts, and reporting teams to support data transformation, integration, and analytics efforts. Key Responsibilities: ETL/ELT Solutions Development: Design, develop, and deploy scalable ETL/ELT processes using Talend Data Integration (on-prem and cloud). Data Transformation & Integration: Implement data transformation using stored procedures and other data processing techniques. Report Development Support: Collaborate with reporting teams to support dashboard/report creation using tools like MicroStrategy and Power BI. Documentation & Data Governance: Create detailed pipeline documentation, configurations, and data workflows. Performance Optimization: Monitor pipeline performance, identify bottlenecks, and troubleshoot data integration issues. Essential Skills: Hands-on experience with Talend Suite (Talend Data Integration, Talend Cloud) Experience with Snowflake and writing Stored Procedures Knowledge of ETL/ELT design, data warehousing, and data modeling Familiarity with JSON, XML, CSV data formats Experience with data quality frameworks and job monitoring/scheduling tools Proficiency in Agile methodology and tools like JIRA Desirable Skills: Experience with reporting tools such as MicroStrategy and Power BI Skills in scripting languages: Python, Java, or Shell Understanding of cloud platforms (AWS, GCP, Azure) and related data services Qualifications: Bachelor s or Master s degree in Computer Science, Engineering, or a related field Minimum of 3+ years of Talend development experience Qualities We Value: Strong verbal and written communication skills Experience in Agile and cross-functional team environments Problem-solving mindset and ability to work under minimal supervision Quick learner with a passion for data and process improvement Work with modern cloud data integration and enterprise tools Collaborate with global clients and expert teams Be part of cutting-edge data platform transformation initiatives Apply today and be part of our mission to deliver next-gen, data-driven insights. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field
Talend Data Engineer
Infocepts
Position: Talend Data Engineer Location: Bangalore, India Employment Type: Full-time Experience Required: 4 to 9 years Purpose of the Position: As a Talend Data Engineer, you will be responsible for designing, developing, and managing scalable ETL/ELT data pipelines both on-premise and in the cloud. You will work with technologies such as Talend Suite, Snowflake, and reporting tools to support high-impact data integration and business intelligence initiatives. Key Responsibilities: ETL/ELT Development: Design, develop, and deploy ETL/ELT workflows using Talend Data Integration and Talend Cloud. Data Transformation: Apply stored procedures for accurate and structured data processing. Reporting: Build reports using MicroStrategy and Power BI to support decision-making. Documentation: Maintain detailed documentation for pipelines, configurations, and processes to ensure data integrity and quality. Performance Monitoring: Monitor and optimize data pipelines, resolving data-related issues swiftly. Essential Skills: Hands-on experience with Talend Suite (Talend Data Integration, Talend Cloud). Strong skills in Snowflake and writing Stored Procedures. Expertise in ETL/ELT processes, data warehousing, and data modeling. Familiarity with data quality frameworks and job scheduling tools. Proficient in handling data formats like JSON, XML, CSV, and Parquet. Knowledge of Agile methodologies and tools such as JIRA. Desirable Skills: Experience with BI tools like MicroStrategy and Power BI. Proficiency in scripting languages such as Python, Java, or Shell scripting. Familiarity with cloud platforms (AWS, Google Cloud, Azure) and cloud-based data services. Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or related field. 6+ years of relevant experience with Talend and data engineering projects. Key Qualities: Strong consulting, writing, and presentation skills. Self-organized and collaborative in cross-functional teams. Open to feedback and iterative improvement. Effective communicator with clients across geographies. Analytical mindset with a research-oriented approach. Apply now and become part of a high-performing team delivering scalable data solutions across industries! Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or related field.
Data Engineer - Snowflake And Dbt
Infocepts
Position: Data Integration Developer (Snowflake & DBT) Location: Bangalore Employment Type: Full-time Experience Required: 5 to 7 years Purpose of the Position: This role seeks candidates who are passionate about data and motivated to address the organization's analytics challenges. As a Data Integration Developer (Snowflake & DBT), you will play a crucial role in assisting our clients with their data and analytics journey. Your responsibilities will include building robust data pipelines, enhancing data consistency, and developing the necessary infrastructure to support analytics platforms. Key Responsibilities: Technical Expertise: Develop and optimize ETL processes using Snowflake capabilities. Build and maintain advanced data models and ETL processes using DBT (Data Build Tool). Ensure efficient data transformation and integration within the data warehouse. Collaboration: Work closely with data analysts, engineers, and stakeholders to understand business requirements and translate them into technical solutions. Facilitate effective communication and collaboration across teams. Quality Assurance: Implement and oversee data quality checks and testing procedures. Ensure data accuracy, consistency, and compliance with governance policies. Documentation and Reporting: Create and maintain comprehensive documentation for ETL processes and project workflows. Provide regular updates and reports on project progress and performance metrics. Compliance and Security: Ensure all data engineering activities comply with data governance and security policies. Implement measures to protect data integrity and confidentiality. Essential Skills: Proficient in SQL: Skilled in writing efficient queries on large datasets, including CTE and database table design. Snowflake Expertise: Experience with Snowflake or other database technologies, including SQL tuning. ETL Development: Skilled in developing and optimizing ETL processes using Snowflake and other tools. DBT Experience: Familiar with DBT Core/DBT Cloud and fundamental data modeling concepts (3NF, Star, Snowflake). Data Analysis and Profiling: Experienced in data analysis and profiling tasks. Qualifications: Overall Work Experience: More than 5 years of experience, with at least 2-3 years of experience in Snowflake and DBT. Education: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus). Key Qualities: Decision Making: Ability to influence and implement change with confidence and sound decisions. Problem-Solving: Tackles problems head-on with a logical, systematic, and practical approach; follows up with developers. Communication: Ability to consult, write, and present persuasively. Team Collaboration: Works effectively in self-organized, cross-functional teams. Apply now and become an integral part of our innovative team working on cutting-edge data integration solutions! Qualification : Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus).
Data Engineer 1
Loadshare Networks
Job Title: Data Analyst Location: Bengaluru Company: LoadShare Networks About LoadShare Networks At LoadShare, we re building India s largest intra-city logistics marketplace. Founded in 2017, we are a Series C startup backed by a strong set of investors (Tiger Global, Matrix Partners, BII, Stellaris, BeeNext, Filter Capital), focused on building a profitable and impactful business. We work with all major enterprise clients covering a wide range of intra-city use cases, including: Quick Commerce: Blinkit, Zepto, BBNow Food Delivery: Swiggy, Zomato Hyperlocal: Apollo, Licious Grocery: Reliance, Spencers, ONDC eCommerce: Flipkart, Amazon, Meesho, ShipRocket Bike Taxi: Uber, Ola Scale & Reach: Delivering over 500K orders per day across food, e-commerce, grocery, etc. Operating in 500+ towns nationwide with a fleet of 20K+ riders. Our tech platform powers 1M+ shipments daily. Role Overview As a Data Analyst at LoadShare, you will be an integral part of our Data team, responsible for designing, developing, and maintaining analytics reports and dashboards that measure, monitor, and alert the business regarding operations and product metrics. You ll work closely with internal teams to troubleshoot data issues, build ETL pipelines, and contribute to process improvements and innovation. Key Responsibilities Analyze, design, and develop analytics reports and dashboards to track key business metrics, providing insights into operational performance. Use your strong SQL skills to troubleshoot data issues in complex workflows and work with product and tech teams to resolve them. Build and maintain ETL pipelines to support data movement and integration across systems. Create ad-hoc reports as requested, ensuring timely and accurate delivery. Present findings and actionable recommendations to both business and non-technical stakeholders using effective storytelling techniques. Collaborate with product, business, and tech teams to understand the business domain and deliver insightful reports and dashboards that support business growth and optimization. Continuously improve data models, ensuring data is accessible and accurate for decision-making across the organization. Work on in-house technology projects to bring innovation and process improvements. Job Requirements Technical Skills: Strong proficiency in SQL and experience with writing and tuning SQL scripts. Around 1-2 years of experience coding in Python (experience in web scraping is a plus). Experience in data modeling, data warehousing, and building ETL pipelines. Familiarity with Business Intelligence (BI) tools such as Zoho Analytics, Metabase, Redash, Tableau, or Power BI. Collaboration: Ability to partner effectively with product, business, and tech teams to understand the business needs and develop reports and dashboards that support business growth. Communication: Strong communication skills, both written and verbal, with the ability to present complex data and insights to both technical and non-technical stakeholders. Problem-Solving: Proactive in identifying data issues, troubleshooting, and providing solutions that improve data integrity and usability. Key Skills SQL, Python, ETL Pipelines Data Modeling, Data Warehousing BI Tools: Zoho Analytics, Metabase, Redash, Tableau, Power BI Data Analysis & Reporting Communication & Collaboration
Data Engineer
International Business Machines
Azure Data Engineer IBM Consulting Client Innovation Center Location: Bengaluru, India Experience: 7+ Years (Minimum 4+ Years in Azure Technologies) Job Type: Full-Time Education Required: Bachelor s Degree (Master s preferred) Introduction: Join IBM Consulting at our Client Innovation Center in Bengaluru, where we deliver deep technical and industry expertise to a wide range of public and private sector clients. Our delivery centers focus on innovation, agility, and adoption of next-gen technologies to transform businesses locally and globally. Your Role & Responsibilities: Design and develop scalable data engineering solutions on Microsoft Azure. Build, optimize, and manage data pipelines and ETL workflows using tools like Azure Data Factory, ADLS, and Databricks. Write clean, efficient code using PySpark, PL/SQL, and Spark SQL. Integrate and manage data from various sources, both structured and unstructured. Work with SQL, Postgres, Cassandra, and Cosmos DB. Utilize Azure services such as Stream Analytics, SQL DW, Azure Functions, ARM Templates, and Analysis Services. Implement and maintain serverless architectures for modern data solutions. Ensure high-quality data delivery, security, and compliance across systems. Collaborate across teams and contribute to solution design, code reviews, and documentation. Required Skills & Experience: Bachelor s degree in Computer Science, Information Systems, or related technical field. 7+ years total experience in Data Engineering, with 4+ years in Azure-based data projects. Strong hands-on experience with: Azure Data Factory, Data Lake (ADLS), Databricks Programming: Python, PySpark, PL/SQL, Spark SQL Databases: SQL, Postgres, Cassandra, Cosmos DB Solid grasp of data warehousing, relational databases, and cloud-based architectures. Familiarity with version control tools like Git and CI/CD pipelines. Preferred Skills & Qualifications: Master s Degree in a relevant field. Experience with: ARM Templates, Azure Functions, Serverless Architectures Object-oriented scripting languages (Python, Scala, etc.) Excellent problem-solving and communication skills. Ability to work in a fast-paced environment and collaborate effectively with teams and stakeholders. What You ll Get: Work on high-impact, global projects with cutting-edge Azure technologies. Be part of a collaborative and forward-thinking IBM team. Opportunities for professional growth, upskilling, and certifications. A dynamic work culture focused on innovation, agility, and client success. Join us in Bengaluru and be part of IBM s journey in shaping the future of data engineering. Qualification : Bachelors degree in Computer Science, Information Systems, or related technical field.
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Deputy Manager
Deloitte
Job Title: Deputy Manager Location: Bengaluru Role Overview: As a Deputy Manager responsible for Data Protection and Security, you will play a pivotal role in leading and managing data protection initiatives. You will oversee a range of security tools and processes, ensuring the effective implementation of DLP, data classification, and CASB solutions across a global organization. You will coordinate with internal and external stakeholders, manage teams, and contribute to the development and execution of enterprise-wide data protection strategies. Key Responsibilities: Stakeholder Coordination: Collaborate with both internal and external stakeholders to understand client requirements, processes, and governance guidelines, ensuring effective communication and relationship management. Leadership: Manage and lead a team of professionals, fostering strong leadership skills and creating a collaborative environment for continuous improvement. Data Protection Strategy: Lead cross-functional initiatives to advance the enterprise-wide data protection strategy, including risk-based application inventory, data classification, access and encryption controls, data discovery, and monitoring. Risk Management: Identify and manage data protection risks, proposing improvements to the enterprise data protection strategy, policies, processes, and tools. DLP and Data Protection Tools: Hands-on experience in managing and implementing Data Loss Prevention (DLP) solutions (e.g., Forcepoint), data classification tools (Microsoft AIP, TITUS, Klassify), and CASB solutions (Netskope) for 6000+ end users globally. Data Inventory & Reporting: Oversee the management and administration of data inventory tools, providing operational reports to management teams on the status and effectiveness of data protection measures. Policy Development & Implementation: Spearhead the design, implementation, and policy development for DLP platforms and CASB solutions, ensuring compliance with organizational and client-specific requirements. Endpoint Security & Intrusion Detection: Implement measures to detect and prevent intrusions using Endpoint, EDR (Endpoint Detection and Response) tools, and other security solutions. Security Program Expansion: Develop business procedures for DLP programs, recommend and implement expansions based on evolving business requirements, and ensure ongoing program improvements. Collaboration & Reporting: Collaborate with leadership to present findings, updates, and strategies for enhancing data protection initiatives. Desired Skills & Experience: Technical Expertise: Hands-on experience with DLP (Forcepoint), Data Classification tools (Microsoft AIP, TITUS, Klassify), and CASB (Netskope). Familiarity with file/email/endpoint encryption, data discovery, and data masking solutions. Experience implementing DLP and CASB standards across a large-scale global environment (6000+ users). Leadership & Management: Strong leadership skills with the ability to manage and mentor a team of professionals, ensuring project delivery and quality standards are met. Data Protection Strategy & Risk Management: In-depth knowledge of data protection strategies, risk management, and enterprise-wide data protection frameworks. Communication & Collaboration: Excellent communication skills with the ability to manage stakeholder relationships and work across multiple teams, ensuring alignment on data protection goals. Process & Policy Development: Experience in developing, fine-tuning, and implementing DLP policies, as well as working on continuous improvements in data protection practices. Security Tools & Practices: Hands-on experience with tools like Endpoint Detection and Response (EDR), DLP solutions, and CASB, with a focus on security program implementation and risk mitigation. Qualifications: Education: Bachelor's degree or equivalent in IT, Cybersecurity, or related fields. Experience: 5+ years of relevant experience in data protection, DLP implementation, and team management in a complex global environment. Certifications: Relevant certifications (e.g., CISSP, CISM, CISA, or equivalent) would be an advantage. Why Join Us: In this role, you will have the opportunity to shape and drive critical data protection initiatives across a large global organization. You will lead the implementation of cutting-edge solutions and be an integral part of a dynamic team focused on securing enterprise data and improving security frameworks. This role offers the chance to make a significant impact on the company s data security posture while also growing and mentoring a team of cybersecurity professionals. Qualification : Bachelor's degree or equivalent in IT, Cybersecurity, or related fields.
Analytics Solutions - Associate
J.p. Morgan
Job Description You are a strategic thinker passionate about driving solutions in Analytics Solutions. You have found the right team. As an Analytics Solutions Associate in our Finance team, you will spend each day defining, refining and delivering set goals for our firm. You will be responsible for the design, implementation and execution of end-to-end processes supporting U.S. Regulatory Reporting including Consolidated, Capital, Standalone and CCAR/DFAST reporting, regulatory reporting training and exam management. Additionally, FRRA drives broader strategic initiatives across external reporting including accountability, error and issue management, manual adjustments, variance analysis, quality assurance and the target U.S. Regulatory Reporting platform. The FRRA Innovation team sits within FRRA and is responsible for leading the development and implementation of Business Intelligence, Data Analytics and Intelligent automation solutions, identifying and delivering process automation and technology innovation, supporting the reporting production close, and helping to define and design multi-year business infrastructure strategy. Job Responsibilities Implement process automation solutions across the business using Business Intelligence tools. Drive process discovery through partnerships with key stakeholders in the business. Follow established project lifecycle from end to end to deliver timely, efficient, and fit-for-purpose solutions. Engage partners such as FRRA process owners, Center of Excellence teams, and Control partners through established forums. Assist with various aspects of project management including development of project plans, task management, design, testing scenarios and analysis, implementation, and procedural / operating model documentation. Collaborate with system / data owners and business project teams to improve overall data quality and implement tactical solutions to automate repetitive, manual data clean-up and aggregation work. Develop expertise in existing and future strategic data source systems to streamline and improve information content, transparency, and delivery. Communicate summary of analysis and findings thoroughly and succinctly (summary of facts, data sources, analyses performed, conclusions, and recommendations) to various stakeholders, including executive leadership and participate/lead Innovation forums. Stay up-to-date with industry trends and best practices in process automation, analytics, and innovation. Required Qualifications, Capabilities, and Skills Minimum 3 years experience in design and delivery of analytics, reporting and process automation solutions. Advanced data transformation skills using Alteryx and/or Python. Experience with data visualization tools (e.g., Tableau, Power BI) and analytics platforms. Strong project management skills with the ability to manage multiple projects simultaneously. Good analytical and presentation skills. Willingness to learn and adopt new cutting edge technologies, toolsets and techniques. Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams. Preferred Qualifications, Capabilities, and Skills Bachelor's degree in Computer Science, Information Technology, Business Administration, or a related field. Finance experience a plus. Certifications in process automation or data analytics. Knowledge of SQL and/or RPA tools like UIPath. Experience with process review, discovery and reengineering. Understanding of workflow automation tools such as Pega or ServiceNow. Experience in a similar role within a fast-paced, innovative environment. About Us JPMorgan Chase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. Qualification : Bachelor's degree in Computer Science, Information Technology, Business Administration, or a related field. Finance experience a plus.
Senior Power Bi Developer
Iqvia
Job Title: Business Intelligence (BI) Lead Life Sciences Sector About the Role: As the BI Lead, you will spearhead and develop Business Intelligence (BI) projects within the team, focusing on constructing an analytical data layer, developing custom BI reporting solutions, monitoring platform performance, and enabling self-serve reporting for Regional Business Units (RBU) and Global Business Units (GBU). Your primary responsibility is to deliver high-quality contributions to client projects in the life sciences sector. These tasks will range from basic analysis and problem-solving to assisting in the creation of more complex solutions. You ll demonstrate a comprehensive understanding of pharmaceutical data assets, including IQVIA, CRM, and MCM data, as well as country-specific variations. Key duties include training and upskilling Business Units (BUs) to use the self-serve layer effectively for report and dashboard creation, assessing data requirements for decision-making, and ensuring data accuracy. You ll work closely with engineering and data platform teams to improve data availability and reliability, while collaborating on client proposals and solution strategies. Additionally, you will contribute to documentation and specifications, design presentations, and actively engage in the consulting methodologies and life sciences market to continuously grow your knowledge. Key Responsibilities: Lead BI projects, including building and maintaining an analytical data layer, and developing BI solutions for reporting and visualization. Deliver high-quality, timely contributions to life sciences client projects, ranging from basic analysis to complex solutions. Utilize pharmaceutical data assets (IQVIA, CRM, MCM) and understand regional data variations. Train Business Units (BUs) to efficiently use the self-serve reporting layer for creating reports and dashboards. Assess data requirements, identify suitable data sources, ensure data accuracy, and perform necessary transformations for decision-making. Establish and track business metrics, and perform in-depth process analysis to identify areas for improvement. Collaborate with engineering and data platform teams to enhance data availability and reliability. Review and analyze client requirements, contribute to proposal development, and create tailored client solutions. Create detailed documentation, including specifications and quantitative/qualitative analyses. Present client deliverables within established frameworks, adapting presentations to audience needs. Stay engaged in consulting methodologies, life sciences market trends, and professional development opportunities. Manage project-based responsibilities under the guidance of senior consultants and directors. Desired Candidate Profile: Proficiency in SQL and BI platforms, particularly Power BI (Spotfire knowledge is a plus). Extensive experience with data transformation/ETL, data modeling, and a strong understanding of data platforms and ETL processes. Hands-on experience with Power BI, including the creation of reports, dashboards, and visualizations, and experience in environments such as Salesforce, Snowflake, or Azure. Skilled in migrating SSRS reports/Tabular reports to Power BI Paginated Reports. Advanced knowledge of Power Query M and experience building sophisticated DAX queries. Experience implementing static and dynamic Row Level Security, along with extensive knowledge in dataset design, data cleansing, and aggregation. Understanding of relational database structures, principles, and practices. Solid SQL skills, including the ability to write complex queries and create SQL views for custom datasets. Strong proficiency in Excel, PowerPoint, and Access, with VBA knowledge considered a plus. Proven ability to build relationships with multiple stakeholders (BI engineers, Data Engineers, Consulting teams, Product Managers). Familiarity with Software Development Life Cycle (SDLC) and Agile methodologies. Experience with technical project execution, including proposal writing, creating BRD, PDD, SDD, and user documentation. Excellent verbal and written communication skills. Previous experience in application or implementation support is required. Strong problem-solving skills and a macro-level approach to research and analytics. Good to Have: Experience with other BI technologies (e.g., Tableau, Looker Studio, ThoughtSpot). Knowledge of Python/R. Experience with Microsoft Power Platform tools (e.g., PowerApps, Power Automate). Hands-on experience with Canvas App Configuration, Canvas App Functions, Power Portals, Power Automate Desktop, and custom connectors. Familiarity with Azure services, AI builder, Virtual Agents, and SharePoint list customization. Microsoft Power Platform certification is a plus. Qualifications: Bachelor s or Master s degree in Computer Science, Information Technology, or a related field. 6-8 years of relevant experience. Demonstrated collaborative approach, working effectively across teams to achieve objectives. Knowledge of core business processes and their impact on decision-making and growth. Familiarity with consulting methodologies, tools, and techniques. Up-to-date with current industry trends and insights into competitors and marketplace dynamics. Proficiency in time management, Scrum methodologies, and agile working practices. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
Data Engineer
Kpit Technologies
Job/Position Summary: Data Engineer Responsibilities: Implement data pipelines that meet design and are efficient, scalable, and maintainable. Implement best practices including proper use of source control, participation in code reviews, data validation and testing. Timely deliveries while working on projects. Act as advisor/mentor and helps junior data engineers in their deliverables. Must Have Skills: Should have experience of at least 4+ years with Data Engineering. Strong experience of design, implementation and fine-tuning big data processing pipelines in production environment. Experience with big tools like Hadoop, Spark, Kafka, Hive, Databricks. Experience in programming at least one of with Python, Java, Scala, Shell Script. Experience with relational SQL and NO SQL databases like PostgresSQL, MYSQL, Cassandra etc. Experience with any data visualization tool (Plotly, Tableau, Power BI, Google Data Studio, Quick sight etc.). Good To Have Skills: Should have Basic Knowledge of CI/CD Pipeline. Experience in working on at least one Cloud (AWS or Azure or GCP). For AWS: - Experience with AWS Cloud services like EC2, S3, EMR, RDS, Athena, Glue, Lambda, EMR. For Azure: -Experience with Azure Cloud services like Azure Blob/Data Lake GEN2, Delta Lake, Databricks, Azure SQL, Azure DevOps, Azure Data Factory, Power BI. For GCP: - Experience with GCP Cloud services Big Query, Cloud Storage bucket, DataProc, Dataflow, Pub Sub, Cloud Function, Data Studio. Sound familiarity in Versioning tools (Git, SVN etc.). Experience Mentoring students is desirable. Knowledge of latest developments in Machine Learning, Deep Learning, Optimization in Automotive domain. Open minded approach to explore multiple algorithms to design optimal solution. History of contribution to articles/blogs/whitepapers etc. in Analytics. History of contribution to Open Source. Requirement: ESSENTIAL SKILLS /COMPETENCIES Data Engineering Hadoop Kafka CI/CD Cloud
Data Engineer: Data Warehouse
International Business Machines Corporation
Job Title: Application Developer - ETL and Data Management Introduction: In this role, you ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we provide deep technical and industry expertise to a wide range of public and private sector clients globally. Our delivery centers leverage locally-based skills to help clients drive innovation and the adoption of new technologies. A career in IBM Consulting is built on long-term relationships and close collaboration with clients across the world. You will work with leaders across industries to improve the hybrid cloud and AI journeys for some of the most innovative and valuable companies worldwide. Your ability to make a meaningful impact for clients is enabled by our strategic partner ecosystem and robust technology platforms, including Software and Red Hat. Curiosity and a constant quest for knowledge are key to success in IBM Consulting. In your role, you ll be encouraged to challenge the norm, explore new ideas, and come up with creative solutions that result in groundbreaking impact for a wide network of clients. Our culture is built on evolution and empathy, focusing on long-term career growth and development in an environment that values your unique skills and experience. Your Role and Responsibilities: ETL Workflow Development: Develop and implement ETL workflows by creating ETL jobs, and data models in datamarts using technologies such as Snowflake, DBT, Unix, and SQL. Batch Processing Redesign: Redesign Control M Batch processing for ETL job builds to run efficiently in a production environment. System Evaluation and Improvement: Study the existing system to evaluate its effectiveness and design new systems to improve workflow efficiency. Business Program Analysis & Support: Perform requirements identification, business program analysis, testing, and system enhancements while providing production support. Agile Environment: Work effectively in an Agile environment and gain familiarity with tools such as JIRA and SharePoint. Client Interaction: Good written and verbal communication skills are essential as you will interact directly with client counterparts to understand requirements and provide solutions. Required Technical and Professional Expertise: Experience: A minimum of 3 years of experience in developing ETL applications, implementing workflows, and creating data models using Snowflake, DBT, Unix, and SQL technologies. Agile Environment: Strong understanding of working in an Agile environment and proficiency in tools like JIRA and SharePoint. Problem-Solving Skills: Ability to manage change and proven time management skills. Strong interpersonal skills to contribute effectively to team efforts. Continuous Learning: Stay up-to-date with technical knowledge by attending educational workshops and reviewing relevant publications. Preferred Technical and Professional Expertise: ETL Development: Experience in developing triggers, functions, and stored procedures to support ETL workflows. Impact Analysis: Assist with impact analysis of changing upstream processes on the Data Warehouse and reporting systems. ETL & Reporting Support: Participate in the design, testing, support, and debugging of new and existing ETL and reporting processes. Data Profiling & Troubleshooting: Perform data profiling and analysis using a variety of tools, troubleshoot and support production processes, and maintain documentation. Innovation: Be part of a team that drives global change and leverages cutting-edge technologies to solve complex problems. Growth: Gain access to continuous learning and career development opportunities to further your expertise in data management and cloud technologies. Collaboration: Work with a diverse team in a collaborative environment that values new ideas and creative solutions. Global Impact: Your work will contribute to improving business operations and technological advancements for clients around the world. If you're passionate about driving innovative solutions, working with a variety of clients, and continuously evolving your skills, IBM Consulting is the perfect place for you to advance your career.
Staff Data Engineer
Intuit
Intuit is a global leader in financial technology, dedicated to helping individuals and businesses thrive. Our suite of products, including TurboTax, Credit Karma, QuickBooks, and Mailchimp, serves approximately 100 million customers worldwide. At Intuit, we believe in providing everyone with the tools and resources they need to achieve financial success. We are constantly innovating to make financial empowerment a reality for all. Job Overview Join the Intuit Data Platform (IDP) team as a Staff Engineer and help us transform the way we handle big data! The IDP team is responsible for the Intuit Analytics Platform, which powers real-time data ingestion, cataloging, analytics, and machine learning across the entire organization. As Intuit s customer base grows, so does the volume of data we process. Our engineering excellence ensures that we can scale and leverage this data to drive machine learning and product innovations. We re in the process of building the next-generation real-time and batch ingestion engine, capable of indexing, cataloging, and organizing data and metadata. We are passionate about using open-source technologies to solve challenges and contributing back to the community. If you're excited about building a platform that will directly impact data scientists and analysts and have a desire to shape the future of data at Intuit, then come join us! Key Responsibilities Architect & Design: Build fault-tolerant and scalable big-data platforms using open-source technologies to handle massive datasets. Data Solutions: Create architecture solutions that address complex use cases like data normalization, lineage, governance, ontology, and discoverability. Cross-Team Collaboration: Work with analysts and data scientists to understand data requirements for building operational propensity models and gaining deep customer insights. Hands-On Coding: Lead development efforts within the Hadoop ecosystem using technologies such as Java MapReduce, Spark, Scala, HBase, and Hive to build and optimize data pipelines for both real-time and batch applications. Database Management: Work with NoSQL, SQL, and in-memory databases to design high-performance data systems. Code Reviews: Ensure code quality, consistency, and adherence to best practices through regular code reviews. Architectural Alignment: Ensure alignment between enterprise architecture and business requirements. Prove Feasibility: Conduct proof-of-concept (POC) experiments for new technologies or approaches and drive them to production. Collaboration with Data Cataloging Team: Work closely with data catalog teams and architects to index and catalog all data sources at Intuit. Agile Leadership: Lead fast-paced development teams using agile methodologies and promote best practices in software development, testing, and incident response. Design & Model: Build dimension models suited for customer business use cases and ensure seamless integration of business and technical requirements. Qualifications Experience: 12+ years of relevant experience, with at least 5+ years specializing in the big data domain. Big Data Architecture: Proven experience in architecting end-to-end ecosystems for big data and analytics platforms. Expert Knowledge: Deep expertise in building fault-tolerant, scalable big data solutions, especially using the Hadoop ecosystem (Hive, HBase, Spark, Kafka, MapReduce, etc.). Programming Expertise: Mastery of Java and Scala, with a focus on building high-throughput data services. Machine Learning: Knowledge of machine learning principles and AI applications in big data. Big-Data Technologies: Familiarity with tools such as HDFS, Storm, Zookeeper, Cassandra, Redshift, GraphDB, and others. Understanding both real-time and batch processing in the Hadoop ecosystem. Communication: Strong communication skills, with an ability to explain complex technical topics to both technical and non-technical audiences. Programming Skills: Intermediate experience in Python or R for data processing. Education: BE/BTech/MS in Computer Science or a related field (or equivalent experience). Collaboration: Demonstrated ability to work cross-functionally and lead change through influence and example. At Intuit, you ll be part of a talented, passionate team working on innovative solutions that shape the future of data analytics and machine learning. As a Staff Engineer, you ll have the chance to work with cutting-edge technologies, build scalable systems, and help revolutionize how Intuit leverages data to drive product innovation. If you're looking for a dynamic environment where you can have a meaningful impact, come join us at Intuit! Qualification : BE/BTech/MS in Computer Science (or equivalent)
Sr. Data Engineer
Databricks
Job Title: Data Engineer Job Summary As a Data Engineer in the IT team, you will work on various big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help business to get most value out of their data. The Impact You Will Have You will work on a variety of impactful Big Data projects which may include building reference architectures, how-to's and production grade MVPs. Work on implementing transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications. Work on architecture and design; bootstrap or implement strategic projects. What We Look For 7+ years experience with Big Data Technologies such as Apache Spark , Kafka, Cloud Native and Data Lakes. 4+ years of experience working on Big Data Architectures independently. Preferred experience working in the Databricks ecosystem. Comfortable writing code in either Python or Scala. Experience working across Cloud Platforms (GCP / AWS / Azure). Documentation and white-boarding skills. Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics, and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake, and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.
Sr. Data Engineer
Ness Digital Engineering
Job Title: Sr. Data Engineer Job Overview: We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in Snowflake to manage data ingestion and transformation. The ideal candidate will work with an offshore team to deliver scalable data solutions aligned with business and performance requirements. Key Responsibilities: Design, build, and maintain ELT pipelines using Snowflake. Lead offshore development teams in applying data engineering best practices. Collaborate with stakeholders to manage data integration across systems. Optimize data pipelines for performance and reliability, including query tuning and resource management. Implement data validation processes to ensure data accuracy. Document data pipelines, flow diagrams, and transformation logic. Troubleshoot pipeline failures and resolve performance issues. Ensure compliance with data governance and regulatory requirements. Required Qualifications: 5+ years of experience in data engineering with a focus on ELT development. Strong expertise in Snowflake, including data sharing, secure views, and performance optimization. Proficiency in SQL and data integration tools. Experience managing offshore development teams. Strong problem-solving and communication skills. Preferred Qualifications: Snowflake certification or relevant certifications. Experience in financial services with knowledge of data security and compliance. Familiarity with cloud platforms (AWS, Azure) and orchestration tools like Apache Airflow. Experience with Python or JavaScript for data transformation. Knowledge of data visualization tools like Tableau or Power BI.
Data Engineer
Couchbase
Job Title: Data Engineer Location: Bengaluru (Hybrid) About Couchbase: As industries race to embrace AI, traditional database solutions fall short of rising demands for versatility, performance, and affordability. Couchbase is leading the way with Capella, the developer data platform for critical applications in our AI world. By uniting transactional, analytical, mobile, and AI workloads into a seamless, fully managed solution, Couchbase empowers developers and enterprises to build and scale applications with unmatched flexibility, performance, and cost-efficiency from cloud to edge. Trusted by over 30% of the Fortune 100, Couchbase is unlocking innovation, accelerating AI transformation, and redefining customer experiences. Come join our mission! Position Overview: We are seeking a highly skilled Data Engineer with a strong background in data warehousing, advanced analytics, and AI integration. The ideal candidate will have 5+ years of experience designing and implementing data pipelines, building robust analytics platforms, and working with modern data technologies like Snowflake, Google Cloud, Databricks, Looker, PowerBI, and Tableau. As part of our Delorean team, you will play a pivotal role in driving innovation and ensuring our data infrastructure supports strategic decision-making. Key Responsibilities: Data Infrastructure Development: Design, develop, and maintain scalable data pipelines and ETL processes to support data ingestion, transformation, and storage across multiple platforms. Experience with Cloud Data Platforms: Expertise in implementing and optimizing solutions using industry-leading tools such as Snowflake, Databricks, and Google Cloud Platform. Demonstrated ability to ensure high performance, scalability, and cost-effectiveness in data infrastructure and workflows. Analytics & Visualization: Build and maintain interactive dashboards and reports using Looker, PowerBI, and Tableau to provide actionable insights to business stakeholders. AI & Advanced Analytics: Collaborate with Data Science teams to integrate AI models and machine learning workflows into data pipelines for predictive analytics and automation. Data Governance: Ensure data quality, security, and compliance with industry best practices and regulatory requirements. Collaboration: Partner with cross-functional teams, including Product, Engineering, and Business Operations, to understand data requirements and deliver tailored solutions. Continuous Improvement: Identify opportunities to improve data workflows, adopt new technologies, and drive operational efficiency. Qualifications: Education: Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field. Experience: 5+ years of hands-on experience in data engineering, data warehousing, or related fields. Technical Skills: Expertise in Snowflake, Databricks, and Google Cloud Platform (Mandatory experience in at least one tool). Proficiency in ETL/ELT processes and data pipeline tools (e.g., Apache Airflow, dbt). Experience with data visualization tools like Looker, Power BI, and Tableau. Strong SQL skills and familiarity with Python or Scala for data processing. Knowledge of AI/ML concepts and frameworks for integrating predictive models. Soft Skills: Excellent problem-solving skills with a proactive mindset. Strong communication and collaboration skills to work effectively with technical and non-technical teams. Ability to manage multiple priorities in a fast-paced environment. Modern customer experiences need a flexible cloud database platform that can power applications spanning from cloud to edge and everything in between. Couchbase s mission is to simplify how developers and architects develop, deploy, and consume modern applications. With Capella, our flexible, affordable cloud platform, we empower organizations to quickly build and deliver premium customer experiences with unmatched price-performance. More than 30% of the Fortune 100 trust Couchbase to power their modern applications. Benefits at Couchbase: Generous Time Off Program: Flexibility to care for yourself and your family. Wellness Benefits: Comprehensive medical plans, dental, vision, life insurance, and employee assistance programs. Financial Planning: RSU equity program, ESPP, retirement planning, and business travel insurance. Career Growth: A Be valued, Create value approach to your career development. Fun Perks: Ergonomic office setup, food & snacks for in-office employees, and more! Qualification : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted