Data Pipeline Jobs in Bengaluru
1194 Jobs Found
Data Engineer
Capital One
Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field
Data Science Specialist
5c Network Pvt. Ltd.
Position: Data Science Specialist Employment Type: Full-time Location: Bangalore, On-site Experience Required: 1 to 6 years (Mindset > Experience) About the Role: We re seeking a mission-driven, hands-on Data Analytics Specialist passionate about impact. This is not a typical analytics role you will drive key business metrics across clinical operations, stakeholder reporting, and automation. Collaborate closely with leadership, radiologists, operations, product teams, and AI engineers to ensure every decision is data-driven, actionable, and scalable. If you thrive on building dashboards, automating processes, streamlining pipelines, and driving growth through insights, this is your playground. Key Responsibilities: Own Business KPIs: Take full ownership of company-wide metrics, ensuring their accuracy, relevance, and actionability through stakeholder alignment. Data Engineering: Build and optimize ETL/ELT pipelines integrating data from Postgres, ClickHouse, and other sources. Dashboards & Reporting: Design and maintain intuitive dashboards (Metabase, Power BI, Tableau, Google Data Studio) that stakeholders actively use. Backend Data Transformation: Write clean, reusable code to convert raw data into actionable insights. API Development: Build and maintain internal APIs to serve analytics data to frontend and production systems. Email Automation: Develop real-time and scheduled email reports delivering dynamic insights to stakeholders. Spreadsheet Expertise: Automate and manipulate complex data in Excel/Google Sheets for detailed analysis and reporting. AI & Automation: Collaborate with AI teams to integrate predictive algorithms and automate analytics workflows. Business Acumen: Develop deep understanding of the teleradiology ecosystem clinical workflows, operations, financials, and tech platforms. Proactive Collaboration: Identify data gaps, flag inconsistencies, recommend improvements, and work closely with leadership. Required Skills: Strong Python skills for data analytics (Pandas, NumPy, FastAPI, Jupyter, etc.) Proficient in SQL (ClickHouse, PostgreSQL) with experience optimizing queries End-to-end dashboard ownership from data modeling to UI presentation Experience building or integrating APIs for analytics Advanced spreadsheet skills and formula-driven reporting Experience working with AI/ML models in applied settings (preferred) Hands-on backend data transformations, version control, and automation Familiarity with full-stack development frameworks (bonus) Bonus / Nice to Have: Exposure to dbt, Airflow, ChromaDB, Streamlit, Plotly Knowledge of data privacy, compliance, and healthcare analytics Experience building analytics platforms for SaaS or health-tech companies Mindset We re Looking For: 10x Hustler: Ready to learn fast and go the extra mile to solve problems. Obsessed with Accuracy: Data must be flawless before release. Extreme Ownership: Proactive in driving results without waiting for instructions. Fast Learner: Able to pick up new tools and concepts quickly. Business First, Code Later: Focused on impact, not just coding. Be part of India s fastest-growing teleradiology platform Direct access to leadership and real-world business impact Build game-changing analytics systems and influence strategy Gain exposure to AI, automation, product, and operations in one role Clear ramp-up roadmap and growth plan Expectations in First 3 Months: Build an end-to-end dashboard from scratch Clean up at least one messy data pipeline Automate a stakeholder email update Validate accuracy across critical business metrics Understand full-stack platform structure and propose an improvement
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Intern, Analytics Engineer
Workato
Position: Intern, Analytics Engineer Location: Bangalore, India Duration: Minimum 6 months commitment About Workato Workato is a leader in enterprise orchestration, helping businesses worldwide connect data, processes, and applications through an AI-powered platform. Trusted by 400,000+ customers, Workato enables organizations to drive efficiency and agility in today s fast-changing landscape. Recognized by Business Insider, Forbes, Deloitte, and Quartz for its innovation and workplace culture, Workato fosters a flexible, trust-based environment. Opportunity to work in a vibrant, innovative culture that balances productivity and self-care. Be part of a fast-growing tech company ranked among the fastest-growing and best for remote work. Take ownership and collaborate with passionate teams driving meaningful business impact. Your Responsibilities Build efficient data models that support analysis and key metrics for internal stakeholders. Optimize analytical workflows with macros, scripts, and packages to improve productivity. Design and develop frontend analytics solutions reports, dashboards, and interfaces to drive data-informed decision making. Contribute to Data Governance initiatives by improving processes. Collaborate with business stakeholders to understand data challenges and develop actionable solutions. Support operational needs across various business units. What You ll Need Currently pursuing a degree in Business Analytics, Information Systems, or a related field. Strong understanding of database concepts (e.g., Entity-Relationship Diagrams). Intermediate SQL skills including joins, CTEs, and window functions. Experience with Business Intelligence tools such as Tableau, Power BI, or Sigma Computing. Experience or familiarity with ELT scripting and tools like Snowflake and dbt Cloud is a plus. Personal Traits Fast learner, adaptable, and comfortable in a fast-paced environment. Excellent organizational and multitasking abilities. Strong analytical skills with clear verbal and written communication to present insights effectively. Collaborative team player with a growth mindset and proactive attitude.
Ai Solutions Architect
Workato
Position: AI Solutions Architect Location: Bangalore, India Shift: 2 PM to 11 PM IST (supporting EMEA/US business hours) About Workato Workato is a global leader in enterprise orchestration, leveraging AI-powered automation to streamline complex workflows across data, processes, and applications. Recognized by Business Insider, Forbes, Deloitte, and Quartz, Workato fosters an innovative, flexible, and trust-driven culture, empowering employees to own their work and grow alongside a vibrant team. Join a fast-growing tech company celebrated for innovation and remote work culture. Collaborate in a diverse, inclusive environment focused on continuous improvement. Impact the future of AI-driven business automation on a global scale. Your Responsibilities Architect and develop advanced agent-based AI solutions exhibiting autonomous, adaptive, and proactive behaviors. Design techniques for large language models (LLMs) to author complex AI behaviors reliably. Provide technical expertise, advising clients and internal teams on AI workflows and integration. Tailor and deploy AI-powered IT workflows that are scalable, fault-tolerant, and aligned with enterprise best practices. Collaborate across teams to integrate AI automation into existing IT infrastructures. Deliver custom product demos and support sales and product teams. Contribute to internal knowledge bases and continuously improve processes. Support product ideation through to implementation stages, working closely with product managers. What You ll Need BTech/BE or higher in Computer Science, AI, ML, or related field. 12+ years of relevant experience in AI solution design, development, and deployment. Proven expertise in AI engineering focused on agent-based systems. Strong background in integration projects with hands-on experience in middleware, APIs (REST/SOAP), SOA, ESB, BPM, and databases (RDBMS/NoSQL). Coding experience (2-3 years) in Java, Python, or Ruby. Experience with integration platforms (TIBCO, Dell Boomi, MuleSoft) and cloud technologies (iPaaS, SaaS) is a plus. Familiarity with cloud business apps like Workday, NetSuite, Salesforce, ServiceNow, or Marketo is advantageous. Knowledge of microservices, event-driven architecture, process automation (BPM/RPA) is a plus. Personal Attributes Collaborative mindset and ability to thrive in a dynamic startup environment. Strong analytical and critical thinking skills with entrepreneurial initiative. Effective time management and prioritization, even under pressure. Excellent communication skills to convey complex ideas clearly to non-technical audiences. Proactive problem solver and fast learner who can conduct deep research independently. Qualification : BTech/BE or higher in Computer Science, AI, ML, or related field.
AI/ML Architect
Thoughtfocus
Job Title: AI/ML Architect Location: Bangalore, India Experience: 15 17 Years Employment Type: Full-Time Overview: We are seeking an experienced AI/ML Architect with 15 17 years of overall experience, including 2 3 years in project management. This strategic role requires deep expertise in AI/ML technologies, enterprise AI architecture, and hands-on delivery of cutting-edge solutions such as autonomous AI agents and generative AI platforms. The architect will lead the design, proposal, and execution of AI-driven solutions across diverse client engagements. Key Responsibilities: Solution Architecture & Design: Design and evolve robust AI/ML architectures incorporating autonomous agents, scalable business intelligence, and generative AI. Collaborate with cross-functional teams (data scientists, ML engineers, UX designers, and business strategists) to convert business needs into technical designs. Evaluate emerging technologies, frameworks, and trends to guide architectural roadmaps and innovation strategies. RFP Response & Proposal Development: Lead the technical response for RFPs, creating solution frameworks that align with client objectives and industry standards. Draft detailed technical proposals, use cases, and presentations to demonstrate the business value and ROI of AI solutions. Partner with sales and business teams to align proposals with market needs and positioning. Project Delivery & Technical Leadership: Oversee full AI/ML solution lifecycles from architecture design to deployment and monitoring ensuring compliance, quality, and performance. Provide hands-on guidance and mentorship to technical teams, promoting best practices in data science, ML model development, and deployment pipelines. Manage project schedules, resource planning, and risk mitigation for successful delivery outcomes. Stakeholder & Cross-Functional Collaboration: Act as the primary technical liaison across teams, ensuring stakeholder alignment on vision, progress, and technical challenges. Conduct technical workshops, reviews, and solution demos to showcase innovation and architectural decisions. Innovation & Continuous Improvement: Monitor industry trends, publications, and competitor offerings to integrate innovative features into AI/ML initiatives. Continuously refine and optimize existing platforms, ensuring scalability, performance, and user-centricity. Required Skills & Qualifications: 15 17 years of overall experience with 2 3 years in a leadership/project management role. Strong track record in AI/ML architecture, especially with autonomous agent systems, enterprise AI, and generative AI technologies. Proficient in modern AI/ML frameworks (TensorFlow, PyTorch, etc.), data pipelines, and cloud platforms (AWS, Azure, GCP). Experience designing and implementing end-to-end AI solutions in complex, data-driven environments. Demonstrated success in crafting technical proposals and responding to RFPs. In-depth knowledge of NLP, deep learning, traditional ML, and AI product integration. Effective project and stakeholder management skills; able to balance priorities across multiple projects. Excellent communication and presentation skills, with the ability to articulate AI value to technical and non-technical stakeholders.
Pipeline And Gtm Senior Data Analyst
Rubrik
Pipeline and GTM Senior Data Analyst Location: Bangalore, India About the Role Rubrik s Pipeline & GTM Strategy and Analytics team seeks a Senior Pipeline and GTM Data Analyst to ensure high-quality data for pipeline development, measurement, and operational efficiency. Reporting to the Senior Manager of Pipeline & GTM Strategy and Analytics, you will play a key role in pipeline analytics, dashboard creation, and providing operational support for the Sales Development Representative (SDR) team. Your analytical expertise will empower data-driven decisions to accelerate growth. Key Responsibilities SDR Operations Support: Support territory and quota planning to grow the Inside Sales organization and drive revenue. Analyze strategic funnel metrics and measure sales performance. Administer and optimize sales tools like Salesforce (SFDC), Outreach, ZoomInfo, LinkedIn Sales Navigator, and more. Enhance lead routing and customer-facing messaging processes. Collaborate with Sales, Marketing, and IT teams to improve lead qualification and pipeline growth. Use data-driven insights to improve Inside Sales functions, incorporating input from cross-functional teams such as Marketing and Finance. Analytics & Reporting: Build, prepare, and analyze reports to support pipeline analytics and special projects that drive pipeline growth (PG) attainment. Create and maintain real-time dashboards for actionable insights. Validate and ensure data quality for SDR and pipeline dashboards. Continuous Improvement & Innovation: Enhance data management processes for improved efficiency and accuracy. Stay current with industry best practices in data analytics and management. Implement new tools and techniques for better data preparation and validation. Cross-Functional Collaboration: Facilitate smooth communication between SDR Operations and Analytics teams. Provide accurate, timely data to all relevant teams for informed decision-making. Participate in team meetings, offering data-driven recommendations. Required Skills and Experience 5+ years in Sales Operations, Strategy, or a related analytical role. Bachelor s degree or equivalent practical experience. Strong communication skills (written and oral). Self-starter with the ability to work independently and collaborate across all business levels. Salesforce (SFDC) administration experience. Advanced proficiency in Microsoft Excel or Google Sheets, including complex modeling and robust analysis. Experience with Microsoft Office suite (Word, Excel, PowerPoint, Outlook). Skilled in data visualization tools such as Tableau, PowerBI, or similar. Comfortable managing and analyzing large datasets. Preferred: Experience with SQL and/or Python for data querying and automation. Rubrik (NYSE: RBRK) is on a mission to secure the world s data. With Zero Trust Data Security , we help organizations build resilience against cyberattacks, insider threats, and operational disruptions. Our AI-powered Rubrik Security Cloud protects data across enterprise, cloud, and SaaS applications, ensuring integrity, availability, and rapid business recovery.
Data Engineer
Colan Infotech
Data Engineer Experience: 5+ Years Location: Bangalore, Karnataka, India Job Type: Full Time Job Summary We are looking for a talented Data Engineer with over 5 years of experience and a strong foundation in machine learning development to join our team in Bangalore. The ideal candidate will have hands-on expertise in Python programming, machine learning basics, and computer vision techniques like custom object detection and OCR. Key Responsibilities Develop and maintain data pipelines supporting machine learning models and data analytics. Implement custom object detection algorithms and OCR solutions using computer vision techniques. Utilize Python ML libraries such as OpenCV, SciPy, NumPy, Matplotlib, Pandas, Scikit-learn, Keras, PyTorch, and TensorFlow. Collaborate with data scientists and software engineers to optimize data workflows and ML model deployment. Ensure data quality, integrity, and scalability within data infrastructure. Troubleshoot and improve existing machine learning systems and pipelines. Required Skills Minimum of 5 years of experience in data engineering or related roles. At least 2 years of hands-on experience as a Machine Learning developer. Strong programming skills in Python. Solid understanding of machine learning fundamentals. Practical experience with custom object detection and OCR applications. Proficiency in key Python libraries for machine learning and data processing. Ability to work collaboratively in cross-functional teams. Qualifications Any graduate degree from a recognized university. Work with cutting-edge machine learning technologies in a supportive, innovative environment in Bangalore. Grow your career by solving complex problems and building impactful data solutions with a passionate team. Qualification : Any graduate degree from a recognized university.
Data Science Manager
Mathco (themathcompany)
Job Title: Data Science Manager Location: Bengaluru, Karnataka, India Department: Data Science Experience: 6 8 Years Employment Type: Full-Time About CloudSEK CloudSEK is one of India s most trusted cybersecurity product companies, building world-class AI-driven platforms to detect and resolve digital threats in real-time. Our suite of products XVigil, BeVigil, and SVigil serve Fortune 500s and government bodies across the globe. Headquartered in Singapore and expanding rapidly across Asia, India, and the Americas, CloudSEK s mission is to create a safer digital ecosystem through contextual threat intelligence and proactive security. Role Overview: Data Science Manager (Marketing Mix Modeling) We are looking for a highly analytical Data Science Manager with specialized experience in Marketing Mix Modeling (MMM) to lead data-driven strategic initiatives. You will be responsible for delivering predictive models that evaluate the impact of marketing investments and optimizing ROI. The role involves direct engagement with cross-functional teams, including marketing, finance, and strategy, to influence key business decisions. Key Responsibilities Project Management & Delivery: Collaborate with Engagement Managers, Account Delivery Managers, and client stakeholders to define and refine business requirements. Develop detailed project plans that align with business goals and delivery timelines. Lead end-to-end execution of MMM projects, monitoring milestones, scope, and quality. Host internal scrum meetings and external Weekly Business Reviews (WBRs) with clients. Ensure all deliverables codes, dashboards, presentations meet quality standards and timelines. Report on delivery scorecard metrics and implement corrective action plans to improve performance. Data Science & Modeling: Design and develop Marketing Mix Models (MMM) to assess the effectiveness of marketing channels. Apply advanced techniques in predictive modeling, machine learning, and linear regression. Interpret model outputs to guide media planning, budget allocation, and strategic forecasting. Stay up-to-date with evolving methodologies and tools in data science and ML. Team Leadership & Coaching: Assign tasks based on team members strengths and monitor performance. Provide both business and technical mentorship, guiding team members through challenges. Build a high-performance, collaborative, and innovative delivery environment. Encourage experimentation and ownership within the team. Required Skills & Qualifications Technical Skills (Must-Have): Expertise in Marketing Mix Modeling (MMM) and predictive analytics. Advanced proficiency in machine learning, statistics, and data interpretation. Working knowledge of Python and SQL for data manipulation and model development. Intermediate experience with project management tools and methodologies (Agile/Scrum). Familiarity with MS Excel, PowerPoint, and data visualization tools. Soft Skills: Strong business acumen with the ability to translate insights into financial and strategic impact. Excellent communication skills for interacting with mid-level to senior stakeholders. Strong leadership and interpersonal skills: coaching, conflict resolution, and negotiation. Ability to balance perfection and pragmatism when delivering real-world solutions. Preferred Educational Background: Bachelor s degree in Engineering, Statistics, Mathematics, Computer Science, or a related technical field. Candidates with non-technical degrees must demonstrate strong technical aptitude through prior work experience. Impactful Work: Build models that influence multi-million-dollar marketing decisions. Collaborative Culture: Work alongside a high-energy, motivated, and diverse team. Growth Opportunities: Drive meaningful outcomes with room to experiment and lead. Work-Life Balance: Enjoy flexible working hours, a relaxed work environment, and plenty of snacks! Location: Work out of our energetic and innovation-driven Bengaluru office.
Engineering Manager- Data
Meesho
Engineering Manager Data Location: Bangalore, Karnataka | Department: Tech About the Team At Meesho, we power millions of orders daily with zero downtime thanks to our cutting-edge data and backend systems. Our engineering culture is built on speed, ownership, and a growth mindset. We embrace failures as learning opportunities and foster a 'Founder s Mindset' across all engineering teams. We're passionate technologists, team players, and storytellers just as comfortable building robust data platforms as we are bonding over books, games, or chai. If you're ready to lead a team building high-impact, real-time data systems that touch millions of users, come join us. About the Role We are seeking an experienced Engineering Manager Data to lead our data engineering initiatives. You ll be responsible for building scalable data platforms, managing distributed systems, and ensuring data accuracy, accessibility, and real-time analytics capabilities. This role combines technical depth, strategic thinking, and team leadership to build next-gen data systems powering Meesho s mission. What You Will Do Design and allocate technical tasks based on Meesho s data engineering standards and architecture. Lead and mentor a team of data engineers; conduct regular performance reviews and provide growth feedback. Oversee development of scalable, distributed data systems across streaming and batch pipelines. Collaborate with Product, Design, and Sales teams to create innovative data-driven products and features. Monitor project progress, drive sprint planning, and report on key metrics using OKRs. Promote engineering best practices, data quality standards, and cloud-native development. What You Will Need Bachelor s or Master s in Computer Science or a related field. 8+ years of overall experience, with 4+ years managing software/data engineering teams. Hands-on expertise in Java, Python, or Go and multithreading. Experience with distributed data systems, including Apache Spark, Kafka, and streaming architectures. Deep understanding of relational and NoSQL databases. Proficient in cloud platforms (preferably AWS) and containerized deployments. Experience in data modeling, pipeline architecture, and data quality frameworks. Familiarity with BI tools like Tableau, Metabase, or Superset. Good to have: Knowledge of Trino, Flink, Presto, Druid, Pinot, and real-time analytics platforms. Strong project and stakeholder management; ability to lead cross-functional teams. About Us Meesho is India s fastest-growing e-commerce platform on a mission to democratize internet commerce for every Indian. With 1.75M+ sellers and millions of active customers, we offer zero commission, the lowest shipping costs, and unparalleled reach across every serviceable pincode in India. We're building Meesho to be Meri Shop for the next billion users empowering small businesses and first-time entrepreneurs to sell and thrive online. Our Culture & Total Rewards Our culture is rooted in impact, innovation, and inclusivity. Guided by 11 core principles or "Mantras", we empower our teams to think big, move fast, and grow constantly. Daily rituals like Reflections and Listen or Die ensure everyone has a voice and a growth path. What We Offer: Competitive Compensation including salary, performance bonuses, and equity. Wellness & Insurance via our MeeCare program, with extensive coverage for employees and families, plus mental health and wellness initiatives. Work-Life Balance with flexible work hours, generous leave policies, and parental support. Learning & Development with courses, mentorship, and career mobility through our Internal Mobility Program. Perks & Benefits including salary advances, relocation support, recreational discounts, and employee gifts. Join us to lead the data transformation at Meesho and help shape the future of commerce for India s next billion users. Apply now to make your mark! Qualification : Bachelors or Masters in Computer Science or a related field.
Python/apache Airflow Developer
Wipro Limited
Python/Apache Airflow Developer Location: Bengaluru, India Company: Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) Company Overview Wipro Limited is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For more information, visit www.wipro.com. Role Purpose The purpose of this role is to design, test, and maintain software programs for operating systems or applications to be deployed at the client end and ensure they meet 100% quality assurance parameters. Position Overview We are seeking a skilled Python and Apache Airflow Developer with a strong background in data engineering to help develop and maintain robust data pipelines and support business intelligence initiatives. Key Responsibilities Develop and maintain data pipelines using Apache Airflow and Python. Collaborate with business managers to understand data requirements. Optimize existing data workflows for performance and reliability. Manage SQL and NoSQL databases for business intelligence. Ensure data quality and security. Troubleshoot data pipeline issues and ensure smooth data flow. Required Qualifications Proven experience in Python programming and data engineering. Hands-on experience with Apache Airflow. Strong understanding of SQL and experience with SQL databases. Familiarity with NoSQL databases. Experience in data modeling and ETL processes. Must have: Python and Apache Airflow, with preferably 5+ years of experience. About Wipro Wipro is constantly evolving, and we re looking for passionate individuals who want to build a modern digital transformation partner with bold ambitions. Join Wipro, where we empower you to design your own reinvention. Realize your ambitions and take part in our global, purpose-driven business. Applications from people with disabilities are explicitly welcome.
Data Engineer, Product Analytics
Meta Careers
Data Engineer, Product Analytics Location: Bangalore, India Full Time Company: Meta Meta is looking for an experienced Data Engineer to join our Product Analytics team. In this role, you will work on some of the most extensive data sets in the world, crafting experiences for billions of people and millions of businesses. Your technical expertise and analytical mindset will help shape data solutions across Meta to drive user experience optimization, growth, and strategy. You'll work alongside software engineers, data scientists, and product managers to tackle the most interesting data challenges at a scale few companies can match. Key Responsibilities: Conceptualize and own the data architecture for multiple large-scale projects, balancing design and operational cost-benefit tradeoffs. Design and contribute to frameworks that improve logging data efficacy, working with data infrastructure teams to resolve issues. Collaborate with engineers, product managers, and data scientists to understand data needs and represent insights meaningfully. Define and manage Service Level Agreements (SLAs) for all data sets in allocated areas of ownership. Implement and maintain security models based on privacy requirements and ensure safeguards are followed to ensure data quality. Design, build, and launch sophisticated data models and visualizations that support multiple use cases across various products. Address complex data integration challenges using optimal ETL patterns, frameworks, and techniques from structured and unstructured data sources. Optimize existing processes, pipelines, dashboards, and systems to enhance the development of data artifacts. Influence product and cross-functional teams to identify data opportunities that will drive impact. Mentor junior team members by providing constructive feedback and receiving feedback to grow as a team. Minimum Qualifications: Bachelor s degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience. 4+ years of experience in roles focused on data engineering, data analysis, or similar positions, working with SQL, ETL, data modeling, and programming languages (e.g., Python, C++, Scala). Experience with SQL, ETL processes, and data modeling, along with at least one programming language (e.g., Python, C++, C#, Scala). Preferred Qualifications: Master's or Ph.D. degree in a STEM field (Science, Technology, Engineering, Mathematics). About Meta: Meta builds technologies that help people connect, find communities, and grow businesses. Since launching Facebook in 2004, we have revolutionized how people connect. Our apps, including Messenger, Instagram, and WhatsApp, empower billions worldwide. Now, Meta is moving beyond 2D screens towards immersive experiences like augmented and virtual reality, building the next evolution in social technology. When you join Meta, you help shape the future of digital connection, taking us beyond screens, distance, and even the rules of physics. Equal Employment Opportunity: Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based on race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. Qualification : Bachelors degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience.
Data Engineer-dataiku/python
Infocepts
Data Engineer (Python/Dataiku/Spark/SAS DI) Location: Bangalore Type of Employment: Full-Time Experience Required: 3 to 5 years Job Overview: We are looking for a passionate Data Engineer with expertise in Python, Dataiku, Spark, or SAS DI to join our dynamic team. In this role, you will collaborate with clients to build data pipelines that support their Data and Analytics journey. As a member of our team, you will be responsible for driving data engineering initiatives, developing and implementing ETL solutions, and optimizing data workflows for efficiency and scalability. Key Responsibilities: Data Engineering Initiatives: Collaborate with clients to define and implement data engineering initiatives based on business needs. ETL Development: Design and develop data integration solutions using tools like Python, Dataiku, Spark, and SAS DI. Develop and maintain automated data pipelines for real-time and batch data ingestions. Performance Tuning: Conduct performance tuning and optimize queries and data models to enhance performance and scalability. Database Design: Design and implement database objects such as tables, views, schemas, and stored procedures. Ensure data quality and consistency across the data warehouse. Collaboration: Work closely with cross-functional teams to translate business requirements into technical solutions and communicate effectively with clients across multiple regions. Troubleshooting: Troubleshoot and resolve data-related issues while ensuring the quality and integrity of the data. Project & Technical Leadership: Act as the technical lead or single point of contact (SPOC) for the client and internal teams, ensuring smooth project delivery. Essential Skills: Data Engineering Tools: Experience with Python, Dataiku, Spark, and SAS DI. SQL Proficiency: Strong SQL experience for extracting data from various databases and performing data analysis. ETL Development: Expertise in designing and developing ETL processes to integrate data from diverse sources into a data mart layer. Data Modeling: Understanding of data modeling concepts, including relational and dimensional modeling. BI Knowledge: Basic understanding of Business Intelligence (BI) tools and analytics needs. Communication Skills: Excellent communication skills to understand business requirements and translate them into technical solutions. Desirable Skills: Data Analysis: Strong analytical skills to perform data analysis, especially for banking products data. BI Tools: Experience with MicroStrategy or Power BI for reporting and dashboarding. Qualifications: 3+ years of experience designing and developing scalable data integration solutions. Familiarity with data analytics and reporting needs. Technical certifications that align with your continuous learning aspirations. Qualities: Strong problem-solving skills with a systematic approach to resolving issues. Ability to influence and implement change confidently. Excellent team player who works effectively in cross-functional teams. Strong communication and presentation skills, capable of interacting with clients and presenting ideas persuasively. Fluent in English, both written and spoken, for effective communication. Opportunity to work with cutting-edge data engineering tools and technologies. Be a key player in building and optimizing data pipelines for clients data and analytics needs. Competitive salary, benefits, and a dynamic, innovative work culture.
Sr. Data Engineer- Aws- Big Data
Infocepts
Sr. Data Engineer - AWS - Big Data Location:Bangalore Type of Employment: Full-Time Experience Required: 7 to 10 years Job Overview: We are seeking a highly skilled Sr. Data Engineer with expertise in AWS cloud technologies and Big Data to join our Cloud Data Architect Team at Infocepts. In this critical role, you will design and implement robust data solutions using technologies like EMR, Athena, PySpark, AWS Lambda, S3, and other AWS services. The ideal candidate will have a strong foundation in database concepts and SQL and will be responsible for building scalable data pipelines to support high-performance data processing. Key Responsibilities: Technology Assessment and Design: Study the existing technology landscape and evaluate current data integration frameworks. Assist in designing complex Big Data use cases leveraging AWS services. Documentation and Stakeholder Communication: Prepare and maintain comprehensive project documentation, adhering to quality guidelines and schedules. Work closely with Architects and Project Managers to provide accurate estimations, scoping, and scheduling assistance. Clearly communicate design decisions and conduct Proof-of-Concepts to validate new solutions before implementation. Process Improvement and Automation: Identify areas for process automation to improve efficiency and team productivity. Provide expert guidance and troubleshooting support to junior Data Engineers. Training and Knowledge Sharing: Develop and deliver technology-focused training sessions for the team, ensuring continuous knowledge sharing. Share expertise through Expert Knowledge Sharing sessions with Client Stakeholders. Essential Skills: AWS Services Expertise: In-depth knowledge of S3, EC2, EMR, Athena, AWS Glue, and Lambda. Big Data Technologies: Proficiency with Apache Spark, Databricks, and Big Data table formats such as Delta Lake (open-source). Data Warehousing: Strong understanding of data warehousing concepts and architectures. Programming Skills: Advanced programming skills in Python for building data pipelines. SQL Expertise: Strong SQL skills for data transformation, aggregation, and querying large datasets. ETL Workflow Development: Expertise in creating ETL workflows with complex transformations (e.g., SCD, deduplication, aggregation). Orchestration Tools: Familiarity with orchestration tools like Apache Airflow. MPP Databases: Experience with at least one MPP database (e.g., AWS Redshift, Snowflake, SingleStore). Cloud Databases: Exposure to cloud databases like Snowflake or AWS Aurora. Desirable Skills: Cloud Databases: Familiarity with Snowflake, AWS Aurora. Big Data Technologies: Experience with Hadoop and Hive. AWS Certification: Associate or Professional Level AWS Certification. Advanced Knowledge of Big Data Solutions: Exposure to big data tools and frameworks on cloud platforms. Qualifications: Experience: 7+ years of overall IT experience, with 5+ years specifically focused on AWS-related projects. Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus). Technical Certifications: Demonstrated commitment to continuous learning through certifications or relevant training. Qualities: Strong analytical and problem-solving skills to deep dive into complex technical challenges.
Data Integration Developer- Talend
Infocepts
Position: Data Integration Developer Talend Location: Bangalore Employment Type: Full-time Experience Required: 4 to 7 years Overview: We are seeking a Data Integration Developer with strong expertise in Talend to join our growing data engineering team. This role is ideal for professionals who are passionate about designing and building robust, scalable ETL/ELT pipelines and integrating enterprise data across cloud and on-premise platforms. You will work closely with data architects, business analysts, and reporting teams to support data transformation, integration, and analytics efforts. Key Responsibilities: ETL/ELT Solutions Development: Design, develop, and deploy scalable ETL/ELT processes using Talend Data Integration (on-prem and cloud). Data Transformation & Integration: Implement data transformation using stored procedures and other data processing techniques. Report Development Support: Collaborate with reporting teams to support dashboard/report creation using tools like MicroStrategy and Power BI. Documentation & Data Governance: Create detailed pipeline documentation, configurations, and data workflows. Performance Optimization: Monitor pipeline performance, identify bottlenecks, and troubleshoot data integration issues. Essential Skills: Hands-on experience with Talend Suite (Talend Data Integration, Talend Cloud) Experience with Snowflake and writing Stored Procedures Knowledge of ETL/ELT design, data warehousing, and data modeling Familiarity with JSON, XML, CSV data formats Experience with data quality frameworks and job monitoring/scheduling tools Proficiency in Agile methodology and tools like JIRA Desirable Skills: Experience with reporting tools such as MicroStrategy and Power BI Skills in scripting languages: Python, Java, or Shell Understanding of cloud platforms (AWS, GCP, Azure) and related data services Qualifications: Bachelor s or Master s degree in Computer Science, Engineering, or a related field Minimum of 3+ years of Talend development experience Qualities We Value: Strong verbal and written communication skills Experience in Agile and cross-functional team environments Problem-solving mindset and ability to work under minimal supervision Quick learner with a passion for data and process improvement Work with modern cloud data integration and enterprise tools Collaborate with global clients and expert teams Be part of cutting-edge data platform transformation initiatives Apply today and be part of our mission to deliver next-gen, data-driven insights. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field
Cloud Data Engineer - AWS Big Data
Infocepts
Position: Cloud Data Engineer AWS Big Data Location: Bangalore, India Employment Type: Full-time Experience Required: 5 to 8 years Purpose of the Position: Join the Infocepts Cloud Data Architect Team as a Cloud Data Engineer and help design and implement cutting-edge big data solutions on AWS. You will leverage your expertise in EMR, Athena, PySpark, S3, AWS Lambda, and SQL to develop robust and scalable data platforms. Key Responsibilities: Technology Assessment and Design: Assess existing technology landscape and data integration frameworks. Design complex Big Data use cases using AWS services under guidance of the Architect. Support architectural decision-making by evaluating trade-offs in cost, performance, and durability. Recommend optimizations to existing data infrastructure. Documentation and Stakeholder Communication: Create project documentation adhering to quality and delivery standards. Collaborate closely with Architects and Project Managers for scoping, estimation, and planning. Present design decisions to technical and business stakeholders clearly. Conduct PoCs and design review sessions. Process Improvement and Automation: Identify and suggest opportunities for automation and process enhancements. Mentor junior engineers and support technical problem solving. Training and Knowledge Sharing: Prepare and deliver internal training on AWS and Big Data topics. Lead client knowledge sharing sessions and contribute to case studies. Essential Skills: In-depth experience with AWS services: S3, EC2, EMR, Athena, Glue, Lambda Familiarity with MPP databases like Redshift, Snowflake, or SingleStore Proficiency in Apache Spark and Databricks Strong programming skills in Python Experience building data pipelines using AWS and Databricks Knowledge of Big Data file formats such as Delta Lake Advanced SQL skills for large-scale data manipulation Hands-on experience with Apache Airflow or similar orchestration tools Strong understanding of ETL workflows and data warehousing concepts Desirable Skills: Cloud databases: AWS Aurora, Snowflake Experience with Hadoop and Hive AWS Certifications (Associate or Professional level) are a plus Qualifications: Bachelor s degree in Computer Science, Engineering, or related field (Master s preferred) Overall 5+ years of IT experience with at least 3 years in AWS Big Data projects Ongoing learning and technical certifications are strongly encouraged Key Qualities: Strong problem-solving and analytical thinking Self-driven with a passion for emerging data technologies Excellent communication and client presentation skills Ability to work in cross-functional, agile teams Apply now to be part of a high-impact data transformation team working on large-scale cloud data projects! Qualification : Bachelors degree in Computer Science, Engineering, or related field (Masters preferred)
Talend Data Engineer
Infocepts
Position: Talend Data Engineer Location: Bangalore, India Employment Type: Full-time Experience Required: 4 to 9 years Purpose of the Position: As a Talend Data Engineer, you will be responsible for designing, developing, and managing scalable ETL/ELT data pipelines both on-premise and in the cloud. You will work with technologies such as Talend Suite, Snowflake, and reporting tools to support high-impact data integration and business intelligence initiatives. Key Responsibilities: ETL/ELT Development: Design, develop, and deploy ETL/ELT workflows using Talend Data Integration and Talend Cloud. Data Transformation: Apply stored procedures for accurate and structured data processing. Reporting: Build reports using MicroStrategy and Power BI to support decision-making. Documentation: Maintain detailed documentation for pipelines, configurations, and processes to ensure data integrity and quality. Performance Monitoring: Monitor and optimize data pipelines, resolving data-related issues swiftly. Essential Skills: Hands-on experience with Talend Suite (Talend Data Integration, Talend Cloud). Strong skills in Snowflake and writing Stored Procedures. Expertise in ETL/ELT processes, data warehousing, and data modeling. Familiarity with data quality frameworks and job scheduling tools. Proficient in handling data formats like JSON, XML, CSV, and Parquet. Knowledge of Agile methodologies and tools such as JIRA. Desirable Skills: Experience with BI tools like MicroStrategy and Power BI. Proficiency in scripting languages such as Python, Java, or Shell scripting. Familiarity with cloud platforms (AWS, Google Cloud, Azure) and cloud-based data services. Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or related field. 6+ years of relevant experience with Talend and data engineering projects. Key Qualities: Strong consulting, writing, and presentation skills. Self-organized and collaborative in cross-functional teams. Open to feedback and iterative improvement. Effective communicator with clients across geographies. Analytical mindset with a research-oriented approach. Apply now and become part of a high-performing team delivering scalable data solutions across industries! Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or related field.
Data Engineer - Snowflake And Dbt
Infocepts
Position: Data Integration Developer (Snowflake & DBT) Location: Bangalore Employment Type: Full-time Experience Required: 5 to 7 years Purpose of the Position: This role seeks candidates who are passionate about data and motivated to address the organization's analytics challenges. As a Data Integration Developer (Snowflake & DBT), you will play a crucial role in assisting our clients with their data and analytics journey. Your responsibilities will include building robust data pipelines, enhancing data consistency, and developing the necessary infrastructure to support analytics platforms. Key Responsibilities: Technical Expertise: Develop and optimize ETL processes using Snowflake capabilities. Build and maintain advanced data models and ETL processes using DBT (Data Build Tool). Ensure efficient data transformation and integration within the data warehouse. Collaboration: Work closely with data analysts, engineers, and stakeholders to understand business requirements and translate them into technical solutions. Facilitate effective communication and collaboration across teams. Quality Assurance: Implement and oversee data quality checks and testing procedures. Ensure data accuracy, consistency, and compliance with governance policies. Documentation and Reporting: Create and maintain comprehensive documentation for ETL processes and project workflows. Provide regular updates and reports on project progress and performance metrics. Compliance and Security: Ensure all data engineering activities comply with data governance and security policies. Implement measures to protect data integrity and confidentiality. Essential Skills: Proficient in SQL: Skilled in writing efficient queries on large datasets, including CTE and database table design. Snowflake Expertise: Experience with Snowflake or other database technologies, including SQL tuning. ETL Development: Skilled in developing and optimizing ETL processes using Snowflake and other tools. DBT Experience: Familiar with DBT Core/DBT Cloud and fundamental data modeling concepts (3NF, Star, Snowflake). Data Analysis and Profiling: Experienced in data analysis and profiling tasks. Qualifications: Overall Work Experience: More than 5 years of experience, with at least 2-3 years of experience in Snowflake and DBT. Education: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus). Key Qualities: Decision Making: Ability to influence and implement change with confidence and sound decisions. Problem-Solving: Tackles problems head-on with a logical, systematic, and practical approach; follows up with developers. Communication: Ability to consult, write, and present persuasively. Team Collaboration: Works effectively in self-organized, cross-functional teams. Apply now and become an integral part of our innovative team working on cutting-edge data integration solutions! Qualification : Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus).
Data Engineer: Data Warehouse
International Business Machines Corporation
Job Title: Application Developer - ETL and Data Management Introduction: In this role, you ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we provide deep technical and industry expertise to a wide range of public and private sector clients globally. Our delivery centers leverage locally-based skills to help clients drive innovation and the adoption of new technologies. A career in IBM Consulting is built on long-term relationships and close collaboration with clients across the world. You will work with leaders across industries to improve the hybrid cloud and AI journeys for some of the most innovative and valuable companies worldwide. Your ability to make a meaningful impact for clients is enabled by our strategic partner ecosystem and robust technology platforms, including Software and Red Hat. Curiosity and a constant quest for knowledge are key to success in IBM Consulting. In your role, you ll be encouraged to challenge the norm, explore new ideas, and come up with creative solutions that result in groundbreaking impact for a wide network of clients. Our culture is built on evolution and empathy, focusing on long-term career growth and development in an environment that values your unique skills and experience. Your Role and Responsibilities: ETL Workflow Development: Develop and implement ETL workflows by creating ETL jobs, and data models in datamarts using technologies such as Snowflake, DBT, Unix, and SQL. Batch Processing Redesign: Redesign Control M Batch processing for ETL job builds to run efficiently in a production environment. System Evaluation and Improvement: Study the existing system to evaluate its effectiveness and design new systems to improve workflow efficiency. Business Program Analysis & Support: Perform requirements identification, business program analysis, testing, and system enhancements while providing production support. Agile Environment: Work effectively in an Agile environment and gain familiarity with tools such as JIRA and SharePoint. Client Interaction: Good written and verbal communication skills are essential as you will interact directly with client counterparts to understand requirements and provide solutions. Required Technical and Professional Expertise: Experience: A minimum of 3 years of experience in developing ETL applications, implementing workflows, and creating data models using Snowflake, DBT, Unix, and SQL technologies. Agile Environment: Strong understanding of working in an Agile environment and proficiency in tools like JIRA and SharePoint. Problem-Solving Skills: Ability to manage change and proven time management skills. Strong interpersonal skills to contribute effectively to team efforts. Continuous Learning: Stay up-to-date with technical knowledge by attending educational workshops and reviewing relevant publications. Preferred Technical and Professional Expertise: ETL Development: Experience in developing triggers, functions, and stored procedures to support ETL workflows. Impact Analysis: Assist with impact analysis of changing upstream processes on the Data Warehouse and reporting systems. ETL & Reporting Support: Participate in the design, testing, support, and debugging of new and existing ETL and reporting processes. Data Profiling & Troubleshooting: Perform data profiling and analysis using a variety of tools, troubleshoot and support production processes, and maintain documentation. Innovation: Be part of a team that drives global change and leverages cutting-edge technologies to solve complex problems. Growth: Gain access to continuous learning and career development opportunities to further your expertise in data management and cloud technologies. Collaboration: Work with a diverse team in a collaborative environment that values new ideas and creative solutions. Global Impact: Your work will contribute to improving business operations and technological advancements for clients around the world. If you're passionate about driving innovative solutions, working with a variety of clients, and continuously evolving your skills, IBM Consulting is the perfect place for you to advance your career.
Data Engineer
Indium Software
Data Engineer Role Overview We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs. This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows. Key Responsibilities Data Pipeline Development & Optimization Design and build scalable ETL/ELT processes for structured and unstructured data. Develop and maintain data ingestion frameworks to handle large datasets efficiently. Ensure data integrity, consistency, and security across multiple sources. Database & Data Warehouse Management Develop, optimize, and maintain relational and NoSQL databases. Implement data modeling best practices for performance and scalability. Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery). Big Data & Cloud Technologies Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing. Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions. Develop real-time and batch processing workflows. Collaboration & Documentation Work closely with data scientists, engineers, and business teams to understand data requirements. Document data pipelines, architecture, and workflows for scalability and maintenance. Required Qualifications & Skills Technical Expertise: Strong experience with SQL and Python for data processing. Proficiency in ETL/ELT frameworks and data integration techniques. Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka). Cloud & Database Management: Expertise in cloud data platforms (Azure, AWS, GCP). Experience with data warehousing solutions (Snowflake, Redshift, BigQuery). Understanding of data governance, security, and compliance. Performance Optimization & Troubleshooting: Ability to optimize SQL queries and improve data processing efficiency. Experience troubleshooting complex data pipeline issues. Apply Now & Be Part of an Innovative Data Team!
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted