Cloud Data Jobs in Bengaluru
1409 Jobs Found
Data Engineer
Capital One
Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field
Product Manager Data Warehouse & Business Intelligence
Mahindra First Choice
Product Manager Data Warehouse & Business Intelligence Location: Bangalore Company: Mahindra First Choice About Mahindra First Choice Mahindra First Choice is a pioneer in India s multi-brand used car segment. With a strong focus on innovation, data-driven decision-making, and cutting-edge technology, we are transforming the automotive ecosystem and delivering seamless customer experiences. Our commitment to excellence fuels our drive to create scalable, impactful solutions across the value chain. Role Overview We are looking for a strategic and technically strong Product Manager to lead our Data Warehouse and Business Intelligence (BI) initiatives. Based in Bangalore, this role will own the vision, development, and optimization of enterprise-wide data products. You will play a critical role in enabling data-led decisions, working closely with engineering, analytics, and business teams to drive measurable outcomes. Key Responsibilities 1. Product Strategy & Roadmap Define the vision, strategy, and long-term roadmap for Data Warehouse and BI products. Align product goals with overall business strategy through collaboration with senior leadership. Stay abreast of emerging technologies and industry trends to drive innovation in data architecture and analytics. 2. Development & Execution Partner with engineering, data science, and analytics teams to build scalable, high-performance data platforms. Prioritize product features and enhancements based on impact, feasibility, and business value. Lead cross-functional teams to ensure timely and efficient delivery of data solutions. 3. Business Intelligence & Analytics Oversee the development of interactive BI dashboards, reports, and self-service tools to empower business users. Collaborate with business stakeholders to identify critical metrics and create meaningful data visualizations. Champion data quality, consistency, governance, and accessibility across all platforms. 4. Stakeholder Management Serve as the single point of contact for data needs across Sales, Marketing, Operations, Finance, and other departments. Communicate roadmaps, progress updates, and outcomes clearly and effectively to stakeholders at all levels. Gather continuous feedback to refine products and enhance user experience. 5. Performance Monitoring & Optimization Define and track KPIs to assess product adoption, usage, and business impact. Analyze system performance and user engagement to identify areas for improvement. Drive initiatives to increase data platform efficiency and reliability. Qualifications & Skills Required Bachelor s degree in Computer Science, Engineering, Business, or a related field (Master s preferred). 7+ years of experience in product management, specifically in data warehousing, business intelligence, or analytics. Deep understanding of data architecture, ETL processes, and data modeling. Hands-on experience with BI tools like Tableau, Power BI, or Looker. Strong SQL skills and familiarity with cloud platforms (AWS, Azure, GCP). Proven track record of managing complex, cross-functional data projects in fast-paced environments. Ability to translate business needs into scalable, data-driven solutions. Preferred Experience in automotive, mobility, or e-commerce domains. Familiarity with machine learning concepts and advanced analytics techniques. Soft Skills Strong communication, presentation, and stakeholder engagement skills. Analytical mindset with a focus on delivering business value through data. Effective leadership and cross-functional collaboration. High attention to detail and ability to manage multiple priorities. At Mahindra First Choice, you ll join a fast-growing, innovation-led organization at the forefront of transforming the used car market in India. This is a unique opportunity to shape our data landscape and make a real impact on business outcomes. If you're passionate about unlocking the power of data, we d love to meet you. Qualification : Bachelors degree in Computer Science, Engineering, Business, or a related field (Masters preferred)
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Senior Developer SQL & Snowflake
Thoughtfocus
Job Title: Senior Developer SQL & Snowflake Location: Bangalore, India Experience: 7+ Years (Minimum 3+ years in Snowflake) Employment Type: Full-Time Job Overview: We are seeking a highly skilled Senior Snowflake Developer to join a global financial services project for a client operating in public/private loans, CLOs, and long/short credit. The ideal candidate will bring expertise in Snowflake, SQL, Coalesce, and Fivetran, with a strong background in data integration and cloud-based data warehousing. You will be instrumental in driving forward key data initiatives and delivering innovative, scalable data solutions in a fast-paced, agile environment. Key Responsibilities: Design, develop, and optimize Snowflake objects including databases, schemas, tables, views, and stored procedures. Build and maintain Snowflake data pipelines utilizing tools like SnowSQL, SnowPipe, Streams, and Tasks. Implement data loading strategies using COPY, PUT, GET, LIST, and REMOVE commands for batch and bulk data movement. Ensure seamless migration and integration of data from Azure Cloud to Snowflake with high attention to performance and data integrity. Define and manage Snowflake roles, custom role hierarchies, masking policies, and network policies for enhanced security and governance. Use Coalesce and Fivetran for designing and managing ETL/ELT workflows that extract and transform data from MS SQL Server. Write complex T-SQL queries, stored procedures, triggers, and functions for data transformation and reporting. Collaborate closely with cross-functional teams to understand requirements and translate them into technical solutions. Participate in Agile sprints, offering technical guidance, solution design, and timely issue resolution. Required Skills & Qualifications: 8+ years of total IT experience with at least 3+ years of Snowflake development experience. In-depth understanding of Snowflake architecture, utilities, and performance optimization techniques. Strong expertise in MS SQL Server with proficiency in writing advanced T-SQL scripts. Hands-on experience with ETL tools like Coalesce and Fivetran. Proficiency in Azure Data Integration strategies and tools. Excellent problem-solving and communication skills. Experience working in an Agile development environment. Preferred Skills: Prior exposure or high-level understanding of hedge funds, private equity, or private debt domains. Familiarity with data governance and compliance requirements in financial institutions. What s on Offer: Competitive and above-market salary. Hybrid work model with flexibility. Opportunity to work on cutting-edge technology in global financial markets. Collaborative, innovation-driven team culture. Education: Bachelor s degree in Computer Science, Information Technology, Finance, Economics, or a related discipline.
Data Architect
Camsdata Technologies India Pvt. Ltd.
Data Architect Bangalore, India Location: Bangalore (Bengaluru) Experience: 10 to 15 Years Industry: IT & Data Systems Job Summary: We are seeking an experienced Data Architect with a strong background in designing and implementing enterprise-scale data solutions. The ideal candidate will have expertise in building data lakes, warehouses, and pipelines, with deep knowledge of cloud platforms, data management, and industry best practices. Key Responsibilities: Design, develop, and maintain complex data architectures including data lakes, data warehouses, data marts, and efficient schema design Build and optimize scalable data pipelines for extraction, transformation, and loading (ETL/ELT) processes Apply Agile methodologies in project delivery and collaborate within cross-functional teams Perform data profiling, cleansing, conversion, and ensure high-quality data management for both structured and unstructured data Implement CI/CD and Infrastructure as Code (IaC) practices using tools like GitHub, Jenkins, CloudFormation, and Azure Resource Manager Manage database systems and tools such as PostgreSQL, Oracle, Snowflake, Teradata, MongoDB, Hadoop, and others Utilize data modeling tools like Erwin, Power Designer, and Toad for effective data architecture design Leverage cloud platforms including AWS and Microsoft Azure, with hands-on experience in services like AWS Glue, DMS, Lambda, Azure Data Factory, Synapse, and Data Lake Storage Work with programming and scripting languages including SQL, PL/SQL, Python, Spark, YAML, and JSON Use containerization and automation tools such as Docker, Ansible, and NodeJS for efficient deployment Ensure compliance with cybersecurity principles and frameworks such as NIST Lead data governance initiatives and enforce best practices in data quality and security Preferred Qualifications: ITIL certification and experience with Agile methodology Knowledge of code review and version control best practices, especially in GitHub Familiarity with data science tools and AI/ML frameworks like R, Keras, or TensorFlow Experience with natural language processing (NLP) and machine learning concepts Background in regulated industries, with pharma manufacturing experience highly preferred Exposure to multi-site, global IT projects and manufacturing operations Lead innovative data architecture projects within a dynamic and fast-paced environment Work with cutting-edge cloud technologies and big data ecosystems Collaborate with global teams on impactful enterprise solutions Access to professional growth opportunities in data governance, AI, and cloud technologies
Director - Data Management
Maxval Group
Director Data Management (Data Migration & Automation) Location: Bangalore, India About MaxVal Founded in 2004, MaxVal is a pioneer in IP services focused on efficiency, cost-effectiveness, and continuous improvement driven by metrics-based processes. Our technology-driven IP solutions serve over 600 clients globally. With a talented team of 725+ IP and tech experts, MaxVal continuously innovates to deliver exceptional customer and employee success. Job Summary MaxVal is looking for an experienced and visionary Director of Data Migration and Automation to lead our data migration initiatives. You will oversee migrating data from various IP solutions to our software platform, ensuring accuracy, integrity, and efficiency through automation. This leadership role requires strategic thinking, strong domain expertise in Intellectual Property, and the ability to inspire and guide a team of specialists. Key Responsibilities Team Leadership & Management Lead, mentor, and empower a team of Data Migration specialists, ensuring resources and guidance for successful project delivery. Cultivate a collaborative, client-centric culture within the team. Data Mapping & Transformation Design comprehensive data mapping and transformation plans aligning external IP data with MaxVal s platform. Maintain data integrity and consistency throughout migration. Competitor Data Analysis Analyze competitor IP data structures and models to inform effective migration strategies. Automation System Development Architect and develop automation solutions to streamline migration workflows, including data mapping and transformation. Create processes and scripts to automate repetitive tasks and enhance efficiency. IP Domain Expertise Utilize deep knowledge of IP data types (patents, trademarks, copyrights, legal entities). Collaborate with legal experts to ensure precise migration of IP information. Technical Integration & Customization Partner with technical teams to embed automation into migration workflows. Customize automation tools to accommodate unique IP and legacy system requirements. Quality Assurance & Testing Define QA protocols specific to IP data migration. Conduct thorough testing to validate data accuracy and completeness. Stakeholder Engagement Interface with clients to understand migration needs and challenges. Offer expert recommendations to achieve successful migration aligned with client goals. Continuous Learning & Innovation Stay abreast of industry trends, best practices, and emerging technologies in data migration and automation. Drive continuous improvements in automation and migration efficiency. Cross-Functional Collaboration Work closely with product, engineering, and client-facing teams to ensure migration success and contribute to product enhancements. Documentation & Knowledge Sharing Maintain detailed documentation of migration processes and automation workflows. Lead workshops and training to disseminate best practices internally and to clients. Requirements Experience: 15+ years leading data migration projects in software implementations. 10+ years in leadership roles managing and mentoring teams. Expertise: Strong knowledge of data migration methodologies, tools, and best practices. Familiarity with automation tools, database management, and data integration platforms. Deep understanding of the Intellectual Property domain is highly preferred. Skills: Strategic leadership with excellent communication and stakeholder management skills. Ability to drive innovation and build scalable automation solutions.
Data Engineer
Colan Infotech
Data Engineer Experience: 5+ Years Location: Bangalore, Karnataka, India Job Type: Full Time Job Summary We are looking for a talented Data Engineer with over 5 years of experience and a strong foundation in machine learning development to join our team in Bangalore. The ideal candidate will have hands-on expertise in Python programming, machine learning basics, and computer vision techniques like custom object detection and OCR. Key Responsibilities Develop and maintain data pipelines supporting machine learning models and data analytics. Implement custom object detection algorithms and OCR solutions using computer vision techniques. Utilize Python ML libraries such as OpenCV, SciPy, NumPy, Matplotlib, Pandas, Scikit-learn, Keras, PyTorch, and TensorFlow. Collaborate with data scientists and software engineers to optimize data workflows and ML model deployment. Ensure data quality, integrity, and scalability within data infrastructure. Troubleshoot and improve existing machine learning systems and pipelines. Required Skills Minimum of 5 years of experience in data engineering or related roles. At least 2 years of hands-on experience as a Machine Learning developer. Strong programming skills in Python. Solid understanding of machine learning fundamentals. Practical experience with custom object detection and OCR applications. Proficiency in key Python libraries for machine learning and data processing. Ability to work collaboratively in cross-functional teams. Qualifications Any graduate degree from a recognized university. Work with cutting-edge machine learning technologies in a supportive, innovative environment in Bangalore. Grow your career by solving complex problems and building impactful data solutions with a passionate team. Qualification : Any graduate degree from a recognized university.
Senior Data Engineer
Neuron7.ai
Senior Data Engineer Location: Bengaluru, India Employment Type: Full-time, On-site About Neuron7.ai Neuron7.ai is a rapidly growing AI-first SaaS company that is revolutionizing the world of service intelligence. Backed by leading Silicon Valley venture capitalists and a distinguished group of angel investors, we are recognized as a startup to watch. Our AI-driven platform delivers service predictions in seconds by analyzing structured and unstructured data, alongside insights from top experts. We specialize in complex service environments like high-tech devices, manufacturing, and medical devices, empowering service leaders to optimize key metrics like first-call resolution, turnaround time, and service margins. At Neuron7.ai, you will be part of a dynamic, innovative team that is pushing the boundaries of service intelligence. We value creativity, collaboration, and a relentless commitment to innovation. This is your chance to join a fast-growing startup and help redefine how AI impacts the future of service optimization. About the Role We are building a real-time analytics platform to improve uptime of connected devices and minimize maintenance costs. This involves collecting, analyzing, and leveraging large volumes of sensor data for observability and predictive analytics. As a Senior Data Engineer, you will have the opportunity to build and maintain scalable, high-performance data systems using modern data engineering tools. The ideal candidate will have hands-on experience with Python, Scala, ELT processes, Lakehouse architecture, Apache Spark, Databricks, real-time streaming systems like Kafka and Flink, and observability tools such as the ELK stack, Prometheus, and Grafana. What You ll Do: Data Model Development: Design and implement advanced data models to extract insights from complex datasets. Collaborative Problem Solving: Work with cross-functional teams to devise data-driven solutions for service optimization. Experimental Analysis: Conduct experiments and analyses to enhance service predictions and outcomes. Actionable Insights: Present findings and actionable recommendations to stakeholders, translating complex data insights into clear, understandable concepts. Mentorship: Guide and mentor junior team members, fostering a collaborative and knowledge-sharing environment. What We re Looking For: Experience: At least 4 years of hands-on experience in data engineering, with a focus on building large-scale data systems. Data Pipeline Expertise: Strong proficiency in Python and Scala for developing data pipelines. Big Data Tools: Proven experience with Apache Spark and Databricks for big data processing and analytics. Observability Tools: Hands-on experience with observability tools like Prometheus, Grafana, and the ELK stack or OpenSearch. Real-Time Data Streaming: Experience working with real-time streaming systems such as Kafka and Flink. Cloud Platforms: Familiarity with cloud platforms like Azure, GCP, or AWS. Problem-Solving Skills: Strong analytical and problem-solving abilities to work with complex data systems in fast-paced environments. Collaboration: Excellent communication and teamwork skills, with the ability to work effectively with cross-functional teams. What We Do and Value: At Neuron7.ai, we prioritize integrity, innovation, and a customer-centric approach. Our mission is to leverage advanced AI technology to enhance service decision-making and we are dedicated to delivering excellence in all aspects of our work. Company Perks & Benefits: Competitive salary, equity, and spot bonuses Paid sick leave Latest MacBook Pro for your work Comprehensive health insurance Paid parental leave Flexible work arrangements work from home or from our vibrant Bengaluru office Our Commitment to Diversity and Inclusion: Neuron7.ai is committed to fostering a diverse and inclusive workplace. We ensure equal employment opportunities without discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, marital status, or any other characteristic protected by law. If you re passionate about using data to drive service intelligence and want to be part of a forward-thinking team, we d love to hear from you!
Engineering Manager- Data
Meesho
Engineering Manager Data Location: Bangalore, Karnataka | Department: Tech About the Team At Meesho, we power millions of orders daily with zero downtime thanks to our cutting-edge data and backend systems. Our engineering culture is built on speed, ownership, and a growth mindset. We embrace failures as learning opportunities and foster a 'Founder s Mindset' across all engineering teams. We're passionate technologists, team players, and storytellers just as comfortable building robust data platforms as we are bonding over books, games, or chai. If you're ready to lead a team building high-impact, real-time data systems that touch millions of users, come join us. About the Role We are seeking an experienced Engineering Manager Data to lead our data engineering initiatives. You ll be responsible for building scalable data platforms, managing distributed systems, and ensuring data accuracy, accessibility, and real-time analytics capabilities. This role combines technical depth, strategic thinking, and team leadership to build next-gen data systems powering Meesho s mission. What You Will Do Design and allocate technical tasks based on Meesho s data engineering standards and architecture. Lead and mentor a team of data engineers; conduct regular performance reviews and provide growth feedback. Oversee development of scalable, distributed data systems across streaming and batch pipelines. Collaborate with Product, Design, and Sales teams to create innovative data-driven products and features. Monitor project progress, drive sprint planning, and report on key metrics using OKRs. Promote engineering best practices, data quality standards, and cloud-native development. What You Will Need Bachelor s or Master s in Computer Science or a related field. 8+ years of overall experience, with 4+ years managing software/data engineering teams. Hands-on expertise in Java, Python, or Go and multithreading. Experience with distributed data systems, including Apache Spark, Kafka, and streaming architectures. Deep understanding of relational and NoSQL databases. Proficient in cloud platforms (preferably AWS) and containerized deployments. Experience in data modeling, pipeline architecture, and data quality frameworks. Familiarity with BI tools like Tableau, Metabase, or Superset. Good to have: Knowledge of Trino, Flink, Presto, Druid, Pinot, and real-time analytics platforms. Strong project and stakeholder management; ability to lead cross-functional teams. About Us Meesho is India s fastest-growing e-commerce platform on a mission to democratize internet commerce for every Indian. With 1.75M+ sellers and millions of active customers, we offer zero commission, the lowest shipping costs, and unparalleled reach across every serviceable pincode in India. We're building Meesho to be Meri Shop for the next billion users empowering small businesses and first-time entrepreneurs to sell and thrive online. Our Culture & Total Rewards Our culture is rooted in impact, innovation, and inclusivity. Guided by 11 core principles or "Mantras", we empower our teams to think big, move fast, and grow constantly. Daily rituals like Reflections and Listen or Die ensure everyone has a voice and a growth path. What We Offer: Competitive Compensation including salary, performance bonuses, and equity. Wellness & Insurance via our MeeCare program, with extensive coverage for employees and families, plus mental health and wellness initiatives. Work-Life Balance with flexible work hours, generous leave policies, and parental support. Learning & Development with courses, mentorship, and career mobility through our Internal Mobility Program. Perks & Benefits including salary advances, relocation support, recreational discounts, and employee gifts. Join us to lead the data transformation at Meesho and help shape the future of commerce for India s next billion users. Apply now to make your mark! Qualification : Bachelors or Masters in Computer Science or a related field.
Analytics Lead/architect
Oracle India
Analytics Lead/Architect Location: Bengaluru, Karnataka, India Job Category: Consulting Job Type: Regular Employee Role: Individual Contributor Job Description: As a BI Architect, you will work on both offshore and onsite client projects. Your responsibilities will involve working with Oracle BI Applications, OAC (Oracle Analytics Cloud), and ODI (Oracle Data Integrator) implementations. You will engage with clients to understand their requirements, lead technical designs, and oversee system and integration testing using Oracle methodologies. You will also contribute to PreSales, the creation of Go-to-Market (GTM) strategies, and take the lead in developing IP/solution accelerators. Additionally, you will be responsible for owning the technical delivery of large, complex projects. Responsibilities: Lead Oracle BI Applications, OAC, and ODI implementations. Interact with clients to understand and gather business requirements. Oversee technical design, development, and system/integration testing. Contribute to PreSales activities and the creation of Go-to-Market (GTM) strategies. Lead the development of IP/solution accelerators. Own the technical delivery of large and complex projects. Required Skills: BI (Business Intelligence) expertise. Experience with Oracle Data Integrator (ODI). This position offers the opportunity to work on cutting-edge analytics technologies and deliver impactful solutions in a collaborative and dynamic environment. If you have significant experience in Oracle BI and ODI implementations, and enjoy leading large, complex projects, we would love to hear from you.
Cloud Data Engineer - AWS Big Data
Infocepts
Position: Cloud Data Engineer AWS Big Data Location: Bangalore, India Employment Type: Full-time Experience Required: 5 to 8 years Purpose of the Position: Join the Infocepts Cloud Data Architect Team as a Cloud Data Engineer and help design and implement cutting-edge big data solutions on AWS. You will leverage your expertise in EMR, Athena, PySpark, S3, AWS Lambda, and SQL to develop robust and scalable data platforms. Key Responsibilities: Technology Assessment and Design: Assess existing technology landscape and data integration frameworks. Design complex Big Data use cases using AWS services under guidance of the Architect. Support architectural decision-making by evaluating trade-offs in cost, performance, and durability. Recommend optimizations to existing data infrastructure. Documentation and Stakeholder Communication: Create project documentation adhering to quality and delivery standards. Collaborate closely with Architects and Project Managers for scoping, estimation, and planning. Present design decisions to technical and business stakeholders clearly. Conduct PoCs and design review sessions. Process Improvement and Automation: Identify and suggest opportunities for automation and process enhancements. Mentor junior engineers and support technical problem solving. Training and Knowledge Sharing: Prepare and deliver internal training on AWS and Big Data topics. Lead client knowledge sharing sessions and contribute to case studies. Essential Skills: In-depth experience with AWS services: S3, EC2, EMR, Athena, Glue, Lambda Familiarity with MPP databases like Redshift, Snowflake, or SingleStore Proficiency in Apache Spark and Databricks Strong programming skills in Python Experience building data pipelines using AWS and Databricks Knowledge of Big Data file formats such as Delta Lake Advanced SQL skills for large-scale data manipulation Hands-on experience with Apache Airflow or similar orchestration tools Strong understanding of ETL workflows and data warehousing concepts Desirable Skills: Cloud databases: AWS Aurora, Snowflake Experience with Hadoop and Hive AWS Certifications (Associate or Professional level) are a plus Qualifications: Bachelor s degree in Computer Science, Engineering, or related field (Master s preferred) Overall 5+ years of IT experience with at least 3 years in AWS Big Data projects Ongoing learning and technical certifications are strongly encouraged Key Qualities: Strong problem-solving and analytical thinking Self-driven with a passion for emerging data technologies Excellent communication and client presentation skills Ability to work in cross-functional, agile teams Apply now to be part of a high-impact data transformation team working on large-scale cloud data projects! Qualification : Bachelors degree in Computer Science, Engineering, or related field (Masters preferred)
Data Engineer - Snowflake And Dbt
Infocepts
Position: Data Integration Developer (Snowflake & DBT) Location: Bangalore Employment Type: Full-time Experience Required: 5 to 7 years Purpose of the Position: This role seeks candidates who are passionate about data and motivated to address the organization's analytics challenges. As a Data Integration Developer (Snowflake & DBT), you will play a crucial role in assisting our clients with their data and analytics journey. Your responsibilities will include building robust data pipelines, enhancing data consistency, and developing the necessary infrastructure to support analytics platforms. Key Responsibilities: Technical Expertise: Develop and optimize ETL processes using Snowflake capabilities. Build and maintain advanced data models and ETL processes using DBT (Data Build Tool). Ensure efficient data transformation and integration within the data warehouse. Collaboration: Work closely with data analysts, engineers, and stakeholders to understand business requirements and translate them into technical solutions. Facilitate effective communication and collaboration across teams. Quality Assurance: Implement and oversee data quality checks and testing procedures. Ensure data accuracy, consistency, and compliance with governance policies. Documentation and Reporting: Create and maintain comprehensive documentation for ETL processes and project workflows. Provide regular updates and reports on project progress and performance metrics. Compliance and Security: Ensure all data engineering activities comply with data governance and security policies. Implement measures to protect data integrity and confidentiality. Essential Skills: Proficient in SQL: Skilled in writing efficient queries on large datasets, including CTE and database table design. Snowflake Expertise: Experience with Snowflake or other database technologies, including SQL tuning. ETL Development: Skilled in developing and optimizing ETL processes using Snowflake and other tools. DBT Experience: Familiar with DBT Core/DBT Cloud and fundamental data modeling concepts (3NF, Star, Snowflake). Data Analysis and Profiling: Experienced in data analysis and profiling tasks. Qualifications: Overall Work Experience: More than 5 years of experience, with at least 2-3 years of experience in Snowflake and DBT. Education: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus). Key Qualities: Decision Making: Ability to influence and implement change with confidence and sound decisions. Problem-Solving: Tackles problems head-on with a logical, systematic, and practical approach; follows up with developers. Communication: Ability to consult, write, and present persuasively. Team Collaboration: Works effectively in self-organized, cross-functional teams. Apply now and become an integral part of our innovative team working on cutting-edge data integration solutions! Qualification : Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus).
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Senior Power Bi Developer
Iqvia
Job Title: Business Intelligence (BI) Lead Life Sciences Sector About the Role: As the BI Lead, you will spearhead and develop Business Intelligence (BI) projects within the team, focusing on constructing an analytical data layer, developing custom BI reporting solutions, monitoring platform performance, and enabling self-serve reporting for Regional Business Units (RBU) and Global Business Units (GBU). Your primary responsibility is to deliver high-quality contributions to client projects in the life sciences sector. These tasks will range from basic analysis and problem-solving to assisting in the creation of more complex solutions. You ll demonstrate a comprehensive understanding of pharmaceutical data assets, including IQVIA, CRM, and MCM data, as well as country-specific variations. Key duties include training and upskilling Business Units (BUs) to use the self-serve layer effectively for report and dashboard creation, assessing data requirements for decision-making, and ensuring data accuracy. You ll work closely with engineering and data platform teams to improve data availability and reliability, while collaborating on client proposals and solution strategies. Additionally, you will contribute to documentation and specifications, design presentations, and actively engage in the consulting methodologies and life sciences market to continuously grow your knowledge. Key Responsibilities: Lead BI projects, including building and maintaining an analytical data layer, and developing BI solutions for reporting and visualization. Deliver high-quality, timely contributions to life sciences client projects, ranging from basic analysis to complex solutions. Utilize pharmaceutical data assets (IQVIA, CRM, MCM) and understand regional data variations. Train Business Units (BUs) to efficiently use the self-serve reporting layer for creating reports and dashboards. Assess data requirements, identify suitable data sources, ensure data accuracy, and perform necessary transformations for decision-making. Establish and track business metrics, and perform in-depth process analysis to identify areas for improvement. Collaborate with engineering and data platform teams to enhance data availability and reliability. Review and analyze client requirements, contribute to proposal development, and create tailored client solutions. Create detailed documentation, including specifications and quantitative/qualitative analyses. Present client deliverables within established frameworks, adapting presentations to audience needs. Stay engaged in consulting methodologies, life sciences market trends, and professional development opportunities. Manage project-based responsibilities under the guidance of senior consultants and directors. Desired Candidate Profile: Proficiency in SQL and BI platforms, particularly Power BI (Spotfire knowledge is a plus). Extensive experience with data transformation/ETL, data modeling, and a strong understanding of data platforms and ETL processes. Hands-on experience with Power BI, including the creation of reports, dashboards, and visualizations, and experience in environments such as Salesforce, Snowflake, or Azure. Skilled in migrating SSRS reports/Tabular reports to Power BI Paginated Reports. Advanced knowledge of Power Query M and experience building sophisticated DAX queries. Experience implementing static and dynamic Row Level Security, along with extensive knowledge in dataset design, data cleansing, and aggregation. Understanding of relational database structures, principles, and practices. Solid SQL skills, including the ability to write complex queries and create SQL views for custom datasets. Strong proficiency in Excel, PowerPoint, and Access, with VBA knowledge considered a plus. Proven ability to build relationships with multiple stakeholders (BI engineers, Data Engineers, Consulting teams, Product Managers). Familiarity with Software Development Life Cycle (SDLC) and Agile methodologies. Experience with technical project execution, including proposal writing, creating BRD, PDD, SDD, and user documentation. Excellent verbal and written communication skills. Previous experience in application or implementation support is required. Strong problem-solving skills and a macro-level approach to research and analytics. Good to Have: Experience with other BI technologies (e.g., Tableau, Looker Studio, ThoughtSpot). Knowledge of Python/R. Experience with Microsoft Power Platform tools (e.g., PowerApps, Power Automate). Hands-on experience with Canvas App Configuration, Canvas App Functions, Power Portals, Power Automate Desktop, and custom connectors. Familiarity with Azure services, AI builder, Virtual Agents, and SharePoint list customization. Microsoft Power Platform certification is a plus. Qualifications: Bachelor s or Master s degree in Computer Science, Information Technology, or a related field. 6-8 years of relevant experience. Demonstrated collaborative approach, working effectively across teams to achieve objectives. Knowledge of core business processes and their impact on decision-making and growth. Familiarity with consulting methodologies, tools, and techniques. Up-to-date with current industry trends and insights into competitors and marketplace dynamics. Proficiency in time management, Scrum methodologies, and agile working practices. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
Data Engineer
Kpit Technologies
Job/Position Summary: Data Engineer Responsibilities: Implement data pipelines that meet design and are efficient, scalable, and maintainable. Implement best practices including proper use of source control, participation in code reviews, data validation and testing. Timely deliveries while working on projects. Act as advisor/mentor and helps junior data engineers in their deliverables. Must Have Skills: Should have experience of at least 4+ years with Data Engineering. Strong experience of design, implementation and fine-tuning big data processing pipelines in production environment. Experience with big tools like Hadoop, Spark, Kafka, Hive, Databricks. Experience in programming at least one of with Python, Java, Scala, Shell Script. Experience with relational SQL and NO SQL databases like PostgresSQL, MYSQL, Cassandra etc. Experience with any data visualization tool (Plotly, Tableau, Power BI, Google Data Studio, Quick sight etc.). Good To Have Skills: Should have Basic Knowledge of CI/CD Pipeline. Experience in working on at least one Cloud (AWS or Azure or GCP). For AWS: - Experience with AWS Cloud services like EC2, S3, EMR, RDS, Athena, Glue, Lambda, EMR. For Azure: -Experience with Azure Cloud services like Azure Blob/Data Lake GEN2, Delta Lake, Databricks, Azure SQL, Azure DevOps, Azure Data Factory, Power BI. For GCP: - Experience with GCP Cloud services Big Query, Cloud Storage bucket, DataProc, Dataflow, Pub Sub, Cloud Function, Data Studio. Sound familiarity in Versioning tools (Git, SVN etc.). Experience Mentoring students is desirable. Knowledge of latest developments in Machine Learning, Deep Learning, Optimization in Automotive domain. Open minded approach to explore multiple algorithms to design optimal solution. History of contribution to articles/blogs/whitepapers etc. in Analytics. History of contribution to Open Source. Requirement: ESSENTIAL SKILLS /COMPETENCIES Data Engineering Hadoop Kafka CI/CD Cloud
Staff Data Engineer
Intuit
Intuit is a global leader in financial technology, dedicated to helping individuals and businesses thrive. Our suite of products, including TurboTax, Credit Karma, QuickBooks, and Mailchimp, serves approximately 100 million customers worldwide. At Intuit, we believe in providing everyone with the tools and resources they need to achieve financial success. We are constantly innovating to make financial empowerment a reality for all. Job Overview Join the Intuit Data Platform (IDP) team as a Staff Engineer and help us transform the way we handle big data! The IDP team is responsible for the Intuit Analytics Platform, which powers real-time data ingestion, cataloging, analytics, and machine learning across the entire organization. As Intuit s customer base grows, so does the volume of data we process. Our engineering excellence ensures that we can scale and leverage this data to drive machine learning and product innovations. We re in the process of building the next-generation real-time and batch ingestion engine, capable of indexing, cataloging, and organizing data and metadata. We are passionate about using open-source technologies to solve challenges and contributing back to the community. If you're excited about building a platform that will directly impact data scientists and analysts and have a desire to shape the future of data at Intuit, then come join us! Key Responsibilities Architect & Design: Build fault-tolerant and scalable big-data platforms using open-source technologies to handle massive datasets. Data Solutions: Create architecture solutions that address complex use cases like data normalization, lineage, governance, ontology, and discoverability. Cross-Team Collaboration: Work with analysts and data scientists to understand data requirements for building operational propensity models and gaining deep customer insights. Hands-On Coding: Lead development efforts within the Hadoop ecosystem using technologies such as Java MapReduce, Spark, Scala, HBase, and Hive to build and optimize data pipelines for both real-time and batch applications. Database Management: Work with NoSQL, SQL, and in-memory databases to design high-performance data systems. Code Reviews: Ensure code quality, consistency, and adherence to best practices through regular code reviews. Architectural Alignment: Ensure alignment between enterprise architecture and business requirements. Prove Feasibility: Conduct proof-of-concept (POC) experiments for new technologies or approaches and drive them to production. Collaboration with Data Cataloging Team: Work closely with data catalog teams and architects to index and catalog all data sources at Intuit. Agile Leadership: Lead fast-paced development teams using agile methodologies and promote best practices in software development, testing, and incident response. Design & Model: Build dimension models suited for customer business use cases and ensure seamless integration of business and technical requirements. Qualifications Experience: 12+ years of relevant experience, with at least 5+ years specializing in the big data domain. Big Data Architecture: Proven experience in architecting end-to-end ecosystems for big data and analytics platforms. Expert Knowledge: Deep expertise in building fault-tolerant, scalable big data solutions, especially using the Hadoop ecosystem (Hive, HBase, Spark, Kafka, MapReduce, etc.). Programming Expertise: Mastery of Java and Scala, with a focus on building high-throughput data services. Machine Learning: Knowledge of machine learning principles and AI applications in big data. Big-Data Technologies: Familiarity with tools such as HDFS, Storm, Zookeeper, Cassandra, Redshift, GraphDB, and others. Understanding both real-time and batch processing in the Hadoop ecosystem. Communication: Strong communication skills, with an ability to explain complex technical topics to both technical and non-technical audiences. Programming Skills: Intermediate experience in Python or R for data processing. Education: BE/BTech/MS in Computer Science or a related field (or equivalent experience). Collaboration: Demonstrated ability to work cross-functionally and lead change through influence and example. At Intuit, you ll be part of a talented, passionate team working on innovative solutions that shape the future of data analytics and machine learning. As a Staff Engineer, you ll have the chance to work with cutting-edge technologies, build scalable systems, and help revolutionize how Intuit leverages data to drive product innovation. If you're looking for a dynamic environment where you can have a meaningful impact, come join us at Intuit! Qualification : BE/BTech/MS in Computer Science (or equivalent)
Sr. Data Engineer
Ness Digital Engineering
Job Title: Sr. Data Engineer Job Overview: We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in Snowflake to manage data ingestion and transformation. The ideal candidate will work with an offshore team to deliver scalable data solutions aligned with business and performance requirements. Key Responsibilities: Design, build, and maintain ELT pipelines using Snowflake. Lead offshore development teams in applying data engineering best practices. Collaborate with stakeholders to manage data integration across systems. Optimize data pipelines for performance and reliability, including query tuning and resource management. Implement data validation processes to ensure data accuracy. Document data pipelines, flow diagrams, and transformation logic. Troubleshoot pipeline failures and resolve performance issues. Ensure compliance with data governance and regulatory requirements. Required Qualifications: 5+ years of experience in data engineering with a focus on ELT development. Strong expertise in Snowflake, including data sharing, secure views, and performance optimization. Proficiency in SQL and data integration tools. Experience managing offshore development teams. Strong problem-solving and communication skills. Preferred Qualifications: Snowflake certification or relevant certifications. Experience in financial services with knowledge of data security and compliance. Familiarity with cloud platforms (AWS, Azure) and orchestration tools like Apache Airflow. Experience with Python or JavaScript for data transformation. Knowledge of data visualization tools like Tableau or Power BI.
Senior Cloud Data Engineer
Capgemini Invent
Job Title: Senior Cloud Data Engineer Experience: 10+ Years Location: Bengaluru About Capgemini Invent: Capgemini Invent is the digital innovation, consulting, and transformation brand of the Capgemini Group. It brings together leading expertise in strategy, technology, data science, and creative design to help CxOs reimagine their businesses. We are a global business line dedicated to helping organizations envision and build what s next. Your Role: As a Senior Cloud Data Engineer at Capgemini Invent, you will design, develop, and maintain scalable data pipelines using advanced cloud technologies to ensure smooth data integration and efficient workflows. You will collaborate with cross-functional teams to deliver robust and optimized data solutions while ensuring compliance and security throughout the process. Key Responsibilities: Design, develop, and maintain scalable data pipelines using AWS services. Optimize data storage and retrieval processes to ensure efficiency and accessibility. Ensure data security and compliance with industry standards, including data privacy laws. Manage large volumes of data, focusing on accuracy, integrity, and secure accessibility. Develop and refine data processes for data modeling, mining, and production. Implement quality checks, data validation, and monitoring of data flows. Collaborate with data scientists, analysts, and IT teams to meet data requirements. Work closely with data architects and modelers on project objectives and solutions. Troubleshoot and resolve issues in data pipelines, ensuring performance tuning and optimization. Develop and implement disaster recovery procedures to safeguard data. Ensure seamless integration of HR and other business data into cloud-based environments. Research new opportunities for data acquisition and discover additional uses for existing data. Stay up-to-date with the latest cloud technologies, data management practices, and trends, including Generative AI. Recommend and implement improvements to enhance data reliability, efficiency, and quality. Your Profile: 10+ years of experience in cloud data engineering. Proficiency with cloud platforms such as AWS, Azure, or Google Cloud. Experience with data pipeline tools like Apache Spark, AWS Glue, or similar technologies. Strong programming skills in Python, SQL, Java, or Scala. Familiarity with Snowflake, Informatica, or similar tools is an advantage. In-depth knowledge of data privacy laws, security best practices, and data governance. Expertise in analyzing and interpreting complex datasets to derive actionable insights. Strong communication, collaboration, and problem-solving skills. Knowledge of database technologies, including SQL, Big Data, and Cloud-based systems. Passion for learning and keeping up with emerging technologies, particularly in Generative AI. Experience working in an Agile framework and managing multiple projects simultaneously. Ability to adapt to evolving priorities and business needs. What You Will Love About Working Here: Flexibility: Enjoy flexible work arrangements such as remote work or flexible hours, ensuring a healthy work-life balance. Career Growth: We offer numerous opportunities for career advancement and personal development, helping you explore diverse paths and expand your skills. Certifications & Learning: Gain valuable certifications in cutting-edge technologies, including Generative AI, to stay ahead of the curve. About Capgemini: Capgemini is a global business and technology transformation partner that helps organizations accelerate their dual transition to a digital and sustainable world. With a team of 340,000 professionals in over 50 countries, we are dedicated to making a tangible impact on enterprises and society. Trusted by clients for over 55 years, Capgemini uses its deep industry expertise and cutting-edge technologies such as AI, cloud, and data to unlock the full potential of businesses worldwide. In 2023, the group reported global revenues of 22.5 billion.
Data Engineer
Indium Software
Data Engineer Role Overview We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs. This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows. Key Responsibilities Data Pipeline Development & Optimization Design and build scalable ETL/ELT processes for structured and unstructured data. Develop and maintain data ingestion frameworks to handle large datasets efficiently. Ensure data integrity, consistency, and security across multiple sources. Database & Data Warehouse Management Develop, optimize, and maintain relational and NoSQL databases. Implement data modeling best practices for performance and scalability. Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery). Big Data & Cloud Technologies Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing. Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions. Develop real-time and batch processing workflows. Collaboration & Documentation Work closely with data scientists, engineers, and business teams to understand data requirements. Document data pipelines, architecture, and workflows for scalability and maintenance. Required Qualifications & Skills Technical Expertise: Strong experience with SQL and Python for data processing. Proficiency in ETL/ELT frameworks and data integration techniques. Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka). Cloud & Database Management: Expertise in cloud data platforms (Azure, AWS, GCP). Experience with data warehousing solutions (Snowflake, Redshift, BigQuery). Understanding of data governance, security, and compliance. Performance Optimization & Troubleshooting: Ability to optimize SQL queries and improve data processing efficiency. Experience troubleshooting complex data pipeline issues. Apply Now & Be Part of an Innovative Data Team!
Sr. Data Engineer
Orange Mantra
Skills Required: Should have a minimum 6+ years in Data Engineering, Data Analytics platform. Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements. Should be involved in Requirements Gathering and transforming them to into Functionally and technical design. Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources. Design, build and maintain batch or real-time data pipelines in production. Develop ETL/ELT Data pipeline (extract, transform, load) processes to help extract and manipulate data from multiple sources. Automate data workflows such as data ingestion, aggregation, and ETL processing and should have good experience with different types of data ingestion techniques: File-based, API-based, streaming data sources (OLTP, OLAP, ODS etc) and heterogeneous databases. Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders. Strong experience and implementation of Data lakes, Data warehousing, Data Lakehousing architectures. Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. Monitor data systems performance and implement optimization strategies. Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership. Experience of AWS tools (AWS S3, EC2, Athena, Redshift, Glue, EMR, Lambda, RDS, Kinesis, DynamoDB, QuickSight etc.). Strong experience with Python, SQL, pySpark, Scala, Shell Scripting etc. Strong experience with workflow management & Orchestration tools (Airflow, Should hold decent experience and understanding of data manipulation/wrangling techniques. Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit testing, version control, code review). Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR etc. Snowflake Data Warehouse/Platform. Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming. Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, Ansible etc Experience building and deploying solutions to AWS Cloud. Good experience on NoSQL databases like Dynamo DB, Redis, Cassandra, MongoDB, or Neo4j etc. Experience with working on large data sets and distributed computing (e.g., Hive/Hadoop/Spark/Presto/MapReduce). Good to have working knowledge on Data Visualization tools like Tableau, Amazon QuickSight, Power BI, QlikView etc. Experience in Insurance domain preferred.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted