Azure Data Factory Jobs in Bengaluru
520 Jobs Found
Data Engineer
Capital One
Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field
Data Architect
Acqueon
Position Title: Data Architect Department: R&D Engineering Location: Bangalore Experience: 15+ Years Industry: SaaS / Conversational Engagement / Customer Experience Technology About Acqueon: Acqueon is a leading provider of conversational engagement software that enables customer-centric enterprises to proactively engage with their customers across voice, messaging, and email channels. By leveraging a powerful data platform, predictive models, and intelligent workflows, we help brands enhance customer experience, improve collections, and drive revenue growth. With over 200 global clients, Acqueon is at the forefront of AI-powered customer engagement. Role Overview: We are seeking a visionary and technically hands-on Data Architect to lead the development of enterprise-scale data platforms and engineering solutions. You will work closely with Product Owners, Engineering Leadership, and cross-functional teams to define and execute a strategic technology roadmap aligned with Acqueon s business goals. As a key member of our R&D team, you ll lead the design and development of highly scalable, low-latency, fault-tolerant data systems, while mentoring top-tier engineering talent and driving high-impact product features. Key Responsibilities: Architect & Lead: Design and lead development of scalable data architectures and solutions supporting real-time and batch processing, analytics, and enterprise applications. Strategic Ownership: Define and implement the data strategy, technology roadmap, and long-term architecture vision for Acqueon s platforms. Leadership: Manage and mentor a team of senior developers and engineers, fostering innovation, ownership, and delivery excellence. Cross-functional Collaboration: Work with Product, Sales, Engineering, and Customer teams to align on feature development and delivery strategy. Project Management: Oversee the end-to-end delivery of complex features, ensuring adherence to timelines, scalability, and quality standards. System Design: Review architecture and design for robustness, performance, and fault tolerance, including multi-region, high-availability setups. R&D Enablement: Collaborate with international R&D teams and align development efforts across global product initiatives. Innovation & Optimization: Drive architectural decisions, recommend performance improvements, and ensure best practices for enterprise-scale data solutions. Required Skills & Experience: Education: Bachelor s or Master s in Computer Science, IT, or related field. Experience: 15+ years in software development and data architecture, with leadership experience in managing engineering teams. Architecture Expertise: Proven experience in designing scalable, concurrent, distributed, and highly available data systems. Database Proficiency: Strong in SQL/NoSQL databases Experience with MS SQL, Aerospike, DynamoDB, Snowflake In-depth knowledge of micro-partitions, cluster keys, warehouse cloning, time travel in Snowflake Strong in writing and tuning complex stored procedures ETL & Pipelines: Experience in building ETL pipelines and integrating data from S3, Kinesis Streams, APIs Cloud & DevOps: Strong understanding of Docker, AWS, and cloud-native deployment architectures Setting up multi-region resilience, disaster recovery strategies Technologies: Elasticsearch, AWS data services, container orchestration Big Data & Analytics: Exposure to analytical processing and statistical modeling is a plus Leadership: Strong project management skills, stakeholder engagement, and team mentoring experience Preferred Qualifications: Background in customer engagement, VDI, Cybersecurity, or Secure Access technologies Previous experience working with distributed R&D and product teams Knowledge of Acqueon, Citrix, VMware, Omnissa platforms is a plus Certifications in AWS, Snowflake, or similar technologies are an advantage Soft Skills & Behavioral Traits: Strong verbal and written communication skills Strategic thinking with hands-on execution ability High accountability and ownership mindset Ability to work in a fast-paced, dynamic, startup-like environment Comfortable with ambiguity and context-switching Team player with the ability to lead by influence and collaboration Be a part of a fast-growing, AI-driven SaaS company disrupting the customer engagement space Work on cutting-edge technologies with global product teams Ownership of end-to-end solutions and ability to shape the data platform of the future A culture that promotes innovation, agility, and career growth
Snowflake Data Engineer
Growtharc Technologies
Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.
Data Architect
Growtharc Technologies
Position: Data Architect Location: Remote/Hybrid | Bengaluru, IND We're searching for a highly skilled and experienced Data Architect to join our team. If you have a deep understanding of big data technologies and extensive experience with Hadoop, Python, Snowflake, and Databricks, you're the ideal candidate. You'll be responsible for designing, implementing, and managing complex data architectures that support our critical business needs and objectives. What You'll Do: Design & Architecture Leadership: Design scalable and efficient data architecture solutions that meet current and future business data needs. Lead the development of data models, schemas, and databases, ensuring alignment with business requirements. Architect and implement robust data solutions on leading cloud platforms (AWS, Azure, or GCP). Data Management & Governance: Develop and maintain robust data pipelines and ETL processes using Hadoop, Databricks, and other essential tools. Oversee data integration and quality efforts to ensure consistency and reliability across the organization. Implement data governance best practices, focusing on data security, privacy, and compliance. Collaboration & Mentorship: Work closely with data engineers, data scientists, and business stakeholders to translate data requirements into effective technical solutions. Provide technical leadership and mentorship to junior data engineers and architects. Collaborate with cross-functional teams to ensure data solutions align perfectly with overall business goals. Optimization & Innovation: Optimize existing data architectures for peak performance, scalability, and cost-efficiency. Monitor and troubleshoot data systems to ensure high availability and reliability. Continuously evaluate and recommend new tools and technologies to improve our data architecture. What You'll Bring: Experience: 10+ years in data architecture, data engineering, or a related field. Big Data Expertise: Proven experience with Hadoop ecosystems (HDFS, MapReduce, Hive, HBase). Programming Prowess: Strong programming skills in Python for data processing and automation. Data Platform Mastery: Hands-on experience with Snowflake for data warehousing and Databricks for analytics. Cloud Fluency: Extensive experience with cloud platforms (AWS, Azure, GCP) and their data services. Data Modeling: Familiarity with data modeling tools and methodologies. Core Skills: Deep understanding of big data technologies and distributed computing. Strong problem-solving skills to design solutions for complex data challenges. Excellent communication skills, able to explain complex technical concepts clearly to diverse audiences. Proficient in SQL and database performance tuning. Experience with CI/CD pipelines and automation in data environments. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Advanced Degree: A Master's degree in a related field. Cloud Certifications: Certifications like AWS Certified Data Analytics, Google Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate. Additional Languages: Experience with other programming languages like Java or Scala. Machine Learning Integration: Knowledge of machine learning frameworks and their integration with data pipelines.
Engineer - Distributed Control Systems (DCS)
Madox Technologies Pvt. Ltd
Engineer - Distributed Control Systems (DCS) Location: Bengaluru Experience: 0 - 1 Year Openings: 1 About the Role: As a DCS Engineer, you will report to the Assistant Manager Engineering Services. Your primary purpose will be to manage the complete product lifecycle for DCS applications, encompassing software application development, hardware programming, and crucial commissioning and testing activities. This is a hands-on technical role that requires both strong analytical skills and a readiness to travel. What You'll Do: DCS Software Development: Develop and program software applications for Distributed Control Systems, with a focus on ABB 800xA. System Configuration: Gain hands-on experience and apply your knowledge in Control Builder, PG2 Graphics, Communication Protocols, and AC800M Hardware. Commissioning & Testing: Lead and execute the programming, commissioning, and testing of 800xA systems on-site. Customer Support: Provide excellent customer handling and support for Factory Acceptance Testing (FAT), ensuring client satisfaction. Project Lifecycle Management: Take responsibility for the entire project lifecycle, from initial software development through to final commissioning. Travel: Be prepared to travel extensively to customer sites across India for commissioning activities. What We're Looking For: Educational Qualification: A Bachelor's degree in Electrical and Electronics Engineering (EEE), Instrumentation, Electronics, or Electronics & Communication. Experience: 0 to 1 year of experience in a relevant engineering role. Technical Skills: Strong knowledge and hands-on experience with ABB 800xA Software Development. Proficiency in Control Builder, PG2 Graphics, Communication Protocols, and AC800M Hardware. Demonstrated experience in the complete project lifecycle from software development to commissioning in ABB 800xA. Excellent analytical skills to troubleshoot and optimize systems. Software Proficiency: Strong knowledge of Microsoft Office, Excel, and PowerPoint. Communication: Good communication skills in English for effective internal and external interactions. Physical Requirements: Must be physically fit and willing to travel to customer locations across all regions of India.
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Engineering Manager
Themathcompany
Job Title: Engineering Manager Data Engineering Location: Bengaluru, Karnataka, India Department: Engineering Experience: 6 to 8 years Open Positions: 2 About the Role As an Engineering Manager - Data Engineering, you will lead a team of skilled data engineers who design, build, and maintain scalable data pipelines and infrastructure. You will collaborate with cross-functional teams and client stakeholders to deliver high-quality data systems that meet business goals. Your leadership will be pivotal in mentoring your team, driving project execution, and advancing data engineering capabilities across the organization. Key Responsibilities Lead, mentor, and develop a team of data engineers, fostering a collaborative and inclusive work environment. Conduct performance reviews, provide constructive feedback, and set clear goals for team members. Identify skill gaps and create opportunities for continuous professional growth. Plan, execute, and deliver data engineering projects on schedule and within scope. Coordinate with stakeholders to gather requirements, prioritize tasks, and define project timelines. Ensure all projects align with broader business objectives and data strategies. Oversee design, development, and maintenance of data pipelines, ETL processes, and data warehouses. Guarantee data quality, integrity, and security in all data engineering initiatives. Identify and drive process improvements to enhance efficiency and effectiveness in data operations. Manage client conversations to understand requirements and translate them into technical deliverables. Build and promote reusable frameworks to drive efficiency in data systems. Lead multiple projects involving streaming, batch, and large-scale data pipelines. Required Technical Skills Strong execution knowledge of data modeling, relational and non-relational databases (SQL and NoSQL). Expertise with ETL and orchestration tools such as IICS, Metatron, Airflow, Azure Data Factory, AWS Glue, or GCP Composer. Experience working with data warehouses like Snowflake, Redshift, Hive, or BigQuery. Proficiency in Apache Spark and optimization of Spark jobs. Strong programming skills in Python (mandatory), with knowledge of Scala, Rust, or Java as a plus. Understanding of Medallion architecture patterns. Advanced SQL skills with query optimization expertise. Experience with software development lifecycle, unit testing, and functional programming concepts. Required Non-Technical Skills Strong problem-solving skills with the ability to assess financial impacts of decisions. Excellent written and verbal communication skills, capable of engaging with mid-management client stakeholders. Ability to balance pragmatic solutions against perfect ones, driving team consensus and business value. Exceptional people management skills, including conflict resolution, empathy, negotiation, and active listening. Proven leadership and mentorship abilities, providing technical guidance to delivery teams. Self-driven, with a strong sense of ownership and accountability. Preferred Educational Qualifications Bachelor s degree in Engineering (B.E./B.Tech), MCA, or M.Sc. (Mathematics, Statistics). Lead and mentor a talented team working on cutting-edge data engineering projects. Collaborate closely with clients and cross-functional teams in a dynamic, fast-growing company. Drive innovation with scalable, high-impact data solutions. Grow your leadership and technical skills in a supportive, inclusive environment. Qualification : Bachelors degree in Engineering (B.E./B.Tech), MCA, or M.Sc. (Mathematics, Statistics).
Senior Developer SQL & Snowflake
Thoughtfocus
Job Title: Senior Developer SQL & Snowflake Location: Bangalore, India Experience: 7+ Years (Minimum 3+ years in Snowflake) Employment Type: Full-Time Job Overview: We are seeking a highly skilled Senior Snowflake Developer to join a global financial services project for a client operating in public/private loans, CLOs, and long/short credit. The ideal candidate will bring expertise in Snowflake, SQL, Coalesce, and Fivetran, with a strong background in data integration and cloud-based data warehousing. You will be instrumental in driving forward key data initiatives and delivering innovative, scalable data solutions in a fast-paced, agile environment. Key Responsibilities: Design, develop, and optimize Snowflake objects including databases, schemas, tables, views, and stored procedures. Build and maintain Snowflake data pipelines utilizing tools like SnowSQL, SnowPipe, Streams, and Tasks. Implement data loading strategies using COPY, PUT, GET, LIST, and REMOVE commands for batch and bulk data movement. Ensure seamless migration and integration of data from Azure Cloud to Snowflake with high attention to performance and data integrity. Define and manage Snowflake roles, custom role hierarchies, masking policies, and network policies for enhanced security and governance. Use Coalesce and Fivetran for designing and managing ETL/ELT workflows that extract and transform data from MS SQL Server. Write complex T-SQL queries, stored procedures, triggers, and functions for data transformation and reporting. Collaborate closely with cross-functional teams to understand requirements and translate them into technical solutions. Participate in Agile sprints, offering technical guidance, solution design, and timely issue resolution. Required Skills & Qualifications: 8+ years of total IT experience with at least 3+ years of Snowflake development experience. In-depth understanding of Snowflake architecture, utilities, and performance optimization techniques. Strong expertise in MS SQL Server with proficiency in writing advanced T-SQL scripts. Hands-on experience with ETL tools like Coalesce and Fivetran. Proficiency in Azure Data Integration strategies and tools. Excellent problem-solving and communication skills. Experience working in an Agile development environment. Preferred Skills: Prior exposure or high-level understanding of hedge funds, private equity, or private debt domains. Familiarity with data governance and compliance requirements in financial institutions. What s on Offer: Competitive and above-market salary. Hybrid work model with flexibility. Opportunity to work on cutting-edge technology in global financial markets. Collaborative, innovation-driven team culture. Education: Bachelor s degree in Computer Science, Information Technology, Finance, Economics, or a related discipline.
IT Manager
Thoughtfocus
Job Title: IT Manager Location: Bangalore, India Experience: 12-15 Years Employment Type: Full-Time Role Overview: We are seeking a seasoned IT Manager with strong technical expertise and proven experience in managing IT infrastructure projects. The ideal candidate will lead data center migrations, cloud initiatives, networking, and enterprise infrastructure, ensuring robust, secure, and scalable IT operations. Key Responsibilities: Manage end-to-end IT infrastructure projects including data center migrations, cloud deployments (AWS, Azure, GCP), and networking upgrades. Oversee enterprise infrastructure ensuring high availability, security, and disaster recovery readiness. Lead cross-functional teams while coordinating multiple projects in fast-paced environments. Manage project budgets and implement cost control measures for large-scale infrastructure programs. Implement and adhere to best practices guided by ITIL, PMI, or PRINCE2 frameworks. Collaborate with cybersecurity teams to enforce security policies and controls. Utilize project management tools such as Jira, MS Project, and ServiceNow for effective tracking and reporting. Provide leadership and mentorship to technical teams, driving continuous improvement and operational excellence. Required Skills & Qualifications: 12-15 years of experience in IT infrastructure project management. Strong technical background in cloud platforms (AWS, Azure, GCP), data centers, networking, and enterprise systems. Solid knowledge of ITIL, PMI, or PRINCE2 frameworks. Proven experience in budget management and cost optimization. Deep understanding of cybersecurity principles, disaster recovery, and infrastructure resilience. Excellent communication, leadership, and stakeholder management skills. Hands-on experience with project tracking and service management tools like Jira, MS Project, ServiceNow, or equivalents. Preferred Qualifications: Certifications: PMP, ITIL, PRINCE2, AWS/Azure Cloud certifications (highly desirable). Experience with DevOps practices, automation, and Infrastructure as Code (IaC). Knowledge of hybrid cloud strategies and emerging infrastructure technologies.
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Data Architect
Camsdata Technologies India Pvt. Ltd.
Data Architect Bangalore, India Location: Bangalore (Bengaluru) Experience: 10 to 15 Years Industry: IT & Data Systems Job Summary: We are seeking an experienced Data Architect with a strong background in designing and implementing enterprise-scale data solutions. The ideal candidate will have expertise in building data lakes, warehouses, and pipelines, with deep knowledge of cloud platforms, data management, and industry best practices. Key Responsibilities: Design, develop, and maintain complex data architectures including data lakes, data warehouses, data marts, and efficient schema design Build and optimize scalable data pipelines for extraction, transformation, and loading (ETL/ELT) processes Apply Agile methodologies in project delivery and collaborate within cross-functional teams Perform data profiling, cleansing, conversion, and ensure high-quality data management for both structured and unstructured data Implement CI/CD and Infrastructure as Code (IaC) practices using tools like GitHub, Jenkins, CloudFormation, and Azure Resource Manager Manage database systems and tools such as PostgreSQL, Oracle, Snowflake, Teradata, MongoDB, Hadoop, and others Utilize data modeling tools like Erwin, Power Designer, and Toad for effective data architecture design Leverage cloud platforms including AWS and Microsoft Azure, with hands-on experience in services like AWS Glue, DMS, Lambda, Azure Data Factory, Synapse, and Data Lake Storage Work with programming and scripting languages including SQL, PL/SQL, Python, Spark, YAML, and JSON Use containerization and automation tools such as Docker, Ansible, and NodeJS for efficient deployment Ensure compliance with cybersecurity principles and frameworks such as NIST Lead data governance initiatives and enforce best practices in data quality and security Preferred Qualifications: ITIL certification and experience with Agile methodology Knowledge of code review and version control best practices, especially in GitHub Familiarity with data science tools and AI/ML frameworks like R, Keras, or TensorFlow Experience with natural language processing (NLP) and machine learning concepts Background in regulated industries, with pharma manufacturing experience highly preferred Exposure to multi-site, global IT projects and manufacturing operations Lead innovative data architecture projects within a dynamic and fast-paced environment Work with cutting-edge cloud technologies and big data ecosystems Collaborate with global teams on impactful enterprise solutions Access to professional growth opportunities in data governance, AI, and cloud technologies
Senior Data Engineer
Cognite
Senior Data Engineer Location: Bengaluru Department: Global Strategic Services Data Engineering EMEA Type: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader driving industrial digital transformation. Our platforms Cognite Data Fusion and Cognite Atlas AI enable companies across Energy, Utilities, Manufacturing, and Chemicals to solve complex challenges using AI, contextual data, and automation. Cognite is backed by top-tier investors and recognized with global innovation awards. Our Values Impact: We deliver results that matter. Ownership: We take initiative, act inclusively, and embrace accountability. Relentless: We pursue excellence and innovation with resilience. About the Role As a Senior Data Engineer, you ll lead the development of scalable data solutions that empower critical industries to make informed decisions. You ll work on high-impact projects across regions, collaborating with solution architects, data scientists, and product teams. This is a growth role with room to influence product direction and mentor junior engineers. Key Responsibilities Architect and implement robust data pipelines using Cognite Data Fusion, Python, SQL, and REST APIs. Lead integrations, data modeling, and transformation tasks using cloud-native technologies. Design custom data models for discovery, mapping, and cleansing industrial data. Collaborate closely with cross-functional teams to deliver digital solutions. Conduct code reviews and champion engineering best practices. Contribute to Cognite s SDKs and internal tools. Translate customer use cases into scalable, reusable data engineering frameworks. Mentor team members and support customer onboarding when needed. What You ll Bring Bachelor s or Master s in Computer Science or related field (or equivalent experience). 5+ years in a data-intensive, customer-facing engineering role. Expertise in Python, SQL, REST APIs, and pipeline orchestration. Experience with distributed computing, Kubernetes, and cloud platforms (Azure, GCP). Familiarity with data from industrial domains like oil & gas or manufacturing is a plus. Strong DevOps mindset with hands-on experience in Git, CI/CD, and deployments. Proactive and collaborative; able to work independently and solve complex challenges. A growth mindset with willingness to ask for help and share knowledge openly. Be part of a global team spanning 70+ nationalities with strong DEI focus. Work at our Bengaluru office (Rathi Legacy, Hoodi) in a modern hybrid environment. Enjoy flat hierarchy, fast decision-making, and high ownership culture. Collaborate with world-class professionals on industry-transforming projects. Shape the future of industrial data and drive real-world impact at scale. If you re passionate about solving meaningful problems with cutting-edge data technologies, apply today. We welcome applicants from all backgrounds and experiences you might be the perfect fit, even if you don t meet every single requirement. Qualification : Bachelors or Masters in Computer Science or related field (or equivalent experience).
Platform Solution Architect
Rubrik
Platform Solution Architect Job Overview As a Platform Solutions Architect, you will serve as a pre-sales specialist, supporting the broader sales organization with deep technical knowledge across database and cloud workloads. This means working with customers and prospects to educate them on how Rubrik protects and manages data. Additionally, the Solution Architect will have an active role in providing real-world feedback to product teams to enhance the product, testing new features before they are released, and championing new features within the sales team. The Solutions Architect provides both immediate and long-term impact with their technical knowledge and position of influence with prospects and customers. Key Responsibilities Serve as a subject matter expert on Rubrik s data protection and data security solutions, focused on database and cloud workloads. Act as a trusted advisor on assigned opportunities, aligning Rubrik s technology and roadmap with customer business objectives. Lead impactful product demonstrations, technical workshops, and solution presentations tailored for technical and executive-level audiences. Contribute to high-quality proposals, white papers, and responses to RFPs/RFIs. Collaborate with presales teams to design, execute, and troubleshoot proof-of-concepts (POCs), ensuring successful outcomes. Proactively identify technical challenges and architect creative solutions to overcome sales barriers. Translate complex customer requirements into clear, actionable technical strategies. Stay abreast of industry trends in data protection, security, database and cloud technologies, effectively positioning Rubrik s solutions. Evangelize Rubrik s offerings and clearly communicate strategic direction and product roadmap aligned with customer needs. Work closely with Product Management and Engineering to influence feature development based on customer feedback and market demands. Provide competitive intelligence and actionable insights from customer engagements to internal stakeholders. Qualifications 8+ years of successful experience in customer-facing technical sales or consulting roles focused on enterprise database technologies and cloud. Bachelor s Degree in Computer Science, Engineering, or equivalent experience. Deep technical expertise in two or more areas across database and cloud: Database focus: Primary: Oracle (Oracle Cloud, Data Guard, Golden Gate, Exadata, ExaCC) Secondary: MongoDB, Apache Cassandra, SQL Server, IBM DB2, Informix, PostgreSQL Multi-Cloud focus (Azure or AWS or GCP): Primary: AWS EC2, Azure VM, GCP Compute Engine, AWS S3, Azure Blob Secondary: Azure SQL and AWS RDS Proficiency in scripting languages such as Python, PowerShell, Go, or JavaScript. Excellent problem-solving capabilities, able to troubleshoot complex technical issues and deliver scalable solutions. Experience conducting benchmarks and performance testing on enterprise systems (preferred). Demonstrated sales acumen, capable of articulating technical value to C-level executives and technical audiences including database administrators. Strong cross-functional collaboration skills with sales, engineering, and product management. Exceptional communication skills, including compelling presentations and clear, concise writing. Proven experience with data center hardware/software, cloud platforms, data security solutions, IaaS, PaaS, or hypervisor software. Self-motivated and results-driven, comfortable working remotely with a high degree of autonomy. Willingness to travel approximately 20%-50% of the time. #LF-SF1 Join Us in Securing the World's Data Rubrik (NYSE: RBRK) is on a mission to secure the world s data. With Zero Trust Data Security , we help organizations achieve business resilience against cyberattacks, malicious insiders, and operational disruptions. Rubrik Security Cloud, powered by machine learning, secures data across enterprise, cloud, and SaaS applications. We help organizations uphold data integrity, deliver data availability that withstands adverse conditions, continuously monitor data risks and threats, and restore businesses with their data when infrastructure is attacked. Qualification : Bachelors degree or equivalent practical experience.
Data Engineer
International Business Machines
Azure Data Engineer IBM Consulting Client Innovation Center Location: Bengaluru, India Experience: 7+ Years (Minimum 4+ Years in Azure Technologies) Job Type: Full-Time Education Required: Bachelor s Degree (Master s preferred) Introduction: Join IBM Consulting at our Client Innovation Center in Bengaluru, where we deliver deep technical and industry expertise to a wide range of public and private sector clients. Our delivery centers focus on innovation, agility, and adoption of next-gen technologies to transform businesses locally and globally. Your Role & Responsibilities: Design and develop scalable data engineering solutions on Microsoft Azure. Build, optimize, and manage data pipelines and ETL workflows using tools like Azure Data Factory, ADLS, and Databricks. Write clean, efficient code using PySpark, PL/SQL, and Spark SQL. Integrate and manage data from various sources, both structured and unstructured. Work with SQL, Postgres, Cassandra, and Cosmos DB. Utilize Azure services such as Stream Analytics, SQL DW, Azure Functions, ARM Templates, and Analysis Services. Implement and maintain serverless architectures for modern data solutions. Ensure high-quality data delivery, security, and compliance across systems. Collaborate across teams and contribute to solution design, code reviews, and documentation. Required Skills & Experience: Bachelor s degree in Computer Science, Information Systems, or related technical field. 7+ years total experience in Data Engineering, with 4+ years in Azure-based data projects. Strong hands-on experience with: Azure Data Factory, Data Lake (ADLS), Databricks Programming: Python, PySpark, PL/SQL, Spark SQL Databases: SQL, Postgres, Cassandra, Cosmos DB Solid grasp of data warehousing, relational databases, and cloud-based architectures. Familiarity with version control tools like Git and CI/CD pipelines. Preferred Skills & Qualifications: Master s Degree in a relevant field. Experience with: ARM Templates, Azure Functions, Serverless Architectures Object-oriented scripting languages (Python, Scala, etc.) Excellent problem-solving and communication skills. Ability to work in a fast-paced environment and collaborate effectively with teams and stakeholders. What You ll Get: Work on high-impact, global projects with cutting-edge Azure technologies. Be part of a collaborative and forward-thinking IBM team. Opportunities for professional growth, upskilling, and certifications. A dynamic work culture focused on innovation, agility, and client success. Join us in Bengaluru and be part of IBM s journey in shaping the future of data engineering. Qualification : Bachelors degree in Computer Science, Information Systems, or related technical field.
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Senior Power Bi Developer
Iqvia
Job Title: Business Intelligence (BI) Lead Life Sciences Sector About the Role: As the BI Lead, you will spearhead and develop Business Intelligence (BI) projects within the team, focusing on constructing an analytical data layer, developing custom BI reporting solutions, monitoring platform performance, and enabling self-serve reporting for Regional Business Units (RBU) and Global Business Units (GBU). Your primary responsibility is to deliver high-quality contributions to client projects in the life sciences sector. These tasks will range from basic analysis and problem-solving to assisting in the creation of more complex solutions. You ll demonstrate a comprehensive understanding of pharmaceutical data assets, including IQVIA, CRM, and MCM data, as well as country-specific variations. Key duties include training and upskilling Business Units (BUs) to use the self-serve layer effectively for report and dashboard creation, assessing data requirements for decision-making, and ensuring data accuracy. You ll work closely with engineering and data platform teams to improve data availability and reliability, while collaborating on client proposals and solution strategies. Additionally, you will contribute to documentation and specifications, design presentations, and actively engage in the consulting methodologies and life sciences market to continuously grow your knowledge. Key Responsibilities: Lead BI projects, including building and maintaining an analytical data layer, and developing BI solutions for reporting and visualization. Deliver high-quality, timely contributions to life sciences client projects, ranging from basic analysis to complex solutions. Utilize pharmaceutical data assets (IQVIA, CRM, MCM) and understand regional data variations. Train Business Units (BUs) to efficiently use the self-serve reporting layer for creating reports and dashboards. Assess data requirements, identify suitable data sources, ensure data accuracy, and perform necessary transformations for decision-making. Establish and track business metrics, and perform in-depth process analysis to identify areas for improvement. Collaborate with engineering and data platform teams to enhance data availability and reliability. Review and analyze client requirements, contribute to proposal development, and create tailored client solutions. Create detailed documentation, including specifications and quantitative/qualitative analyses. Present client deliverables within established frameworks, adapting presentations to audience needs. Stay engaged in consulting methodologies, life sciences market trends, and professional development opportunities. Manage project-based responsibilities under the guidance of senior consultants and directors. Desired Candidate Profile: Proficiency in SQL and BI platforms, particularly Power BI (Spotfire knowledge is a plus). Extensive experience with data transformation/ETL, data modeling, and a strong understanding of data platforms and ETL processes. Hands-on experience with Power BI, including the creation of reports, dashboards, and visualizations, and experience in environments such as Salesforce, Snowflake, or Azure. Skilled in migrating SSRS reports/Tabular reports to Power BI Paginated Reports. Advanced knowledge of Power Query M and experience building sophisticated DAX queries. Experience implementing static and dynamic Row Level Security, along with extensive knowledge in dataset design, data cleansing, and aggregation. Understanding of relational database structures, principles, and practices. Solid SQL skills, including the ability to write complex queries and create SQL views for custom datasets. Strong proficiency in Excel, PowerPoint, and Access, with VBA knowledge considered a plus. Proven ability to build relationships with multiple stakeholders (BI engineers, Data Engineers, Consulting teams, Product Managers). Familiarity with Software Development Life Cycle (SDLC) and Agile methodologies. Experience with technical project execution, including proposal writing, creating BRD, PDD, SDD, and user documentation. Excellent verbal and written communication skills. Previous experience in application or implementation support is required. Strong problem-solving skills and a macro-level approach to research and analytics. Good to Have: Experience with other BI technologies (e.g., Tableau, Looker Studio, ThoughtSpot). Knowledge of Python/R. Experience with Microsoft Power Platform tools (e.g., PowerApps, Power Automate). Hands-on experience with Canvas App Configuration, Canvas App Functions, Power Portals, Power Automate Desktop, and custom connectors. Familiarity with Azure services, AI builder, Virtual Agents, and SharePoint list customization. Microsoft Power Platform certification is a plus. Qualifications: Bachelor s or Master s degree in Computer Science, Information Technology, or a related field. 6-8 years of relevant experience. Demonstrated collaborative approach, working effectively across teams to achieve objectives. Knowledge of core business processes and their impact on decision-making and growth. Familiarity with consulting methodologies, tools, and techniques. Up-to-date with current industry trends and insights into competitors and marketplace dynamics. Proficiency in time management, Scrum methodologies, and agile working practices. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
Expert Associate Partner, Ais Coe, India
Bain & Company
Company Culture and Values: Emphasis on Diversity and Inclusion: Bain & Company prioritizes diversity, inclusion, and collaboration as key factors for building high-performing teams. They believe that fostering a diverse and inclusive environment contributes to the creation of exceptional teams and innovative solutions. Recognition as a Top Workplace: Consistently recognized as a top workplace, Bain & Company is featured on the Glassdoor Best Place to Work list and has maintained a strong position in various workplace rankings since its inception. Focus on Employee Development: The company creates an environment where employees can reach their full potential, both professionally and personally. Bain supports growth through learning opportunities, career advancement, and a focus on personal well-being. Social Responsibility: Bain & Company invests significantly in pro bono services, reflecting its commitment to addressing critical social and environmental challenges globally. The company believes in making a positive impact through expertise and resources. Role: Technical Leader, AIS COE Team Leadership: The role entails building and leading a team of over 40 engineers specializing in software product development within the AIS COE in Bengaluru. As a Technical Leader, you will foster a culture of excellence, collaboration, and innovation, ensuring the team is highly effective and motivated. AI Solution Development: The Technical Leader will oversee the entire lifecycle of AI solutions, from Proof of Concept (PoC) and Minimum Viable Product (MVP) stages to large-scale production deployment. The leader will guide the team in creating reusable model assets and solution accelerators that provide value to clients. Stakeholder Engagement: Collaboration with Bain partners and clients is critical. The role requires promoting the COE s capabilities, understanding client needs, and tailoring solutions to meet those needs. The Technical Leader will occasionally engage directly with clients to solve complex problems and provide strategic guidance. Engineering Excellence: The leader will ensure the delivery of high-quality solutions by maintaining rigorous engineering standards. They will leverage diverse technologies to meet client needs while keeping a sharp focus on performance, scalability, and reliability. Operational Oversight: The Technical Leader will work closely with the operations leader to manage the COE s operations and delivery schedules, ensuring the team meets deadlines and delivers high-impact solutions. Location: Bengaluru, India, with some presence in New Delhi. The role may require some travel for client engagements or operational needs. Qualifications: Education: Advanced degree in Computer Science, Engineering, or a related field. Experience: 12+ years of experience in software engineering, with at least 5+ years of managing engineering teams. Experience in setting up or managing an engineering hub is a significant advantage. Technical Skills: Expertise in computer science principles, software design, and development workflows. Proficiency in programming languages such as Python, Java, or C++. Experience with cloud platforms (AWS, Azure, Google Cloud) and modern software methodologies (e.g., Agile, DevOps). Other Skills: Proven ability in building and scaling engineering teams. Strong leadership skills with a focus on inspiring and guiding teams. Ability to engage with stakeholders, articulate technical solutions, and build trust. Commitment to mentoring and nurturing talent in the engineering field. Excellent collaboration skills and the ability to work with global teams across diverse functions. Key Highlights: Reusable Model Assets & Solution Accelerators: Emphasis on building scalable, reusable assets that can be leveraged across projects, improving efficiency and impact. Agile Delivery Pods & End-to-End Ownership: The team works in agile pods that focus on full ownership of projects, ensuring quality solutions and close collaboration. Growing Team & Innovative Environment: The role offers an opportunity to lead a growing team in a dynamic, innovative environment with ample opportunities for growth and professional development. Remote and Collaborative Work: The team works primarily remotely, allowing for flexibility while focusing on delivering robust solutions with minimal direct client interaction. This role provides an exciting opportunity to lead a talented and dynamic team, contribute to impactful AI and software solutions, and work at the forefront of cutting-edge technology. Qualification : Advanced degree in Computer Science, Engineering, or a related field.
Data Engineer
Kpit Technologies
Job/Position Summary: Data Engineer Responsibilities: Implement data pipelines that meet design and are efficient, scalable, and maintainable. Implement best practices including proper use of source control, participation in code reviews, data validation and testing. Timely deliveries while working on projects. Act as advisor/mentor and helps junior data engineers in their deliverables. Must Have Skills: Should have experience of at least 4+ years with Data Engineering. Strong experience of design, implementation and fine-tuning big data processing pipelines in production environment. Experience with big tools like Hadoop, Spark, Kafka, Hive, Databricks. Experience in programming at least one of with Python, Java, Scala, Shell Script. Experience with relational SQL and NO SQL databases like PostgresSQL, MYSQL, Cassandra etc. Experience with any data visualization tool (Plotly, Tableau, Power BI, Google Data Studio, Quick sight etc.). Good To Have Skills: Should have Basic Knowledge of CI/CD Pipeline. Experience in working on at least one Cloud (AWS or Azure or GCP). For AWS: - Experience with AWS Cloud services like EC2, S3, EMR, RDS, Athena, Glue, Lambda, EMR. For Azure: -Experience with Azure Cloud services like Azure Blob/Data Lake GEN2, Delta Lake, Databricks, Azure SQL, Azure DevOps, Azure Data Factory, Power BI. For GCP: - Experience with GCP Cloud services Big Query, Cloud Storage bucket, DataProc, Dataflow, Pub Sub, Cloud Function, Data Studio. Sound familiarity in Versioning tools (Git, SVN etc.). Experience Mentoring students is desirable. Knowledge of latest developments in Machine Learning, Deep Learning, Optimization in Automotive domain. Open minded approach to explore multiple algorithms to design optimal solution. History of contribution to articles/blogs/whitepapers etc. in Analytics. History of contribution to Open Source. Requirement: ESSENTIAL SKILLS /COMPETENCIES Data Engineering Hadoop Kafka CI/CD Cloud
Data Engineer
Indium Software
Data Engineer Role Overview We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs. This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows. Key Responsibilities Data Pipeline Development & Optimization Design and build scalable ETL/ELT processes for structured and unstructured data. Develop and maintain data ingestion frameworks to handle large datasets efficiently. Ensure data integrity, consistency, and security across multiple sources. Database & Data Warehouse Management Develop, optimize, and maintain relational and NoSQL databases. Implement data modeling best practices for performance and scalability. Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery). Big Data & Cloud Technologies Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing. Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions. Develop real-time and batch processing workflows. Collaboration & Documentation Work closely with data scientists, engineers, and business teams to understand data requirements. Document data pipelines, architecture, and workflows for scalability and maintenance. Required Qualifications & Skills Technical Expertise: Strong experience with SQL and Python for data processing. Proficiency in ETL/ELT frameworks and data integration techniques. Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka). Cloud & Database Management: Expertise in cloud data platforms (Azure, AWS, GCP). Experience with data warehousing solutions (Snowflake, Redshift, BigQuery). Understanding of data governance, security, and compliance. Performance Optimization & Troubleshooting: Ability to optimize SQL queries and improve data processing efficiency. Experience troubleshooting complex data pipeline issues. Apply Now & Be Part of an Innovative Data Team!
Senior Software Engineer - Azure Storage
Microsoft
Overview The Microsoft Azure Storage team is looking for a Senior Software Engineer - Azure Storage with design, coding, and testing skills, to develop strategy and automation to validate Azure's massive distributed storage system. We are looking for talented Senior Software Engineer - Azure Storage who are customer obsessed and passionate about creating high quality end to end experiences that delight customers. You will have an opportunity to make high impact changes on a daily basis as you work on a hyperscale storage system that may indirectly or directly be used daily by your friends and family. Microsoft s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Qualifications Required Qualifications: Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or C# OR equivalent experience. 3+ years of experience in developing software/drivers for Windows PCs or Embedded systems. 3+ years of experience with Windows Kernel debugging, Windbg Debug Extensions, and auto analysis 3+ years of experience building scalable, distributed services. Familiarity with engineering build tooling and automation at scale. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Additional / Preferred Qualifications: Experience with a large scale storage, high quality code, distributed systems, and cloud services. Competent in software engineering practices, coding and foundation in data structures, algorithms with testing, debugging and analytical skills. Knowledge of UMDF/KMDF driver fundamentals and knowledge of new hardware platform enablement and bring-up activities. #Azurecorejobs Responsibilities Design, develop and operate scalable, low latency and high throughput cloud services and frameworks to stress storage backend. Work on complex and critical cloud scale storage features integration. Play a crucial role in the product quality by designing end to end scenario validation. Develop software and infrastructure for new hardware storage solutions (Windows Drivers, Windows services, fault analysis automation, performance analysis). Experiment, study and analyze the system behavior, health under different load conditions. Take an active role and partner with peer teams and external partners to ensure new storage features meeting target availability, security and reliability. Drive cross organization Quality initiatives to streamline release quality gates and release pipeline. Being part of Azure core team, work on the product code base to improve its test-ability, diagnostic-ability, debug-ability and overall product health for the storage system. Qualification : Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or C# OR equivalent experience.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted