Data Storage Jobs in Bengaluru
1114 Jobs Found
Software Development Engineer Iii
Observe.ai Networks Private Limited
Software Development Engineer III Location: Bengaluru About Us: Observe.AI Observe.AI is a leading AI-powered platform revolutionizing customer experience. We enable enterprises to deploy AI agents that automate customer interactions, creating natural conversations and delivering predictable outcomes. Combining advanced speech understanding, workflow automation, and enterprise-grade governance, our platform empowers teams to guide and augment human agents with AI copilots, and analyze 100% of both human and AI interactions for insights, coaching, and quality management. Companies such as DoorDash, Affordable Care, Signify Health, and Verida rely on Observe.AI to accelerate service speed, increase operational efficiency, and strengthen customer loyalty across all communication channels. At Observe.AI, you will be building the backend that powers AI agents, transforming customer service for global enterprises. You'll work on high-scale, complex systems where your contributions have a direct and visible impact. In a culture that emphasizes speed, innovation, and ownership, this is your chance to sharpen your skills, drive forward innovation, and shape the future of AI-powered customer experiences. You will collaborate closely with product, design, and engineering leaders to define the technical roadmap and build solutions that matter. If you are looking for an environment where your ideas drive innovation, your expertise shapes the platform s future, and your growth is fueled by working with brilliant peers, Observe.AI is the place for you. What You ll Be Doing: AI Agent Development: Contribute to building and deploying AI agents (Voice Agents, Chat Agents, and Copilots) at enterprise scale for customer service. Full Application Lifecycle: Design, code, test, deploy, and debug applications with a high focus on quality throughout the entire lifecycle. Collaborative Roadmap Creation: Work with product and design teams to translate product goals into clear, actionable technical roadmaps. Reusable Code Development: Create reusable code, frameworks, and libraries to accelerate development, ensuring consistency across multiple projects. Optimization: Optimize applications for speed, scalability, and reliability, proactively addressing bottlenecks and performance issues. Security & Data Protection: Implement robust security measures and data protection practices to safeguard customer data and sensitive information. Scalable Data Storage: Design and manage scalable data storage solutions to ensure efficiency, reliability, and long-term maintainability. Efficient Data Pipelines: Build and scale data pipelines to process large volumes of data accurately and efficiently. Team Leadership: Review work of other team members, provide feedback, and lead by example across all aspects of the development lifecycle. Thought Leadership: Represent Observe.AI at tech conferences, demonstrating thought leadership and presenting solutions to complex challenges. What You ll Bring to the Role: 6-9 years of experience in building large-scale products with a strong track record of delivering high-quality solutions. Expertise in Python (with immediate proficiency), and familiarity with other high-level languages such as Java, Golang, or similar. Solid experience with SQL or NoSQL databases (e.g., Postgres, MongoDB, Cassandra). In-depth knowledge of asynchronous communication tools like Kafka, SQS, Temporal, etc. Understanding of popular caching tools such as Ehcache, Memcache, Redis. A customer-first mindset with the ability to adapt quickly in a fast-paced environment. Strong problem-solving skills and the ability to think and communicate from first principles. Open-mindedness to learning new technologies and staying current with industry trends. Perks & Benefits: Medical Insurance: Comprehensive medical coverage with free online doctor consultations. Leave Policies: Generous leave options, including privilege and sick leave as per Karnataka S&E Act, national and festive holidays, and parental leave. Learning & Development: A dedicated fund for continuous learning and professional development. Flexible Benefits: Tax-saving benefits (e.g., meal cards, PF, etc.) and flexible benefit plans. Team Culture: Regular fun events to promote collaboration and build company culture.
Manager - Data Analytics, Credit Card Portfolios
Zeta
Job Title: Manager - Data Analytics, Credit Card Portfolios Location: Bangalore Employment Type: Full-time About Zeta: Zeta is a next-gen banking technology company empowering banks and fintechs to build the future of financial products. Founded in 2015 by Bhavin Turakhia and Ramki Gaddipati, Zeta s flagship platform Zeta Tachyon is a cloud-native, fully API-enabled banking stack powering issuance, processing, lending, core banking, fraud & risk, and more. Over 20 million cards have been issued globally through our platform. With 1,700+ employees across the US, EMEA, and Asia and 70%+ in R&D, Zeta is backed by SoftBank, Mastercard, and others, having raised $330M at a $2B valuation in 2025. We work with leading banks and fintechs worldwide to transform multi-million card portfolios. Role Overview: We are looking for a strategic and experienced Manager - Data Analytics to lead business intelligence and enterprise reporting for global fintech portfolios including Credit Cards, Deposits, and other financial products. This role involves managing a team of analysts, leveraging multiple data lakes and warehouses, and building a scalable, comprehensive reporting framework for diverse markets including the US, UK, and India. Key Responsibilities: Enterprise Reporting & Data Architecture: Design and maintain end-to-end reporting across the customer lifecycle: acquisition, activation, usage, delinquency, collections, retention, operations, and support. Deliver accurate analysis of key financial KPIs: revenue, profitability, credit risk, defaults, acquisition cost. Build dashboards, self-service BI tools, and automated pipelines using Apache Superset, Metabase, Tableau. Optimize data storage and reporting for scalability and cost-efficiency. Data Integration & Analytics Execution: Collaborate with vendors and internal engineering to integrate data from credit bureaus, open banking, core banking, card and payment processors, loan origination, CCaaS, and aggregators into a centralized Data Lake. Business Intelligence & Growth: Lead analytics projects to uncover user behavior, optimize acquisition channels, underwriting, and portfolio performance via segmentation, cohort, and funnel analyses. Partner with Product and Marketing teams to evaluate experiments (A/B testing) and guide roadmap decisions. Leadership: Build, mentor, and lead a high-performing team of BI analysts and data visualization experts. Data Governance: Establish and enforce data governance best practices, ensuring compliance and data security. Skills & Experience: Expert in BI tools such as Apache Superset, Metabase, Tableau; strong SQL skills. Familiarity with cloud data platforms like Snowflake, Redshift, BigQuery. Deep knowledge of credit and fintech KPIs: acquisition, credit decisioning, delinquency, repayment, charge-offs, profitability, RoA, CLTV, etc. Proven leadership experience managing analytics teams and scaling reporting infrastructures. Excellent communication skills with the ability to translate complex data into business strategies. Knowledge of data governance, privacy, and security in financial services. Qualifications: 10+ years in Business Intelligence/Analytics with 3+ years in the credit card industry. 3+ years managing teams of analysts or data professionals. Bachelor s degree in Computer Science, Engineering, Statistics, or a related field. Equal Opportunity: Zeta celebrates diversity and is an equal opportunity employer. We are committed to fostering an inclusive environment and encourage candidates from all backgrounds to apply. Qualification : Bachelors degree in Computer Science, Engineering, Statistics, or a related field
Snowflake Data Engineer
Growtharc Technologies
Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.
Senior Data Scientist - LLM
5c Network Pvt. Ltd.
Position: Senior Data Scientist LLM Location: Bangalore, Karnataka, India Type: Full-Time (On-site) Experience Required: 2+ years in Deep Learning, 1+ years in LLMs Industry: Healthcare AI Company Overview: 5C Network is pioneering multi-modal AI systems for autonomous diagnosis in medical imaging. We're building next-generation models that integrate deep learning with language understanding to revolutionize clinical workflows and diagnostic accuracy. Role Summary: As a Senior Data Scientist LLM, you will lead the development and deployment of Large Language Models (LLMs) focused on enhancing medical imaging diagnostics. You ll work on cutting-edge problems such as instruction fine-tuning, prompt engineering, and Retrieval-Augmented Generation (RAG), while ensuring scalability and robustness in production environments. Key Responsibilities: LLM Development & Fine-Tuning Design and optimize prompts for diverse clinical and imaging-related use cases. Perform instruction fine-tuning of LLMs to meet task-specific requirements. Develop reasoning pipelines including Chain of Thought (CoT) techniques for complex diagnostic workflows. LLM Deployment & Optimization Self-host and deploy LLMs in secure, scalable production environments. Apply quantization and other performance optimization methods to minimize compute and memory footprint. Ensure high performance, uptime, and security in AI deployments. Retrieval-Augmented Generation (RAG) & Vector Databases Develop and implement RAG pipelines by integrating LLMs with semantic search. Work with vector databases (e.g., Qdrant) to enable fast, efficient retrieval of contextual data. Optimize data storage, indexing, and retrieval to support clinical applications. Data Engineering & Annotation Build and manage high-quality datasets tailored for CoT and multi-step reasoning tasks. Lead data annotation efforts to enhance LLM understanding of medical contexts. Collaboration & Research Collaborate with researchers, ML engineers, and domain experts to bring LLM solutions from prototype to product. Stay ahead of the curve by experimenting with novel LLM architectures and emerging techniques. Qualifications: Bachelor's or Master s degree in Computer Science, Data Science, AI, or a related field. 2+ years of hands-on experience in deep learning. Minimum 1 year of experience working with LLMs (e.g., instruction tuning, prompt engineering, RAG). Prior experience in LLM deployment (self-hosting, optimization, quantization, scaling). Proficient in Python and common ML frameworks (e.g., PyTorch, Hugging Face Transformers). Familiarity with vector databases like Qdrant or similar. Strong interest or prior exposure to healthcare/medical AI. Excellent problem-solving, communication, and team collaboration skills. Technical Stack: Languages: Python Frameworks: PyTorch, Hugging Face Technologies: LLMs (e.g., GPT, LLaMA), Vector Databases (Qdrant), RAG, Quantization Tools: Docker, Kubernetes, REST APIs, Git Work on high-impact AI solutions in the healthcare domain. Collaborate with a team at the forefront of multi-modal diagnostic technology. Access cutting-edge tools and real-world data to drive innovation. Qualification : Bachelor's or Masters degree in Computer Science, Data Science, AI, or a related field.
Software Engineer, Backend (AI Team)
Limechat
Job Title: Software Engineer, Backend (AI Team) Location: Bengaluru, India Company: LimeChat About LimeChat LimeChat is building the future of conversational commerce enabling brands to deliver human-level interactions at scale via WhatsApp and other messaging platforms. As a proud graduate of Y Combinator s Winter 2021 batch, we serve 300+ top-tier brands like HUL, ITC, Wow Skin Science, Piramal Health, and Snitch. Our mission is simple: use Generative AI to automate and personalize customer interactions in e-commerce and now expanding into BFSI, Health, and Retail sectors. If you're a backend engineer who thrives on impact, collaboration, and building innovative systems at scale, this is your opportunity to do work that truly matters. What You ll Do Architect and Develop Backend Systems: Design robust, scalable backend architectures for AI products that handle millions of conversations. Integrations and APIs: Build and maintain seamless, secure integrations with third-party platforms and internal services. Work with AI Products: Collaborate with ML engineers and product teams to connect AI models and agents to real-time customer journeys. Database Management: Design and optimize relational and NoSQL databases (e.g., PostgreSQL, MongoDB). Performance & Reliability: Identify bottlenecks and implement backend improvements to ensure high performance and reliability. Collaborate Cross-Functionally: Work closely with product, design, and frontend teams to ship features that delight users. Write Clean, Maintainable Code: Follow best practices in code quality, documentation, and testing. Participate in peer code reviews. You Should Have Must-Haves 2 4 years of backend experience in a high-growth tech/startup environment Proficiency in Python, Node.js, and frameworks like Django Strong command of SQL and NoSQL databases (e.g., PostgreSQL, MongoDB) Solid understanding of RESTful API design and best practices Experience with Git, code reviews, and agile development workflows Excellent debugging and code analysis skills, including performance optimization Nice-to-Haves Hands-on experience with Docker, Kubernetes, or other container orchestration tools Familiarity with CI/CD pipelines (GitLab CI, Jenkins, etc.) Experience with API load testing, monitoring, and observability tools Exposure to AI/ML pipelines and/or conversational AI systems Why You ll Love Working Here Massive Impact: Join a lean, fast-moving team where your work directly influences product and user experience. Innovation-First Culture: Work at the intersection of AI, automation, and customer experience. Smart Team: Collaborate with ex-founders, IITians, and top engineers. Fast-Growth Startup: Backed by leading VCs and part of Y Combinator, we re scaling globally. Ownership and Autonomy: You ll be trusted to take full ownership and drive initiatives end to end. Quotes We Live By It s okay to fail. It s not okay to not try. Do the right thing when others are not looking. Apply now and be part of the LimeChat revolution.
Senior Data Engineer
Neuron7.ai
Senior Data Engineer Location: Bengaluru, India Employment Type: Full-time, On-site About Neuron7.ai Neuron7.ai is a rapidly growing AI-first SaaS company that is revolutionizing the world of service intelligence. Backed by leading Silicon Valley venture capitalists and a distinguished group of angel investors, we are recognized as a startup to watch. Our AI-driven platform delivers service predictions in seconds by analyzing structured and unstructured data, alongside insights from top experts. We specialize in complex service environments like high-tech devices, manufacturing, and medical devices, empowering service leaders to optimize key metrics like first-call resolution, turnaround time, and service margins. At Neuron7.ai, you will be part of a dynamic, innovative team that is pushing the boundaries of service intelligence. We value creativity, collaboration, and a relentless commitment to innovation. This is your chance to join a fast-growing startup and help redefine how AI impacts the future of service optimization. About the Role We are building a real-time analytics platform to improve uptime of connected devices and minimize maintenance costs. This involves collecting, analyzing, and leveraging large volumes of sensor data for observability and predictive analytics. As a Senior Data Engineer, you will have the opportunity to build and maintain scalable, high-performance data systems using modern data engineering tools. The ideal candidate will have hands-on experience with Python, Scala, ELT processes, Lakehouse architecture, Apache Spark, Databricks, real-time streaming systems like Kafka and Flink, and observability tools such as the ELK stack, Prometheus, and Grafana. What You ll Do: Data Model Development: Design and implement advanced data models to extract insights from complex datasets. Collaborative Problem Solving: Work with cross-functional teams to devise data-driven solutions for service optimization. Experimental Analysis: Conduct experiments and analyses to enhance service predictions and outcomes. Actionable Insights: Present findings and actionable recommendations to stakeholders, translating complex data insights into clear, understandable concepts. Mentorship: Guide and mentor junior team members, fostering a collaborative and knowledge-sharing environment. What We re Looking For: Experience: At least 4 years of hands-on experience in data engineering, with a focus on building large-scale data systems. Data Pipeline Expertise: Strong proficiency in Python and Scala for developing data pipelines. Big Data Tools: Proven experience with Apache Spark and Databricks for big data processing and analytics. Observability Tools: Hands-on experience with observability tools like Prometheus, Grafana, and the ELK stack or OpenSearch. Real-Time Data Streaming: Experience working with real-time streaming systems such as Kafka and Flink. Cloud Platforms: Familiarity with cloud platforms like Azure, GCP, or AWS. Problem-Solving Skills: Strong analytical and problem-solving abilities to work with complex data systems in fast-paced environments. Collaboration: Excellent communication and teamwork skills, with the ability to work effectively with cross-functional teams. What We Do and Value: At Neuron7.ai, we prioritize integrity, innovation, and a customer-centric approach. Our mission is to leverage advanced AI technology to enhance service decision-making and we are dedicated to delivering excellence in all aspects of our work. Company Perks & Benefits: Competitive salary, equity, and spot bonuses Paid sick leave Latest MacBook Pro for your work Comprehensive health insurance Paid parental leave Flexible work arrangements work from home or from our vibrant Bengaluru office Our Commitment to Diversity and Inclusion: Neuron7.ai is committed to fostering a diverse and inclusive workplace. We ensure equal employment opportunities without discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, marital status, or any other characteristic protected by law. If you re passionate about using data to drive service intelligence and want to be part of a forward-thinking team, we d love to hear from you!
Lead Consultant Data Engineer
Thoughtworks Technologies (india) Pvt Ltd.
Lead Data Engineer | ThoughtWorks | Bangalore, India Location: Bangalore, India Employment Type: Full-time, Regular Industry: Information Technology About ThoughtWorks At ThoughtWorks, we're a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. For over 30 years, we've worked alongside our clients to deliver solutions that challenge the status status quo. With a diverse and inclusive team, we empower each other to grow through shared learning, fostering an environment where innovation thrives. Our commitment to a cultivation culture is key to our success, and we re looking for a Lead Data Engineer to join our Bangalore team and lead transformative projects. Job Overview As a Lead Data Engineer at ThoughtWorks, you will be responsible for designing, developing, and operating modern data architectures that meet client business objectives. You will lead and manage data engineering projects end-to-end, from strategic planning to hands-on coding, ensuring the delivery of scalable and efficient data solutions. Working with cutting-edge technologies, you ll collaborate with stakeholders, clients, and cross-functional teams to implement data-driven strategies that address complex business challenges. Key Responsibilities Project Leadership: Lead and manage data engineering projects from inception to completion, including goal-setting, scope definition, and ensuring on-time delivery in collaboration with cross-functional teams. Data Architecture & Solution Design: Collaborate with clients to design modern data architecture and implement end-to-end solutions that meet key business objectives. Create intricate data processing pipelines to address complex business problems. Stakeholder Collaboration: Work closely with stakeholders to understand business objectives and identify opportunities to leverage data and data quality improvements. Data Modeling & Governance: Develop data models using modern modeling techniques and implement them using appropriate technologies. Ensure compliance with data governance, security, and privacy requirements. Scalable Implementations: Partner with data scientists to design scalable implementations of their models, ensuring the solutions are robust and efficient. Clean, Iterative Code: Write clean, modular code based on TDD (Test-Driven Development) and implement continuous delivery practices to support and operate data pipelines. Technology Guidance: Advise clients on distributed storage and computing technologies, selecting the best options to fit their business needs. Data Quality Strategy: Define and incorporate data quality strategies into daily work processes to ensure high standards and compliance. Job Qualifications Technical Skills: Proven experience in data engineering and system design, with a focus on building Big Data architecture and data pipelines within distributed systems. Deep knowledge of data modeling and hands-on experience with modern data engineering tools and platforms. Strong programming skills, with expertise in building scalable, high-quality data pipelines using languages like Python, Java, Scala, or others. Experience with distributed storage platforms (e.g., Hadoop, Amazon S3, etc.) and distributed processing platforms (e.g., Spark, Flink). Experience working with SQL, NoSQL, data lakes, and other data storage technologies. Familiarity with data visualization techniques and ability to communicate insights effectively across varying audiences. Professional Skills: Stakeholder Management: Strong ability to liaise between clients and other key stakeholders, ensuring trust and buy-in throughout projects. Adaptability & Resilience: Comfortable handling ambiguity and finding innovative solutions to complex challenges. Leadership & Mentorship: Experienced in coaching and mentoring team members, fostering a culture of professional growth and accountability. Risk & Conflict Management: Skilled in managing risks and resolving conflicts, driving projects forward despite challenges. Relationship Building: Natural at cultivating strong relationships with clients, stakeholders, and internal teams to create new opportunities. What You Bring to the Team Leadership: A proven track record in leading high-performance teams and supporting colleagues in their professional development. Curiosity & Innovation: A passion for data and technology and a willingness to continually learn and push the boundaries of what's possible. Collaboration: Ability to work closely with cross-functional teams and stakeholders to design and implement innovative data solutions. At ThoughtWorks, we believe in giving you the autonomy to carve out your unique career path, while providing support through development programs and a vibrant culture of learning. You ll work on exciting projects with a diverse team, solve complex challenges, and make an impact at a global scale. Join ThoughtWorks and be part of a global community of innovators. Together, we turn curiosity into action and creativity into impactful solutions.
Senior Software Engineer, Core Data, Data Indexing
Google Careers
Job Title: Software Engineer Location: Bengaluru, India Company: Google Minimum Qualifications: Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience. 5 years of experience with one or more general-purpose programming languages, including but not limited to: Java, C/C++, Python, Objective C, JavaScript, or Go. 4 years of experience with Distributed Processing, System Design, and High-Performance Computing. Preferred Qualifications: Experience in solving ambiguous problems in complex environments. Experience in building distributed systems that are scalable and efficient. Ability to design and complete projects independently, taking ownership of the end-to-end process. About the Job: Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking, data storage, security, artificial intelligence, natural language processing, UI design, and mobile. The list of technologies we engage with is always growing. As a software engineer, you will work on a specific project critical to Google s needs, with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, to display leadership qualities, and to be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Core Team Overview: The Core team builds the technical foundation behind Google s flagship products. We are the owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure that make up the backbone of Google s services. These are essential building blocks for creating excellent, safe, and coherent user experiences that also drive the pace of innovation for every developer at Google. We look across Google s products to build central solutions, break down technical barriers, and strengthen existing systems. As the Core team, we have the unique opportunity to impact critical technical decisions across the company, influencing the direction of the most foundational and influential aspects of Google s technology. Responsibilities: Work on a core indexing platform that is pivotal to the functionality and performance of Google s services. Design, develop, and maintain highly efficient, scalable, and robust systems to manage large-scale indexing challenges. Work with cross-functional teams to create innovative solutions for distributed computing problems, ensuring that Google s products remain performant and reliable at scale. Contribute to building distributed systems capable of handling immense data volumes in real-time, ensuring that Google's systems can scale with global usage. Participate in code reviews, design discussions, and the creation of detailed documentation to ensure high-quality outcomes. Qualification : Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience.
System Administrator
Aezion Technologies Pvt Ltd
Role: System Administrator Experience Required: Minimum of 4+ years of relevant experience Location: Bangalore Notice Period: Open Preferably Immediate Joiners Employment Type: Full-Time About Aezion: Aezion is a forward-thinking technology solutions provider, specializing in custom software development, AI-driven solutions, and enterprise digital transformation. As a trusted digital engineering partner in the USA, we are committed to exceeding client expectations by delivering results that transform clients into long-term partners. Our promise: We get it right or make it right. At Aezion, we believe that work is more than just a job it s a ministry that reflects our values. We are dedicated to delivering excellence throughout the entire project lifecycle, from design and development to hosting, maintenance, and support. Our Culture: Aezion is a mission-driven company with a purpose rooted in service: Love others like Christ. Guided by our core values Love, Dependability, Humility, Diversity, Speed, and Innovation we aim to provide exceptional service. Our 200+ dedicated employees work together to turn our customers into lifelong partners, fueling their success through a commitment to excellence. Role Overview: As a System Administrator at Aezion, you will be pivotal in designing, implementing, and maintaining our IT infrastructure. You will ensure the reliability, scalability, and security of systems, while also optimizing performance and minimizing downtime. This role requires you to collaborate with cross-functional teams to develop infrastructure solutions that align with the business s strategic goals. Key Responsibilities: Provide day-to-day technical support for desktops, laptops, and servers, ensuring minimal downtime for end-users. Troubleshoot and resolve hardware, software, and network-related issues across the organization. Install, configure, and maintain both Windows and Linux operating systems. Manage user accounts, permissions, and security settings within Active Directory and other identity management systems. Deploy, configure, and maintain enterprise applications, antivirus solutions, and other security tools. Support and troubleshoot peripheral devices such as printers, scanners, and mobile devices. Assist with network connectivity issues, including Wi-Fi, LAN, and VPN configurations. Perform regular system updates, patch management, and ensure compliance with security protocols. Document technical procedures, troubleshooting solutions, and best practices for internal use and knowledge sharing. Provide training and support to users regarding IT policies, security, and best practices. Required Skills and Experience: Proven experience with Windows & Linux desktop and server environments. Strong troubleshooting skills for hardware, software, and network issues. Familiarity with Active Directory, Group Policy, and user management processes. Knowledge of IT security best practices, including antivirus solutions and endpoint protection. Expertise in software installation, driver configurations, and system updates. Experience with remote desktop support tools. Basic understanding of networking concepts such as IP addressing, DNS, DHCP, and VPN. Proficiency in supporting Office 365, email clients, and enterprise-level applications. Excellent customer service and communication skills for providing end-user support. IT certifications such as CompTIA A+, Microsoft Certified (MCP, MCSA), or ITIL are highly desirable.
Senior Software Development Engineer Idc Vn Edge
Oracle
Job Description: Senior Software Development Engineer - Oracle Cloud Infrastructure Core Services Development Team Role: Senior Software Development Engineer Team: OCI Virtual Networking Core Services Development Team Location: India Career Level: IC3 Experience: 4+ years Overview: Oracle's Cloud Infrastructure (OCI) is building state-of-the-art infrastructure-as-a-service (IaaS) technologies that operate at high scale across a globally distributed, multi-tenant cloud. The OCI Virtual Networking team is at the heart of this effort, developing distributed, highly available virtual networking services. This team is responsible for foundational cloud services, such as the Virtual Cloud Network (VCN), VPN, Customer Cloud Connectivity, Network Firewalls, and other edge services. As a Senior Software Development Engineer, you will be responsible for designing, developing, and optimizing complex distributed systems that interact with end users and network infrastructure. Your role will involve working on distributed services, developing algorithms for efficient data transfer across networks, and ensuring scalability and reliability within Oracle's cloud environment. You will work closely with a collaborative, agile team of engineers while contributing to building the future of cloud networking services. Key Responsibilities: Software Development & Design: Design, develop, and implement distributed networking services within OCI's Virtual Cloud Network (VCN). Focus on writing clean, maintainable, and optimized code to enhance performance and scalability. Develop and optimize algorithms to ensure efficient data transfer and network operations across the distributed cloud infrastructure. Ensure the performance and scalability of the code, especially when deployed in a cloud environment. Collaboration & Agile Work Environment: Collaborate closely with cross-functional teams in a fast-paced, agile development environment. Participate in the full software development lifecycle, from planning and design to testing and deployment. Work with other team members to ensure the integration of various OCI services, with a focus on automation and scalability. Operational Support & Troubleshooting: Contribute to the operational support of production services, including on-call duties. Troubleshoot and resolve complex issues, ensuring high availability and reliability of networking services. Provide technical leadership and contribute to the continuous improvement of the services. Leadership & Mentorship: Take ownership of parts of the service and its components, leading from design to implementation. Mentor junior engineers and provide technical guidance and support. Share knowledge and contribute to the team s growth through code reviews, knowledge-sharing sessions, and coaching. Technical and Professional Requirements: Programming Expertise: Expert-level experience with Java in developing large-scale, high-performance applications. Experience in concurrent programming and the design of distributed systems. Proficiency in solving complex problems related to scalability, performance, and reliability in cloud environments. Cloud & Distributed Systems: Experience in building and maintaining distributed, scalable services, especially within cloud infrastructures. Strong knowledge of cloud technologies and networking protocols. System Design & Optimization: Solid understanding of system architecture, including how components interact in a distributed, cloud-based system. Ability to optimize code for performance and scalability in production environments. Operational Understanding: Experience in operating production services and providing support during on-call rotations. Understanding of troubleshooting complex system issues, particularly in a distributed cloud environment. Team Collaboration & Communication: Ability to work in a collaborative and agile team environment. Strong verbal and written communication skills for effective coordination across teams. Preferred Qualifications: Experience in Large-Scale Distributed Services: Prior experience in building and scaling distributed services, particularly in cloud or network-related domains. Python Skills: Knowledge of Python for scripting, automation, and solving network-related problems is a plus. Additional Skills: Experience with cloud services, such as VPN, firewalls, network connectivity, and network security. Exposure to containerization technologies such as Docker and orchestration tools like Kubernetes is advantageous. Educational Requirements: Bachelor s or Master s degree in Computer Science, Electrical/Hardware Engineering, or a related field. At Oracle, you will have the opportunity to work on cutting-edge technologies that power cloud networking at a global scale. You will be part of a dynamic and innovative team, contributing to the development of highly scalable and distributed networking services within Oracle's cloud infrastructure. Your expertise will be crucial to driving the evolution of cloud technologies, and you will have a chance to mentor junior engineers while working in a collaborative, fast-paced environment. Qualification : Bachelors or Masters degree in Computer Science, Electrical/Hardware Engineering, or a related field.
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Sap Cpi Developer
Pure Storage
Join Us in Reshaping the Data Storage Industry We re in an unbelievably exciting area of tech, fundamentally reshaping the data storage industry. At Pure Storage, you ll have the chance to lead with innovative thinking, grow alongside us, and collaborate with the smartest team in the industry. If you're ready to make a lasting impact and seize boundless opportunities, come join us! Position Overview: Join our growing SAP team as an experienced SAP Cloud Platform Integration (CPI) Developer. In this role, you'll specialize in designing and implementing scalable integration solutions. You will be a key player in building and optimizing SAP CPI processes to support our expanding business operations. If you're excited about working with a dynamic, innovative team and creating impactful solutions, this is the perfect opportunity for you to grow your career. Responsibilities: Design, develop, and deploy integration flows using SAP CPI between SAP and non-SAP systems. Collaborate with business stakeholders and functional teams to confirm integration requirements and create technical specifications. Monitor, troubleshoot, and resolve integration-related issues. Ensure compliance with security and governance standards during integration design and development. Qualifications: Bachelor's degree in Information Technology, Computer Science, or a related field. 4 to 6 years of experience in IT with a focus on SAP integration development, specifically on SAP CPI. Knowledge of integration patterns and techniques, as well as experience with API management. Experience implementing security protocols such as OAuth, HTTPS, and SSL/TLS. SAP CPI certification is preferred. This is a primarily in-office role, so you will be expected to work in our Bangalore office in compliance with Pure's policies, unless on PTO, work travel, or other approved leave. What You Can Expect from Us: Pure Innovation: We celebrate those who think critically, embrace challenges, and aspire to be trailblazers. Pure Growth: We provide the space and support for you to grow alongside us and contribute meaningfully. Pure Storage has been named one of Fortune's Best Large Workplaces in the Bay Area, Fortune s Best Workplaces for Millennials, and certified as a Great Place to Work. Pure Team: We build each other up, setting aside egos for the greater good. We understand the value of bringing your full and best self to work. That's why we offer a variety of perks to help you maintain a healthy balance, including flexible time off, wellness resources, and company-sponsored team events. For more details, visit purebenefits.com. Qualification : Bachelors degree in Information Technology, Computer Science or related field.
Software Engineer III, Scaled Infrastructure
Google Careers
Software Engineer at Google Minimum Qualifications: Bachelor's degree or equivalent practical experience. 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree in an industry setting. 2 years of experience with data structures or algorithms in either an academic or industry setting, and building software for data privacy or security (e.g., identity and access management). Experience with C++, infrastructure design, and Android app development. Preferred Qualifications: Master's degree or PhD in Computer Science or related technical fields. 2 years of experience with performance, large scale systems data analysis, visualization tools, or debugging. Experience developing accessible technologies. Experience with Security Analysis, Program Analysis, Decompiler. Knowledge of code and system health, diagnosis and resolution, and software test engineering. About the Job: Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will participate in the development of large scale Google infrastructure Design, as well as develop, and maintain scalable Google wide infrastructure to scan 1 million Android apps per day, manage Petabytes of analysis data, and protect over 3 billion devices. You will build systems to manage and extract intelligence from various sources and make the intelligence available to various internal systems and stakeholders The Platforms and Ecosystems product area encompasses Google's various computing software platforms across environments (desktop, mobile, applications). The products provide enterprises, and ultimately end users, the ability to utilize and manage their services at scale. We build innovative and compelling software products from apps to TVs, from laptops to phones that have an impact on people s lives across the world. Responsibilities: Write product or system development code. Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies. Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency). Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
Software Engineer Iii, Android
Google Careers
Software Engineer at Google (Android Focus) Minimum Qualifications: Bachelor s degree or equivalent practical experience. 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree in an industry setting. 2 years of experience with data structures or algorithms in either an academic or industry setting, and with Android application development. Experience in Android, Kotlin, Java, Mobile App Development, API Design. Preferred Qualifications: Master's degree or PhD in Computer Science or related technical field. 2 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging. Experience developing accessible technologies. Experience in code and system health, diagnosis and resolution, and software test engineering. Experience in backend e-commerce, internationalization, and localization. About the Job: Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions. The Platforms and Ecosystems product area encompasses Google's various computing software platforms across environments (desktop, mobile, applications). The products provide enterprises, and ultimately end users, the ability to utilize and manage their services at scale. We build innovative and compelling software products from apps to TVs, from laptops to phones that have an impact on people s lives across the world. Responsibilities: Write product or system development code. Review code developed by other engineers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency). Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality. Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies.
Data Engineer
Kpit Technologies
Job/Position Summary: Data Engineer Responsibilities: Implement data pipelines that meet design and are efficient, scalable, and maintainable. Implement best practices including proper use of source control, participation in code reviews, data validation and testing. Timely deliveries while working on projects. Act as advisor/mentor and helps junior data engineers in their deliverables. Must Have Skills: Should have experience of at least 4+ years with Data Engineering. Strong experience of design, implementation and fine-tuning big data processing pipelines in production environment. Experience with big tools like Hadoop, Spark, Kafka, Hive, Databricks. Experience in programming at least one of with Python, Java, Scala, Shell Script. Experience with relational SQL and NO SQL databases like PostgresSQL, MYSQL, Cassandra etc. Experience with any data visualization tool (Plotly, Tableau, Power BI, Google Data Studio, Quick sight etc.). Good To Have Skills: Should have Basic Knowledge of CI/CD Pipeline. Experience in working on at least one Cloud (AWS or Azure or GCP). For AWS: - Experience with AWS Cloud services like EC2, S3, EMR, RDS, Athena, Glue, Lambda, EMR. For Azure: -Experience with Azure Cloud services like Azure Blob/Data Lake GEN2, Delta Lake, Databricks, Azure SQL, Azure DevOps, Azure Data Factory, Power BI. For GCP: - Experience with GCP Cloud services Big Query, Cloud Storage bucket, DataProc, Dataflow, Pub Sub, Cloud Function, Data Studio. Sound familiarity in Versioning tools (Git, SVN etc.). Experience Mentoring students is desirable. Knowledge of latest developments in Machine Learning, Deep Learning, Optimization in Automotive domain. Open minded approach to explore multiple algorithms to design optimal solution. History of contribution to articles/blogs/whitepapers etc. in Analytics. History of contribution to Open Source. Requirement: ESSENTIAL SKILLS /COMPETENCIES Data Engineering Hadoop Kafka CI/CD Cloud
Data Engineer - Platform Generative Ai
Mckinsey & Company
Your Impact We are seeking a passionate Data Engineer with expertise in Python development who is excited about cloud-based data engineering using AWS services. You will be an integral part of a dynamic, multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers, and other stakeholders. As a key member of a global team working on our generative AI initiative, you will be based in one of our European offices. McKinsey s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm s internal use, and your role will be crucial in driving the development of data solutions to support generative AI applications. You will work with a team of data engineers to develop robust data ingestion pipelines and enhance data processing capabilities that integrate data into systems used by AI applications. Your responsibilities will include writing Python code, creating tests, developing and maintaining GitHub Action CICD pipelines, and managing AWS-based infrastructure and Docker containers. Your Growth As a member of the global team working on our generative AI initiative, you will play a key role in shaping and accelerating the delivery of McKinsey's target state data platform, which will enable AI use-cases. You will be part of our cloud-first approach, transforming data platforms and analytical applications across the firm. Working closely with multidisciplinary teams, you will contribute to building cutting-edge data solutions in a fast-paced, innovative environment. McKinsey s Tech Ecosystem function is responsible for developing all technology solutions for the firm s internal needs, and you ll have the opportunity to shape how these solutions evolve. Your Qualifications and Skills 3+ years of professional experience as a Data Engineer, with a focus on cloud-based data engineering using AWS services Expertise in Python development and a strong understanding of clean code, modularity, error handling, and test automation Extensive experience with relational databases and data pipeline performance Hands-on experience with Docker and CI/CD pipelines (e.g., GitHub Actions) Strong execution focus, with the ability to work independently in complex, fast-paced environments and deliver results Demonstrable experience in solving data pipeline performance issues and diagnostics Interest in generative AI and machine learning topics Experience with Kedro framework is a plus Opinionated and confident in sharing ideas, willing to speak up at all levels Familiarity with Agile principles and product development methodologies Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams
Data Engineer Ii
Mckinsey & Company
Your Impact As a Data Engineer at QuantumBlack, you will collaborate with stakeholders, data scientists, and internal teams to develop and implement impactful data products and solutions. Your key responsibilities will include building and maintaining technical platforms for advanced analytics, designing scalable and reproducible data pipelines for machine learning, and ensuring information security within data environments. You will assess clients' data quality, map data fields to hypotheses, and prepare data for use in analytics models. Additionally, you will contribute to R&D projects, internal asset development, and participate in cross-functional problem-solving sessions with a variety of stakeholders, including C-level executives, to create innovative analytics solutions. You will be based in Gurugram, joining a global data engineering community, and work within cross-functional and Agile project teams alongside project managers, data scientists, machine learning engineers, other data engineers, and industry experts. You will collaborate directly with our clients, ranging from data owners and users to C-level executives. You will be aligned with one of our industry-focused practices: Pharma & Medical Products (PMP) or Global Energy & Materials (GEM). In these practices, you ll work on solving the most critical challenges for our clients in these sectors. PMP focuses on advancing the development and delivery of life-saving medicines and medical treatments, while GEM supports industries like chemicals, steel, mining, and energy to achieve operational excellence. GEMx and PMPx, the assetization arm of these practices, focus on creating reusable digital and analytics assets to support client work. As part of this team, you will help shape impactful solutions for large organizations, developing capabilities for sustained impact. Your Growth In this role, you will contribute to the frameworks and libraries that our teams of Data Scientists and Engineers use to progress from data to meaningful impact. You will have the opportunity to guide global companies through data science solutions, helping them transform and enhance performance across industries including healthcare, automotive, energy, and elite sports. Real-World Impact: You ll gain unique learning and development opportunities globally. Fusing Tech & Leadership: Work with the latest technologies and methodologies, with access to top-tier learning programs. Multidisciplinary Teamwork: Collaborate with data scientists, engineers, project managers, UX designers, and more to enhance performance. Innovative Work Culture: Creativity, passion, and wellness are central to our modern work environment, which includes insightful talks, training sessions, and a focus on work-life balance. Striving for Diversity: We celebrate diversity, with colleagues from over 40 nationalities, appreciating the value that diverse perspectives bring to the workplace. You are a highly collaborative individual who prioritizes impact over agenda. You enjoy learning from colleagues, challenging ideas thoughtfully, and working together to improve processes and solve problems. You believe in iterative change, experimenting with new approaches, and advancing quickly through constant learning and improvement. While we value using the right tech for the right task, our team often leverages technologies such as Python, PySpark, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions like AWS, GCP, and Azure. Your Role as a Data Engineer Collaboration: Work with business stakeholders, data scientists, and internal teams to create extraordinary, domain-focused data products (reusable assets) and deliver them to clients. Domain Expertise: Develop deep understanding of client industries and use creative techniques to deliver meaningful impact. Technical Platforms: Build and maintain technical platforms for advanced analytics engagements, spanning both data science and data engineering work. Data Pipelines: Design and implement robust, modular, scalable, deployable, and reproducible data pipelines for machine learning. Data Management: Ensure the security of data environments and compliance with information security standards. Data Wrangling: Assess data quality, map data fields to hypotheses, and prepare data for analytics models. Contribute to R&D: Participate in internal asset development and contribute to R&D projects to drive innovation. Cross-functional Problem Solving: Collaborate with internal teams and clients, including data owners and C-level executives, to create impactful analytics solutions. Your Qualifications and Skills Bachelor s degree in computer science or related field; Master's degree is a plus. 2-5 years of relevant work experience. Proficiency in at least one programming language such as Python, Scala, or Java. Strong experience with distributed processing frameworks (e.g., Spark, Hadoop, EMR) and SQL. Experience in commercial client-facing projects, particularly in close-knit teams. Ability to work with structured, semi-structured, and unstructured data, and identify linkages across disparate data sets. Clear communication skills to explain complex solutions effectively. Understanding of information security principles to ensure compliant handling of client data. Experience with cloud platforms (AWS, Azure, Google Cloud, Databricks) is highly desirable. Experience with CI/CD processes using GitHub Actions, CircleCI, or similar, and end-to-end pipeline development including application deployment is a plus. Qualification : Bachelors degree in computer science or related field; Master's degree is a plus.
Data Engineer: Data Warehouse
International Business Machines Corporation
Job Title: Application Developer - ETL and Data Management Introduction: In this role, you ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we provide deep technical and industry expertise to a wide range of public and private sector clients globally. Our delivery centers leverage locally-based skills to help clients drive innovation and the adoption of new technologies. A career in IBM Consulting is built on long-term relationships and close collaboration with clients across the world. You will work with leaders across industries to improve the hybrid cloud and AI journeys for some of the most innovative and valuable companies worldwide. Your ability to make a meaningful impact for clients is enabled by our strategic partner ecosystem and robust technology platforms, including Software and Red Hat. Curiosity and a constant quest for knowledge are key to success in IBM Consulting. In your role, you ll be encouraged to challenge the norm, explore new ideas, and come up with creative solutions that result in groundbreaking impact for a wide network of clients. Our culture is built on evolution and empathy, focusing on long-term career growth and development in an environment that values your unique skills and experience. Your Role and Responsibilities: ETL Workflow Development: Develop and implement ETL workflows by creating ETL jobs, and data models in datamarts using technologies such as Snowflake, DBT, Unix, and SQL. Batch Processing Redesign: Redesign Control M Batch processing for ETL job builds to run efficiently in a production environment. System Evaluation and Improvement: Study the existing system to evaluate its effectiveness and design new systems to improve workflow efficiency. Business Program Analysis & Support: Perform requirements identification, business program analysis, testing, and system enhancements while providing production support. Agile Environment: Work effectively in an Agile environment and gain familiarity with tools such as JIRA and SharePoint. Client Interaction: Good written and verbal communication skills are essential as you will interact directly with client counterparts to understand requirements and provide solutions. Required Technical and Professional Expertise: Experience: A minimum of 3 years of experience in developing ETL applications, implementing workflows, and creating data models using Snowflake, DBT, Unix, and SQL technologies. Agile Environment: Strong understanding of working in an Agile environment and proficiency in tools like JIRA and SharePoint. Problem-Solving Skills: Ability to manage change and proven time management skills. Strong interpersonal skills to contribute effectively to team efforts. Continuous Learning: Stay up-to-date with technical knowledge by attending educational workshops and reviewing relevant publications. Preferred Technical and Professional Expertise: ETL Development: Experience in developing triggers, functions, and stored procedures to support ETL workflows. Impact Analysis: Assist with impact analysis of changing upstream processes on the Data Warehouse and reporting systems. ETL & Reporting Support: Participate in the design, testing, support, and debugging of new and existing ETL and reporting processes. Data Profiling & Troubleshooting: Perform data profiling and analysis using a variety of tools, troubleshoot and support production processes, and maintain documentation. Innovation: Be part of a team that drives global change and leverages cutting-edge technologies to solve complex problems. Growth: Gain access to continuous learning and career development opportunities to further your expertise in data management and cloud technologies. Collaboration: Work with a diverse team in a collaborative environment that values new ideas and creative solutions. Global Impact: Your work will contribute to improving business operations and technological advancements for clients around the world. If you're passionate about driving innovative solutions, working with a variety of clients, and continuously evolving your skills, IBM Consulting is the perfect place for you to advance your career.
Staff Data Engineer
Intuit
Intuit is a global leader in financial technology, dedicated to helping individuals and businesses thrive. Our suite of products, including TurboTax, Credit Karma, QuickBooks, and Mailchimp, serves approximately 100 million customers worldwide. At Intuit, we believe in providing everyone with the tools and resources they need to achieve financial success. We are constantly innovating to make financial empowerment a reality for all. Job Overview Join the Intuit Data Platform (IDP) team as a Staff Engineer and help us transform the way we handle big data! The IDP team is responsible for the Intuit Analytics Platform, which powers real-time data ingestion, cataloging, analytics, and machine learning across the entire organization. As Intuit s customer base grows, so does the volume of data we process. Our engineering excellence ensures that we can scale and leverage this data to drive machine learning and product innovations. We re in the process of building the next-generation real-time and batch ingestion engine, capable of indexing, cataloging, and organizing data and metadata. We are passionate about using open-source technologies to solve challenges and contributing back to the community. If you're excited about building a platform that will directly impact data scientists and analysts and have a desire to shape the future of data at Intuit, then come join us! Key Responsibilities Architect & Design: Build fault-tolerant and scalable big-data platforms using open-source technologies to handle massive datasets. Data Solutions: Create architecture solutions that address complex use cases like data normalization, lineage, governance, ontology, and discoverability. Cross-Team Collaboration: Work with analysts and data scientists to understand data requirements for building operational propensity models and gaining deep customer insights. Hands-On Coding: Lead development efforts within the Hadoop ecosystem using technologies such as Java MapReduce, Spark, Scala, HBase, and Hive to build and optimize data pipelines for both real-time and batch applications. Database Management: Work with NoSQL, SQL, and in-memory databases to design high-performance data systems. Code Reviews: Ensure code quality, consistency, and adherence to best practices through regular code reviews. Architectural Alignment: Ensure alignment between enterprise architecture and business requirements. Prove Feasibility: Conduct proof-of-concept (POC) experiments for new technologies or approaches and drive them to production. Collaboration with Data Cataloging Team: Work closely with data catalog teams and architects to index and catalog all data sources at Intuit. Agile Leadership: Lead fast-paced development teams using agile methodologies and promote best practices in software development, testing, and incident response. Design & Model: Build dimension models suited for customer business use cases and ensure seamless integration of business and technical requirements. Qualifications Experience: 12+ years of relevant experience, with at least 5+ years specializing in the big data domain. Big Data Architecture: Proven experience in architecting end-to-end ecosystems for big data and analytics platforms. Expert Knowledge: Deep expertise in building fault-tolerant, scalable big data solutions, especially using the Hadoop ecosystem (Hive, HBase, Spark, Kafka, MapReduce, etc.). Programming Expertise: Mastery of Java and Scala, with a focus on building high-throughput data services. Machine Learning: Knowledge of machine learning principles and AI applications in big data. Big-Data Technologies: Familiarity with tools such as HDFS, Storm, Zookeeper, Cassandra, Redshift, GraphDB, and others. Understanding both real-time and batch processing in the Hadoop ecosystem. Communication: Strong communication skills, with an ability to explain complex technical topics to both technical and non-technical audiences. Programming Skills: Intermediate experience in Python or R for data processing. Education: BE/BTech/MS in Computer Science or a related field (or equivalent experience). Collaboration: Demonstrated ability to work cross-functionally and lead change through influence and example. At Intuit, you ll be part of a talented, passionate team working on innovative solutions that shape the future of data analytics and machine learning. As a Staff Engineer, you ll have the chance to work with cutting-edge technologies, build scalable systems, and help revolutionize how Intuit leverages data to drive product innovation. If you're looking for a dynamic environment where you can have a meaningful impact, come join us at Intuit! Qualification : BE/BTech/MS in Computer Science (or equivalent)
Sr. Data Engineer
Databricks
Job Title: Data Engineer Job Summary As a Data Engineer in the IT team, you will work on various big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help business to get most value out of their data. The Impact You Will Have You will work on a variety of impactful Big Data projects which may include building reference architectures, how-to's and production grade MVPs. Work on implementing transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications. Work on architecture and design; bootstrap or implement strategic projects. What We Look For 7+ years experience with Big Data Technologies such as Apache Spark , Kafka, Cloud Native and Data Lakes. 4+ years of experience working on Big Data Architectures independently. Preferred experience working in the Databricks ecosystem. Comfortable writing code in either Python or Scala. Experience working across Cloud Platforms (GCP / AWS / Azure). Documentation and white-boarding skills. Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics, and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake, and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted