Data Pipeline Automation Jobs in Bengaluru
1272 Jobs Found
Senior Data Engineer
Okta
Senior Data Engineer Enterprise Data Platform Location: Bengaluru Department: Business Technology Data Engineering Experience: 5+ Years Employment Type: Full-Time About Okta Okta is The World s Identity Company. We empower people to securely use any technology, anywhere, on any device. Through our Okta and Auth0 platforms, we provide secure access, authentication, and automation placing identity at the center of security and growth for thousands of organizations. We value diverse perspectives and lifelong learners. We re not looking for someone who checks every box we re looking for someone who will make us better with their unique experiences. Team: Business Technology Data Engineering The Data Engineering team at Okta supports cross-functional partners by building scalable, secure, and high-performing platforms. These platforms power decision-making and business processes across sales, marketing, engineering, finance, product, and operations. As part of this team, you ll contribute to data solutions that fuel Okta s hyper-growth. You will have the opportunity to work with cutting-edge technologies in cloud infrastructure, data lakes, automation, and CI/CD pipelines. The Role: Senior Data Engineer As a Senior Data Engineer, you will design, build, and manage modern data pipelines, infrastructure, and automation frameworks. You ll help scale our enterprise data platform using tools such as Snowflake, dbt, Airflow, Databricks, and AWS, while ensuring security, observability, and performance. You ll also contribute to CI/CD pipelines, infrastructure as code (IaC), and secure development lifecycle practices, enabling consistent, efficient, and secure delivery of data solutions. Key Responsibilities Platform Development & Infrastructure Design and maintain scalable data pipelines and platforms using Snowflake, AWS, Databricks, dbt, and Airflow. Manage infrastructure with Terraform, enabling repeatable and consistent deployments. Develop and maintain robust CI/CD pipelines using GitHub Actions, GitLab, or Jenkins. Containerize data services using Docker for better scalability and portability. Security & Compliance Implement and enforce secure development lifecycle practices, integrating tools like DAST, SAST, SCA, and Secret Scanning into pipelines. Conduct vulnerability scanning and apply patches to ensure system integrity. Ensure data security and compliance with industry standards and regulations. Collaboration & Innovation Collaborate with data engineers, data scientists, and analysts across business units to ensure data availability and integrity. Identify opportunities for automation and optimization within the data platform. Stay updated on emerging technologies and drive adoption of best practices. Must-Have Skills Bachelor s degree in Computer Science, Engineering, or a related technical field. 5+ years of experience in data engineering, including: Advanced SQL and ETL development with Airflow and dbt. Experience with data warehouses such as Snowflake, Redshift, or BigQuery. Strong hands-on experience with AWS (S3, Lambda, EC2, EMR, EKS). 2+ years of experience managing CI/CD pipelines using tools like GitHub Actions, GitLab, Jenkins, or ArgoCD. Experience with Terraform and Docker. Proficiency in backend languages such as Python, Java, or Go. Preferred Skills Experience with lakehouse architectures like Databricks, including knowledge of Delta Lake and Apache Iceberg. Background in infrastructure security, vulnerability management, and observability tooling. High Impact: Help build and scale the data platform that powers Okta s global business. Cutting-Edge Stack: Work with best-in-class technologies like AWS, Snowflake, dbt, Terraform, and Databricks. Collaborative Culture: Join a diverse, inclusive, and globally distributed team that values knowledge sharing and continuous learning. Career Growth: Shape the future of Okta s data engineering practice while expanding your technical and leadership skills. Bring your passion for data, cloud, and automation and let s shape the future of secure, scalable enterprise data platforms together. Qualification : Bachelors degree in Computer Science, Engineering, or a related technical field
Software Development Manager
Kaleidofin Private Limited
Software Development Manager Experience: 8+ Years Location: Bangalore Company: Kaleidofin About Us Kaleidofin is a mission-driven fintech platform committed to delivering financial solutions for underserved communities. Our proprietary ki credit platform combines advanced credit health analytics, middleware integration, risk dashboards, and debt capital structuring empowering financial institutions to serve low-income customers, informal sector businesses, and MSMEs more effectively. Operating across India, Bangladesh, and Kenya, we ve already impacted over 6 million customers, enabling over $3 billion in debt capital for underserved communities. Backed by global investors including the Gates Foundation, Omidyar Network, and Blume Ventures, Kaleidofin is recognized as a leader in inclusive finance. Featured on Forbes Asia's "100 to Watch" Winner of RBI s Swanari TechSprint 2023 Winner of G20 TechSprint 2024 by BIS Certified as a Great Place to Work Role Overview As a Software Development Manager, you will play a key leadership role in shaping the technical roadmap and executing high-impact fintech products. You ll lead a team of engineers to build scalable, secure, and robust systems. This is a hands-on leadership role requiring active involvement in design, architecture, and code-level decisions. What You ll Do Own the product s engineering roadmap, architecture, scalability, and code quality. Guide system design decisions and lead architecture/code reviews. Collaborate closely with Product and Business teams to align on product strategy and feature development. Provide hands-on technical leadership especially in solving complex problems in fintech and lending domains. Mentor and develop engineering talent; foster a culture of ownership, innovation, and quality. Champion engineering best practices including test automation, CI/CD, and DevOps. Lead the adoption of data-driven practices including Big Data, PySpark, and data pipeline architectures. Balance short-term deliverables with long-term technical sustainability and scalability. Support team growth through career development, learning plans, and succession planning. 8+ years of software development experience, with 1 2+ years in people/team management roles. Strong fundamentals in computer science, system design, and problem-solving. Bachelor's or Master's degree in CS or related field from a top engineering institution (IITs, NITs, etc.). Proven experience building distributed, scalable, and secure systems. Strong hands-on experience with Python, Java, Spring Boot, and microservice architectures. Proficient in SQL/NoSQL, Kafka, CI/CD pipelines, and DevOps tools (Docker, Kubernetes, Jenkins, etc.). Familiarity with AI/ML model integration and credit scoring systems is a strong plus. Experience with data engineering: Big Data, Spark, Airflow, AWS stack (S3, Glue, Athena), etc. Knowledge of front-end and mobile (Android) development is a plus. Experience working in fintech, lending tech, or high-growth startup environments preferred. Excellent leadership, communication, and cross-functional collaboration skills. Be part of a high-impact team driving financial inclusion at scale. Work on cutting-edge technology in fintech and data infrastructure. Grow with a company that s winning global recognition and delivering real-world impact. Contribute to a people-first culture that values learning, innovation, and work-life balance. Qualification : Bachelor's or Master's degree in CS or related field from a top engineering institution
Business Development Executive / Manager
Ebsl Automat
Job Title: Business Development Executive / Manager Location: Bengaluru No. of Positions: 1 2 Industry: Home Automation & AV, Building Automation Joining: Immediate About EBSL Automat Pvt. Ltd. EBSL Automat Pvt. Ltd. is a leading innovator in smart home automation solutions, committed to enhancing the comfort, convenience, and security of modern homes. Our portfolio includes a wide range of wired (KNX) and wireless (Wi-Fi, Zigbee) smart systems that simplify daily living and elevate the user experience. We re passionate about transforming spaces into intelligent, connected environments. Position Overview We are looking for an ambitious and tech-savvy Business Development Executive / Manager to expand our presence in the growing home automation market. The ideal candidate should have proven experience in sales, client engagement, and smart home technology, with a strong focus on KNX and wireless systems. You will play a critical role in driving revenue, building partnerships, and delivering tailored automation solutions to a premium clientele. Key Responsibilities Market Research & Strategy Identify trends, customer needs, and business opportunities within the home automation segment. Analyze market data, customer feedback, and competitor offerings to shape effective go-to-market strategies. Lead Generation & Prospecting Generate leads through client site visits, referrals, online platforms, and networking with architects, builders, contractors, interior designers, and consultants. Qualify prospects by assessing their needs, project scope, and budget alignment. Client Engagement & Relationship Building Build strong, long-lasting relationships with clients and key stakeholders in the industry. Understand customer pain points and provide tailored automation solutions, ensuring a high level of satisfaction. Sales Presentations & Proposals Conduct in-depth product demonstrations showcasing KNX and wireless automation systems. Prepare customized proposals, quotes, and contracts that align with client requirements and business goals. Sales Pipeline & Coordination Manage and track the entire sales cycle from lead to closure ensuring timely follow-ups and accurate reporting. Work closely with the technical and project teams to ensure smooth project execution and post-sale support. Business Growth & Market Expansion Identify cross-selling and upselling opportunities through existing client networks. Drive revenue growth by executing sales strategies to meet and exceed monthly, quarterly, and yearly targets. Qualifications & Skills Must-Have: Bachelor s degree in Business, Marketing, Engineering, or related field. Minimum 1+ years of experience in home automation and 2+ years of total work experience. In-depth knowledge of KNX, Wi-Fi, Zigbee and smart home technologies. Strong communication, negotiation, and presentation skills. Comfortable with local travel (10+ client visits/week). Proficient in CRM tools, Microsoft Office, and sales platforms. Commitment to a minimum 2-year tenure. Good-to-Have: Strong professional network with architects, interior designers, and builders. Skilled in closing deals and handling objections. Team-oriented mindset with the ability to align with marketing, technical, and customer service teams. Awareness of emerging trends in smart home and building automation sectors. If you're a motivated professional ready to shape the future of smart living and work in a high-impact role, EBSL Automat welcomes you to join our team and grow with us. Qualification : Bachelors degree in Business, Marketing, Engineering, or related field.
Data Architect
Growtharc Technologies
Position: Data Architect Location: Remote/Hybrid | Bengaluru, IND We're searching for a highly skilled and experienced Data Architect to join our team. If you have a deep understanding of big data technologies and extensive experience with Hadoop, Python, Snowflake, and Databricks, you're the ideal candidate. You'll be responsible for designing, implementing, and managing complex data architectures that support our critical business needs and objectives. What You'll Do: Design & Architecture Leadership: Design scalable and efficient data architecture solutions that meet current and future business data needs. Lead the development of data models, schemas, and databases, ensuring alignment with business requirements. Architect and implement robust data solutions on leading cloud platforms (AWS, Azure, or GCP). Data Management & Governance: Develop and maintain robust data pipelines and ETL processes using Hadoop, Databricks, and other essential tools. Oversee data integration and quality efforts to ensure consistency and reliability across the organization. Implement data governance best practices, focusing on data security, privacy, and compliance. Collaboration & Mentorship: Work closely with data engineers, data scientists, and business stakeholders to translate data requirements into effective technical solutions. Provide technical leadership and mentorship to junior data engineers and architects. Collaborate with cross-functional teams to ensure data solutions align perfectly with overall business goals. Optimization & Innovation: Optimize existing data architectures for peak performance, scalability, and cost-efficiency. Monitor and troubleshoot data systems to ensure high availability and reliability. Continuously evaluate and recommend new tools and technologies to improve our data architecture. What You'll Bring: Experience: 10+ years in data architecture, data engineering, or a related field. Big Data Expertise: Proven experience with Hadoop ecosystems (HDFS, MapReduce, Hive, HBase). Programming Prowess: Strong programming skills in Python for data processing and automation. Data Platform Mastery: Hands-on experience with Snowflake for data warehousing and Databricks for analytics. Cloud Fluency: Extensive experience with cloud platforms (AWS, Azure, GCP) and their data services. Data Modeling: Familiarity with data modeling tools and methodologies. Core Skills: Deep understanding of big data technologies and distributed computing. Strong problem-solving skills to design solutions for complex data challenges. Excellent communication skills, able to explain complex technical concepts clearly to diverse audiences. Proficient in SQL and database performance tuning. Experience with CI/CD pipelines and automation in data environments. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Advanced Degree: A Master's degree in a related field. Cloud Certifications: Certifications like AWS Certified Data Analytics, Google Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate. Additional Languages: Experience with other programming languages like Java or Scala. Machine Learning Integration: Knowledge of machine learning frameworks and their integration with data pipelines.
Data Science Specialist
5c Network Pvt. Ltd.
Position: Data Science Specialist Employment Type: Full-time Location: Bangalore, On-site Experience Required: 1 to 6 years (Mindset > Experience) About the Role: We re seeking a mission-driven, hands-on Data Analytics Specialist passionate about impact. This is not a typical analytics role you will drive key business metrics across clinical operations, stakeholder reporting, and automation. Collaborate closely with leadership, radiologists, operations, product teams, and AI engineers to ensure every decision is data-driven, actionable, and scalable. If you thrive on building dashboards, automating processes, streamlining pipelines, and driving growth through insights, this is your playground. Key Responsibilities: Own Business KPIs: Take full ownership of company-wide metrics, ensuring their accuracy, relevance, and actionability through stakeholder alignment. Data Engineering: Build and optimize ETL/ELT pipelines integrating data from Postgres, ClickHouse, and other sources. Dashboards & Reporting: Design and maintain intuitive dashboards (Metabase, Power BI, Tableau, Google Data Studio) that stakeholders actively use. Backend Data Transformation: Write clean, reusable code to convert raw data into actionable insights. API Development: Build and maintain internal APIs to serve analytics data to frontend and production systems. Email Automation: Develop real-time and scheduled email reports delivering dynamic insights to stakeholders. Spreadsheet Expertise: Automate and manipulate complex data in Excel/Google Sheets for detailed analysis and reporting. AI & Automation: Collaborate with AI teams to integrate predictive algorithms and automate analytics workflows. Business Acumen: Develop deep understanding of the teleradiology ecosystem clinical workflows, operations, financials, and tech platforms. Proactive Collaboration: Identify data gaps, flag inconsistencies, recommend improvements, and work closely with leadership. Required Skills: Strong Python skills for data analytics (Pandas, NumPy, FastAPI, Jupyter, etc.) Proficient in SQL (ClickHouse, PostgreSQL) with experience optimizing queries End-to-end dashboard ownership from data modeling to UI presentation Experience building or integrating APIs for analytics Advanced spreadsheet skills and formula-driven reporting Experience working with AI/ML models in applied settings (preferred) Hands-on backend data transformations, version control, and automation Familiarity with full-stack development frameworks (bonus) Bonus / Nice to Have: Exposure to dbt, Airflow, ChromaDB, Streamlit, Plotly Knowledge of data privacy, compliance, and healthcare analytics Experience building analytics platforms for SaaS or health-tech companies Mindset We re Looking For: 10x Hustler: Ready to learn fast and go the extra mile to solve problems. Obsessed with Accuracy: Data must be flawless before release. Extreme Ownership: Proactive in driving results without waiting for instructions. Fast Learner: Able to pick up new tools and concepts quickly. Business First, Code Later: Focused on impact, not just coding. Be part of India s fastest-growing teleradiology platform Direct access to leadership and real-world business impact Build game-changing analytics systems and influence strategy Gain exposure to AI, automation, product, and operations in one role Clear ramp-up roadmap and growth plan Expectations in First 3 Months: Build an end-to-end dashboard from scratch Clean up at least one messy data pipeline Automate a stakeholder email update Validate accuracy across critical business metrics Understand full-stack platform structure and propose an improvement
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Senior Associate Infrastructure L1 (AWS)
Publicis Sapient
Senior Associate Infrastructure L1 (AWS) Location: Bengaluru, India Department: Infrastructure & Cloud Engineering Employment Type: Full-Time About the Role As a Senior Associate Infrastructure L1 (AWS), you will design, implement, and manage secure, scalable, and highly available cloud infrastructure for enterprise digital transformation initiatives. You ll collaborate with cross-functional teams to automate deployments, enable DevOps best practices, and ensure robust observability across systems. Your goal is to reduce time-to-market and optimize performance, cost, and compliance. Key Responsibilities Architect and build immutable infrastructure on AWS and/or other cloud platforms. Implement and maintain infrastructure as code using Terraform, CloudFormation, or similar. Manage containerized environments using Kubernetes (EKS/GKE), ECS, Docker, and Helm. Implement service mesh (e.g., Istio) for advanced traffic management, monitoring, and security. Develop and manage CI/CD pipelines using Jenkins, GitLab, CircleCI, or similar. Automate build/deployment processes using Groovy, Go, Python, Shell, or PowerShell. Integrate DevSecOps and security scanning into the software delivery lifecycle. Configure and maintain monitoring, logging, and observability using: Monitoring: Prometheus, Grafana, Datadog, New Relic Logging: ELK Stack, Fluentd, Splunk Observability: OpenTelemetry, Jaeger, Kiali, CloudTrail, Dynatrace Troubleshoot infrastructure, performance, and deployment issues. Collaborate with application teams and stakeholders to ensure high performance and availability of deployed services. Required Skills & Qualifications 4 to 12 years of experience in Cloud Infrastructure & DevOps roles. Bachelor's or Master s degree in Engineering, Computer Science, or related field. Hands-on experience with AWS (EC2, VPC, IAM, Lambda, RDS, CloudWatch, etc.) Solid experience in container orchestration using Kubernetes (EKS/GKE) and infrastructure management. Expert in IaC tools like Terraform (preferred), ARM templates, Pulumi, etc. Proficiency in CI/CD pipeline automation and scripting. Familiarity with cloud-native security practices and vulnerability scanning tools. Experience with DNS, Load Balancers, and high-volume application infrastructure setup. Hands-on experience with artifact repositories like Nexus or Artifactory. Preferred Certifications (Nice to Have) Associate-level certifications in AWS, Azure, or GCP HashiCorp Certified Terraform Associate Benefits Gender-neutral workplace policies 18 paid holidays per year Generous parental leave and new parent transition support Flexible work arrangements Comprehensive Employee Assistance Program (mental & physical wellness) About Publicis Sapient Publicis Sapient is a global digital transformation partner helping established organizations evolve into their future state through technology, data, consulting, and customer-first experiences. With over 20,000 employees across 53 offices, we combine deep domain knowledge with a start-up mindset and agile methods to solve complex business challenges.
Business Technology Data Engineer
Samsara Inc
Position: Business Technology Data Engineer Location: Bengaluru, India (Hybrid 3 days onsite) Company: Samsara Technologies India Pvt. Ltd. About Samsara Samsara (NYSE: IOT) is a leader in the Connected Operations Cloud, enabling businesses across industries like transportation, logistics, manufacturing, and field services to harness IoT data for safety, efficiency, and sustainability improvements. Samsara helps organizations digitize physical operations at scale, improving outcomes that impact global infrastructure. Role Overview Samsara is seeking a Business Technology Data Engineer to join its Data & Analytics team within the Business Technology division. In this role, you will design, build, and optimize end-to-end data pipelines and infrastructure for various business-critical systems across CRM, marketing, support, and product platforms. You'll collaborate with teams across the company to build reliable and scalable data solutions that power reporting, automation, and analytics. This hybrid role requires working 3 days per week from the Bengaluru office and 2 days remotely, with working hours aligned to India Standard Time (IST). Key Responsibilities Data Engineering & Platform Development Design and maintain ETL/ELT pipelines that integrate and transform data across business systems. Build scalable data infrastructure to support advanced analytics and real-time reporting needs. Write Python and SQL scripts for data ingestion, transformation, and validation. Data Integration & Enablement Work with diverse data sources: CRM, product telemetry, marketing automation, support ticketing, and order flow systems. Develop and support data lake and data warehouse solutions using Snowflake, Redshift, Databricks, or BigQuery. Ensure interoperability between applications and data layers. Performance & Quality Monitor and optimize pipeline performance, implement observability and alerting. Improve data quality, lineage, and governance across systems. Partner with internal stakeholders (e.g., Sales Ops, Marketing Ops, Analytics) to deliver reliable data products. Minimum Qualifications Bachelor s degree in Computer Science, Data Engineering, or related field. 5+ years of professional experience in data engineering. 3+ years experience building and maintaining end-to-end pipelines in a modern data stack. Strong in SQL and Python. Hands-on experience with: ETL tools: Fivetran, dbt Cloud: AWS (preferred), GCP, or Azure Databases: MySQL, PostgreSQL, Oracle, or similar Data Warehouses: Snowflake, Redshift, BigQuery, Databricks Preferred Qualifications Familiarity with API-based ingestion, serverless architecture (Lambda, API Gateway, SQS, etc.). Experience with monitoring tools (DataDog, CloudWatch, Splunk). Comfortable engaging stakeholders to translate business needs into data solutions. Proficiency in Docker, Kubernetes, or AWS Fargate is a plus. Qualification : Bachelors degree in Computer Science, Data Engineering, or related field
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Senior Data Engineer
Cognite
Senior Data Engineer Location: Bengaluru Department: Global Strategic Services Data Engineering EMEA Type: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader driving industrial digital transformation. Our platforms Cognite Data Fusion and Cognite Atlas AI enable companies across Energy, Utilities, Manufacturing, and Chemicals to solve complex challenges using AI, contextual data, and automation. Cognite is backed by top-tier investors and recognized with global innovation awards. Our Values Impact: We deliver results that matter. Ownership: We take initiative, act inclusively, and embrace accountability. Relentless: We pursue excellence and innovation with resilience. About the Role As a Senior Data Engineer, you ll lead the development of scalable data solutions that empower critical industries to make informed decisions. You ll work on high-impact projects across regions, collaborating with solution architects, data scientists, and product teams. This is a growth role with room to influence product direction and mentor junior engineers. Key Responsibilities Architect and implement robust data pipelines using Cognite Data Fusion, Python, SQL, and REST APIs. Lead integrations, data modeling, and transformation tasks using cloud-native technologies. Design custom data models for discovery, mapping, and cleansing industrial data. Collaborate closely with cross-functional teams to deliver digital solutions. Conduct code reviews and champion engineering best practices. Contribute to Cognite s SDKs and internal tools. Translate customer use cases into scalable, reusable data engineering frameworks. Mentor team members and support customer onboarding when needed. What You ll Bring Bachelor s or Master s in Computer Science or related field (or equivalent experience). 5+ years in a data-intensive, customer-facing engineering role. Expertise in Python, SQL, REST APIs, and pipeline orchestration. Experience with distributed computing, Kubernetes, and cloud platforms (Azure, GCP). Familiarity with data from industrial domains like oil & gas or manufacturing is a plus. Strong DevOps mindset with hands-on experience in Git, CI/CD, and deployments. Proactive and collaborative; able to work independently and solve complex challenges. A growth mindset with willingness to ask for help and share knowledge openly. Be part of a global team spanning 70+ nationalities with strong DEI focus. Work at our Bengaluru office (Rathi Legacy, Hoodi) in a modern hybrid environment. Enjoy flat hierarchy, fast decision-making, and high ownership culture. Collaborate with world-class professionals on industry-transforming projects. Shape the future of industrial data and drive real-world impact at scale. If you re passionate about solving meaningful problems with cutting-edge data technologies, apply today. We welcome applicants from all backgrounds and experiences you might be the perfect fit, even if you don t meet every single requirement. Qualification : Bachelors or Masters in Computer Science or related field (or equivalent experience).
Pipeline And Gtm Senior Data Analyst
Rubrik
Pipeline and GTM Senior Data Analyst Location: Bangalore, India About the Role Rubrik s Pipeline & GTM Strategy and Analytics team seeks a Senior Pipeline and GTM Data Analyst to ensure high-quality data for pipeline development, measurement, and operational efficiency. Reporting to the Senior Manager of Pipeline & GTM Strategy and Analytics, you will play a key role in pipeline analytics, dashboard creation, and providing operational support for the Sales Development Representative (SDR) team. Your analytical expertise will empower data-driven decisions to accelerate growth. Key Responsibilities SDR Operations Support: Support territory and quota planning to grow the Inside Sales organization and drive revenue. Analyze strategic funnel metrics and measure sales performance. Administer and optimize sales tools like Salesforce (SFDC), Outreach, ZoomInfo, LinkedIn Sales Navigator, and more. Enhance lead routing and customer-facing messaging processes. Collaborate with Sales, Marketing, and IT teams to improve lead qualification and pipeline growth. Use data-driven insights to improve Inside Sales functions, incorporating input from cross-functional teams such as Marketing and Finance. Analytics & Reporting: Build, prepare, and analyze reports to support pipeline analytics and special projects that drive pipeline growth (PG) attainment. Create and maintain real-time dashboards for actionable insights. Validate and ensure data quality for SDR and pipeline dashboards. Continuous Improvement & Innovation: Enhance data management processes for improved efficiency and accuracy. Stay current with industry best practices in data analytics and management. Implement new tools and techniques for better data preparation and validation. Cross-Functional Collaboration: Facilitate smooth communication between SDR Operations and Analytics teams. Provide accurate, timely data to all relevant teams for informed decision-making. Participate in team meetings, offering data-driven recommendations. Required Skills and Experience 5+ years in Sales Operations, Strategy, or a related analytical role. Bachelor s degree or equivalent practical experience. Strong communication skills (written and oral). Self-starter with the ability to work independently and collaborate across all business levels. Salesforce (SFDC) administration experience. Advanced proficiency in Microsoft Excel or Google Sheets, including complex modeling and robust analysis. Experience with Microsoft Office suite (Word, Excel, PowerPoint, Outlook). Skilled in data visualization tools such as Tableau, PowerBI, or similar. Comfortable managing and analyzing large datasets. Preferred: Experience with SQL and/or Python for data querying and automation. Rubrik (NYSE: RBRK) is on a mission to secure the world s data. With Zero Trust Data Security , we help organizations build resilience against cyberattacks, insider threats, and operational disruptions. Our AI-powered Rubrik Security Cloud protects data across enterprise, cloud, and SaaS applications, ensuring integrity, availability, and rapid business recovery.
Lead Software Engineer - Backend
Neuron7.ai
Lead Software Engineer - Backend Location: Bengaluru, India Employment Type: Full-time, Hybrid About Neuron7.ai Neuron7.ai is a rapidly growing AI-first SaaS company that is redefining service intelligence. Backed by top-tier venture capitalists in Silicon Valley and a distinguished group of angel investors, we are recognized as a startup to watch. Our AI-driven platform helps enterprises make accurate service decisions at scale by delivering service predictions in seconds through the analysis of structured and unstructured data. We work across industries, including high-tech devices, manufacturing, and medical devices, enabling service leaders to excel in critical metrics like first-call resolution, turnaround time, and service margins. At Neuron7.ai, you ll be part of an innovative and dynamic team that is shaping the future of service intelligence. We value creativity, collaboration, and a commitment to pushing boundaries. This is your chance to make an impact in a fast-growing startup and work with cutting-edge technology. About the Team As a Lead Software Engineer - Backend, you will play a crucial role in architecting, developing, and optimizing backend systems for our groundbreaking products. You will lead a talented team, collaborating across functions to deliver scalable and high-performance systems. As a leader, you ll also mentor and guide junior engineers to help them grow in their careers. What You ll Do: Backend Systems Design: Lead the design and implementation of scalable, reliable, and high-performance backend systems. Distributed Systems: Develop and optimize distributed systems to handle large-scale traffic and data. System Architecture: Lead the architecture and design of critical components, ensuring robust and efficient solutions. Code Development: Write clean, maintainable, and efficient code that powers our AI-driven platform. Cross-Functional Collaboration: Work closely with product managers, frontend engineers, and other stakeholders to deliver end-to-end solutions. Troubleshooting & Debugging: Solve complex production issues and implement reliable, performance-optimized solutions. Mentorship: Provide guidance and mentorship to junior and mid-level engineers, fostering a collaborative environment. Continuous Learning: Stay updated on the latest trends and advancements in backend development, AI, and distributed systems. What We re Looking For: Experience: Minimum 10 years of professional experience in backend development, with at least 4 years of experience in AI, NLP, or ML. Programming Skills: Expertise in one of the following programming languages: Java, Python, or Golang. Distributed Systems: Proven experience in building and maintaining distributed systems at scale. Cloud Platforms: Familiarity with at least one major cloud platform (Azure, AWS, or GCP). System Design: Strong understanding of system design, architecture patterns, and data structures. Database Knowledge: Experience with relational and NoSQL databases. API Development: Proficiency in developing RESTful APIs and microservices. Security & Performance: Solid understanding of security best practices and performance optimization in backend systems. Problem-Solving Skills: Strong analytical skills with a proven track record of solving complex engineering challenges. Communication: Excellent communication skills with the ability to collaborate across teams and interact with non-technical stakeholders. Preferred Skills: Containerization: Experience with Kubernetes, Docker, or other containerization tools for scalable deployment. Messaging Systems: Familiarity with Kafka, RabbitMQ, or similar messaging systems for real-time data processing. CI/CD: Knowledge of CI/CD pipelines and automation tools to ensure efficient development and deployment. Data Pipelines: Familiarity with data pipelining frameworks such as PySpark, Flink, or similar for real-time processing. What We Do and Value: At Neuron7.ai, we prioritize integrity, innovation, and a customer-centric approach. Our mission is to enhance service decision-making through advanced AI technology, and we are dedicated to delivering excellence in every aspect of our work. Company Perks & Benefits: Competitive salary, equity, and spot bonuses Paid sick leave Latest MacBook Pro for your work Comprehensive health insurance Paid parental leave Work from home or from our vibrant Bengaluru office with hybrid work arrangements Our Commitment to Diversity and Inclusion: Neuron7.ai is committed to fostering a diverse and inclusive workplace. We ensure equal employment opportunities without discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, marital status, or any other characteristic protected by law. If you re excited about building innovative backend solutions and want to work with cutting-edge technologies in a forward-thinking team, we d love to hear from you!
Product Manager
Mathco (themathcompany)
Product Manager Location: Bengaluru, Karnataka, India Department: Product Engineering Experience: 5 8 Years Employment Type: Full-Time About the Role We re looking for a Product Manager who thrives on building enterprise-grade products from the ground up. In this role, you ll own the P&L for custom-built, high-impact self-service apps developed for Fortune 500 clients ranging from performance monitoring to advanced analytics. These products already show 3x 5x ROI within the first year, and you ll be central to scaling that success. You will lead cross-functional squads of engineers, data scientists, designers, and BAs through the 0-to-1 journey across more than 30+ products in development. This is your chance to work on deeply technical solutions while driving product vision, delivery, and value realization. What You ll Do Product Development & Delivery Own and drive the entire product lifecycle from discovery to go-to-market and continuous iteration. Collaborate with engineering and design teams to translate requirements into feature-rich, scalable applications. Manage timelines, scope, and quality to ensure timely and high-quality product delivery using Agile/Scrum methodologies. Strategic Product Ownership Collaborate closely with clients to co-create tailored solutions that address specific business challenges. Define product goals, success metrics, and prioritization frameworks that align with business outcomes. Participate in core platform strategy meetings to influence the architecture powering all client-facing products. Technical Collaboration Partner with technical architects to design system architecture that is scalable and cloud-optimized. Oversee DevOps and CI/CD pipelines, promoting seamless development-to-deployment workflows. Ensure efficient data pipeline development, warehousing, and transformation aligned with product needs. Quality, Testing, and Rollout Define and manage test strategy including unit testing, automation suites, and QA gates. Own production rollouts and ensure smooth post-launch monitoring and feedback loops. Key Requirements Technical Skills 5 8 years of experience in product management, particularly for custom or data-driven applications. Hands-on experience working with UI/UX teams, and comfort with technologies such as React, Python, APIs, HTML/CSS. Understanding of cloud environments (AWS, Azure, GCP) and cost-optimized architectures. Familiarity with ETL processes, data lakes/warehouses, and modern product analytics frameworks. Non-Technical Skills Exceptional problem-solving, communication, and stakeholder management skills. Ability to juggle multiple priorities in a fast-paced environment while keeping teams aligned and motivated. Experience working with project management tools such as JIRA, Confluence, or similar platforms. Preferred Qualifications Proven experience managing multiple cross-functional product teams. Demonstrated ability to build from scratch ideate, prototype, iterate, and launch. Exposure to product-led growth strategies or enterprise SaaS models. Work on cutting-edge enterprise solutions used by Fortune 500 companies. Be part of a fast-paced, high-ownership environment where your contributions directly impact business outcomes. Collaborate with top-tier tech, data, and design teams to build transformative tools. Shape the future of self-service analytics and intelligent apps.
Java Developer
Raytheon Technologies Corporation
Java Developer Digital Engine Services Company: Pratt & Whitney Location: Bengaluru Experience: 5 8 years Job Type: Full-time About Us Pratt & Whitney, a Raytheon Technologies company, designs the world s most advanced aircraft engines. Our digital transformation efforts include connected engines and diagnostic platforms, enabling safer and smarter flight. Join our global team of innovators redefining aerospace. Role Summary We're hiring a skilled Java Developer to work on our DPHM Ground Station platform, managing engine data ingestion, transfer, and diagnostics. You will develop cloud-based microservices and automation tools to support predictive maintenance and fleet insights. Responsibilities Design and develop Java microservices for file ingestion and transfer. Work with AWS services (Lambda, S3) for cloud-native development. Manage Apache Kafka-based data pipelines. Automate alerts and monitoring systems for engine data processing. Build CI/CD pipelines and implement unit/integration testing. Define KPIs and create dashboards using data cubes and APIs. Collaborate with P&WC IT for DevSecOps and troubleshooting. Qualifications Bachelor s/Master s in Software Engineering or Computer Science. 5 8 years of experience in Java, OOP, cloud, and messaging systems. Hands-on with Kafka, AWS Lambda, CI/CD, and GitHub. Excellent English communication and teamwork skills. Preferred AWS certification IoT data pipeline experience Familiarity with C#/C++ Benefits Flexible work schedules Parental leave and childcare support Career development programs Health and savings plans Apply Now Equal Opportunity Employer All applicants are considered without regard to race, gender, disability, veteran status, or other protected attributes. RTX is an equal opportunity employer. Qualification : Bachelors/Masters in Software Engineering or Computer Science.
Senior Software Engineer - Backend
Finbox
Senior Software Engineer - Backend | FinBox Location: Bengaluru Experience: 4-8 Years About FinBox: Where Fintech Meets Fun! Welcome to FinBox, a thriving hub of innovation at the intersection of fintech and technology. Founded in 2017, we specialize in building cutting-edge technologies for the financial services industry, helping lenders like Banks, NBFCs, and large enterprises to launch credit products faster and more efficiently than ever before. We are a Series A funded startup with a growing global presence, including offices in India, Vietnam, Indonesia, and the Philippines. To date, FinBox has enabled the disbursement of billions of dollars in credit across various types of loans, including personal, business, mortgage, and education loans. Over 100 companies use our solutions, delivering credit to millions of customers every month. Innovative Environment: We encourage creative thinking and experimentation to push the boundaries of fintech. Impactful Work: Your work will have a direct impact on millions of people by making credit more accessible and inclusive. Growth Opportunities: As a Series A startup, we offer plenty of opportunities for personal and professional growth. Collaborative Culture: Work in a diverse, inclusive team where everyone is passionate about making a difference. Creative Thinkers: You love experimenting with new ideas and enjoy solving complex problems in unique ways. Customer Heroes: You understand customer needs and aim to deliver seamless and impactful experiences. Team Players: You thrive in a collaborative environment, and value contributing to the team s success. Role & Responsibilities As a Senior Software Engineer - Backend, you will: Architect & Build: Design and implement new services to meet critical business needs and product requirements. End-to-End Ownership: Take full responsibility for the services you build, including fintech APIs and core components. Collaboration: Work closely with engineers, designers, product managers, and senior leadership to create actionable roadmaps. CI/CD & Automation: Help build and integrate systems into CI/CD pipelines, focusing on testing, QA, and automation. Write High-Quality Code: Deliver clean, performant, and well-tested code for all our products. Continuous Improvement: Ensure the continuous evolution of backend systems to support FinBox s growth and scalability. Who You Are We re looking for someone who has: A degree in Computer Science (B.Tech/MCA/M.Tech) or equivalent. In-depth knowledge of programming languages, with preferences for Go, Rust, Elixir/Erlang, Java, Python, or JavaScript. Strong understanding of Computer Science fundamentals, including algorithms, data structures, and competitive coding. Experience with Cloud Platforms: Proficiency in AWS, Azure, or Google Cloud, including Terraform for infrastructure automation. Experience with Databases: Solid knowledge of PostgreSQL and experience with Big Data pipelines. Proficiency in Automation: Experience automating systems and deployments using tools such as GitLab. Web Tech Understanding: Good knowledge of web technologies, protocols, and architecture such as HTTP, RESTful APIs, and web standards. Problem Solver: Strong analytical and problem-solving skills, combined with a fast-learning mindset. Effective Communicator: Excellent verbal and written communication skills to collaborate effectively with cross-functional teams. Be part of a dynamic, fast-growing company working on innovative financial technologies. Take ownership of high-impact backend systems that power fintech solutions for global customers. Work alongside a talented, diverse team in an inclusive environment where your ideas and contributions matter. If you re passionate about backend development and want to make an impact in the fintech world, apply now and become part of the FinBox team! Excited to start the next chapter in your career? Apply today! Qualification : A degree in Computer Science (B.Tech/MCA/M.Tech) or equivalent.
Analytics Lead/architect
Oracle India
Analytics Lead/Architect Location: Bengaluru, Karnataka, India Job Category: Consulting Job Type: Regular Employee Role: Individual Contributor Job Description: As a BI Architect, you will work on both offshore and onsite client projects. Your responsibilities will involve working with Oracle BI Applications, OAC (Oracle Analytics Cloud), and ODI (Oracle Data Integrator) implementations. You will engage with clients to understand their requirements, lead technical designs, and oversee system and integration testing using Oracle methodologies. You will also contribute to PreSales, the creation of Go-to-Market (GTM) strategies, and take the lead in developing IP/solution accelerators. Additionally, you will be responsible for owning the technical delivery of large, complex projects. Responsibilities: Lead Oracle BI Applications, OAC, and ODI implementations. Interact with clients to understand and gather business requirements. Oversee technical design, development, and system/integration testing. Contribute to PreSales activities and the creation of Go-to-Market (GTM) strategies. Lead the development of IP/solution accelerators. Own the technical delivery of large and complex projects. Required Skills: BI (Business Intelligence) expertise. Experience with Oracle Data Integrator (ODI). This position offers the opportunity to work on cutting-edge analytics technologies and deliver impactful solutions in a collaborative and dynamic environment. If you have significant experience in Oracle BI and ODI implementations, and enjoy leading large, complex projects, we would love to hear from you.
Senior Architect - Gbs
Happiest Minds Technologies
Job Title: AWS / Azure Architect Job Overview: We are seeking a skilled and experienced AWS / Azure Architect to join our team. This individual will be responsible for transforming customer business requirements into innovative, scalable solutions based on Java and other open-source technologies. You will lead architecture discussions, oversee the implementation of solutions, and provide technical guidance to development teams to ensure successful project execution. Key Responsibilities: Solution Design & Architecture: Translate business requirements into cutting-edge, efficient technical solutions using Java and open-source technologies. Lead the architectural discussions and design the overall solution framework, ensuring it aligns with business goals. Define development structures, standards, and best practices for solution implementation. Implementation & Guidance: Take a hands-on approach in the implementation of solutions, providing technical direction to implementation teams. Design and implement Continuous Integration / Deployment (CI/CD) pipelines. Develop and maintain technical documentation to ensure clarity and knowledge sharing. Pre-Sales Support: Participate in Request for Proposals (RFPs) and Proof of Concept (PoC) / Proof of Value (PoV) creation. Present and communicate architectural solutions effectively to prospects and clients, building confidence in the proposed solutions. Research & Development: Stay updated on the latest technological advancements in Java, open-source technologies, cloud computing, and microservices. Share new insights with the team and continuously improve the organization's technical capabilities. Technical Skills & Experience Required: Cloud Infrastructure & Architecture: 10-12 years of experience in designing and delivering enterprise-level solutions, with a focus on Java/Python technologies. 5-6 years of hands-on experience in architecting solutions on AWS and/or Azure. Expertise in cloud architecture, including hybrid infrastructures, multi-zone/cluster setups, and disaster recovery design. Core Technical Knowledge: Strong understanding of cloud design principles, including scalability, resiliency, and high availability. Extensive experience with database systems (SQL & NoSQL) and microservices architectures. Knowledge of key technologies like Docker, Kubernetes, and containerization concepts. Software Engineering & Development: Proficient in data structures, algorithms, design patterns, and application design methodologies. Expertise in developing and deploying RESTful web services, with a focus on performance and security. Familiarity with Test-Driven Development (TDD) and Behavior-Driven Development (BDD) practices, using tools like JUnit and TestNG. Cloud-Specific Expertise: In-depth knowledge of cloud platforms (AWS / Azure), including infrastructure setup, services, networking, security policies, and Kubernetes (EKS). Experience in deploying enterprise-level applications on cloud platforms, managing production environments, and optimizing performance. Preferred Qualifications: Hands-on experience with cloud-native application architectures. Familiarity with CI/CD pipeline setup and automation tools. Strong problem-solving abilities and the capability to mentor and lead cross-functional teams. What We Offer: The opportunity to work on cutting-edge cloud solutions for enterprise clients. A collaborative and dynamic work environment. Opportunities for career growth and continuous learning in the cloud computing space.
Software Quality Assurance Engineer
Isoftcells
Job Title: Software Quality Assurance Engineer Location: Bengaluru Experience: 3-6 years Job Overview We are looking for a skilled Software Quality Assurance Engineer with a strong background in software testing, quality assurance, and automation. The ideal candidate will have hands-on experience with Java, JUnit, and JavaScript scripting, as well as expertise in automating tests for back-end, API, and front-end systems. You will play a key role in ensuring the quality of our software products by working within a dynamic, multi-product, and multi-service environment. Key Responsibilities Software Testing: Perform various types of testing such as white-box, smoke tests, manual, and database tests to ensure the quality of the software. Automation Testing: Automate tests for back-end, API, and front-end components using tools like Protractor, Cypress, and others, in a complex multi-product, multi-service environment. Problem Solving & Troubleshooting: Troubleshoot issues identified during testing, understand the root causes, and work with developers to provide clear information and assist in fixing the problems. Test Documentation: Define, execute, and document manual and automated tests, prepare detailed test data and test results for transparency. CI/CD Integration: Configure and integrate automated testing scripts into the CI/CD pipeline to ensure continuous quality and streamlined testing. Adaptability: Ability to adapt testing techniques and approaches based on specific project and product requirements, ensuring flexibility in a fast-paced environment. Collaboration: Work with multiple teams across different products and projects, ensuring testing methodologies are aligned with functional and non-functional requirements. Agile Methodologies: Exposure to Agile methodologies and ability to participate in sprint cycles to deliver high-quality software at every stage. Performance Testing: Develop and execute performance tests, measuring system efficiency and ensuring optimal performance under various conditions. Skills and Qualifications Programming Skills: Strong hands-on experience with Java, JUnit, and JavaScript (Must have). Automation Tools: Proficiency in using Protractor, Cypress, or similar tools to automate back-end, API, and front-end tests. Software Quality Assurance: Strong experience in software testing, including various test types (unit, integration, system, acceptance). Problem-Solving Skills: Excellent troubleshooting skills with the ability to identify root causes of issues and collaborate with developers to resolve them. Agile Exposure: Familiarity with Agile methodologies and working in a sprint-based development environment. CI/CD Pipeline Integration: Hands-on experience integrating test automation scripts into the CI/CD pipeline for continuous integration and delivery. Test Documentation: Ability to write clear and concise test cases, test results, and test plans. Performance Testing: Experience with developing and running performance tests to assess application performance and scalability. Adaptability: Ability to quickly adapt testing methods to meet different project requirements and environments. Dynamic Environment: Work in a fast-paced, evolving environment where you ll be involved in multiple products and projects. Growth Opportunities: Learn from industry experts and gain exposure to new technologies and methodologies. Collaborative Culture: Be part of a team that celebrates teamwork, continuous learning, and a passion for solving complex problems. If you have a strong background in Software Quality Assurance, Automation Testing, and are passionate about ensuring the highest software quality, we would love to have you join our team! Let s celebrate work together!
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Data Engineer - Platform Generative Ai
Mckinsey & Company
Your Impact We are seeking a passionate Data Engineer with expertise in Python development who is excited about cloud-based data engineering using AWS services. You will be an integral part of a dynamic, multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers, and other stakeholders. As a key member of a global team working on our generative AI initiative, you will be based in one of our European offices. McKinsey s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm s internal use, and your role will be crucial in driving the development of data solutions to support generative AI applications. You will work with a team of data engineers to develop robust data ingestion pipelines and enhance data processing capabilities that integrate data into systems used by AI applications. Your responsibilities will include writing Python code, creating tests, developing and maintaining GitHub Action CICD pipelines, and managing AWS-based infrastructure and Docker containers. Your Growth As a member of the global team working on our generative AI initiative, you will play a key role in shaping and accelerating the delivery of McKinsey's target state data platform, which will enable AI use-cases. You will be part of our cloud-first approach, transforming data platforms and analytical applications across the firm. Working closely with multidisciplinary teams, you will contribute to building cutting-edge data solutions in a fast-paced, innovative environment. McKinsey s Tech Ecosystem function is responsible for developing all technology solutions for the firm s internal needs, and you ll have the opportunity to shape how these solutions evolve. Your Qualifications and Skills 3+ years of professional experience as a Data Engineer, with a focus on cloud-based data engineering using AWS services Expertise in Python development and a strong understanding of clean code, modularity, error handling, and test automation Extensive experience with relational databases and data pipeline performance Hands-on experience with Docker and CI/CD pipelines (e.g., GitHub Actions) Strong execution focus, with the ability to work independently in complex, fast-paced environments and deliver results Demonstrable experience in solving data pipeline performance issues and diagnostics Interest in generative AI and machine learning topics Experience with Kedro framework is a plus Opinionated and confident in sharing ideas, willing to speak up at all levels Familiarity with Agile principles and product development methodologies Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted