Python Developer With Airflow Jobs in Bengaluru
583 Jobs Found
Python Developer
Acsia Technologies
Python Developer Location: Bengaluru Experience: 6 8 years Job Description We are looking for an experienced Python Developer with a strong background in automation and scripting to join our growing development team. The ideal candidate will have hands-on expertise in Python and a keen interest in working on complex systems, with optional experience in C/C++ and exposure to the automotive domain. Key Responsibilities Design, develop, and maintain robust Python applications and automation scripts. Work with Python automation frameworks to streamline development and testing processes. Collaborate with cross-functional teams to integrate software components and improve overall system performance. Contribute to code reviews, technical discussions, and best practices. Required Skills Strong proficiency in Python programming (mandatory). Solid understanding of Python-based automation frameworks. Experience with C/C++ development is a plus. Exposure to the automotive domain is desirable but not essential. Strong problem-solving skills and the ability to work independently. If you're a Python expert looking to build impactful solutions in a fast-paced, tech-driven environment, we d love to hear from you.
Senior Data Engineer
Okta
Senior Data Engineer Enterprise Data Platform Location: Bengaluru Department: Business Technology Data Engineering Experience: 5+ Years Employment Type: Full-Time About Okta Okta is The World s Identity Company. We empower people to securely use any technology, anywhere, on any device. Through our Okta and Auth0 platforms, we provide secure access, authentication, and automation placing identity at the center of security and growth for thousands of organizations. We value diverse perspectives and lifelong learners. We re not looking for someone who checks every box we re looking for someone who will make us better with their unique experiences. Team: Business Technology Data Engineering The Data Engineering team at Okta supports cross-functional partners by building scalable, secure, and high-performing platforms. These platforms power decision-making and business processes across sales, marketing, engineering, finance, product, and operations. As part of this team, you ll contribute to data solutions that fuel Okta s hyper-growth. You will have the opportunity to work with cutting-edge technologies in cloud infrastructure, data lakes, automation, and CI/CD pipelines. The Role: Senior Data Engineer As a Senior Data Engineer, you will design, build, and manage modern data pipelines, infrastructure, and automation frameworks. You ll help scale our enterprise data platform using tools such as Snowflake, dbt, Airflow, Databricks, and AWS, while ensuring security, observability, and performance. You ll also contribute to CI/CD pipelines, infrastructure as code (IaC), and secure development lifecycle practices, enabling consistent, efficient, and secure delivery of data solutions. Key Responsibilities Platform Development & Infrastructure Design and maintain scalable data pipelines and platforms using Snowflake, AWS, Databricks, dbt, and Airflow. Manage infrastructure with Terraform, enabling repeatable and consistent deployments. Develop and maintain robust CI/CD pipelines using GitHub Actions, GitLab, or Jenkins. Containerize data services using Docker for better scalability and portability. Security & Compliance Implement and enforce secure development lifecycle practices, integrating tools like DAST, SAST, SCA, and Secret Scanning into pipelines. Conduct vulnerability scanning and apply patches to ensure system integrity. Ensure data security and compliance with industry standards and regulations. Collaboration & Innovation Collaborate with data engineers, data scientists, and analysts across business units to ensure data availability and integrity. Identify opportunities for automation and optimization within the data platform. Stay updated on emerging technologies and drive adoption of best practices. Must-Have Skills Bachelor s degree in Computer Science, Engineering, or a related technical field. 5+ years of experience in data engineering, including: Advanced SQL and ETL development with Airflow and dbt. Experience with data warehouses such as Snowflake, Redshift, or BigQuery. Strong hands-on experience with AWS (S3, Lambda, EC2, EMR, EKS). 2+ years of experience managing CI/CD pipelines using tools like GitHub Actions, GitLab, Jenkins, or ArgoCD. Experience with Terraform and Docker. Proficiency in backend languages such as Python, Java, or Go. Preferred Skills Experience with lakehouse architectures like Databricks, including knowledge of Delta Lake and Apache Iceberg. Background in infrastructure security, vulnerability management, and observability tooling. High Impact: Help build and scale the data platform that powers Okta s global business. Cutting-Edge Stack: Work with best-in-class technologies like AWS, Snowflake, dbt, Terraform, and Databricks. Collaborative Culture: Join a diverse, inclusive, and globally distributed team that values knowledge sharing and continuous learning. Career Growth: Shape the future of Okta s data engineering practice while expanding your technical and leadership skills. Bring your passion for data, cloud, and automation and let s shape the future of secure, scalable enterprise data platforms together. Qualification : Bachelors degree in Computer Science, Engineering, or a related technical field
Sr. Python Framework Developer
Scaledge
Job Title: Sr. Python Framework Developer Location: Bangalore Experience: 4 6 Years Responsibilities Design and develop scalable, efficient, and functional tools and software solutions. Independently drive development projects ensuring the highest code quality and best practices. Lead a team of developers to deliver high-quality products within deadlines. Collaborate with stakeholders to gather product requirements and assess/prioritize feature requests. Demonstrate expertise in advanced system design and complex subsystem integration. Utilize strong object-oriented programming skills and advanced Python features such as threading, lambda functions, concurrency, and parallelism. Create and maintain clear technical documentation and effectively present solutions to stakeholders. Exhibit strong debugging skills and the ability to investigate and resolve complex issues efficiently.
Software Development Manager
Kaleidofin Private Limited
Software Development Manager Experience: 8+ Years Location: Bangalore Company: Kaleidofin About Us Kaleidofin is a mission-driven fintech platform committed to delivering financial solutions for underserved communities. Our proprietary ki credit platform combines advanced credit health analytics, middleware integration, risk dashboards, and debt capital structuring empowering financial institutions to serve low-income customers, informal sector businesses, and MSMEs more effectively. Operating across India, Bangladesh, and Kenya, we ve already impacted over 6 million customers, enabling over $3 billion in debt capital for underserved communities. Backed by global investors including the Gates Foundation, Omidyar Network, and Blume Ventures, Kaleidofin is recognized as a leader in inclusive finance. Featured on Forbes Asia's "100 to Watch" Winner of RBI s Swanari TechSprint 2023 Winner of G20 TechSprint 2024 by BIS Certified as a Great Place to Work Role Overview As a Software Development Manager, you will play a key leadership role in shaping the technical roadmap and executing high-impact fintech products. You ll lead a team of engineers to build scalable, secure, and robust systems. This is a hands-on leadership role requiring active involvement in design, architecture, and code-level decisions. What You ll Do Own the product s engineering roadmap, architecture, scalability, and code quality. Guide system design decisions and lead architecture/code reviews. Collaborate closely with Product and Business teams to align on product strategy and feature development. Provide hands-on technical leadership especially in solving complex problems in fintech and lending domains. Mentor and develop engineering talent; foster a culture of ownership, innovation, and quality. Champion engineering best practices including test automation, CI/CD, and DevOps. Lead the adoption of data-driven practices including Big Data, PySpark, and data pipeline architectures. Balance short-term deliverables with long-term technical sustainability and scalability. Support team growth through career development, learning plans, and succession planning. 8+ years of software development experience, with 1 2+ years in people/team management roles. Strong fundamentals in computer science, system design, and problem-solving. Bachelor's or Master's degree in CS or related field from a top engineering institution (IITs, NITs, etc.). Proven experience building distributed, scalable, and secure systems. Strong hands-on experience with Python, Java, Spring Boot, and microservice architectures. Proficient in SQL/NoSQL, Kafka, CI/CD pipelines, and DevOps tools (Docker, Kubernetes, Jenkins, etc.). Familiarity with AI/ML model integration and credit scoring systems is a strong plus. Experience with data engineering: Big Data, Spark, Airflow, AWS stack (S3, Glue, Athena), etc. Knowledge of front-end and mobile (Android) development is a plus. Experience working in fintech, lending tech, or high-growth startup environments preferred. Excellent leadership, communication, and cross-functional collaboration skills. Be part of a high-impact team driving financial inclusion at scale. Work on cutting-edge technology in fintech and data infrastructure. Grow with a company that s winning global recognition and delivering real-world impact. Contribute to a people-first culture that values learning, innovation, and work-life balance. Qualification : Bachelor's or Master's degree in CS or related field from a top engineering institution
Lead / Senior Software Engineer
Ultraviolette Automotive
Job Title: Lead / Senior Software Engineer (Microservices, IoT, Kafka, AWS) Location: Bengaluru Experience Required: 5 8 years Industry: Automotive (Electric Mobility) Employment Type: Full-time About Ultraviolette Join the Charge. Create the Future. At Ultraviolette, we re not just building electric vehicles we re redefining what mobility looks and feels like. From creating India s fastest electric motorcycle to designing the world s most advanced electric scooter, we're on a mission to engineer machines that are not only sustainable, but also exhilarating. Our team is a diverse mix of engineers, designers, dreamers, and doers, united by a bold vision to accelerate the global shift to electric mobility. If you're driven by innovation and looking to work on cutting-edge products that challenge the status quo, this is your platform to make a real impact. About the Role We are looking for a Senior/Lead Software Engineer who thrives in designing scalable, high-performance, and cloud-native microservices. This role is ideal for someone with hands-on experience in Java, Spring Boot, Kafka, and AWS, and a keen interest in IoT and real-time data architectures. You will work at the intersection of hardware and software helping us bring our vision of connected, intelligent, and high-performance electric vehicles to life. Key Responsibilities Design, develop, and deploy Java-based microservices using Spring Boot and related technologies. Architect and implement event-driven systems using Apache Kafka for real-time IoT data streaming. Build and manage RESTful APIs with AWS API Gateway for seamless service integration. Leverage AWS services such as Lambda, DynamoDB, and MemoryDB to build scalable, serverless solutions. Collaborate with cross-functional teams front-end developers, DevOps, and product managers to convert ideas into working features. Optimize application performance, troubleshoot issues, and ensure high reliability and availability. Mentor junior engineers, conduct code reviews, and enforce clean coding practices. Contribute to architecture decisions, technical roadmaps, and innovation initiatives. Stay on top of emerging technologies in cloud, microservices, and IoT ecosystems. Participate actively in Agile processes including sprint planning, stand-ups, and retrospectives. Required Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or a related field. 5+ years of hands-on experience in Java development, with a strong foundation in Spring Boot. Proven experience designing and deploying microservices architectures. Strong knowledge of Kafka and real-time streaming/data pipeline architectures. Hands-on experience with Docker and Kubernetes for containerization and orchestration. Understanding of IoT protocols such as MQTT or CoAP and device connectivity. Proficiency with version control (Git) and Agile methodologies. Excellent problem-solving, communication, and collaboration skills. Nice to Have AWS Certifications (e.g., AWS Certified Developer or Solutions Architect). Experience with additional languages like Python or Rust. Familiarity with NoSQL databases such as MongoDB or Cassandra. Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure as Code (e.g., Terraform). Exposure to stream processing frameworks (e.g., Apache Flink, Spark Streaming). Experience in edge computing and distributed systems. Strong understanding of cloud security best practices. Work on India s most futuristic electric vehicles at the intersection of technology, performance, and sustainability. Be part of a mission-driven company shaping the future of mobility. Collaborate with some of the most talented engineers and designers in the industry. A fast-paced environment that celebrates innovation, learning, and growth. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field
Fullstack (java) Developer
Sourcefuse
Job Title: Full Stack (Java) Developer Location: Bangalore, India Experience: 3+ years Industry: IT Services Job Type: Full-time Role Overview As a Full Stack (Java) Developer, you ll design and build scalable backend services, integrate cloud-native features, and contribute across the stack from UI development to DevOps. The role demands hands-on expertise with Java, JavaScript, cloud platforms (especially AWS), RESTful APIs, and modern frameworks. You ll collaborate with cross-functional teams to deliver robust, secure, and high-performance applications, while also mentoring junior developers and contributing to code quality and DevOps processes. Key Technical Skills Programming Languages: Proficient in Java, JavaScript, and Python Familiar with Ruby, PHP, C# (bonus) Frontend & Web: Strong with HTML, CSS, JavaScript, jQuery Experience with modern JS frameworks: React, Angular, Vue.js Backend & Frameworks: Skilled in Spring, Django, Express.js Cloud & DevOps: AWS: Lambda, API Gateway, S3, CloudWatch Tools: Docker, Kubernetes, Git, Maven, CI/CD pipelines Databases & APIs: SQL/NoSQL: MySQL, PostgreSQL, MongoDB RESTful APIs and familiarity with GraphQL Testing & Optimization: Testing frameworks: JUnit, Jest, Mocha Performance optimization and code reviews Other Tools & Skills: Familiarity with IBM RAM Basic understanding of UI/UX principles Responsibilities Build and maintain scalable backend architectures Optimize backend services for performance and reliability Integrate and manage RESTful APIs Lead feature testing, release planning, and automation Work with CI/CD pipelines, Docker, and Kubernetes Implement security measures and ensure compliance Conduct code reviews and mentor junior team members Preferred Qualifications 3+ years of full stack development experience Strong problem-solving and communication skills English (mandatory); Japanese (optional but a bonus) Interview Process Assessment Two Technical Rounds
Senior Developer SQL & Snowflake
Thoughtfocus
Job Title: Senior Developer SQL & Snowflake Location: Bangalore, India Experience: 7+ Years (Minimum 3+ years in Snowflake) Employment Type: Full-Time Job Overview: We are seeking a highly skilled Senior Snowflake Developer to join a global financial services project for a client operating in public/private loans, CLOs, and long/short credit. The ideal candidate will bring expertise in Snowflake, SQL, Coalesce, and Fivetran, with a strong background in data integration and cloud-based data warehousing. You will be instrumental in driving forward key data initiatives and delivering innovative, scalable data solutions in a fast-paced, agile environment. Key Responsibilities: Design, develop, and optimize Snowflake objects including databases, schemas, tables, views, and stored procedures. Build and maintain Snowflake data pipelines utilizing tools like SnowSQL, SnowPipe, Streams, and Tasks. Implement data loading strategies using COPY, PUT, GET, LIST, and REMOVE commands for batch and bulk data movement. Ensure seamless migration and integration of data from Azure Cloud to Snowflake with high attention to performance and data integrity. Define and manage Snowflake roles, custom role hierarchies, masking policies, and network policies for enhanced security and governance. Use Coalesce and Fivetran for designing and managing ETL/ELT workflows that extract and transform data from MS SQL Server. Write complex T-SQL queries, stored procedures, triggers, and functions for data transformation and reporting. Collaborate closely with cross-functional teams to understand requirements and translate them into technical solutions. Participate in Agile sprints, offering technical guidance, solution design, and timely issue resolution. Required Skills & Qualifications: 8+ years of total IT experience with at least 3+ years of Snowflake development experience. In-depth understanding of Snowflake architecture, utilities, and performance optimization techniques. Strong expertise in MS SQL Server with proficiency in writing advanced T-SQL scripts. Hands-on experience with ETL tools like Coalesce and Fivetran. Proficiency in Azure Data Integration strategies and tools. Excellent problem-solving and communication skills. Experience working in an Agile development environment. Preferred Skills: Prior exposure or high-level understanding of hedge funds, private equity, or private debt domains. Familiarity with data governance and compliance requirements in financial institutions. What s on Offer: Competitive and above-market salary. Hybrid work model with flexibility. Opportunity to work on cutting-edge technology in global financial markets. Collaborative, innovation-driven team culture. Education: Bachelor s degree in Computer Science, Information Technology, Finance, Economics, or a related discipline.
Lead AI/ML Engineer
Synechron
Position Title: Lead AI/ML Engineer Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is seeking a seasoned Lead AI/ML Engineer to lead cutting-edge initiatives in artificial intelligence and machine learning. This role requires deep technical expertise in AI/ML, including deep learning, NLP, computer vision, and generative AI, combined with strong leadership skills to manage teams and drive innovation. You will collaborate closely with stakeholders to deliver high-impact solutions and play a key role in shaping the company s AI-driven digital transformation. Key Responsibilities Lead end-to-end development of AI/ML solutions across use cases involving machine learning, deep learning, computer vision, NLP, and generative AI. Design and implement scalable models and algorithms, ensuring performance, accuracy, and interpretability. Collaborate with product owners, engineers, and business stakeholders to align AI/ML initiatives with strategic objectives. Mentor and guide data scientists and ML engineers to elevate technical quality and delivery standards. Continuously evaluate emerging AI technologies, frameworks, and methodologies to enhance team capabilities. Contribute to innovation strategy by identifying new business opportunities driven by AI/ML. Ensure data and model governance, ethical AI practices, and responsible deployment of AI solutions. Required Skills & Tools Core Competencies: Strong hands-on experience in machine learning, deep learning, NLP, computer vision, and generative AI. Expertise in Python (primary), with additional knowledge of R, SQL, Java, or C++. Deep understanding of statistics, linear algebra, probability, and algorithm design. Frameworks & Tools: TensorFlow, PyTorch, Keras, OpenCV, Hugging Face, spaCy, Scikit-learn, etc. Data processing tools like Pandas, NumPy, and Spark. Version control and CI/CD tools (e.g., Git, MLflow, Docker, Airflow). Methodologies: Proficient in Agile development and model lifecycle management. Experience with productionizing AI models and deploying them on cloud platforms (AWS, Azure, GCP). Experience 8 12 years of experience in AI/ML, Data Science, or related domains. Minimum 8+ years in a leadership or technical lead role driving successful AI/ML initiatives. Proven record of delivering high-impact AI/ML projects at scale. Experience mentoring and managing AI/ML teams in collaborative, cross-functional environments. Day-to-Day Activities Direct and oversee AI/ML model development, validation, deployment, and monitoring. Review project designs, provide technical oversight, and conduct code/model reviews. Drive research and experimentation to apply novel AI methods to solve real-world problems. Support proposal development and client engagements with AI/ML subject matter expertise. Foster a culture of continuous learning, innovation, and data-driven thinking. Qualifications Bachelor s or Master s degree in Computer Science, Data Science, Artificial Intelligence, or a related field. Relevant certifications (e.g., TensorFlow, AWS Machine Learning, Azure AI Engineer) are a plus. Soft Skills Strong leadership, team management, and mentoring capabilities. Excellent communication and stakeholder engagement skills. Strategic thinking with a passion for innovation and emerging technologies. Ability to thrive in a dynamic, fast-paced environment and lead through ambiguity. Diversity & Inclusion at Synechron Synechron is committed to a diverse and inclusive workplace. Through our Same Difference DEI initiative, we celebrate unique backgrounds and perspectives while fostering a respectful, empowering environment. We welcome applications from candidates of all identities and provide support through mentoring, internal mobility, and flexible work arrangements. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Artificial Intelligence, or a related field.
Backend Developer
Team Vunet Systems
Backend Developer Location: Bengaluru, India Experience: 2 - 5 Years Job Type: Full-time About VuNet VuNet is pioneering Business Observability by combining big data and machine learning to revolutionize customer journey monitoring and enhance digital payment experiences for leading financial institutions. We foster financial inclusion nationwide by delivering innovative, scalable solutions in a collaborative, high-impact environment. Role Overview: Backend Developer Join VuNet s Platform Core OS team to build highly scalable backend systems powering critical products. As a Backend Developer, you ll have significant ownership and influence in shaping the architecture, collaborating across teams, and delivering world-class software solutions that impact millions of users. Key Responsibilities Own backend development and work closely with product, design, and business teams to architect and deliver scalable solutions Deliver major initiatives independently and on time Follow best development practices including design specs, coding standards, unit testing, and code reviews Solve complex service scalability problems with creativity and technical expertise Take complete ownership of your solutions and drive their success Communicate effectively across multidisciplinary teams Skills & Experience 2+ years of strong programming experience in Python Experience with asyncio and the Django framework Hands-on with web application development and working knowledge of SQL/NoSQL databases Experience with third-party integrations Strong communication and teamwork skills Detail-oriented with good analytical and problem-identification abilities Proven success as an individual contributor Bonus Skills: Elasticsearch, Kafka, Apache Spark, Redis, Cassandra, Hadoop Eagerness to learn new technologies and domains 100% health insurance coverage for you and your family, including parents Financial protection with disability, life, and accidental death insurance Mental wellness programs and one-on-one counseling A culture focused on delivering excellence and fostering career growth Transparent, inclusive, and collaborative work environment Continuous learning and development opportunities Apply now and be part of our trailblazing team!
Software Developer-c++
Siemens
Software Developer C++ Location: Bangalore, Karnataka, India Employment Type: Full-time, Permanent Experience Level: Experienced Professional (6-8 years) Role Overview We are seeking a proactive and skilled Full Stack Developer with deep expertise in C++ to contribute to the development of MR image reconstruction modules integrated with AI. The ideal candidate will actively research and innovate MR reconstruction techniques, improve module performance, and collaborate closely with cross-functional teams to deliver high-quality medical imaging solutions. Key Responsibilities Develop, improve, test, and maintain MR image reconstruction modules. Conduct research to enhance acquisition speed, data extraction, noise/artifact robustness, and overall reconstruction quality. Develop AI inferencing code, prepare data, and support model training activities. Manage code repositories and version control systems such as Git or Azure Repos. Participate actively in design discussions, code reviews, and agile development processes. Troubleshoot and optimize module performance, security, and scalability. Collaborate with product owners and stakeholders to manage backlogs and ensure continuous feature delivery. Required Skills & Qualifications Education: BE/B.Tech/MCA/ME/M.Tech from a recognized institution. Core Expertise: Strong practical experience in C++ development, object-oriented programming, and design patterns. Additional Skills: Python programming experience (advantageous). Knowledge of medical imaging modalities, particularly MRI (preferred). Strong foundation in physics, mathematics, signal processing, linear algebra, probability, and random processes. Understanding of inverse problems, AI, imaging chains, MR reconstruction, and pulse sequences is a plus. Soft Skills: Strong analytical and problem-solving skills, clear communication, and a passion for learning and creative thinking. Tools: Experience with Azure Repos or Git for version control. Experience 6 to 8 years of core development experience with C++. Collaborative work environment fostering professional growth. Challenging projects enhancing technical expertise. Competitive compensation and benefits.
Backend Developer - Python
Goavega Software India
Job Title: Backend Developer - Python | 4-5 Years Experience | FastAPI, Flask, MySQL | Bangalore, India Location: Bangalore, Karnataka, India Job Overview: We are seeking a skilled Backend Developer with 4 to 5 years of experience in designing and building scalable backend services and APIs using Python. You will work with modern frameworks like FastAPI and Flask, integrate relational databases, and deploy applications in containerized environments. Collaboration with DevOps and frontend teams is key to ensuring seamless feature delivery and backend reliability. Key Responsibilities: Design and develop robust, scalable RESTful backend APIs using FastAPI and Flask Build efficient server-side logic and core business functionalities using Python Design, integrate, and optimize MySQL and PostgreSQL databases for backend applications Deploy and manage applications in Docker and Kubernetes environments to ensure high availability and scalability Maintain and enhance CI/CD pipelines using tools like Git and Jenkins Collaborate closely with DevOps and frontend teams for smooth integration and deployment Ensure high code quality by conducting peer reviews, writing clear documentation, and following best practices Technical Skills: Strong proficiency in Python with hands-on experience in FastAPI and Flask Expertise in building and consuming RESTful APIs Experience with relational databases: MySQL and PostgreSQL Containerization skills using Docker and orchestration with Kubernetes Version control with Git and CI/CD pipeline management using Jenkins Comfortable working in a Linux-based development environment Education & Qualifications: Bachelor s or Master s degree in Computer Science, Engineering, or a related field Desirable Skills: Advanced experience with Docker and Kubernetes for container orchestration Open Positions: 2 Work on scalable backend systems supporting innovative FinTech and other industry projects Collaborate with a skilled team across DevOps, frontend, and backend domains Grow your expertise with cutting-edge technologies and containerized deployments in a dynamic work environment Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field
Backend Engineer
Cognite
Backend Engineer Location: Bengaluru (Hoodi, Rathi Legacy, Rohan Tech Park) Team: Product Engineering Employment: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader leveraging AI and data to solve complex industrial challenges in Oil & Gas, Chemicals, Pharma, Manufacturing, and Energy. Our flagship products include Cognite Atlas AI and Cognite Data Fusion (CDF). We have been recognized as a 2022 Technology Innovation Leader and 2024 Microsoft Energy & Resources Partner of the Year, driving the future of industrial digital transformation. Our Values Impact: Deliver meaningful, measurable results. Ownership: Take responsibility beyond your comfort zone and foster inclusivity. Relentless: Innovate with determination and resilience. Role & Responsibilities Design and develop scalable, high-performance backend services and APIs using Java, Kotlin, or Python for Cognite Data Fusion. Work with advanced database technologies like PostgreSQL and Elasticsearch to enhance our industrial knowledge graph. Collaborate with application teams to create user-centric solutions addressing complex industrial problems. Build resilient, scalable infrastructure using modern open-source tools and Cognite s data platform. Influence critical product and technical decisions by partnering closely with stakeholders and domain experts. 5+ years of backend engineering experience, primarily using Java, Kotlin, or Python in SaaS/product companies at scale. Flexibility with tech stacks: Java/Kotlin experience is a plus for Python developers and vice versa. Experience with Spark is highly valued. Strong background in modern databases (PostgreSQL, Elasticsearch), graph processing, distributed systems, and performance tuning. Commitment to clean, maintainable code and best practices through continuous code review and improvement. DevOps experience: CI/CD, Infrastructure as Code, Kubernetes multi-cloud deployments (AWS, GCP, Azure). Skilled in observability and diagnostics with tools like Prometheus, Grafana, and expertise in troubleshooting complex system issues. Comfortable contributing to and learning from the open-source community. Excellent communication skills to collaborate effectively across diverse, global teams. Be part of a diverse global team representing 70+ nationalities, committed to DEI. Work in a modern, vibrant office environment at Rathi Legacy, Hoodi, Bengaluru with hybrid flexibility. Flat hierarchy with direct access to leadership and minimal bureaucracy. Collaborate with world-class talent on ambitious, high-impact projects across multiple industries. Engage in Cognite s HUB community for direct interaction with colleagues and partners. Make Your Impact Join Cognite and help revolutionize industrial digital transformation with strong DataOps, enabling better decisions and sustainability for global clients. We encourage applications from all backgrounds and identities. If you re passionate about shaping the future of industrial SaaS, apply today!
Data Engineer
Colan Infotech
Data Engineer Experience: 5+ Years Location: Bangalore, Karnataka, India Job Type: Full Time Job Summary We are looking for a talented Data Engineer with over 5 years of experience and a strong foundation in machine learning development to join our team in Bangalore. The ideal candidate will have hands-on expertise in Python programming, machine learning basics, and computer vision techniques like custom object detection and OCR. Key Responsibilities Develop and maintain data pipelines supporting machine learning models and data analytics. Implement custom object detection algorithms and OCR solutions using computer vision techniques. Utilize Python ML libraries such as OpenCV, SciPy, NumPy, Matplotlib, Pandas, Scikit-learn, Keras, PyTorch, and TensorFlow. Collaborate with data scientists and software engineers to optimize data workflows and ML model deployment. Ensure data quality, integrity, and scalability within data infrastructure. Troubleshoot and improve existing machine learning systems and pipelines. Required Skills Minimum of 5 years of experience in data engineering or related roles. At least 2 years of hands-on experience as a Machine Learning developer. Strong programming skills in Python. Solid understanding of machine learning fundamentals. Practical experience with custom object detection and OCR applications. Proficiency in key Python libraries for machine learning and data processing. Ability to work collaboratively in cross-functional teams. Qualifications Any graduate degree from a recognized university. Work with cutting-edge machine learning technologies in a supportive, innovative environment in Bangalore. Grow your career by solving complex problems and building impactful data solutions with a passionate team. Qualification : Any graduate degree from a recognized university.
Python/apache Airflow Developer
Wipro Limited
Python/Apache Airflow Developer Location: Bengaluru, India Company: Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) Company Overview Wipro Limited is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For more information, visit www.wipro.com. Role Purpose The purpose of this role is to design, test, and maintain software programs for operating systems or applications to be deployed at the client end and ensure they meet 100% quality assurance parameters. Position Overview We are seeking a skilled Python and Apache Airflow Developer with a strong background in data engineering to help develop and maintain robust data pipelines and support business intelligence initiatives. Key Responsibilities Develop and maintain data pipelines using Apache Airflow and Python. Collaborate with business managers to understand data requirements. Optimize existing data workflows for performance and reliability. Manage SQL and NoSQL databases for business intelligence. Ensure data quality and security. Troubleshoot data pipeline issues and ensure smooth data flow. Required Qualifications Proven experience in Python programming and data engineering. Hands-on experience with Apache Airflow. Strong understanding of SQL and experience with SQL databases. Familiarity with NoSQL databases. Experience in data modeling and ETL processes. Must have: Python and Apache Airflow, with preferably 5+ years of experience. About Wipro Wipro is constantly evolving, and we re looking for passionate individuals who want to build a modern digital transformation partner with bold ambitions. Join Wipro, where we empower you to design your own reinvention. Realize your ambitions and take part in our global, purpose-driven business. Applications from people with disabilities are explicitly welcome.
Data Integration Developer- Talend
Infocepts
Position: Data Integration Developer Talend Location: Bangalore Employment Type: Full-time Experience Required: 4 to 7 years Overview: We are seeking a Data Integration Developer with strong expertise in Talend to join our growing data engineering team. This role is ideal for professionals who are passionate about designing and building robust, scalable ETL/ELT pipelines and integrating enterprise data across cloud and on-premise platforms. You will work closely with data architects, business analysts, and reporting teams to support data transformation, integration, and analytics efforts. Key Responsibilities: ETL/ELT Solutions Development: Design, develop, and deploy scalable ETL/ELT processes using Talend Data Integration (on-prem and cloud). Data Transformation & Integration: Implement data transformation using stored procedures and other data processing techniques. Report Development Support: Collaborate with reporting teams to support dashboard/report creation using tools like MicroStrategy and Power BI. Documentation & Data Governance: Create detailed pipeline documentation, configurations, and data workflows. Performance Optimization: Monitor pipeline performance, identify bottlenecks, and troubleshoot data integration issues. Essential Skills: Hands-on experience with Talend Suite (Talend Data Integration, Talend Cloud) Experience with Snowflake and writing Stored Procedures Knowledge of ETL/ELT design, data warehousing, and data modeling Familiarity with JSON, XML, CSV data formats Experience with data quality frameworks and job monitoring/scheduling tools Proficiency in Agile methodology and tools like JIRA Desirable Skills: Experience with reporting tools such as MicroStrategy and Power BI Skills in scripting languages: Python, Java, or Shell Understanding of cloud platforms (AWS, GCP, Azure) and related data services Qualifications: Bachelor s or Master s degree in Computer Science, Engineering, or a related field Minimum of 3+ years of Talend development experience Qualities We Value: Strong verbal and written communication skills Experience in Agile and cross-functional team environments Problem-solving mindset and ability to work under minimal supervision Quick learner with a passion for data and process improvement Work with modern cloud data integration and enterprise tools Collaborate with global clients and expert teams Be part of cutting-edge data platform transformation initiatives Apply today and be part of our mission to deliver next-gen, data-driven insights. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field
Cloud Data Engineer - AWS Big Data
Infocepts
Position: Cloud Data Engineer AWS Big Data Location: Bangalore, India Employment Type: Full-time Experience Required: 5 to 8 years Purpose of the Position: Join the Infocepts Cloud Data Architect Team as a Cloud Data Engineer and help design and implement cutting-edge big data solutions on AWS. You will leverage your expertise in EMR, Athena, PySpark, S3, AWS Lambda, and SQL to develop robust and scalable data platforms. Key Responsibilities: Technology Assessment and Design: Assess existing technology landscape and data integration frameworks. Design complex Big Data use cases using AWS services under guidance of the Architect. Support architectural decision-making by evaluating trade-offs in cost, performance, and durability. Recommend optimizations to existing data infrastructure. Documentation and Stakeholder Communication: Create project documentation adhering to quality and delivery standards. Collaborate closely with Architects and Project Managers for scoping, estimation, and planning. Present design decisions to technical and business stakeholders clearly. Conduct PoCs and design review sessions. Process Improvement and Automation: Identify and suggest opportunities for automation and process enhancements. Mentor junior engineers and support technical problem solving. Training and Knowledge Sharing: Prepare and deliver internal training on AWS and Big Data topics. Lead client knowledge sharing sessions and contribute to case studies. Essential Skills: In-depth experience with AWS services: S3, EC2, EMR, Athena, Glue, Lambda Familiarity with MPP databases like Redshift, Snowflake, or SingleStore Proficiency in Apache Spark and Databricks Strong programming skills in Python Experience building data pipelines using AWS and Databricks Knowledge of Big Data file formats such as Delta Lake Advanced SQL skills for large-scale data manipulation Hands-on experience with Apache Airflow or similar orchestration tools Strong understanding of ETL workflows and data warehousing concepts Desirable Skills: Cloud databases: AWS Aurora, Snowflake Experience with Hadoop and Hive AWS Certifications (Associate or Professional level) are a plus Qualifications: Bachelor s degree in Computer Science, Engineering, or related field (Master s preferred) Overall 5+ years of IT experience with at least 3 years in AWS Big Data projects Ongoing learning and technical certifications are strongly encouraged Key Qualities: Strong problem-solving and analytical thinking Self-driven with a passion for emerging data technologies Excellent communication and client presentation skills Ability to work in cross-functional, agile teams Apply now to be part of a high-impact data transformation team working on large-scale cloud data projects! Qualification : Bachelors degree in Computer Science, Engineering, or related field (Masters preferred)
Lead Full-stack Engineer (client Facing Role)
Bain & Company
Job Title: Cloud-Based AI Developer - Advanced Analytics Group (AAG) Company: Bain & Company Job Type: Full-Time Employment Type: Permanent What Makes Us a Great Place to Work: We are proud to be consistently recognized as one of the world s best places to work, a champion of diversity, and a model of social responsibility. We are currently ranked #1 on Glassdoor's Best Places to Work list, and we have maintained a spot in the top four for the last 13 years. Diversity, inclusion, and collaboration are key to building extraordinary teams. We hire people with exceptional talents, abilities, and potential, creating an environment where you can thrive both professionally and personally. We are publicly recognized for being a great place to work for diversity and inclusion, women, LGBTQ, and parents. Who You ll Work With: As a member of Bain s Advanced Analytics Group (AAG), you will work alongside generalist consultants to help clients across industries solve their biggest problems using expertise in data science, customer insights, statistics, machine learning, data management, supply chain analytics, and data engineering. AAG team members hold advanced degrees in computer science, engineering, AI, data science, physics, statistics, mathematics, and other quantitative disciplines, with backgrounds in tech, data science, marketing analytics, and academia. We are committed to building a diverse and inclusive team and encourage candidates of all backgrounds to apply. What You ll Do: As a member of the AAG, you will be responsible for designing, developing, and maintaining cloud-based AI applications that provide high-quality, scalable, and secure solutions for our clients. Your work will encompass the full stack, from API design to deployment, delivering analytics solutions across various sectors. Cloud-Based AI Development: Design, develop, and maintain cloud-based AI applications, ensuring scalability and security, leveraging full-stack technology solutions. Cross-Functional Collaboration: Work with product managers, data scientists, and other engineers to define and implement analytics features that meet business requirements. Cloud and Containerization: Use Kubernetes and containerization technologies to deploy, manage, and scale applications in cloud environments for optimal performance. API & Microservices Development: Develop and maintain APIs and microservices to expose analytics functionality, adhering to industry best practices for design and documentation. Security and Compliance: Implement robust security measures to protect sensitive data and ensure compliance with data privacy regulations. Troubleshooting and Performance Monitoring: Continuously monitor and troubleshoot application performance, resolving issues impacting system reliability and user experience. Code Reviews and Best Practices: Participate in code reviews and contribute to the establishment of coding standards to ensure high-quality, maintainable code. Emerging Trends and Technologies: Stay current with emerging trends in cloud computing, data analytics, and software engineering to enhance the platform s capabilities. Collaboration with DevOps: Work with DevOps and infrastructure teams to automate deployment and release processes, optimizing the development workflow. Client Collaboration: Collaborate closely with business consulting teams to assess opportunities and develop analytics solutions across sectors. Education and Influence: Influence and educate clients on analytics application engineering capabilities, supporting their teams directly. Travel: Expect occasional travel (30%) for project work. About You: Required Qualifications: Education: Master s degree in Computer Science, Engineering, or a related technical field. Experience: 3+ years of experience at Senior or Staff level, or equivalent. Expertise in client-side technologies such as React, Angular, Vue.js, HTML, and CSS. Experience with server-side technologies such as Django, Flask, and Fast API. Proficiency with cloud platforms (AWS, Azure, GCP) and Terraform automation (good to have). 3+ years of expertise in Python. Experience using Git for version control and collaboration. Familiarity with DevOps, CI/CD, and tools like GitHub Actions. Demonstrated interest in LLMs, prompt engineering, and Langchain. Experience with workflow orchestration tools such as dbt, Beam, Airflow, Luigi, Metaflow, Kubeflow, or similar. Experience in the implementation of large-scale structured or unstructured databases, as well as containerization technologies like Docker and Kubernetes. Skills and Knowledge: Strong interpersonal and communication skills to explain complex engineering topics to colleagues and clients from various disciplines. Curiosity, proactivity, and critical thinking. Solid computer science fundamentals in data structures, algorithms, automated testing, object-oriented programming, performance complexity, and software architecture. Expertise in designing API interfaces and knowledge of data architecture and database schema design. Familiarity with agile development methodologies. Join Bain & Company: Become a part of a forward-thinking team committed to solving complex problems, building innovative solutions, and delivering impactful data analytics and AI solutions. Collaborate with talented professionals and gain valuable experience that shapes the future of data analytics and AI. Qualification : Masters degree in Computer Science, Engineering, or a related technical field.
Senior Python Expert
Hashedin Technologies Pvt. Ltd.
Job Title: Senior Python Expert Experience: 3 to 8 years Overview of the Role: This role sets the benchmark for team software development processes and deployment procedures, while actively contributing to establishing best practices and methodologies within the team. Responsibilities: Develop backend services using Python Flask or similar web frameworks. Design and maintain data and pipeline management frameworks using open-source technologies such as Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud-based data engineering services like S3, Redshift, Athena, Kinesis. Design and develop efficient CRUD operations for large datasets with millions of records. Collaborate with teams to build and maintain innovative, reliable, secure, and cost-effective distributed solutions. Own and deliver complex application components within defined timelines. Ensure quality delivery using best practices in API development, performance, and scalability. Participate in customer communication, presentations, and resolution of critical issues. Contribute to architecture, feature set, and design decisions. Proactively recognize and address requirement inconsistencies and project risks. Break down work effectively and estimate accurately. Serve as a technical mentor and role model within the team. Required Skills: Strong knowledge of Python and a web framework like Flask. Experience with AWS services such as EC2, S3, Lambda, Step Functions, Glue, SNS, SQS, Secret Manager, and CodeBuild/CodePipeline. Solid understanding of SQL, including query writing, optimization, and database interaction tools. Experience with API development (RESTful services, Postman, API Gateway). Strong coding, debugging, and problem-solving skills. Understanding of architectural trade-offs and data engineering principles (data acquisition, ingestion, distributed processing, high availability). Ability to independently handle delivery of complex projects. Excellent team management and individual contributor skills. Good to Have Skills: Experience with Big Data frameworks like Hadoop and Spark. Knowledge of AWS Aurora. Familiarity with pip, setuptools, etc. Education: B.E./B.Tech, MCA, M.E./M.Tech.
Sr. Engineering Manager
Ness Digital Engineering
Job Title: Sr. Engineering Manager - Data Engineering Level: L5 Experience: 13-16 years Overview We are seeking an experienced Engineering Manager with a strong background in Data Engineering, including ETL/ELT processes and cloud-based data platforms such as Snowflake. The ideal candidate will lead and mentor a team of data engineers, drive data architecture initiatives, and work closely with cross-functional stakeholders to ensure our data infrastructure supports evolving business needs. Key Responsibilities Team Leadership: Lead, mentor, and develop a high-performing data engineering team, fostering a culture of collaboration, innovation, and continuous learning. Data Pipeline Development: Oversee the design, development, and maintenance of robust ETL/ELT pipelines to ingest, transform, and process data at scale. Cloud Data Infrastructure: Drive the architecture and implementation of cloud-based data solutions, especially leveraging Snowflake, ensuring scalability, security, and reliability. Cross-Functional Collaboration: Partner with product managers, analysts, data scientists, and other business stakeholders to gather requirements and prioritize engineering efforts that deliver the most impact. Architecture and Design: Develop and enforce data architecture standards for high-performance data warehousing, ensuring seamless data integration across diverse sources. Performance Optimization: Identify and resolve performance bottlenecks, focusing on query optimization, cost management, and resource efficiency. Data Quality & Governance: Define and implement data quality frameworks and governance practices, ensuring data consistency and reliability across all pipelines. Innovation & Strategy: Stay informed on emerging data technologies and industry best practices, continuously improving processes and aligning solutions with long-term data strategies. Required Skills 8+ years of hands-on experience in data engineering, including 5+ years in a leadership role. Strong expertise in ETL/ELT processes and hands-on experience with tools like Talend, Informatica, or similar platforms. Deep proficiency in Snowflake or comparable cloud data platforms such as Redshift or BigQuery. Advanced SQL skills, including query optimization, performance tuning, data modeling, and schema design. Hands-on experience with Python or Java for data processing and automation. Knowledge of data governance, compliance standards, and data security best practices. Excellent communication and project management skills, with the ability to prioritize and manage multiple projects in parallel. Preferred Skills Exposure to Big Data technologies such as Spark, Hadoop, Databricks, Synapse, etc. Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions. Familiarity with CI/CD pipelines and DevOps practices within data engineering. Experience working with BI tools like Tableau or Power BI, and reporting integrations.
Sr. Data Engineer
Ness Digital Engineering
Job Title: Sr. Data Engineer Job Overview: We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in Snowflake to manage data ingestion and transformation. The ideal candidate will work with an offshore team to deliver scalable data solutions aligned with business and performance requirements. Key Responsibilities: Design, build, and maintain ELT pipelines using Snowflake. Lead offshore development teams in applying data engineering best practices. Collaborate with stakeholders to manage data integration across systems. Optimize data pipelines for performance and reliability, including query tuning and resource management. Implement data validation processes to ensure data accuracy. Document data pipelines, flow diagrams, and transformation logic. Troubleshoot pipeline failures and resolve performance issues. Ensure compliance with data governance and regulatory requirements. Required Qualifications: 5+ years of experience in data engineering with a focus on ELT development. Strong expertise in Snowflake, including data sharing, secure views, and performance optimization. Proficiency in SQL and data integration tools. Experience managing offshore development teams. Strong problem-solving and communication skills. Preferred Qualifications: Snowflake certification or relevant certifications. Experience in financial services with knowledge of data security and compliance. Familiarity with cloud platforms (AWS, Azure) and orchestration tools like Apache Airflow. Experience with Python or JavaScript for data transformation. Knowledge of data visualization tools like Tableau or Power BI.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted