Spark Engineer Jobs in Bengaluru

Job Title: Sr. Data Science Engineer Location: Bangalore Experience: 5 8+ Years Job Description As a Senior Data Science Engineer, you will develop and maintain scalable data pipelines and manage API integrations to support growing data volume and complexity. You will play a key role in ensuring data quality and enabling accurate AI model development through effective data handling and automation. Responsibilities Monitor data quality and implement processes for data cleansing and validation. Analyze data to troubleshoot and resolve data-related issues promptly. Develop automation workflows for efficient data labeling, preparation, and augmentation to improve AI model accuracy and utility. Requirements Proven experience as a Data Scientist, Data Analyst, or related role, with experience in data mining. Strong proficiency in data manipulation using Python or R; familiarity with Scala, Java, or C++ for raw data processing is a plus. Experience with business intelligence tools (e.g., Tableau) and big data frameworks like Hadoop and Spark. Strong mathematical foundation, especially in statistics and algebra. Advanced SQL skills with experience in database development, data migration, and integration. Expertise in exploratory data analysis and familiarity with common data science toolkits. Ability to communicate complex data insights clearly and effectively to non-technical stakeholders. Familiarity with data management tools and experience applying machine learning and AI techniques.

Software Development Manager Experience: 8+ Years Location: Bangalore Company: Kaleidofin About Us Kaleidofin is a mission-driven fintech platform committed to delivering financial solutions for underserved communities. Our proprietary ki credit platform combines advanced credit health analytics, middleware integration, risk dashboards, and debt capital structuring empowering financial institutions to serve low-income customers, informal sector businesses, and MSMEs more effectively. Operating across India, Bangladesh, and Kenya, we ve already impacted over 6 million customers, enabling over $3 billion in debt capital for underserved communities. Backed by global investors including the Gates Foundation, Omidyar Network, and Blume Ventures, Kaleidofin is recognized as a leader in inclusive finance. Featured on Forbes Asia's "100 to Watch" Winner of RBI s Swanari TechSprint 2023 Winner of G20 TechSprint 2024 by BIS Certified as a Great Place to Work Role Overview As a Software Development Manager, you will play a key leadership role in shaping the technical roadmap and executing high-impact fintech products. You ll lead a team of engineers to build scalable, secure, and robust systems. This is a hands-on leadership role requiring active involvement in design, architecture, and code-level decisions. What You ll Do Own the product s engineering roadmap, architecture, scalability, and code quality. Guide system design decisions and lead architecture/code reviews. Collaborate closely with Product and Business teams to align on product strategy and feature development. Provide hands-on technical leadership especially in solving complex problems in fintech and lending domains. Mentor and develop engineering talent; foster a culture of ownership, innovation, and quality. Champion engineering best practices including test automation, CI/CD, and DevOps. Lead the adoption of data-driven practices including Big Data, PySpark, and data pipeline architectures. Balance short-term deliverables with long-term technical sustainability and scalability. Support team growth through career development, learning plans, and succession planning. 8+ years of software development experience, with 1 2+ years in people/team management roles. Strong fundamentals in computer science, system design, and problem-solving. Bachelor's or Master's degree in CS or related field from a top engineering institution (IITs, NITs, etc.). Proven experience building distributed, scalable, and secure systems. Strong hands-on experience with Python, Java, Spring Boot, and microservice architectures. Proficient in SQL/NoSQL, Kafka, CI/CD pipelines, and DevOps tools (Docker, Kubernetes, Jenkins, etc.). Familiarity with AI/ML model integration and credit scoring systems is a strong plus. Experience with data engineering: Big Data, Spark, Airflow, AWS stack (S3, Glue, Athena), etc. Knowledge of front-end and mobile (Android) development is a plus. Experience working in fintech, lending tech, or high-growth startup environments preferred. Excellent leadership, communication, and cross-functional collaboration skills. Be part of a high-impact team driving financial inclusion at scale. Work on cutting-edge technology in fintech and data infrastructure. Grow with a company that s winning global recognition and delivering real-world impact. Contribute to a people-first culture that values learning, innovation, and work-life balance. Qualification : Bachelor's or Master's degree in CS or related field from a top engineering institution

Distinguished Engineer Machine Learning Engineering Location: Bangalore Company: Capital One India About Us At Capital One India, we re redefining how technology powers financial services. Our teams work in a fast-paced, intellectually rigorous environment to tackle complex business challenges at scale. By harnessing the power of advanced analytics, data science, and machine learning, we create innovative, patentable solutions that transform customer experiences and drive the business forward. Team Overview: Machine Learning Experience (MLX) The MLX team leads Capital One s mission to build scalable, well-managed ML systems and platforms. We empower teams across the enterprise to develop, govern, and deploy machine learning models efficiently, securely, and at scale. From automated model governance to observability platforms, MLX enables end-to-end ML lifecycle management laying the foundation for AI-driven innovation across the organization. Role Overview We re looking for a Distinguished Engineer Machine Learning Engineering to join our MLX team. In this high-impact role, you'll architect and implement the platforms and tools that support model observability, automated governance, and ML model deployment at scale. This is an opportunity to drive enterprise-wide innovation and shape how ML is integrated into Capital One s core business systems. What You ll Do Design and build systems that capture and analyze large-scale model and feature metadata, including training metrics and runtime performance, to power model observability and governance automation. Partner with cross-functional teams including product managers, designers, and platform engineers to create scalable solutions that accelerate ML model lifecycle management. Lead efforts to enable automated governance decisions for ML models, ensuring compliance, auditability, and operational integrity. Architect and implement high-performance data pipelines that feed ML models with real-time and batch data. Contribute to the design and implementation of cloud-native ML systems using tools such as AWS, Kubernetes, and Terraform. Write clean, scalable, production-grade code in languages like Python, Go, or Java. Implement CI/CD pipelines, testing frameworks, and monitoring systems for ML applications. Drive the adoption of best practices in ML Ops, observability, and platform resilience. Basic Qualifications Master s Degree in Computer Science or related field. 15+ years of experience in software engineering or solution architecture. 10+ years building data-intensive, distributed computing systems. 10+ years programming in Python, Go, or Java. 8+ years of hands-on experience with industry-leading ML frameworks (e.g., Scikit-learn, TensorFlow, PyTorch, Dask, Spark). Preferred Qualifications PhD or Master's in Computer Science, Electrical Engineering, Mathematics, or related field. 5+ years of experience building, scaling, and optimizing production ML systems. Deep expertise in data preparation, feature engineering, and ML pipeline optimization. 10+ years writing performant, maintainable, and resilient production code. Strong experience deploying ML solutions on public cloud platforms (AWS, Azure, GCP). Expertise in distributed systems, file systems, or multi-node databases. Open-source contributor to ML tools or libraries. Published work in ML (papers, patents, blogs, etc.). 5+ years of experience in ML Ops (using MLflow, TFX, Kubeflow, etc.). Experience with LLMs and Generative AI applications (open-source or commercial models). Proven experience designing production-ready observability platforms for ML applications. Be at the forefront of building scalable, secure, and enterprise-grade ML platforms. Shape the future of AI and ML adoption in a top-tier financial institution. Collaborate with world-class engineers and data scientists. Solve real-world problems with high business impact. Thrive in a diverse, inclusive, and innovation-focused culture. Qualification : PhD or Master's in Computer Science, Electrical Engineering, Mathematics, or related field

Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field

Job Title: Lead / Senior Software Engineer (Microservices, IoT, Kafka, AWS) Location: Bengaluru Experience Required: 5 8 years Industry: Automotive (Electric Mobility) Employment Type: Full-time About Ultraviolette Join the Charge. Create the Future. At Ultraviolette, we re not just building electric vehicles we re redefining what mobility looks and feels like. From creating India s fastest electric motorcycle to designing the world s most advanced electric scooter, we're on a mission to engineer machines that are not only sustainable, but also exhilarating. Our team is a diverse mix of engineers, designers, dreamers, and doers, united by a bold vision to accelerate the global shift to electric mobility. If you're driven by innovation and looking to work on cutting-edge products that challenge the status quo, this is your platform to make a real impact. About the Role We are looking for a Senior/Lead Software Engineer who thrives in designing scalable, high-performance, and cloud-native microservices. This role is ideal for someone with hands-on experience in Java, Spring Boot, Kafka, and AWS, and a keen interest in IoT and real-time data architectures. You will work at the intersection of hardware and software helping us bring our vision of connected, intelligent, and high-performance electric vehicles to life. Key Responsibilities Design, develop, and deploy Java-based microservices using Spring Boot and related technologies. Architect and implement event-driven systems using Apache Kafka for real-time IoT data streaming. Build and manage RESTful APIs with AWS API Gateway for seamless service integration. Leverage AWS services such as Lambda, DynamoDB, and MemoryDB to build scalable, serverless solutions. Collaborate with cross-functional teams front-end developers, DevOps, and product managers to convert ideas into working features. Optimize application performance, troubleshoot issues, and ensure high reliability and availability. Mentor junior engineers, conduct code reviews, and enforce clean coding practices. Contribute to architecture decisions, technical roadmaps, and innovation initiatives. Stay on top of emerging technologies in cloud, microservices, and IoT ecosystems. Participate actively in Agile processes including sprint planning, stand-ups, and retrospectives. Required Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or a related field. 5+ years of hands-on experience in Java development, with a strong foundation in Spring Boot. Proven experience designing and deploying microservices architectures. Strong knowledge of Kafka and real-time streaming/data pipeline architectures. Hands-on experience with Docker and Kubernetes for containerization and orchestration. Understanding of IoT protocols such as MQTT or CoAP and device connectivity. Proficiency with version control (Git) and Agile methodologies. Excellent problem-solving, communication, and collaboration skills. Nice to Have AWS Certifications (e.g., AWS Certified Developer or Solutions Architect). Experience with additional languages like Python or Rust. Familiarity with NoSQL databases such as MongoDB or Cassandra. Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure as Code (e.g., Terraform). Exposure to stream processing frameworks (e.g., Apache Flink, Spark Streaming). Experience in edge computing and distributed systems. Strong understanding of cloud security best practices. Work on India s most futuristic electric vehicles at the intersection of technology, performance, and sustainability. Be part of a mission-driven company shaping the future of mobility. Collaborate with some of the most talented engineers and designers in the industry. A fast-paced environment that celebrates innovation, learning, and growth. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field

Position Title: Lead AI/ML Engineer Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is seeking a seasoned Lead AI/ML Engineer to lead cutting-edge initiatives in artificial intelligence and machine learning. This role requires deep technical expertise in AI/ML, including deep learning, NLP, computer vision, and generative AI, combined with strong leadership skills to manage teams and drive innovation. You will collaborate closely with stakeholders to deliver high-impact solutions and play a key role in shaping the company s AI-driven digital transformation. Key Responsibilities Lead end-to-end development of AI/ML solutions across use cases involving machine learning, deep learning, computer vision, NLP, and generative AI. Design and implement scalable models and algorithms, ensuring performance, accuracy, and interpretability. Collaborate with product owners, engineers, and business stakeholders to align AI/ML initiatives with strategic objectives. Mentor and guide data scientists and ML engineers to elevate technical quality and delivery standards. Continuously evaluate emerging AI technologies, frameworks, and methodologies to enhance team capabilities. Contribute to innovation strategy by identifying new business opportunities driven by AI/ML. Ensure data and model governance, ethical AI practices, and responsible deployment of AI solutions. Required Skills & Tools Core Competencies: Strong hands-on experience in machine learning, deep learning, NLP, computer vision, and generative AI. Expertise in Python (primary), with additional knowledge of R, SQL, Java, or C++. Deep understanding of statistics, linear algebra, probability, and algorithm design. Frameworks & Tools: TensorFlow, PyTorch, Keras, OpenCV, Hugging Face, spaCy, Scikit-learn, etc. Data processing tools like Pandas, NumPy, and Spark. Version control and CI/CD tools (e.g., Git, MLflow, Docker, Airflow). Methodologies: Proficient in Agile development and model lifecycle management. Experience with productionizing AI models and deploying them on cloud platforms (AWS, Azure, GCP). Experience 8 12 years of experience in AI/ML, Data Science, or related domains. Minimum 8+ years in a leadership or technical lead role driving successful AI/ML initiatives. Proven record of delivering high-impact AI/ML projects at scale. Experience mentoring and managing AI/ML teams in collaborative, cross-functional environments. Day-to-Day Activities Direct and oversee AI/ML model development, validation, deployment, and monitoring. Review project designs, provide technical oversight, and conduct code/model reviews. Drive research and experimentation to apply novel AI methods to solve real-world problems. Support proposal development and client engagements with AI/ML subject matter expertise. Foster a culture of continuous learning, innovation, and data-driven thinking. Qualifications Bachelor s or Master s degree in Computer Science, Data Science, Artificial Intelligence, or a related field. Relevant certifications (e.g., TensorFlow, AWS Machine Learning, Azure AI Engineer) are a plus. Soft Skills Strong leadership, team management, and mentoring capabilities. Excellent communication and stakeholder engagement skills. Strategic thinking with a passion for innovation and emerging technologies. Ability to thrive in a dynamic, fast-paced environment and lead through ambiguity. Diversity & Inclusion at Synechron Synechron is committed to a diverse and inclusive workplace. Through our Same Difference DEI initiative, we celebrate unique backgrounds and perspectives while fostering a respectful, empowering environment. We welcome applications from candidates of all identities and provide support through mentoring, internal mobility, and flexible work arrangements. Qualification : Bachelors or Masters degree in Computer Science, Data Science, Artificial Intelligence, or a related field.

Backend Engineer Location: Bengaluru (Hoodi, Rathi Legacy, Rohan Tech Park) Team: Product Engineering Employment: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader leveraging AI and data to solve complex industrial challenges in Oil & Gas, Chemicals, Pharma, Manufacturing, and Energy. Our flagship products include Cognite Atlas AI and Cognite Data Fusion (CDF). We have been recognized as a 2022 Technology Innovation Leader and 2024 Microsoft Energy & Resources Partner of the Year, driving the future of industrial digital transformation. Our Values Impact: Deliver meaningful, measurable results. Ownership: Take responsibility beyond your comfort zone and foster inclusivity. Relentless: Innovate with determination and resilience. Role & Responsibilities Design and develop scalable, high-performance backend services and APIs using Java, Kotlin, or Python for Cognite Data Fusion. Work with advanced database technologies like PostgreSQL and Elasticsearch to enhance our industrial knowledge graph. Collaborate with application teams to create user-centric solutions addressing complex industrial problems. Build resilient, scalable infrastructure using modern open-source tools and Cognite s data platform. Influence critical product and technical decisions by partnering closely with stakeholders and domain experts. 5+ years of backend engineering experience, primarily using Java, Kotlin, or Python in SaaS/product companies at scale. Flexibility with tech stacks: Java/Kotlin experience is a plus for Python developers and vice versa. Experience with Spark is highly valued. Strong background in modern databases (PostgreSQL, Elasticsearch), graph processing, distributed systems, and performance tuning. Commitment to clean, maintainable code and best practices through continuous code review and improvement. DevOps experience: CI/CD, Infrastructure as Code, Kubernetes multi-cloud deployments (AWS, GCP, Azure). Skilled in observability and diagnostics with tools like Prometheus, Grafana, and expertise in troubleshooting complex system issues. Comfortable contributing to and learning from the open-source community. Excellent communication skills to collaborate effectively across diverse, global teams. Be part of a diverse global team representing 70+ nationalities, committed to DEI. Work in a modern, vibrant office environment at Rathi Legacy, Hoodi, Bengaluru with hybrid flexibility. Flat hierarchy with direct access to leadership and minimal bureaucracy. Collaborate with world-class talent on ambitious, high-impact projects across multiple industries. Engage in Cognite s HUB community for direct interaction with colleagues and partners. Make Your Impact Join Cognite and help revolutionize industrial digital transformation with strong DataOps, enabling better decisions and sustainability for global clients. We encourage applications from all backgrounds and identities. If you re passionate about shaping the future of industrial SaaS, apply today!

Senior Frontend Engineer Atlas AI Location: Bengaluru (Rathi Legacy, Rohan Tech Park, Hoodi) Team: Product Engineering Employment: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader innovating with AI and data to solve industrial challenges. Our products like Cognite Atlas AI and Cognite Data Fusion (CDF) enable transformational digitalization for Oil & Gas, Chemicals, Pharma, Manufacturing, and Energy sectors. Award-winning and recognized globally, we are shaping the future of industrial operations. About Atlas AI Atlas AI aims to revolutionize manufacturing and energy operations by building an advanced framework of industrial AI agents. This initiative leverages Cognite Data Fusion s industrial data expertise and targets collaboration with industry leaders and strategic partners to drive impactful AI innovation. Your Role Join our co-innovation team as a Senior Frontend Engineer focused on building next-gen AI-driven industrial agent applications. Architect and develop modern, responsive web applications with React and TypeScript. Build full-stack generative AI solutions, focusing on AI agents and multi-agent systems powered by large language models integrated via Cognite Data Fusion. Collaborate with architects, data engineers, and domain experts to create scalable AI agent solutions. Implement software development best practices including Git workflows, CI/CD, and robust testing. Work directly with customers and stakeholders to co-innovate and align solutions with real business needs. Contribute to product strategy and technical decision-making. Your Experience & Skills 5+ years in product software engineering, ideally with a focus on Generative AI/ML applications. Strong frontend skills: React, TypeScript, JavaScript; full-stack experience including Python. Experience with multi-agent systems development, preferably using frameworks like LangChain. Knowledge of knowledge graphs and related tech (GraphQL, Neo4j). Familiarity with cloud platforms (AWS, GCP, Azure) and container orchestration (Docker, Kubernetes). Experience with REST APIs, debugging tools, and software lifecycle best practices. Comfortable working with data formats (CSV, JSON, SQL) and databases like SQLite or SQL databases. Strong problem-solving, communication, and collaboration skills. Work in a vibrant, inclusive environment with 70+ nationalities and a strong DEI focus. Hybrid work mode from a modern office in Bengaluru with a culture that fosters impact and ownership. Direct access to decision-makers with minimal bureaucracy. Collaborate with top-tier talent on ambitious AI and industrial digital transformation projects. Engage actively in the Cognite community through HUB events and partnerships. Make an Impact Join Cognite to drive the future of industrial AI, creating innovative tools that empower industries worldwide. We welcome diverse candidates passionate about AI and frontend engineering.

Senior IT Operations Engineer Location: Bengaluru (Rathi Legacy, Rohan Tech Park, Hoodi) Team: Staff Finance Employment: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader advancing industrial digital transformation through AI and data with flagship products like Cognite Atlas AI and Cognite Data Fusion. We are recognized as innovators and partners of choice in sectors including Oil & Gas, Chemicals, Pharma, and Manufacturing. Role Overview Join Cognite s Global IT Operations team in Bengaluru, where you will design, deploy, and maintain cloud infrastructure and IT systems critical to business operations. Your role will encompass managing Azure and SaaS platforms, automating processes, troubleshooting complex issues, and collaborating with teams to enable seamless IT services. Key Responsibilities Architect and manage cloud infrastructure solutions across Microsoft Azure, Google Workspace, and Atlassian tools. Handle IAM, user provisioning, and SaaS management with in-depth expertise in Microsoft Intune, Jamf Pro, and security tools. Develop automation using Terraform, PowerShell, Python, and manage CI/CD pipelines with GitHub. Provide hands-on support including access management, technical troubleshooting, and resolving issues across diverse SaaS platforms (Azure, GWS, Atlassian, Slack). Document IT processes and collaborate with internal teams to enhance IT operations. Your Profile 5 8 years experience in IT Cloud Infrastructure and IT Operations. Strong expertise in Microsoft EntraID, Intune, Azure, Google Workspace, and Atlassian products (Jira, Confluence). Proficient in scripting and automation with PowerShell, Python, Terraform, and GitHub version control. Experience with ITSM tools, preferably Jira Service Management. Bachelor s or Master s degree in IT or related field. Collaborative, service-minded, and patient with problem-solving and troubleshooting. Comfortable working with Windows and macOS environments, and security tools like Microsoft Defender and Jamf Protect. Diverse global team with 70+ nationalities and strong DEI focus. Modern, vibrant office environment in Bengaluru with hybrid work flexibility. Flat organization providing direct access to decision-makers. Work on innovative projects impacting major industries worldwide. Engage in an active community and partner ecosystem. Qualification : Bachelors or Masters degree in IT or related field.

Senior Backend Engineer Innovation Team Location: Bengaluru (Rathi Legacy, Rohan Tech Park, Hoodi) Team: Global Strategic Services Industry Innovation and Solutions Employment: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader using AI and data to transform industries such as Oil & Gas, Chemicals, Pharma, and Manufacturing. Our award-winning platforms include Cognite Data Fusion and Cognite Atlas AI, driving industrial digital transformation worldwide. The Team & Role You ll join Cognite s Innovation Team working on batch processing applications for a key American emulsions industry client. This role focuses on backend development and data engineering to deliver scalable, robust solutions handling complex data workflows with multidisciplinary teams and global stakeholders. Key Responsibilities Architect and develop backend systems for complex batch data processing workflows with a focus on reliability amid inconsistent/incomplete data. Build resilient workflows handling multi-source data and minimizing system impact from component failures. Develop and optimize data models for domain-specific industrial problems. Create data transformation functions to extract actionable insights from raw data. Manage scalable distributed systems and ensure operational reliability. Collaborate cross-functionally to refine requirements and deliver solutions. Work with large datasets using SQL and NoSQL technologies. Troubleshoot full application lifecycle issues, from dev to production. Stay current on tech trends to innovate team practices. Strong backend development experience, distributed systems, and complex domain modeling. Proficiency in Python, SQL, and NoSQL databases. Experience with cloud-based architectures, automated testing, version control, CI/CD pipelines. Problem-solving skills, especially when data or context is incomplete. Self-driven, taking ownership from concept to deployment. Collaborative and excellent communicator, comfortable engaging global stakeholders. Bonus: knowledge of Data Science and Machine Learning. Diverse global team of 70+ nationalities with strong DEI focus. Modern Bengaluru office with hybrid work flexibility. Flat structure with direct leader access, minimal bureaucracy. Work on ambitious, impactful projects with leading tech experts. Active community engagement with partners and customers. Excited to build next-gen industrial data solutions with Cognite? Apply today and make an impact in a fast-growing, innovative SaaS company!

Job Title: Machine Learning Engineer III Location: Bangalore, India Company: Glance An InMobi Group Company About Glance Founded in 2019, Glance is a cutting-edge consumer technology company operating innovative digital platforms including Glance, Roposo, and Nostra. Our flagship Glance Lock Screen reaches over 450 million smartphones worldwide, delivering personalized, context-driven content without requiring app downloads. Roposo redefines live streaming experiences with creator-led interactive content, and Nostra stands as the largest gaming platform in India and Southeast Asia, offering immersive gaming and social engagement. Headquartered in Singapore, Glance is an unconsolidated subsidiary of InMobi Group. At Glance, we believe in empowering you to dream big, innovate boldly, and own your impact from day one. Collaborate with talented peers on mission-critical projects leveraging bleeding-edge technology to disrupt consumer experiences. Enjoy perks including daily meals, gym access, training sessions, state-of-the-art tech tools, and a family-friendly workspace where your kids and pets are always welcome. Role Overview We are seeking a skilled Machine Learning Engineer III passionate about designing, developing, deploying, and scaling high-impact ML solutions. You will partner closely with data scientists, engineers, and product teams to build end-to-end ML systems, microservices, and APIs that power AI-driven products on Glance s platforms. Key Responsibilities Architect and implement scalable ML solutions to accelerate experimentation, model building, and deployment. Develop microservices and APIs for serving machine learning models and services efficiently. Design, prototype, and build new ML/AI products and proof-of-concepts in collaboration with cross-functional teams. Explore and adopt new platforms, algorithms, and technologies to enhance ML capabilities. Manage project priorities, deadlines, and deliverables while maintaining transparent communication across teams. Take ownership of end-to-end ML engineering lifecycle from research collaboration to production deployment. Preferred Qualifications 5+ years of professional experience as a Machine Learning Engineer with a proven track record of delivering impactful ML solutions. Bachelor s, Master s, or PhD degree in Computer Science, Mathematics, Statistics, or related analytical fields. Deep theoretical and practical knowledge of recommender systems, computer vision (CNNs), GPU optimization, and generative AI models. Proficiency in Python, Golang, Spark, and familiarity with popular data science and ML libraries. Strong background in advanced mathematics, statistics, and algorithmic problem solving. Excellent technical documentation skills and demonstrated leadership in driving cross-functional projects. Experience working in data science or research-oriented roles with a passion for solving complex challenges. Join Glance and contribute to building next-generation AI-driven consumer experiences. Apply now to be part of a visionary tech team in Bangalore! Qualification : Bachelors, Masters, or PhD degree in Computer Science, Mathematics, Statistics, or related analytical fields.

Staff Software Engineer - Networking Location: Bengaluru, India Company: Databricks About Databricks Databricks powers the world s best data and AI infrastructure platform, enabling data teams to tackle critical problems from transportation innovation to medical breakthroughs. Our platform unifies data, analytics, and AI for over 10,000 organizations worldwide, including more than half of the Fortune 500. Founded by the creators of Apache Spark , Delta Lake, and MLflow, Databricks is headquartered in San Francisco with global offices. Role Overview As a founding member of our new Networking Infrastructure team in Bengaluru, you will design and develop backend connectivity services that power millions of VMs running on Databricks. This platform connects our control plane to the compute plane, enhancing scalability and optimizing cloud resource usage. You ll collaborate closely with product management, operations, and engineering teams to deliver robust, scalable, and efficient networking solutions. This is an exciting hands-on leadership role for an experienced engineer passionate about multi-cloud and distributed systems challenges. What You ll Do Lead design and development of new networking services powering connectivity between control and compute planes. Build scalable backend connectivity systems supporting millions of virtual machines. Collaborate cross-functionally with product, operations, and engineering teams. Solve complex multi-cloud and distributed systems problems in a fast-paced environment. Contribute to setting up and growing the Bengaluru networking team from scratch. What We Look For 12+ years of production software engineering experience in Python, Java, Scala, C++, or similar. 7+ years building large-scale distributed systems from the ground up. Extensive experience in networking domain and SaaS platforms or Service-Oriented Architectures. Strong leadership and hands-on engineering skills. Passion for solving novel challenges in multi-cloud networking and distributed systems. Benefits Comprehensive benefits package tailored to employee needs. Inclusive and diverse workplace committed to equal opportunity for all. Diversity & Inclusion Databricks is dedicated to fostering a diverse and inclusive culture where all employees can thrive. We uphold equal employment opportunities without regard to age, race, gender, ethnicity, disability, religion, sexual orientation, veteran status, or any other protected characteristic.

Staff Software Engineer Databases Location: Bengaluru, India Company: Databricks About Databricks Databricks is a leading data and AI company powering over 10,000 organizations globally, including half of the Fortune 500. Founded by the original creators of Apache Spark , Delta Lake, and MLflow, Databricks offers a unified platform for data, analytics, and AI, enabling enterprises to innovate with confidence. With its global presence and a growing Bengaluru team, Databricks is rapidly expanding. Role Overview As a Staff Software Engineer in Bengaluru, you ll work within Backend or Distributed Data Systems (DDS) teams to build scalable, reliable, and high-performance services powering Databricks data and AI platform. You will tackle challenges ranging from distributed systems and cloud storage to service architecture, workflow orchestration, and developer experience. Key Responsibilities Develop large-scale distributed backend services, including managing cloud storage backends like AWS S3 or Azure Blob Store. Build and maintain infrastructure that supports millions of cluster-hours per day. Contribute to key DDS projects such as Apache Spark , Delta Lake, and performance engineering. Design and implement high-performance, reliable, and scalable systems and client libraries. Collaborate cross-functionally to drive innovation in cloud-native data processing and storage. Qualifications BS or higher in Computer Science or related field. 10+ years of production software engineering experience in Python, Java, Scala, C++, or similar. Proven experience developing large-scale distributed systems from the ground up. Experience with SaaS platforms or Service-Oriented Architectures. Benefits & Culture Competitive benefits tailored to employees needs. Committed to fostering a diverse, inclusive, and equitable work environment. Diversity & Inclusion Statement Databricks ensures equal employment opportunities regardless of age, race, gender, ethnicity, disability, sexual orientation, veteran status, or other protected characteristics, striving for a welcoming and inclusive workplace. Qualification : BS or higher in Computer Science or related field.

Job Title: Staff Machine Learning Engineer Location: Bengaluru, Karnataka, India Job Type: Full-Time (Hybrid Work Model) Experience Level: 6-10+ Years About Eightfold.ai: At Eightfold.ai, we re revolutionizing the way organizations find, manage, and empower talent. As a leader in AI-driven HR tech, our groundbreaking platform is transforming industries by using artificial intelligence to solve talent management challenges at scale. We are looking for exceptional engineers to join our team and be at the forefront of innovation in the field of AI. About the AI/ML Team: The AI/ML team at Eightfold is passionate about building cutting-edge solutions and pushing the boundaries of applied machine learning. We work with massive datasets and tackle complex, real-world challenges to develop state-of-the-art AI models. Our models are transforming how companies approach talent management, and we are looking for a Staff Machine Learning Engineer to help lead this journey. What You Will Do: As a Staff Machine Learning Engineer, you will play a critical role in leading and inspiring our ML team while architecting and implementing scalable, robust ML pipelines for our core products. Lead and Inspire: Mentor and guide a team of talented ML engineers, fostering a collaborative environment that encourages innovation. Architect and Implement: Design and build scalable ML pipelines that power Eightfold s core products. Innovate and Optimize: Develop novel algorithms and continuously enhance the performance, accuracy, and scalability of our models. Solve Complex Problems: Work on challenging real-world problems, including NLP, recommendation systems, and predictive analytics. Stay Ahead of the Curve: Research and implement cutting-edge techniques in deep learning, reinforcement learning, and other emerging fields. LLM & NLP Expertise: Design and implement scalable solutions using Large Language Models (LLMs), fine-tuning them for specific NLP tasks, and developing LLM-powered applications. What You Bring: Required Skills & Experience: Deep Expertise in ML & AI: Strong foundation in Machine Learning, Deep Learning, and Natural Language Processing (NLP) with a proven track record of developing and deploying ML models at scale. Technical Leadership: Experience leading and mentoring teams, with excellent communication and collaboration skills. Problem-Solving Mindset: Ability to analyze complex problems and develop innovative solutions. Passion for AI: Genuine enthusiasm for pushing the boundaries of AI and its real-world applications. Advanced Skills in Python & ML Frameworks: Proficiency in Python and relevant ML frameworks (TensorFlow, PyTorch), along with experience in big data technologies like Hadoop and Spark. CS Fundamentals & Coding: Strong foundation in computer science fundamentals and coding languages (Python, C/C++, Java, Scala, R). GenAI & LLM Expertise: Experience in developing and deploying LLM-powered applications, with knowledge of LLM fine-tuning techniques, optimization strategies, and ethical considerations. Nice to Haves: 6-10+ years of experience in Machine Learning and AI. MS or PhD in Computer Science or related field. Publications in top-tier AI conferences. Contributions to open-source ML projects. Familiarity with Generative AI (GenAI), Transformers, and LLMs. Impactful Work: Play a pivotal role in shaping the future of AI and its applications in talent management. Innovative Environment: Work on cutting-edge projects with world-class experts in the field of AI/ML. Career Growth: Accelerate your career in a dynamic, fast-paced environment with abundant opportunities for professional growth. Hybrid Work Model: Embrace a flexible work environment with the ability to collaborate remotely and in-person at our Bengaluru or Noida offices twice a week starting February 1, 2024. Competitive Benefits: Comprehensive family medical, vision, and dental coverage, a competitive base salary, equity awards, and discretionary bonuses or commissions. How to Apply: If you're a passionate AI/ML engineer ready to take on challenging problems and make a meaningful impact, we d love to hear from you. Join Eightfold.ai and help shape the future of AI-powered talent intelligence! Qualification : MS or PhD in Computer Science or a related field

Job Title: Senior Software Engineer Backend Location: Bangalore, India Job Type: Full-Time | Hybrid Experience Required: 3 5 Years About Eightfold.ai At Eightfold.ai, we are on a mission to solve one of the most critical challenges of our time employment. We are building the world s first AI-powered Talent Intelligence Platform that helps organizations hire, develop, and retain a diverse and high-performing workforce. By leveraging deep-learning AI and data science, Eightfold is transforming how individuals and companies unlock potential and make career-defining decisions. We have raised $410M+ in funding and are backed by leading investors with a valuation of over $2 billion. If you re passionate about solving meaningful problems at scale, this is your opportunity to make a lasting impact. About the Role We are looking for a Senior Backend Engineer who thrives on solving complex system-level problems and building scalable backend platforms that serve thousands of global enterprise users. You ll be part of a highly motivated engineering team working on impactful products for large enterprises, governments, and nonprofits. What You ll Do Design and develop robust, scalable, and configurable backend applications and modules with a strong focus on performance and reusability. Contribute to distributed systems design, microservices architecture, and scalable API development. Collaborate cross-functionally with Product, Design, and Engineering to deliver feature-rich experiences. Work with AI-assisted development tools like GitHub Copilot and Cursor to boost development velocity. Engage in technical discussions, code reviews, and architectural planning to improve overall software quality. Prototype, test, and iterate on new ideas that push the boundaries of our product capabilities. 3 5 years of industry experience with a strong foundation in computer science fundamentals, data structures, and algorithms. Proven experience in backend application development and a passion for solving system design and scalability challenges. Strong problem-solving mindset and ownership of end-to-end product development. Exposure to cloud-based infrastructure (preferably AWS) is a plus. Curiosity to work on AI-driven applications and modern coding tools. Excellent collaboration and communication skills with a proactive attitude. Our Backend Tech Stack Languages: Python, SQL, Bash Frameworks & Libraries: Flask, TensorFlow Infrastructure & Tools: Docker, Ansible, Apache Spark, Solr Databases: MySQL, AWS Aurora, Redshift Cloud Services: AWS S3, CloudFormation, SNS, SQS Note: Experience with similar technologies is also welcome. Shape the future of work through cutting-edge AI products that solve real-world hiring challenges. Thrive in a high-impact, high-ownership culture built around innovation and autonomy. Work alongside world-class engineers, researchers, and product leaders. Competitive compensation, equity opportunities, and comprehensive health benefits. Hybrid work model: Return to the office 2x per week. Equal Opportunity Statement Eightfold.ai is an equal opportunity employer committed to building an inclusive and diverse workforce. We welcome applications from all backgrounds regardless of race, religion, gender, sexual orientation, or disability. Apply Now If you re a backend engineer who loves tackling hard problems, building scalable systems, and working in a mission-driven environment Eightfold wants to hear from you.

Senior Data Engineer Location: Bengaluru, India Employment Type: Full-time, On-site About Neuron7.ai Neuron7.ai is a rapidly growing AI-first SaaS company that is revolutionizing the world of service intelligence. Backed by leading Silicon Valley venture capitalists and a distinguished group of angel investors, we are recognized as a startup to watch. Our AI-driven platform delivers service predictions in seconds by analyzing structured and unstructured data, alongside insights from top experts. We specialize in complex service environments like high-tech devices, manufacturing, and medical devices, empowering service leaders to optimize key metrics like first-call resolution, turnaround time, and service margins. At Neuron7.ai, you will be part of a dynamic, innovative team that is pushing the boundaries of service intelligence. We value creativity, collaboration, and a relentless commitment to innovation. This is your chance to join a fast-growing startup and help redefine how AI impacts the future of service optimization. About the Role We are building a real-time analytics platform to improve uptime of connected devices and minimize maintenance costs. This involves collecting, analyzing, and leveraging large volumes of sensor data for observability and predictive analytics. As a Senior Data Engineer, you will have the opportunity to build and maintain scalable, high-performance data systems using modern data engineering tools. The ideal candidate will have hands-on experience with Python, Scala, ELT processes, Lakehouse architecture, Apache Spark, Databricks, real-time streaming systems like Kafka and Flink, and observability tools such as the ELK stack, Prometheus, and Grafana. What You ll Do: Data Model Development: Design and implement advanced data models to extract insights from complex datasets. Collaborative Problem Solving: Work with cross-functional teams to devise data-driven solutions for service optimization. Experimental Analysis: Conduct experiments and analyses to enhance service predictions and outcomes. Actionable Insights: Present findings and actionable recommendations to stakeholders, translating complex data insights into clear, understandable concepts. Mentorship: Guide and mentor junior team members, fostering a collaborative and knowledge-sharing environment. What We re Looking For: Experience: At least 4 years of hands-on experience in data engineering, with a focus on building large-scale data systems. Data Pipeline Expertise: Strong proficiency in Python and Scala for developing data pipelines. Big Data Tools: Proven experience with Apache Spark and Databricks for big data processing and analytics. Observability Tools: Hands-on experience with observability tools like Prometheus, Grafana, and the ELK stack or OpenSearch. Real-Time Data Streaming: Experience working with real-time streaming systems such as Kafka and Flink. Cloud Platforms: Familiarity with cloud platforms like Azure, GCP, or AWS. Problem-Solving Skills: Strong analytical and problem-solving abilities to work with complex data systems in fast-paced environments. Collaboration: Excellent communication and teamwork skills, with the ability to work effectively with cross-functional teams. What We Do and Value: At Neuron7.ai, we prioritize integrity, innovation, and a customer-centric approach. Our mission is to leverage advanced AI technology to enhance service decision-making and we are dedicated to delivering excellence in all aspects of our work. Company Perks & Benefits: Competitive salary, equity, and spot bonuses Paid sick leave Latest MacBook Pro for your work Comprehensive health insurance Paid parental leave Flexible work arrangements work from home or from our vibrant Bengaluru office Our Commitment to Diversity and Inclusion: Neuron7.ai is committed to fostering a diverse and inclusive workplace. We ensure equal employment opportunities without discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, marital status, or any other characteristic protected by law. If you re passionate about using data to drive service intelligence and want to be part of a forward-thinking team, we d love to hear from you!

Database Engineer II Location: Bangalore, Karnataka | Department: Tech About the Team At Meesho, 5% of Indian households shop with us and to manage millions of orders every day, we ve built resilient systems that operate with zero downtime! Our engineering muscle is a key driver behind Meesho s growth as an e-commerce giant. We value speed over perfection and view failures as opportunities for growth. As a Database Engineer II, you ll be part of a team that thrives on collaboration, constructive feedback, and innovation. If you enjoy solving complex technical problems while working with a fun, dynamic team, Meesho is the place for you! About the Role As a Database Engineer II at Meesho, you'll implement best practices for NoSQL Database Engineering, working with a variety of NoSQL technologies at a large scale. You ll collaborate closely with engineering teams to optimize and streamline systems and processes. Being proficient in emerging technologies and working effectively with cross-functional teams will be key to your success in this role. What You Will Do Manage, maintain, and monitor relational and NoSQL database clusters to meet SLAs. Oversee both in-house and SaaS solutions in the public cloud or 3rd party environments. Diagnose and communicate database issues to relevant stakeholders and implement solutions. Design and implement best practices for provisioning, tuning, upgrading, and decommissioning database clusters. Cost optimization: Implement mechanisms for cost control and continuous improvement. Collaborate with teams to automate approaches for scalability, reliability, and performance. Participate in R&D: Research new database features and innovative solutions. Be part of the on-call rotation to ensure smooth database operations. What You Will Need 5+ years of experience in provisioning and managing relational/NoSQL databases. Proficiency in two or more of the following: MySQL, PostgreSQL, BigTable, Elasticsearch, MongoDB, Redis, ScyllaDB. Strong Python programming skills. Experience with deployment orchestration, automation, and security management using tools like Jenkins, Terraform, and Ansible. Experience with cloud platforms like AWS or GCP. Comfortable working in Linux/Unix environments. Knowledge of TCP/IP stack, load balancers, and networking concepts. Proven ability to drive projects to completion in a timely manner. A degree in Computer Science, Software Engineering, IT, or a related field is a plus. About Us Welcome to Meesho, where every story starts with a spark of inspiration and entrepreneurial spirit. We're not just an e-commerce platform; we're your partner in making dreams come true. Curious about life at Meesho? Our employees rave about our culture and environment and we re proud to be one of the top-rated e-commerce workplaces on Glassdoor! Our Mission Meesho s mission is to democratize internet commerce for everyone. We started with a single goal: to become the e-commerce destination for the next billion Indian consumers and enable 100 million small businesses to succeed online. With over 1.75 million sellers, we provide industry-first benefits like zero commission and the lowest shipping costs. Meesho is empowering small businesses by connecting them with a massive customer base through cutting-edge tech infrastructure and logistics. Culture & Total Rewards At Meesho, we foster a dynamic, high-impact workplace where performance excellence is key. Our people-centric culture is built on our 11 guiding principles (or "Mantras"), which influence everything from recognition and growth discussions to team collaboration. What We Offer: Competitive compensation: Market-leading cash and equity-based rewards tailored to each role and experience. Holistic wellness support: Our MeeCare Program includes benefits covering physical, mental, financial, and social wellness. Medical insurance: Extensive medical coverage for employees and their families, along with wellness services like telehealth and gym discounts. Work-life balance: Generous leave policies, parental support, retirement benefits, and continuous learning support. Employee recognition: Personalized gifts, team engagement, and a culture of appreciation. Additional benefits including salary advance, relocation assistance, and flexible benefits plans. Qualification : A degree in Computer Science, Software Engineering, IT, or a related field is a plus.

Machine Learning Engineer Full-Time - Bengaluru, India - Data Science / Artificial Intelligence / Engineering Join our dynamic Data Science / Artificial Intelligence / Engineering team in Bengaluru, India as a Full-Time Machine Learning Engineer and play a key role in driving data-driven innovation! We are seeking a skilled and results-oriented Machine Learning Engineer to design, build, and deploy scalable machine learning models that address real-world business challenges. You will collaborate closely with data scientists, engineers, and product managers to transform raw data into actionable insights and integrate intelligent features into our products. As a Machine Learning Engineer, you will be responsible for the complete lifecycle of machine learning models and pipelines, from design and development to seamless deployment for a variety of applications. This includes classification, regression, clustering, recommendation systems, and time-series forecasting. You will leverage your expertise to preprocess and analyze large and complex datasets, extracting meaningful features and valuable insights. Collaboration with cross-functional teams will be crucial as you identify strategic ML opportunities and define clear success metrics. A key aspect of this role involves optimizing machine learning models for peak performance, scalability, and accuracy within production environments. You will build robust APIs or efficient microservices to integrate these models seamlessly into our applications, utilizing tools such as Flask or FastAPI. Continuous improvement is paramount, and you will be responsible for the ongoing monitoring and retraining of models based on their performance and any signs of data drift. Staying at the forefront of the field is essential, and you will be expected to stay updated with the latest ML research and emerging technologies, applying them to continuously enhance our product capabilities. Key Responsibilities: Design, develop, and deploy machine learning models and pipelines for diverse applications including classification, regression, clustering, recommendation, and time-series forecasting. Preprocess and analyze large datasets to extract meaningful features and actionable insights. Collaborate effectively with cross-functional teams to identify strategic ML opportunities and define clear success metrics. Optimize models for maximum performance, scalability, and accuracy in production environments. Build robust APIs or efficient microservices to integrate ML models into applications using tools like Flask or FastAPI. Continuously monitor and retrain models based on performance metrics and potential data drift. Stay updated with the latest ML research and technologies and apply them to enhance product capabilities. Minimum Qualifications: Bachelor s or Master s degree in Computer Science, Data Science, Statistics, or a related field. 2+ years of proven experience as a Machine Learning Engineer or in a similar role. Strong proficiency in Python and key ML libraries such as Scikit-learn, XGBoost, TensorFlow, or PyTorch. Practical experience working with both SQL and NoSQL databases. Solid knowledge of essential data preprocessing, effective feature engineering, and robust model evaluation techniques. Familiarity with standard software engineering practices, including version control (Git), thorough code reviews, and efficient CI/CD pipelines. Preferred Qualifications: Prior experience with deep learning, natural language processing (NLP), or computer vision. Familiarity with major cloud services like AWS, GCP, or Azure (especially SageMaker, Vertex AI, etc.). Understanding of modern MLOps tools and practices (e.g., MLflow, Kubeflow, DVC). Practical experience with containerization and orchestration tools (Docker, Kubernetes). Knowledge of big data tools (e.g., Spark, Hadoop) is considered a significant plus. What We Offer: Competitive salary and performance-based incentives to reward your contributions. Comprehensive health insurance and valuable wellness benefits to support your well-being. Dedicated learning and development programs for continuous professional growth. Exciting opportunities to work on impactful, real-world AI/ML projects with significant scale. A collaborative, inclusive, and innovative work culture that fosters teamwork and creativity. Flexible working hours and a hybrid work model to promote a healthy work-life balance.

Lead Data Engineer | ThoughtWorks | Bangalore, India Location: Bangalore, India Employment Type: Full-time, Regular Industry: Information Technology About ThoughtWorks At ThoughtWorks, we're a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. For over 30 years, we've worked alongside our clients to deliver solutions that challenge the status status quo. With a diverse and inclusive team, we empower each other to grow through shared learning, fostering an environment where innovation thrives. Our commitment to a cultivation culture is key to our success, and we re looking for a Lead Data Engineer to join our Bangalore team and lead transformative projects. Job Overview As a Lead Data Engineer at ThoughtWorks, you will be responsible for designing, developing, and operating modern data architectures that meet client business objectives. You will lead and manage data engineering projects end-to-end, from strategic planning to hands-on coding, ensuring the delivery of scalable and efficient data solutions. Working with cutting-edge technologies, you ll collaborate with stakeholders, clients, and cross-functional teams to implement data-driven strategies that address complex business challenges. Key Responsibilities Project Leadership: Lead and manage data engineering projects from inception to completion, including goal-setting, scope definition, and ensuring on-time delivery in collaboration with cross-functional teams. Data Architecture & Solution Design: Collaborate with clients to design modern data architecture and implement end-to-end solutions that meet key business objectives. Create intricate data processing pipelines to address complex business problems. Stakeholder Collaboration: Work closely with stakeholders to understand business objectives and identify opportunities to leverage data and data quality improvements. Data Modeling & Governance: Develop data models using modern modeling techniques and implement them using appropriate technologies. Ensure compliance with data governance, security, and privacy requirements. Scalable Implementations: Partner with data scientists to design scalable implementations of their models, ensuring the solutions are robust and efficient. Clean, Iterative Code: Write clean, modular code based on TDD (Test-Driven Development) and implement continuous delivery practices to support and operate data pipelines. Technology Guidance: Advise clients on distributed storage and computing technologies, selecting the best options to fit their business needs. Data Quality Strategy: Define and incorporate data quality strategies into daily work processes to ensure high standards and compliance. Job Qualifications Technical Skills: Proven experience in data engineering and system design, with a focus on building Big Data architecture and data pipelines within distributed systems. Deep knowledge of data modeling and hands-on experience with modern data engineering tools and platforms. Strong programming skills, with expertise in building scalable, high-quality data pipelines using languages like Python, Java, Scala, or others. Experience with distributed storage platforms (e.g., Hadoop, Amazon S3, etc.) and distributed processing platforms (e.g., Spark, Flink). Experience working with SQL, NoSQL, data lakes, and other data storage technologies. Familiarity with data visualization techniques and ability to communicate insights effectively across varying audiences. Professional Skills: Stakeholder Management: Strong ability to liaise between clients and other key stakeholders, ensuring trust and buy-in throughout projects. Adaptability & Resilience: Comfortable handling ambiguity and finding innovative solutions to complex challenges. Leadership & Mentorship: Experienced in coaching and mentoring team members, fostering a culture of professional growth and accountability. Risk & Conflict Management: Skilled in managing risks and resolving conflicts, driving projects forward despite challenges. Relationship Building: Natural at cultivating strong relationships with clients, stakeholders, and internal teams to create new opportunities. What You Bring to the Team Leadership: A proven track record in leading high-performance teams and supporting colleagues in their professional development. Curiosity & Innovation: A passion for data and technology and a willingness to continually learn and push the boundaries of what's possible. Collaboration: Ability to work closely with cross-functional teams and stakeholders to design and implement innovative data solutions. At ThoughtWorks, we believe in giving you the autonomy to carve out your unique career path, while providing support through development programs and a vibrant culture of learning. You ll work on exciting projects with a diverse team, solve complex challenges, and make an impact at a global scale. Join ThoughtWorks and be part of a global community of innovators. Together, we turn curiosity into action and creativity into impactful solutions.

Data Engineer (Python/Dataiku/Spark/SAS DI) Location: Bangalore Type of Employment: Full-Time Experience Required: 3 to 5 years Job Overview: We are looking for a passionate Data Engineer with expertise in Python, Dataiku, Spark, or SAS DI to join our dynamic team. In this role, you will collaborate with clients to build data pipelines that support their Data and Analytics journey. As a member of our team, you will be responsible for driving data engineering initiatives, developing and implementing ETL solutions, and optimizing data workflows for efficiency and scalability. Key Responsibilities: Data Engineering Initiatives: Collaborate with clients to define and implement data engineering initiatives based on business needs. ETL Development: Design and develop data integration solutions using tools like Python, Dataiku, Spark, and SAS DI. Develop and maintain automated data pipelines for real-time and batch data ingestions. Performance Tuning: Conduct performance tuning and optimize queries and data models to enhance performance and scalability. Database Design: Design and implement database objects such as tables, views, schemas, and stored procedures. Ensure data quality and consistency across the data warehouse. Collaboration: Work closely with cross-functional teams to translate business requirements into technical solutions and communicate effectively with clients across multiple regions. Troubleshooting: Troubleshoot and resolve data-related issues while ensuring the quality and integrity of the data. Project & Technical Leadership: Act as the technical lead or single point of contact (SPOC) for the client and internal teams, ensuring smooth project delivery. Essential Skills: Data Engineering Tools: Experience with Python, Dataiku, Spark, and SAS DI. SQL Proficiency: Strong SQL experience for extracting data from various databases and performing data analysis. ETL Development: Expertise in designing and developing ETL processes to integrate data from diverse sources into a data mart layer. Data Modeling: Understanding of data modeling concepts, including relational and dimensional modeling. BI Knowledge: Basic understanding of Business Intelligence (BI) tools and analytics needs. Communication Skills: Excellent communication skills to understand business requirements and translate them into technical solutions. Desirable Skills: Data Analysis: Strong analytical skills to perform data analysis, especially for banking products data. BI Tools: Experience with MicroStrategy or Power BI for reporting and dashboarding. Qualifications: 3+ years of experience designing and developing scalable data integration solutions. Familiarity with data analytics and reporting needs. Technical certifications that align with your continuous learning aspirations. Qualities: Strong problem-solving skills with a systematic approach to resolving issues. Ability to influence and implement change confidently. Excellent team player who works effectively in cross-functional teams. Strong communication and presentation skills, capable of interacting with clients and presenting ideas persuasively. Fluent in English, both written and spoken, for effective communication. Opportunity to work with cutting-edge data engineering tools and technologies. Be a key player in building and optimizing data pipelines for clients data and analytics needs. Competitive salary, benefits, and a dynamic, innovative work culture.