Data Modeling Engineer Jobs in Bengaluru
1442 Jobs Found
Analytics Engineer
Postman
Analytics Engineer Location: Bengaluru Work Type: Full-Time About Postman Postman is the world s leading API platform, used by over 40 million developers and 500,000 organizations, including 98% of the Fortune 500. Our mission is to build an API-first world, simplifying every step of the API lifecycle and enabling teams to create better APIs, faster. Founded in Bengaluru, Postman is headquartered in San Francisco, with offices in Boston, New York, and Bengaluru. We are privately held, backed by Battery Ventures, BOND, Coatue, CRV, Insight Partners, and Nexus Venture Partners. The Opportunity We are seeking an Analytics Engineer to join our Data Team and help strengthen the foundation of our modern data stack. In this role, you will own critical transformation pipelines, design scalable data models, and ensure that our analytics environment is performant, reliable, and future-ready. You will operate with a high degree of independence, driving projects from design through production, while implementing best practices in dbt, semantic layers, medallion architecture, and lakehouse paradigms. Key Responsibilities Take ownership of large portions of our dbt project (3k+ models), ensuring scalability, maintainability, and adherence to best practices. Design and implement robust data models, including dimensional modeling, incremental strategies, and Slowly Changing Dimensions (SCDs). Establish and enforce dbt test coverage, automated quality checks, and CI/CD pipeline standards using GitHub Actions. Profile and optimize SQL queries and warehouse performance for efficiency and cost reduction. Build and refine our semantic layer, ensuring consistent business logic across Looker, Redash, and downstream tools. Collaborate with analysts and business partners to define metrics and deliver self-serve data assets. Document models, lineage, and transformation logic to make data discoverable and usable across the company. Contribute to shaping team standards and playbooks, collaborating with analysts on modeling and transformation best practices. Stay ahead of modern data stack innovations, including dbt metrics layer, universal semantic layers, data contracts, and observability. Enabling Self-Serve Analytics & AI Build transformations that empower business stakeholders and analysts to explore data confidently. Ensure metric definitions are consistent, discoverable, and reusable across BI tools. Prepare clean, structured, and accessible datasets for AI-driven initiatives like conversational analytics and anomaly detection. Partner with Data Science & ML teams to provide reliable pipelines that accelerate experimentation and AI/ML deployment. About You 3 5 years of experience in analytics engineering roles. Advanced SQL skills (query optimization, performance tuning). Strong proficiency in dbt Core: models, macros, snapshots, sources, and custom materializations. Solid background in data modeling techniques (Kimball, SCD handling, incremental pipelines). Practical experience with semantic layers and BI integration (LookML, dbt metrics, or equivalent). Familiarity with Medallion architecture and modern lakehouse approaches. Hands-on experience with Redshift; exposure to Databricks is a plus. Proficiency with GitHub and CI/CD pipelines for analytics code. Strong fundamentals in data quality, governance, and lineage tracking. Flexible schedule with a hybrid work model. Full medical coverage, flexible PTO, wellness reimbursement, and monthly lunch stipend. Access to wellness programs, team-building events, and donation-matching initiatives. An inclusive, collaborative culture where everyone can thrive and grow. Our Values Curiosity: Explore and innovate fearlessly. Transparency: Communicate openly about successes and failures. Focus: Set clear goals aligned with a bold vision. Inclusion: Every voice matters. Excellence: Deliver the best products and experiences together.
AI/ML Engineer
Scaledge
Job Title: AI/ML Engineer Location: Bangalore Experience: 4 5 Years Qualification: Bachelor s or Master s Degree in Computer Science or a related field Job Description Design and develop machine learning and deep learning systems tailored to business needs. Select and preprocess appropriate datasets; implement and optimize ML algorithms. Conduct machine learning experiments, run tests, and perform statistical analysis to fine-tune models. Train, retrain, and maintain ML systems to ensure accuracy and performance. Extend and customize existing ML libraries and frameworks. Stay updated with the latest research and advancements in machine learning and AI. Requirements Proven experience as a Machine Learning Engineer or similar role. Strong understanding of data structures, data modeling, and software architecture. Deep knowledge of mathematics, probability, statistics, and algorithms relevant to ML. Proficiency in writing clean, robust code in Python. Experience with ML frameworks such as TensorFlow or PyTorch, and libraries like scikit-learn. Skilled in deploying ML models and developing APIs for production environments. Experience with AWS cloud and ML services; knowledge of SageMaker is a plus. Qualification : Bachelors or Masters Degree in Computer Science or a related field
Snowflake Data Engineer
Growtharc Technologies
Position: Snowflake Data Engineer Location: Remote/Hybrid | Bengaluru, IND What You'll Do: Design & Optimize Data Pipelines: Build and enhance data pipelines and workflows using Snowflake, Azure, and DBT for efficient data ingestion, transformation, and analytics. Boost Performance: Optimize query performance and data storage within Snowflake to ensure lightning-fast data processing and retrieval. Implement ETL/ELT: Design and implement robust ETL/ELT processes, fully leveraging Snowflake's powerful capabilities for data ingestion and transformation. Collaborate Cross-Functionally: Work closely with various teams to understand their data needs and deliver high-quality, scalable data solutions. Ensure Data Governance: Uphold stringent data security, compliance, and governance standards, including data privacy and regulatory requirements. What You'll Bring: Experience: 4-10 years in data engineering, with a minimum of 3 years directly with Snowflake. SQL Mastery: Expert-level proficiency in SQL, including advanced querying, performance tuning, and data modeling. Deep Snowflake Knowledge: In-depth understanding of Snowflake architecture, features, and best practices for optimization and data management. Data Warehousing: Strong grasp of data warehousing concepts and dimensional modeling. Microsoft Technologies: Familiarity with Microsoft SSIS, SSAS, and SSMS. IaC & CI/CD: Knowledge of Infrastructure as Code (IaC) tools like Terraform and experience with GitHub Actions for CI/CD. Workflow Orchestration: Experience with tools like Airflow for managing and automating data workflows. Problem-Solving & Communication: A proactive, positive attitude with excellent written and verbal communication skills. Education: Bachelor s degree in Computer Science, Information Systems, or a related field. Bonus Points If You Have: Migration Experience: Hands-on experience with SQL Server to Snowflake migrations, especially using Fivetran. DBT & Fivetran: Proficiency with the data build tool (dbt) for data transformation and Fivetran for data integration. Cloud Platforms: Knowledge of cloud platforms such as AWS, Azure, or GCP. Certifications: Relevant certifications like Snowflake SnowPro, AWS Certified Data Analytics, or Azure Data Engineer.
Data Architect
Growtharc Technologies
Position: Data Architect Location: Remote/Hybrid | Bengaluru, IND We're searching for a highly skilled and experienced Data Architect to join our team. If you have a deep understanding of big data technologies and extensive experience with Hadoop, Python, Snowflake, and Databricks, you're the ideal candidate. You'll be responsible for designing, implementing, and managing complex data architectures that support our critical business needs and objectives. What You'll Do: Design & Architecture Leadership: Design scalable and efficient data architecture solutions that meet current and future business data needs. Lead the development of data models, schemas, and databases, ensuring alignment with business requirements. Architect and implement robust data solutions on leading cloud platforms (AWS, Azure, or GCP). Data Management & Governance: Develop and maintain robust data pipelines and ETL processes using Hadoop, Databricks, and other essential tools. Oversee data integration and quality efforts to ensure consistency and reliability across the organization. Implement data governance best practices, focusing on data security, privacy, and compliance. Collaboration & Mentorship: Work closely with data engineers, data scientists, and business stakeholders to translate data requirements into effective technical solutions. Provide technical leadership and mentorship to junior data engineers and architects. Collaborate with cross-functional teams to ensure data solutions align perfectly with overall business goals. Optimization & Innovation: Optimize existing data architectures for peak performance, scalability, and cost-efficiency. Monitor and troubleshoot data systems to ensure high availability and reliability. Continuously evaluate and recommend new tools and technologies to improve our data architecture. What You'll Bring: Experience: 10+ years in data architecture, data engineering, or a related field. Big Data Expertise: Proven experience with Hadoop ecosystems (HDFS, MapReduce, Hive, HBase). Programming Prowess: Strong programming skills in Python for data processing and automation. Data Platform Mastery: Hands-on experience with Snowflake for data warehousing and Databricks for analytics. Cloud Fluency: Extensive experience with cloud platforms (AWS, Azure, GCP) and their data services. Data Modeling: Familiarity with data modeling tools and methodologies. Core Skills: Deep understanding of big data technologies and distributed computing. Strong problem-solving skills to design solutions for complex data challenges. Excellent communication skills, able to explain complex technical concepts clearly to diverse audiences. Proficient in SQL and database performance tuning. Experience with CI/CD pipelines and automation in data environments. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Advanced Degree: A Master's degree in a related field. Cloud Certifications: Certifications like AWS Certified Data Analytics, Google Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate. Additional Languages: Experience with other programming languages like Java or Scala. Machine Learning Integration: Knowledge of machine learning frameworks and their integration with data pipelines.
Lead Product Engineer
Themathcompany
Job Title: Lead Product Engineer Location: Bengaluru, Karnataka, India Department: Product Engineering Experience: 6 10 years About TheMathCompany TheMathCompany (MathCo ) is a global Enterprise AI and analytics firm helping Fortune 500 and Global 2000 organizations drive better decision-making through custom-built AI solutions. With our proprietary platform NucliOS, we power scalable, reusable, and intelligent products that accelerate digital transformation across industries. At MathCo, we empower our engineers to innovate, take ownership, and work on cutting-edge enterprise-grade products from scratch. If you re passionate about full-stack product development and thrive in a dynamic, high-impact environment, we d love to talk to you. About the Role As a Lead Product Engineer, you will be responsible for the architecture, development, and deployment of full-stack applications that are critical to our enterprise clients success. You ll lead a cross-functional team and work closely with product managers, designers, and data scientists to deliver high-performance solutions that scale and transform. This role combines hands-on coding, system architecture, and team leadership, and is ideal for engineers looking to make a direct impact on product direction and execution. Key Responsibilities 1. Full Stack Development Build and maintain RESTful APIs and microservices using languages like Python or Node.js. Design and develop scalable and maintainable UI components using modern front-end frameworks (e.g., React, Vue, Angular). Architect and manage application databases (SQL & NoSQL). Integrate with authentication/authorization protocols (e.g., OAuth2, OIDC, SAML). Participate in the full product lifecycle from ideation and development to deployment and support. 2. Product Development & Collaboration Translate business requirements into technical solutions in collaboration with product managers and designers. Provide technical leadership and guidance to the development team. Optimize systems for performance, scalability, and reliability. 3. Code Quality & Testing Write clean, efficient, well-documented code following best practices and industry standards. Conduct and participate in code reviews. Develop and maintain automated test frameworks; ensure unit, integration, and end-to-end testing coverage. Oversee CI/CD pipelines and manage cloud-based deployments. Must-Have Technical Skills 6 10 years of experience in full-stack development and system design. Proficiency in backend languages like Python, Node.js (bonus: Rust, Go). Strong front-end experience with HTML, CSS, JavaScript, and frameworks like React, Angular, or Vue.js. Expertise in REST APIs, microservices, and database design (ER modeling, data flow, API integration). Hands-on with PostgreSQL, MySQL, MongoDB, or similar. Experience deploying applications on cloud platforms (AWS, Azure, GCP). Familiarity with Docker, Kubernetes, and infrastructure tools like Terraform, CloudWatch. Version control and DevOps experience with GitHub, Azure DevOps, and CI/CD pipelines. Non-Technical & Soft Skills Strong knowledge of Agile methodologies (SCRUM). Excellent problem-solving and debugging capabilities. Strong communication and collaboration skills across teams. Ability to manage multiple projects in a fast-paced environment. Work with some of the best minds in data science, engineering, and AI. Drive high-impact product development used by Fortune 500 companies. Be part of a flat, inclusive, and innovation-driven workplace culture. Access to cutting-edge tools, custom-built platforms, and rapid experimentation. Apply now and help build world-class AI-driven solutions with MathCo.
Senior Product Engineer
Themathcompany
Job Title: Senior Product Engineer Location: Bengaluru, Karnataka, India Department: MathCompany India (Product Engineering) Experience: 4.5 to 7 years About TheMathCompany TheMathCompany (MathCo ) is a global Enterprise AI and Analytics company, empowering Fortune 500 and Global 2000 companies with custom-built AI products and platforms. We blend deep domain knowledge, analytics, and cutting-edge technology to solve real-world business challenges. Our proprietary platform NucliOS powers smart, scalable solutions, enabling rapid and sustainable transformation. Join our vibrant team of engineers, data scientists, and designers who are building transformative enterprise products that deliver 3x 5x ROI within their first year of launch. Role Overview As a Senior Product Engineer, you ll play a key role in developing, maintaining, and optimizing full-stack web applications. This is a hands-on role where you'll be responsible for designing both backend services and frontend interfaces, while ensuring high-quality, scalable, and secure performance. You ll collaborate cross-functionally with product managers, designers, and fellow engineers to deliver enterprise-grade software products. This is a great opportunity to contribute to impactful solutions while expanding your technical leadership in a high-growth, agile environment. Key Responsibilities Full Stack Development Design, build, and manage REST APIs, backend services, and deployment pipelines. Develop responsive UI components using modern JavaScript frameworks (e.g., React, Angular, Vue). Architect and manage application databases, handling data modeling, integration, and optimization. Implement secure authentication and authorization protocols (e.g., OAuth2, OIDC, SAML). Own the end-to-end development lifecycle from concept through to deployment and support. Product Development & Collaboration Partner with product managers and UI/UX designers to convert requirements into scalable technical solutions. Drive product performance and usability by identifying opportunities for optimization. Act as a key technical stakeholder, participating in product roadmap discussions and sprint planning. Code Quality & Testing Write clean, maintainable, and efficient code following SOLID principles and industry best practices. Conduct peer code reviews and mentor junior engineers. Develop and maintain unit tests, integration tests, and ensure comprehensive test coverage. Contribute to CI/CD pipelines and participate in deployment and infrastructure automation. Technical Skills Required 4.5 7 years of experience in full-stack product development. Strong programming in Python or Node.js (bonus: Rust/Go). Advanced front-end development with JavaScript, HTML, CSS, and frameworks like React, Vue, or Angular. Strong grasp of object-oriented design, SOLID principles, and modern design patterns. Experience designing and implementing relational (PostgreSQL, MySQL) and NoSQL (MongoDB) databases. Proficient in cloud platforms such as AWS, Azure, or Google Cloud. Familiarity with infrastructure tools: Docker, Kubernetes, Terraform, CloudWatch. Comfortable using version control and project tools like GitHub, Azure DevOps, and JIRA. Soft Skills & Work Style Strong problem-solving mindset and high attention to detail. Effective collaborator and communicator, both within the engineering team and cross-functionally. Familiarity with Agile methodologies (SCRUM), sprint cycles, and backlog grooming. Ability to juggle multiple tasks and deliver under tight deadlines in a fast-paced environment. Work on innovative products delivering real ROI for Fortune 500 companies. Be part of a people-first culture that values transparency, curiosity, and collaboration. Accelerate your career in an organization that rewards initiative and impact. Get access to state-of-the-art tools, resources, and learning programs. Apply now and join us in redefining how enterprise software gets built!
Senior Ai Engineer
Themathcompany
Job Title: Senior AI Engineer Location: Bengaluru, Karnataka, India Department: GenAI Experience: 4.5 to 7 years Open Positions: 5 About the Role As a Senior AI Engineer, you will design, build, and maintain scalable AI solutions with a strong focus on Generative AI technologies such as large language models (LLMs), embeddings, and retrieval techniques. You will lead a team of AI engineers and collaborate with stakeholders to deliver impactful AI-driven products aligned with business goals. Your role includes mentoring, project planning, ensuring data quality, and driving continuous process improvements. Key Responsibilities Design, develop, and deploy scalable AI/ML solutions, specializing in advanced Generative AI (LLMs, embeddings, retrieval-augmented generation, prompt engineering). Lead, mentor, and develop a team of AI engineers in a collaborative, inclusive environment. Coordinate with stakeholders to gather requirements, prioritize tasks, and define project timelines. Ensure projects align with overall business objectives and data strategies. Oversee data quality, integrity, and security in AI engineering projects. Build reusable frameworks to enhance the efficiency and scalability of AI systems. Manage client communications to translate requirements into technical outcomes. Identify skill gaps and create opportunities for professional development. Drive initiatives for improving data operations and AI delivery efficiency. Required Technical Skills 4.5 to 7 years of experience developing and deploying scalable AI/ML solutions. Strong expertise in data modeling, relational and NoSQL databases, software development lifecycle, unit testing, and functional programming. Proficient in designing and implementing advanced Generative AI solutions including LLMs, embeddings, retrieval techniques, and prompt engineering. Experience designing and optimizing Retrieval-Augmented Generation (RAG) systems. Proficiency with Databricks workflows, including job and cluster management, and API usage. Solid understanding of data structures, algorithms, multiprocessing, and optimization techniques. Skilled in Python libraries such as Pandas, NumPy, FastAPI for data processing and API development. Expertise in SQL optimization and database schema design. Experience deploying AI models using Docker and Kubernetes. Familiarity with version control using GitHub. Hands-on experience with cloud platforms like Azure, AWS, or GCP for AI deployments. Optional experience with PySpark for data processing. Basic understanding of CI/CD pipelines and deployment best practices. Required Non-Technical Skills Strong problem-solving ability with financial impact awareness in both team management and solution delivery. Excellent verbal and written communication skills, comfortable interacting with mid-level client management. Ability to balance pragmatic solutions versus perfect outcomes and rally teams accordingly. Strong interpersonal skills including conflict resolution, empathy, negotiation, and active listening. Demonstrated leadership and mentorship capabilities. Self-motivated with a strong sense of ownership. Good to Have Familiarity with data visualization tools and techniques. Understanding of data security, privacy, governance, and compliance frameworks. Experience with graph databases and graph processing frameworks. Knowledge of data virtualization and federation methods. Skills in data profiling and data quality management. Education Bachelor s degree in Engineering, Computer Science, or a related field. Qualification : Bachelors degree in Engineering, Computer Science, or a related field.
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Senior Solution Architect
Cognite
Senior Solution Architect Location: Bengaluru Team: Global Strategic Services Architecture EMEA Type: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader helping industrial companies solve complex problems using AI and data. Our key platforms Cognite Atlas AI, a next-gen industrial agent workbench, and Cognite Data Fusion (CDF) enable businesses to make faster, smarter, and more sustainable decisions. We ve been recognized as a 2022 Technology Innovation Leader for Digital Industrial Platforms and the 2024 Microsoft Energy & Resources Partner of the Year. With a mission to accelerate digital transformation across energy, oil & gas, manufacturing, and heavy industries, we re building a more connected and intelligent industrial future. Our Values Impact: We are result-oriented, focusing on real-world outcomes. Ownership: We take responsibility, work inclusively, and rise to challenges together. Relentless: We push boundaries, solve hard problems, and learn from every setback. About the Role As a Senior Solution Architect in the Global Customer Success (GCS) team, you ll play a key role in designing cutting-edge digital solutions for some of the world s largest industrial companies. Working within the EMEA Delivery organization, you ll collaborate with customers in the MENA and SEA regions to drive business outcomes and successful technology adoption. This is a customer-facing role where your technical leadership will directly influence the success of digital transformation projects helping clients improve productivity, reduce costs, and meet sustainability goals. What You ll Do Lead end-to-end architecture design for large-scale industrial data solutions. Deliver strategic and technical guidance to internal and external stakeholders. Define scalable enterprise architecture, including integrations, data pipelines, and models. Communicate complex ideas clearly using architecture modeling tools and documentation. Ensure operational stability of solutions with clear support models. Own technical relationship building and act as a trusted advisor to clients and partners. Translate customer feedback into product development inputs. Lead training sessions and collaborate with Sales, Product, and Engineering teams. Independently build integration flows using Cognite SDKs, SQL, Python/Java, and REST APIs. What You ll Bring 8+ years in software development, systems architecture, cloud computing, or IT consulting. Proven customer-facing experience, with the ability to bridge technical and business conversations. Solid hands-on experience in Python, with strong software engineering practices. Strong grasp of data modeling, DevOps principles, and cloud infrastructure. Expertise in AI, cloud, and data integration tools. Excellent communication skills, especially in engaging with executive stakeholders. Experience in Oil & Gas or other industrial sectors is a plus. Be part of a global team spanning 70+ nationalities with strong DEI focus. Work from our modern Bengaluru office (Rathi Legacy, Hoodi) with a hybrid work setup. Thrive in a flat, transparent organization with minimal bureaucracy. Collaborate with industry leaders on ambitious digital projects across the globe. Build innovative solutions that enable better decision-making, operational efficiency, and environmental impact. Enjoy a fun, respectful, and highly engaged culture where your work truly matters. Make Your Impact Cognite is not just another tech company we re building a movement that enables safer, more efficient, and more sustainable industrial operations. If you're excited to work on meaningful challenges with cutting-edge AI and data platforms, we encourage you to apply today. We welcome and value candidates from all backgrounds, experiences, and identities.
Senior Data Engineer
Cognite
Senior Data Engineer Location: Bengaluru Department: Global Strategic Services Data Engineering EMEA Type: Full-Time | Hybrid About Cognite Cognite is a global SaaS leader driving industrial digital transformation. Our platforms Cognite Data Fusion and Cognite Atlas AI enable companies across Energy, Utilities, Manufacturing, and Chemicals to solve complex challenges using AI, contextual data, and automation. Cognite is backed by top-tier investors and recognized with global innovation awards. Our Values Impact: We deliver results that matter. Ownership: We take initiative, act inclusively, and embrace accountability. Relentless: We pursue excellence and innovation with resilience. About the Role As a Senior Data Engineer, you ll lead the development of scalable data solutions that empower critical industries to make informed decisions. You ll work on high-impact projects across regions, collaborating with solution architects, data scientists, and product teams. This is a growth role with room to influence product direction and mentor junior engineers. Key Responsibilities Architect and implement robust data pipelines using Cognite Data Fusion, Python, SQL, and REST APIs. Lead integrations, data modeling, and transformation tasks using cloud-native technologies. Design custom data models for discovery, mapping, and cleansing industrial data. Collaborate closely with cross-functional teams to deliver digital solutions. Conduct code reviews and champion engineering best practices. Contribute to Cognite s SDKs and internal tools. Translate customer use cases into scalable, reusable data engineering frameworks. Mentor team members and support customer onboarding when needed. What You ll Bring Bachelor s or Master s in Computer Science or related field (or equivalent experience). 5+ years in a data-intensive, customer-facing engineering role. Expertise in Python, SQL, REST APIs, and pipeline orchestration. Experience with distributed computing, Kubernetes, and cloud platforms (Azure, GCP). Familiarity with data from industrial domains like oil & gas or manufacturing is a plus. Strong DevOps mindset with hands-on experience in Git, CI/CD, and deployments. Proactive and collaborative; able to work independently and solve complex challenges. A growth mindset with willingness to ask for help and share knowledge openly. Be part of a global team spanning 70+ nationalities with strong DEI focus. Work at our Bengaluru office (Rathi Legacy, Hoodi) in a modern hybrid environment. Enjoy flat hierarchy, fast decision-making, and high ownership culture. Collaborate with world-class professionals on industry-transforming projects. Shape the future of industrial data and drive real-world impact at scale. If you re passionate about solving meaningful problems with cutting-edge data technologies, apply today. We welcome applicants from all backgrounds and experiences you might be the perfect fit, even if you don t meet every single requirement. Qualification : Bachelors or Masters in Computer Science or related field (or equivalent experience).
Database Engineer II
Meesho
Database Engineer II Location: Bangalore, Karnataka | Department: Tech About the Team At Meesho, 5% of Indian households shop with us and to manage millions of orders every day, we ve built resilient systems that operate with zero downtime! Our engineering muscle is a key driver behind Meesho s growth as an e-commerce giant. We value speed over perfection and view failures as opportunities for growth. As a Database Engineer II, you ll be part of a team that thrives on collaboration, constructive feedback, and innovation. If you enjoy solving complex technical problems while working with a fun, dynamic team, Meesho is the place for you! About the Role As a Database Engineer II at Meesho, you'll implement best practices for NoSQL Database Engineering, working with a variety of NoSQL technologies at a large scale. You ll collaborate closely with engineering teams to optimize and streamline systems and processes. Being proficient in emerging technologies and working effectively with cross-functional teams will be key to your success in this role. What You Will Do Manage, maintain, and monitor relational and NoSQL database clusters to meet SLAs. Oversee both in-house and SaaS solutions in the public cloud or 3rd party environments. Diagnose and communicate database issues to relevant stakeholders and implement solutions. Design and implement best practices for provisioning, tuning, upgrading, and decommissioning database clusters. Cost optimization: Implement mechanisms for cost control and continuous improvement. Collaborate with teams to automate approaches for scalability, reliability, and performance. Participate in R&D: Research new database features and innovative solutions. Be part of the on-call rotation to ensure smooth database operations. What You Will Need 5+ years of experience in provisioning and managing relational/NoSQL databases. Proficiency in two or more of the following: MySQL, PostgreSQL, BigTable, Elasticsearch, MongoDB, Redis, ScyllaDB. Strong Python programming skills. Experience with deployment orchestration, automation, and security management using tools like Jenkins, Terraform, and Ansible. Experience with cloud platforms like AWS or GCP. Comfortable working in Linux/Unix environments. Knowledge of TCP/IP stack, load balancers, and networking concepts. Proven ability to drive projects to completion in a timely manner. A degree in Computer Science, Software Engineering, IT, or a related field is a plus. About Us Welcome to Meesho, where every story starts with a spark of inspiration and entrepreneurial spirit. We're not just an e-commerce platform; we're your partner in making dreams come true. Curious about life at Meesho? Our employees rave about our culture and environment and we re proud to be one of the top-rated e-commerce workplaces on Glassdoor! Our Mission Meesho s mission is to democratize internet commerce for everyone. We started with a single goal: to become the e-commerce destination for the next billion Indian consumers and enable 100 million small businesses to succeed online. With over 1.75 million sellers, we provide industry-first benefits like zero commission and the lowest shipping costs. Meesho is empowering small businesses by connecting them with a massive customer base through cutting-edge tech infrastructure and logistics. Culture & Total Rewards At Meesho, we foster a dynamic, high-impact workplace where performance excellence is key. Our people-centric culture is built on our 11 guiding principles (or "Mantras"), which influence everything from recognition and growth discussions to team collaboration. What We Offer: Competitive compensation: Market-leading cash and equity-based rewards tailored to each role and experience. Holistic wellness support: Our MeeCare Program includes benefits covering physical, mental, financial, and social wellness. Medical insurance: Extensive medical coverage for employees and their families, along with wellness services like telehealth and gym discounts. Work-life balance: Generous leave policies, parental support, retirement benefits, and continuous learning support. Employee recognition: Personalized gifts, team engagement, and a culture of appreciation. Additional benefits including salary advance, relocation assistance, and flexible benefits plans. Qualification : A degree in Computer Science, Software Engineering, IT, or a related field is a plus.
Data Engineer, Product Analytics
Meta Careers
Data Engineer, Product Analytics Location: Bangalore, India Full Time Company: Meta Meta is looking for an experienced Data Engineer to join our Product Analytics team. In this role, you will work on some of the most extensive data sets in the world, crafting experiences for billions of people and millions of businesses. Your technical expertise and analytical mindset will help shape data solutions across Meta to drive user experience optimization, growth, and strategy. You'll work alongside software engineers, data scientists, and product managers to tackle the most interesting data challenges at a scale few companies can match. Key Responsibilities: Conceptualize and own the data architecture for multiple large-scale projects, balancing design and operational cost-benefit tradeoffs. Design and contribute to frameworks that improve logging data efficacy, working with data infrastructure teams to resolve issues. Collaborate with engineers, product managers, and data scientists to understand data needs and represent insights meaningfully. Define and manage Service Level Agreements (SLAs) for all data sets in allocated areas of ownership. Implement and maintain security models based on privacy requirements and ensure safeguards are followed to ensure data quality. Design, build, and launch sophisticated data models and visualizations that support multiple use cases across various products. Address complex data integration challenges using optimal ETL patterns, frameworks, and techniques from structured and unstructured data sources. Optimize existing processes, pipelines, dashboards, and systems to enhance the development of data artifacts. Influence product and cross-functional teams to identify data opportunities that will drive impact. Mentor junior team members by providing constructive feedback and receiving feedback to grow as a team. Minimum Qualifications: Bachelor s degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience. 4+ years of experience in roles focused on data engineering, data analysis, or similar positions, working with SQL, ETL, data modeling, and programming languages (e.g., Python, C++, Scala). Experience with SQL, ETL processes, and data modeling, along with at least one programming language (e.g., Python, C++, C#, Scala). Preferred Qualifications: Master's or Ph.D. degree in a STEM field (Science, Technology, Engineering, Mathematics). About Meta: Meta builds technologies that help people connect, find communities, and grow businesses. Since launching Facebook in 2004, we have revolutionized how people connect. Our apps, including Messenger, Instagram, and WhatsApp, empower billions worldwide. Now, Meta is moving beyond 2D screens towards immersive experiences like augmented and virtual reality, building the next evolution in social technology. When you join Meta, you help shape the future of digital connection, taking us beyond screens, distance, and even the rules of physics. Equal Employment Opportunity: Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based on race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. Qualification : Bachelors degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience.
Software Development Engineer II - Golang (Instamart Team)
Swiggy Careers
Software Development Engineer II - Golang (Instamart Team) Location: Bangalore, Karnataka Full Time Experience: 3 - 5 Years Position Overview: As a Software Development Engineer II (SDE II) at Swiggy, you will play a pivotal role in owning the end-to-end design and architecture of complex systems within the Instamart team. You will co-own the technology vision of your team and contribute significantly to the success of the team s mission-critical applications. Partnering closely with product and business teams, you will translate product features and specifications into high-level and low-level designs, ensuring smooth execution and delivery. Key Responsibilities: Ownership of Design & Architecture: Own the end-to-end design and architecture of complex systems. Collaborate with teams to create scalable and maintainable solutions. Collaboration & Innovation: Partner with product and business teams to translate product specifications into technical designs, fostering continuous innovation. Best Practices: Establish and drive best practices within your team for efficient design and development. Technology Leadership: Lead discussions on code reviews, design reviews, and architecture discussions. Influence the adoption of new technologies and tools. Long-Term Technology Vision: Contribute to and implement the long-term technology vision for your team, ensuring sustainable growth and innovation. Tool & Technology Decisions: Decide the technology stack and tools for your team, taking ownership of these choices. Educational Background: B Tech/M Tech in Computer Science or equivalent from a reputed college. Experience: 3 - 6 years of experience in a product development company, specifically in designing and developing complex systems. Technical Expertise: Strong knowledge and application of algorithms and data structures, with a focus on space and time complexities. Programming Skills: Proficiency in Golang (mandatory), along with good understanding of object-oriented programming and design patterns. System Design: Strong design skills involving data modeling and low-level class design. Platform Expertise: Hands-on experience with databases and Linux/Unix platforms. Development Practices: Familiarity with SDLC in an agile environment and experience collaborating with cross-functional teams to drive on-time deliveries. Technical Aptitude: Strong technical aptitude and a solid understanding of computer science fundamentals. At Swiggy, you will be part of a high-performing team that is passionate about creating innovative products. As a Software Development Engineer II, you'll have the opportunity to drive technical leadership and innovation while contributing to building mission-critical applications. We offer a dynamic work environment where you can make an impact and grow in your career. Equal Employment Opportunity: Swiggy is an Equal Employment Opportunity employer. We do not discriminate based on race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as an individual with a disability, or any other legally protected characteristic. Qualification : B Tech/M Tech in Computer Science or equivalent from a reputed college.
Senior Machine Learning Engineer
Chevron Corporation
Senior Machine Learning Engineer Location: Bengaluru, India Company: Chevron Experience Required: 5 10 Years Department: AI/ML Engineering Work Mode: Hybrid / Global Operations Support About the Role Chevron is actively seeking a Senior Machine Learning Engineer to join our cutting-edge AI team. You will be responsible for designing, building, and optimizing advanced machine learning systems that power transformative applications in artificial intelligence. In this role, you will develop self-learning applications and refine AI systems using robust engineering, statistics, and software design practices. Key Responsibilities Study and transform data science prototypes into production-ready systems Design scalable and robust machine learning systems Research and implement modern ML algorithms and tools Develop ML applications based on business and technical requirements Select appropriate datasets, data pipelines, and data representation techniques Run experiments and evaluate results to fine-tune models Perform statistical analysis and ML performance optimization Train and retrain models as new data becomes available Extend and customize existing ML libraries and frameworks Stay up to date with the latest ML research and trends Required Qualifications 5 10 years of proven experience as a Machine Learning Engineer or in a similar role Hands-on experience with Azure Machine Learning and MLOps Strong skills in data structures, data modeling, and software architecture Deep knowledge of math, probability, statistics, and algorithm design Proficient in programming languages: Python, R Familiarity with ML frameworks and libraries such as Keras, PyTorch, scikit-learn Excellent analytical and problem-solving skills Strong communication and teamwork abilities Working Hours Chevron supports international teams. Work hours are scheduled to align with global collaboration: Work Days: Monday to Friday Shift Options: 8:00 AM 5:00 PM or 1:30 PM 10:30 PM IST Opportunity to work on impactful ML/AI solutions at enterprise scale Flexible work culture with global exposure Advanced tools, infrastructure, and data at your fingertips Professional growth in a forward-thinking, innovation-driven environment Equal Opportunity Statement Chevron is an equal opportunity employer and adheres to inclusive hiring practices. All qualified candidates will receive consideration without regard to race, gender, age, religion, nationality, sexual orientation, disability, or any other protected status. Chevron also participates in E-Verify as required by law in applicable jurisdictions. Apply Today
Lead Consultant Data Engineer
Thoughtworks Technologies (india) Pvt Ltd.
Lead Data Engineer | ThoughtWorks | Bangalore, India Location: Bangalore, India Employment Type: Full-time, Regular Industry: Information Technology About ThoughtWorks At ThoughtWorks, we're a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. For over 30 years, we've worked alongside our clients to deliver solutions that challenge the status status quo. With a diverse and inclusive team, we empower each other to grow through shared learning, fostering an environment where innovation thrives. Our commitment to a cultivation culture is key to our success, and we re looking for a Lead Data Engineer to join our Bangalore team and lead transformative projects. Job Overview As a Lead Data Engineer at ThoughtWorks, you will be responsible for designing, developing, and operating modern data architectures that meet client business objectives. You will lead and manage data engineering projects end-to-end, from strategic planning to hands-on coding, ensuring the delivery of scalable and efficient data solutions. Working with cutting-edge technologies, you ll collaborate with stakeholders, clients, and cross-functional teams to implement data-driven strategies that address complex business challenges. Key Responsibilities Project Leadership: Lead and manage data engineering projects from inception to completion, including goal-setting, scope definition, and ensuring on-time delivery in collaboration with cross-functional teams. Data Architecture & Solution Design: Collaborate with clients to design modern data architecture and implement end-to-end solutions that meet key business objectives. Create intricate data processing pipelines to address complex business problems. Stakeholder Collaboration: Work closely with stakeholders to understand business objectives and identify opportunities to leverage data and data quality improvements. Data Modeling & Governance: Develop data models using modern modeling techniques and implement them using appropriate technologies. Ensure compliance with data governance, security, and privacy requirements. Scalable Implementations: Partner with data scientists to design scalable implementations of their models, ensuring the solutions are robust and efficient. Clean, Iterative Code: Write clean, modular code based on TDD (Test-Driven Development) and implement continuous delivery practices to support and operate data pipelines. Technology Guidance: Advise clients on distributed storage and computing technologies, selecting the best options to fit their business needs. Data Quality Strategy: Define and incorporate data quality strategies into daily work processes to ensure high standards and compliance. Job Qualifications Technical Skills: Proven experience in data engineering and system design, with a focus on building Big Data architecture and data pipelines within distributed systems. Deep knowledge of data modeling and hands-on experience with modern data engineering tools and platforms. Strong programming skills, with expertise in building scalable, high-quality data pipelines using languages like Python, Java, Scala, or others. Experience with distributed storage platforms (e.g., Hadoop, Amazon S3, etc.) and distributed processing platforms (e.g., Spark, Flink). Experience working with SQL, NoSQL, data lakes, and other data storage technologies. Familiarity with data visualization techniques and ability to communicate insights effectively across varying audiences. Professional Skills: Stakeholder Management: Strong ability to liaise between clients and other key stakeholders, ensuring trust and buy-in throughout projects. Adaptability & Resilience: Comfortable handling ambiguity and finding innovative solutions to complex challenges. Leadership & Mentorship: Experienced in coaching and mentoring team members, fostering a culture of professional growth and accountability. Risk & Conflict Management: Skilled in managing risks and resolving conflicts, driving projects forward despite challenges. Relationship Building: Natural at cultivating strong relationships with clients, stakeholders, and internal teams to create new opportunities. What You Bring to the Team Leadership: A proven track record in leading high-performance teams and supporting colleagues in their professional development. Curiosity & Innovation: A passion for data and technology and a willingness to continually learn and push the boundaries of what's possible. Collaboration: Ability to work closely with cross-functional teams and stakeholders to design and implement innovative data solutions. At ThoughtWorks, we believe in giving you the autonomy to carve out your unique career path, while providing support through development programs and a vibrant culture of learning. You ll work on exciting projects with a diverse team, solve complex challenges, and make an impact at a global scale. Join ThoughtWorks and be part of a global community of innovators. Together, we turn curiosity into action and creativity into impactful solutions.
Data Engineer-dataiku/python
Infocepts
Data Engineer (Python/Dataiku/Spark/SAS DI) Location: Bangalore Type of Employment: Full-Time Experience Required: 3 to 5 years Job Overview: We are looking for a passionate Data Engineer with expertise in Python, Dataiku, Spark, or SAS DI to join our dynamic team. In this role, you will collaborate with clients to build data pipelines that support their Data and Analytics journey. As a member of our team, you will be responsible for driving data engineering initiatives, developing and implementing ETL solutions, and optimizing data workflows for efficiency and scalability. Key Responsibilities: Data Engineering Initiatives: Collaborate with clients to define and implement data engineering initiatives based on business needs. ETL Development: Design and develop data integration solutions using tools like Python, Dataiku, Spark, and SAS DI. Develop and maintain automated data pipelines for real-time and batch data ingestions. Performance Tuning: Conduct performance tuning and optimize queries and data models to enhance performance and scalability. Database Design: Design and implement database objects such as tables, views, schemas, and stored procedures. Ensure data quality and consistency across the data warehouse. Collaboration: Work closely with cross-functional teams to translate business requirements into technical solutions and communicate effectively with clients across multiple regions. Troubleshooting: Troubleshoot and resolve data-related issues while ensuring the quality and integrity of the data. Project & Technical Leadership: Act as the technical lead or single point of contact (SPOC) for the client and internal teams, ensuring smooth project delivery. Essential Skills: Data Engineering Tools: Experience with Python, Dataiku, Spark, and SAS DI. SQL Proficiency: Strong SQL experience for extracting data from various databases and performing data analysis. ETL Development: Expertise in designing and developing ETL processes to integrate data from diverse sources into a data mart layer. Data Modeling: Understanding of data modeling concepts, including relational and dimensional modeling. BI Knowledge: Basic understanding of Business Intelligence (BI) tools and analytics needs. Communication Skills: Excellent communication skills to understand business requirements and translate them into technical solutions. Desirable Skills: Data Analysis: Strong analytical skills to perform data analysis, especially for banking products data. BI Tools: Experience with MicroStrategy or Power BI for reporting and dashboarding. Qualifications: 3+ years of experience designing and developing scalable data integration solutions. Familiarity with data analytics and reporting needs. Technical certifications that align with your continuous learning aspirations. Qualities: Strong problem-solving skills with a systematic approach to resolving issues. Ability to influence and implement change confidently. Excellent team player who works effectively in cross-functional teams. Strong communication and presentation skills, capable of interacting with clients and presenting ideas persuasively. Fluent in English, both written and spoken, for effective communication. Opportunity to work with cutting-edge data engineering tools and technologies. Be a key player in building and optimizing data pipelines for clients data and analytics needs. Competitive salary, benefits, and a dynamic, innovative work culture.
Talend Data Engineer
Infocepts
Position: Talend Data Engineer Location: Bangalore, India Employment Type: Full-time Experience Required: 4 to 9 years Purpose of the Position: As a Talend Data Engineer, you will be responsible for designing, developing, and managing scalable ETL/ELT data pipelines both on-premise and in the cloud. You will work with technologies such as Talend Suite, Snowflake, and reporting tools to support high-impact data integration and business intelligence initiatives. Key Responsibilities: ETL/ELT Development: Design, develop, and deploy ETL/ELT workflows using Talend Data Integration and Talend Cloud. Data Transformation: Apply stored procedures for accurate and structured data processing. Reporting: Build reports using MicroStrategy and Power BI to support decision-making. Documentation: Maintain detailed documentation for pipelines, configurations, and processes to ensure data integrity and quality. Performance Monitoring: Monitor and optimize data pipelines, resolving data-related issues swiftly. Essential Skills: Hands-on experience with Talend Suite (Talend Data Integration, Talend Cloud). Strong skills in Snowflake and writing Stored Procedures. Expertise in ETL/ELT processes, data warehousing, and data modeling. Familiarity with data quality frameworks and job scheduling tools. Proficient in handling data formats like JSON, XML, CSV, and Parquet. Knowledge of Agile methodologies and tools such as JIRA. Desirable Skills: Experience with BI tools like MicroStrategy and Power BI. Proficiency in scripting languages such as Python, Java, or Shell scripting. Familiarity with cloud platforms (AWS, Google Cloud, Azure) and cloud-based data services. Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or related field. 6+ years of relevant experience with Talend and data engineering projects. Key Qualities: Strong consulting, writing, and presentation skills. Self-organized and collaborative in cross-functional teams. Open to feedback and iterative improvement. Effective communicator with clients across geographies. Analytical mindset with a research-oriented approach. Apply now and become part of a high-performing team delivering scalable data solutions across industries! Qualification : Bachelor's or Master's degree in Computer Science, Engineering, or related field.
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Junior Data Scientist
Louis Dreyfus Company
Data Scientist - Global Sugar and Ethanol Production Company Description: Louis Dreyfus Company is a leading merchant and processor of agricultural goods, active across the entire value chain from farm to fork. We operate a broad range of business lines, leveraging our global reach and extensive asset network to serve customers and consumers worldwide. As a matrix organization spanning six geographical regions and ten platforms, we are present in over 100 countries and employ approximately 18,000 people globally. Job Description: We are seeking an experienced Data Scientist to join our team, focusing on managing and analyzing global Sugar and Ethanol production data. This role involves integrating large datasets, applying statistical estimation methods, and developing interactive dashboards to support data-driven decision-making. You will work closely with cross-functional teams to generate insights that enhance business strategies and identify risks in production trends. Main Responsibilities: Manage and estimate global Sugar and Ethanol production and associated risks. Integrate large datasets from various sources and perform feature engineering to improve data quality and usability. Apply statistical methods and estimation techniques to analyze production trends and assess risks. Develop and maintain interactive dashboards to visualize key metrics and insights. Present findings and recommendations to stakeholders through detailed reports and presentations. Collaborate with cross-functional teams to ensure data-driven decision-making across the organization. Experience: Minimum of 3 years of experience in data science, preferably within the commodities sector. Advanced proficiency in Python programming, with expertise in libraries such as Pandas, NumPy, and Scikit-learn. Strong understanding of data integration and feature engineering techniques. Experience in statistical analysis and modeling. Proficiency in data visualization tools such as Dash. Excellent communication and presentation skills. Ability to work independently and as part of a team. Qualifications: Master s degree in economics, applied statistics, or a related field. A Ph.D. is a plus. Fluency in English, both oral and written. Experience working in a commodities-related field is preferred. Qualification : Masters degree in economics, applied statistics, or a related field. A Ph.D. is a plus.
Senior Cloud Data Engineer
Capgemini Invent
Job Title: Senior Cloud Data Engineer Experience: 10+ Years Location: Bengaluru About Capgemini Invent: Capgemini Invent is the digital innovation, consulting, and transformation brand of the Capgemini Group. It brings together leading expertise in strategy, technology, data science, and creative design to help CxOs reimagine their businesses. We are a global business line dedicated to helping organizations envision and build what s next. Your Role: As a Senior Cloud Data Engineer at Capgemini Invent, you will design, develop, and maintain scalable data pipelines using advanced cloud technologies to ensure smooth data integration and efficient workflows. You will collaborate with cross-functional teams to deliver robust and optimized data solutions while ensuring compliance and security throughout the process. Key Responsibilities: Design, develop, and maintain scalable data pipelines using AWS services. Optimize data storage and retrieval processes to ensure efficiency and accessibility. Ensure data security and compliance with industry standards, including data privacy laws. Manage large volumes of data, focusing on accuracy, integrity, and secure accessibility. Develop and refine data processes for data modeling, mining, and production. Implement quality checks, data validation, and monitoring of data flows. Collaborate with data scientists, analysts, and IT teams to meet data requirements. Work closely with data architects and modelers on project objectives and solutions. Troubleshoot and resolve issues in data pipelines, ensuring performance tuning and optimization. Develop and implement disaster recovery procedures to safeguard data. Ensure seamless integration of HR and other business data into cloud-based environments. Research new opportunities for data acquisition and discover additional uses for existing data. Stay up-to-date with the latest cloud technologies, data management practices, and trends, including Generative AI. Recommend and implement improvements to enhance data reliability, efficiency, and quality. Your Profile: 10+ years of experience in cloud data engineering. Proficiency with cloud platforms such as AWS, Azure, or Google Cloud. Experience with data pipeline tools like Apache Spark, AWS Glue, or similar technologies. Strong programming skills in Python, SQL, Java, or Scala. Familiarity with Snowflake, Informatica, or similar tools is an advantage. In-depth knowledge of data privacy laws, security best practices, and data governance. Expertise in analyzing and interpreting complex datasets to derive actionable insights. Strong communication, collaboration, and problem-solving skills. Knowledge of database technologies, including SQL, Big Data, and Cloud-based systems. Passion for learning and keeping up with emerging technologies, particularly in Generative AI. Experience working in an Agile framework and managing multiple projects simultaneously. Ability to adapt to evolving priorities and business needs. What You Will Love About Working Here: Flexibility: Enjoy flexible work arrangements such as remote work or flexible hours, ensuring a healthy work-life balance. Career Growth: We offer numerous opportunities for career advancement and personal development, helping you explore diverse paths and expand your skills. Certifications & Learning: Gain valuable certifications in cutting-edge technologies, including Generative AI, to stay ahead of the curve. About Capgemini: Capgemini is a global business and technology transformation partner that helps organizations accelerate their dual transition to a digital and sustainable world. With a team of 340,000 professionals in over 50 countries, we are dedicated to making a tangible impact on enterprises and society. Trusted by clients for over 55 years, Capgemini uses its deep industry expertise and cutting-edge technologies such as AI, cloud, and data to unlock the full potential of businesses worldwide. In 2023, the group reported global revenues of 22.5 billion.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted