BIG Data Hadoop Jobs in Bengaluru
210 Jobs Found
Mechatronics & Bigdata Scientist Developer
Bharat Fritz Werner
Position: Mechatronics & Big Data Scientist Developer Department: Research & Development Reporting To: General Manager Location: Bengaluru Key Responsibilities Machine Learning: Select features, build, and optimize classifiers using advanced machine learning techniques. Data Mining: Perform data mining using state-of-the-art methods to extract valuable insights from large datasets. Data Enhancement: Extend the company s datasets with third-party data sources when necessary to improve model accuracy and relevance. Data Collection & Processing: Improve data collection procedures to include all necessary information for building analytic systems. Data Cleansing & Integrity: Process, cleanse, and verify the integrity of data used for analysis to ensure reliable results. Ad-hoc Analysis: Perform ad-hoc analysis as needed, presenting the results in a clear, actionable manner. Anomaly Detection: Design and implement automated anomaly detection systems, tracking their performance over time to ensure accuracy. Behavioral Competencies Data-Driven: Strong inclination toward working with data and applying analytical thinking to solve complex problems. Detail-Oriented: Meticulous in data analysis and system development to ensure quality and precision in results. Skills and Expertise Machine Learning Algorithms Strong understanding of machine learning techniques and algorithms such as k-NN, Naive Bayes, SVM, Decision Forests, etc. Data Science Tools Experience with common data science toolkits like R, Weka, NumPy, and MatLab. Proficiency in at least one (preferably NumPy or R) is highly desirable. Data Visualization Skilled in data visualization tools such as D3.js, GGplot, or similar. Database Management Experience with query languages such as SQL, Hive, Pig, NiFi, or others depending on the company s stack. Familiarity with NoSQL databases like InfluxDB, MongoDB, Cassandra, HBase. Statistical Analysis Strong applied statistics skills, including distributions, statistical testing, and regression analysis. Programming Skills Good scripting and programming skills in languages like PHP, Slim, SQL, and Laravel. Big Data Technologies Knowledge of Hadoop, HDFS, NiFi, and other big data platforms and technologies. Qualifications Essential: MTech, MS, or equivalent in Mechatronics, Computer Science, or a related field. Experience: Minimum 2 years of hands-on experience in developing SDKs and working with Big Data platforms. Proven track record in machine learning, data mining, and data science projects. Qualification : MTech, MS, or equivalent in Mechatronics, Computer Science, or a related field
Sr. Data Science Engineer
Scaledge
Job Title: Sr. Data Science Engineer Location: Bangalore Experience: 5 8+ Years Job Description As a Senior Data Science Engineer, you will develop and maintain scalable data pipelines and manage API integrations to support growing data volume and complexity. You will play a key role in ensuring data quality and enabling accurate AI model development through effective data handling and automation. Responsibilities Monitor data quality and implement processes for data cleansing and validation. Analyze data to troubleshoot and resolve data-related issues promptly. Develop automation workflows for efficient data labeling, preparation, and augmentation to improve AI model accuracy and utility. Requirements Proven experience as a Data Scientist, Data Analyst, or related role, with experience in data mining. Strong proficiency in data manipulation using Python or R; familiarity with Scala, Java, or C++ for raw data processing is a plus. Experience with business intelligence tools (e.g., Tableau) and big data frameworks like Hadoop and Spark. Strong mathematical foundation, especially in statistics and algebra. Advanced SQL skills with experience in database development, data migration, and integration. Expertise in exploratory data analysis and familiarity with common data science toolkits. Ability to communicate complex data insights clearly and effectively to non-technical stakeholders. Familiarity with data management tools and experience applying machine learning and AI techniques.
Manager - Analytics
Subex Limited
Position: Manager - Analytics Location: SEZ4, Bangalore, Karnataka, India Department: Advanced Analytics Employment Type: Subexian Experience Required: 6 to 9 years Job Overview: We are seeking an experienced Manager - Analytics to lead a team of talented data scientists in delivering impactful data-driven solutions. The ideal candidate will have a solid background in analytical methodologies, including machine learning, statistical modeling, and business analytics. You ll be responsible for collaborating with business stakeholders, driving the design and development of advanced analytics models, and ensuring the delivery of high-quality insights that support strategic decision-making. Key Responsibilities: Analytical Methodology: Research, evaluate, and implement new analytical methodologies and approaches to build innovative data-driven solutions. Utilize a blend of mathematics, statistics, machine learning, and business knowledge to solve complex problems. Business Collaboration: Work closely with business leaders and data owners to define key problems and challenges, ensuring the solutions developed have a significant impact on the business. Team Leadership: Lead and mentor a team of junior data scientists, guiding them through the development, deployment, and refinement of machine learning models in a production setting. Advanced Modeling: Utilize a wide range of analytical models, including reliability models, Markov models, stochastic models, Bayesian modeling, classification models, neural networks, and more to address business challenges effectively. Hands-On Expertise: Apply strong hands-on skills in R and Python, using libraries such as NLTK and Sklearn for developing machine learning models and data analysis. Large Data Management: Work with large datasets and distributed computing frameworks like MapReduce, Hadoop, and Hive, ensuring scalable and efficient data processing. Continuous Improvement: Stay up to date with the latest advancements in analytics and machine learning, continually enhancing models and methodologies to deliver cutting-edge insights. Required Technical Skills: Hands-on Experience in Python & R: Strong proficiency in R and Python programming, with experience in libraries such as NLTK, Sklearn, and other machine learning frameworks. Advanced Statistical & Machine Learning Techniques: Proven expertise in at least one of the following: Reliability models Markov Models Stochastic models Bayesian Modelling Classification Models Cluster Analysis Neural Networks NLP (Natural Language Processing) Deep Learning Non-parametric Methods Multivariate Statistics Big Data Tools: Experience working with large datasets and distributed computing platforms such as MapReduce, Hadoop, Hive, etc. Soft Skills: Leadership & Collaboration: Strong leadership skills with the ability to mentor a team of junior data scientists. Excellent collaboration and communication skills to work with business and technical teams. Problem-Solving & Critical Thinking: Ability to approach complex business problems analytically and come up with data-driven solutions. Continuous Learning: A passion for staying up to date with the latest trends and advancements in analytics, machine learning, and data science. At Subex, you ll have the opportunity to work on cutting-edge projects that make a tangible impact on the business. If you're passionate about leading analytics teams and leveraging data science to drive business success, we would love to have you on board.
Data Architect
Growtharc Technologies
Position: Data Architect Location: Remote/Hybrid | Bengaluru, IND We're searching for a highly skilled and experienced Data Architect to join our team. If you have a deep understanding of big data technologies and extensive experience with Hadoop, Python, Snowflake, and Databricks, you're the ideal candidate. You'll be responsible for designing, implementing, and managing complex data architectures that support our critical business needs and objectives. What You'll Do: Design & Architecture Leadership: Design scalable and efficient data architecture solutions that meet current and future business data needs. Lead the development of data models, schemas, and databases, ensuring alignment with business requirements. Architect and implement robust data solutions on leading cloud platforms (AWS, Azure, or GCP). Data Management & Governance: Develop and maintain robust data pipelines and ETL processes using Hadoop, Databricks, and other essential tools. Oversee data integration and quality efforts to ensure consistency and reliability across the organization. Implement data governance best practices, focusing on data security, privacy, and compliance. Collaboration & Mentorship: Work closely with data engineers, data scientists, and business stakeholders to translate data requirements into effective technical solutions. Provide technical leadership and mentorship to junior data engineers and architects. Collaborate with cross-functional teams to ensure data solutions align perfectly with overall business goals. Optimization & Innovation: Optimize existing data architectures for peak performance, scalability, and cost-efficiency. Monitor and troubleshoot data systems to ensure high availability and reliability. Continuously evaluate and recommend new tools and technologies to improve our data architecture. What You'll Bring: Experience: 10+ years in data architecture, data engineering, or a related field. Big Data Expertise: Proven experience with Hadoop ecosystems (HDFS, MapReduce, Hive, HBase). Programming Prowess: Strong programming skills in Python for data processing and automation. Data Platform Mastery: Hands-on experience with Snowflake for data warehousing and Databricks for analytics. Cloud Fluency: Extensive experience with cloud platforms (AWS, Azure, GCP) and their data services. Data Modeling: Familiarity with data modeling tools and methodologies. Core Skills: Deep understanding of big data technologies and distributed computing. Strong problem-solving skills to design solutions for complex data challenges. Excellent communication skills, able to explain complex technical concepts clearly to diverse audiences. Proficient in SQL and database performance tuning. Experience with CI/CD pipelines and automation in data environments. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Advanced Degree: A Master's degree in a related field. Cloud Certifications: Certifications like AWS Certified Data Analytics, Google Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate. Additional Languages: Experience with other programming languages like Java or Scala. Machine Learning Integration: Knowledge of machine learning frameworks and their integration with data pipelines.
Senior Manager Data Science, Data Modelling & Analytics
Merkle B2b
Job Title: Senior Manager Data Science, Data Modelling & Analytics Location: Bengaluru Department: Insights & Analysis About the Role: As a Senior Manager, you will lead a team of data scientists and analysts, driving the development and deployment of advanced analytics solutions that enable data-driven decision-making. This role blends strategic leadership with hands-on technical expertise, playing a critical part in delivering impactful insights and analytics across the organization. Key Responsibilities: Hands-On Technical Contribution: Design, develop, and deploy advanced machine learning models and statistical analyses to address complex business challenges. Utilize Python, R, SQL, and other tools to manipulate data and build predictive models. Manage end-to-end data pipelines including collection, cleaning, transformation, and visualization. Collaborate with IT and data engineering teams to integrate analytics solutions into production environments. Provide thought leadership on analytics solutions and metrics aligned with business needs. Team Leadership & Development: Lead, mentor, and manage a team of data scientists and analysts, fostering collaboration and innovation. Guide career development, conduct performance evaluations, and promote skill enhancement. Encourage continuous learning and adoption of best practices in data science methodologies. Strategic Planning & Execution: Collaborate with senior leadership to define and execute data science strategy aligned with business goals. Identify and prioritize high-impact analytics projects that deliver business value. Ensure timely and quality delivery of analytics solutions balancing scope and resources. Client Engagement & Stakeholder Management: Act as primary point of contact for clients, translating business challenges into data science solutions. Lead client presentations, workshops, and discussions, effectively communicating complex analytical concepts. Build and maintain strong client relationships, managing expectations and deliverables. Deliver regular reports and dashboards to senior management and stakeholders. Bridge communication between technical teams and business units to align analytics initiatives with organizational objectives. Cross-Functional Collaboration: Work closely with Business Intelligence, Market Analytics, and Data Engineering teams to integrate analytics into business processes. Translate complex insights into actionable recommendations for non-technical stakeholders. Facilitate data-driven workshops and presentations across the organization. Collaborate with support functions to provide timely leadership updates on operational metrics. Governance & Compliance: Ensure compliance with data governance policies and data privacy regulations (e.g., GDPR, PDPA). Implement best practices for data quality, security, and ethical analytics use. Stay abreast of industry trends and regulatory changes affecting data analytics. Qualifications: Education: Bachelor s or Master s degree in Data Science, Computer Science, Statistics, Mathematics, or related field. Experience: 12+ years in advanced analytics, data science, data modelling, machine learning, or related fields. 5+ years in leadership roles managing analytics teams and projects. Experience in BFSI, Hi-Tech, Retail, or Healthcare industries preferred. Experience with media data is a plus. Technical Skills: Proficiency in Python, R, SQL. Experience with data visualization tools like Tableau, Power BI. Familiarity with big data platforms (Hadoop, Spark) and cloud services (AWS, GCP, Azure). Strong knowledge of machine learning frameworks and libraries. Soft Skills: Excellent analytical and problem-solving skills. Strong communication and interpersonal abilities. Ability to influence and drive organizational change. Strategic thinker focused on business outcomes. Desirable Expertise: Advanced Analytics Techniques: Descriptive Analytics: Statistical analysis, data visualization. Predictive Analytics: Regression, time series forecasting, classification, market mix modelling. Prescriptive Analytics: Optimization, simulation modelling. Text Analytics: NLP, sentiment analysis. Machine Learning Techniques: Supervised Learning: Linear/logistic regression, decision trees, random forests, gradient boosting, SVMs. Unsupervised Learning: Clustering, PCA, anomaly detection. Reinforcement Learning: Q-learning, deep Q-networks. Generative AI & Large Language Models (Good to Have): Experience with GPT, Gemini, LLAMA, etc. for text generation, summarization, conversational agents. Hyperparameter tuning, prompt engineering, embeddings, fine-tuning. Additional Skills: Proficiency with Tableau or Power BI (advanced visualization). Strong data management, structuring, and harmonization skills.
Cloud Architect
Camsdata Technologies India Pvt. Ltd.
Cloud Architect Bangalore, India Location: Bangalore (Bengaluru) Experience: 8 to 15 Years Industry: IT Software / Cloud Computing Job Summary: We are seeking a seasoned Cloud Architect with deep expertise in designing and implementing secure, scalable cloud solutions across public and private cloud platforms. The ideal candidate will have strong knowledge of enterprise application and integration patterns, cloud-native microservices, and security architecture. Key Responsibilities: Architect and design cloud solutions leveraging AWS, Microsoft Azure, and Google Cloud Platform (GCP) Develop microservices-based applications using Docker and Kubernetes, and deploy them on cloud platforms Define security architectural requirements, including threat modeling, identity and access management, PKI, and secrets management Ensure cloud environments adhere to security protocols, compliance standards, and best practices for authentication and authorization Work with a wide range of cloud services including storage, networking, and security components Apply knowledge of Big Data ecosystems such as Hadoop and NoSQL databases to design scalable data processing architectures Deploy and manage cloud infrastructure using Terraform for infrastructure as code (IaC) Utilize configuration management tools like Puppet, Chef, and continuous integration tools such as Git and Jenkins Collaborate within Agile teams to deliver cloud architecture solutions efficiently Stay updated on emerging open-source technologies and integrate them into cloud architectures when applicable Required Skills & Qualifications: Extensive experience with both public and private cloud technologies Strong understanding of Enterprise Application Patterns and Integration Patterns Hands-on experience with containerization, microservices, and orchestration tools (Docker, Kubernetes) In-depth knowledge of cloud security, including threat modeling and compliance requirements Proficiency in managing cloud infrastructure on AWS, Azure, and/or GCP Familiarity with Big Data platforms and NoSQL databases Skilled in Infrastructure as Code (IaC) tools, especially Terraform Experience with automation and configuration management tools like Puppet, Chef, Git, and Jenkins Comfortable working in Agile development environments Preferred Qualifications: Bachelor s or Master s degree in Computer Science, Information Technology, or related field Relevant cloud certifications such as AWS Certified Solutions Architect, Azure Solutions Architect Expert, or Google Cloud Professional Architect Strong communication skills to articulate complex cloud architectures to diverse stakeholders Lead the design of innovative, secure, and scalable cloud architectures Work with cutting-edge cloud and container technologies in a dynamic environment Opportunity to grow professionally with access to training and certifications Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or related field
Senior Analyst - Data Engineering
Latentview Analytics
Role: Senior Analyst Data Engineering Location: Bengaluru, Karnataka, India Experience: 3 6 Years Employment Type: Permanent, Full-Time About the Role We are looking for a results-driven Senior Data Engineer to join our high-performing data team in Bengaluru. The ideal candidate will have 3 6 years of experience in data engineering, AI/ML implementation, and working with large-scale databases like Snowflake and Teradata. If you're passionate about driving data-powered insights, building scalable solutions, and applying advanced machine learning and AI techniques, we want to hear from you. Key Responsibilities Design, develop, and implement machine learning models to solve complex business challenges. Apply AI techniques, including generative AI, NLP, and computer vision, to improve analytics capabilities. Use Tableau, Power BI, and other tools to develop insightful, interactive data dashboards. Manage and optimize large datasets using platforms like Snowflake, Teradata, and SQL/NoSQL databases. Collaborate with business and technical teams to translate requirements into robust data engineering solutions. Guide junior data professionals and foster a culture of learning and innovation. Communicate analytical findings clearly to non-technical stakeholders. Stay current with the latest in data science, machine learning, cloud platforms, and big data technologies. Key Skills & Technologies Machine Learning & AI Techniques: Supervised & unsupervised learning, deep learning, neural networks Reinforcement learning, decision trees, random forests, clustering NLP, computer vision, GANs, transfer learning Data Visualization Tools: Tableau, Power BI, Matplotlib, Seaborn, Plotly Programming Languages & Libraries: Python (essential), R, SQL TensorFlow, PyTorch, scikit-learn, pandas, NumPy, Keras, SciPy Databases & Data Management: Snowflake, Teradata, SQL/NoSQL, ETL, data lakes, data warehousing Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP) Big Data Technologies: Apache Spark, Hadoop
Staff Machine Learning Engineer
Eightfold
Job Title: Staff Machine Learning Engineer Location: Bengaluru, Karnataka, India Job Type: Full-Time (Hybrid Work Model) Experience Level: 6-10+ Years About Eightfold.ai: At Eightfold.ai, we re revolutionizing the way organizations find, manage, and empower talent. As a leader in AI-driven HR tech, our groundbreaking platform is transforming industries by using artificial intelligence to solve talent management challenges at scale. We are looking for exceptional engineers to join our team and be at the forefront of innovation in the field of AI. About the AI/ML Team: The AI/ML team at Eightfold is passionate about building cutting-edge solutions and pushing the boundaries of applied machine learning. We work with massive datasets and tackle complex, real-world challenges to develop state-of-the-art AI models. Our models are transforming how companies approach talent management, and we are looking for a Staff Machine Learning Engineer to help lead this journey. What You Will Do: As a Staff Machine Learning Engineer, you will play a critical role in leading and inspiring our ML team while architecting and implementing scalable, robust ML pipelines for our core products. Lead and Inspire: Mentor and guide a team of talented ML engineers, fostering a collaborative environment that encourages innovation. Architect and Implement: Design and build scalable ML pipelines that power Eightfold s core products. Innovate and Optimize: Develop novel algorithms and continuously enhance the performance, accuracy, and scalability of our models. Solve Complex Problems: Work on challenging real-world problems, including NLP, recommendation systems, and predictive analytics. Stay Ahead of the Curve: Research and implement cutting-edge techniques in deep learning, reinforcement learning, and other emerging fields. LLM & NLP Expertise: Design and implement scalable solutions using Large Language Models (LLMs), fine-tuning them for specific NLP tasks, and developing LLM-powered applications. What You Bring: Required Skills & Experience: Deep Expertise in ML & AI: Strong foundation in Machine Learning, Deep Learning, and Natural Language Processing (NLP) with a proven track record of developing and deploying ML models at scale. Technical Leadership: Experience leading and mentoring teams, with excellent communication and collaboration skills. Problem-Solving Mindset: Ability to analyze complex problems and develop innovative solutions. Passion for AI: Genuine enthusiasm for pushing the boundaries of AI and its real-world applications. Advanced Skills in Python & ML Frameworks: Proficiency in Python and relevant ML frameworks (TensorFlow, PyTorch), along with experience in big data technologies like Hadoop and Spark. CS Fundamentals & Coding: Strong foundation in computer science fundamentals and coding languages (Python, C/C++, Java, Scala, R). GenAI & LLM Expertise: Experience in developing and deploying LLM-powered applications, with knowledge of LLM fine-tuning techniques, optimization strategies, and ethical considerations. Nice to Haves: 6-10+ years of experience in Machine Learning and AI. MS or PhD in Computer Science or related field. Publications in top-tier AI conferences. Contributions to open-source ML projects. Familiarity with Generative AI (GenAI), Transformers, and LLMs. Impactful Work: Play a pivotal role in shaping the future of AI and its applications in talent management. Innovative Environment: Work on cutting-edge projects with world-class experts in the field of AI/ML. Career Growth: Accelerate your career in a dynamic, fast-paced environment with abundant opportunities for professional growth. Hybrid Work Model: Embrace a flexible work environment with the ability to collaborate remotely and in-person at our Bengaluru or Noida offices twice a week starting February 1, 2024. Competitive Benefits: Comprehensive family medical, vision, and dental coverage, a competitive base salary, equity awards, and discretionary bonuses or commissions. How to Apply: If you're a passionate AI/ML engineer ready to take on challenging problems and make a meaningful impact, we d love to hear from you. Join Eightfold.ai and help shape the future of AI-powered talent intelligence! Qualification : MS or PhD in Computer Science or a related field
Data Scientist Ii
Meesho
Data Scientist II Join the Meesho Tech Team Location: Bangalore, Karnataka | Department: Technology Empower the Future of E-Commerce with Meesho We are looking for an experienced Data Scientist II to join our Avengers-like Data Science team at Meesho. As part of our mission to revolutionize e-commerce in India, we solve complex problems related to fraud detection, inventory optimization, and localized platform experiences that impact millions of users daily. As a mid-level Data Scientist, you ll partner with stakeholders across teams to create data-driven strategies, improve platform performance, and lead initiatives that enable better business outcomes for resellers and end users across Bharat. What You ll Do Design and build predictive models and machine learning solutions using large-scale data Conduct experiments and extract insights from high-volume structured and unstructured data Enhance product usability and surface new growth opportunities through advanced analytics Analyze reseller behavior to deliver personalized product recommendations Design effective discount programs to increase reseller sales performance Identify customer preferences to help resellers better serve their buyers and drive revenue Uncover supply chain inefficiencies and support SLA adherence through data insights Forecast seasonal and regional demand to optimize key business metrics Mentor junior data scientists and contribute to team knowledge-sharing What You ll Need Bachelor s or Master s degree in Computer Science, Data Science, or a related technical field 2 4 years of experience in a Data Scientist role, ideally within a fast-moving B2C tech environment Strong knowledge of Machine Learning algorithms, Neural Networks, and data modeling techniques Hands-on experience with SQL, Python, and R for data manipulation and analysis Strong understanding of statistics, linear algebra, and A/B testing methodologies Demonstrated ability to turn business problems into data science solutions Experience working with product and engineering teams to deliver scalable systems Preferred Qualifications Prior experience solving personalization or recommendation engine problems Familiarity with Big Data technologies like Apache Spark, Hadoop, or Amazon Redshift About Meesho Meesho is India's top-rated e-commerce workplace, revolutionizing online commerce for the next billion users. We empower over 1.75 million sellers through an inclusive, technology-driven platform that offers zero-commission selling, the lowest logistics costs, and access to a massive customer base across every serviceable pincode in India. Our Mission Democratizing Internet Commerce for Everyone Meesho (Meri Shop) aims to help 100 million small businesses succeed online. With relatable merchandise and localized user experiences, we re building a truly inclusive digital shopping ecosystem for underserved markets in India. Our Culture and Benefits Meesho fosters a high-performance and people-first culture. Our workplace philosophy is shaped by 11 guiding principles ("Mantras") and practices like Reflections, Listen or Die, and a robust Internal Mobility Program. Our Total Rewards Include: Competitive compensation packages including performance-based equity Comprehensive wellness through our MeeCare Program covering medical, mental, and financial well-being Flexible leave policies and parental support benefits to ensure work-life balance Relocation support, salary advances, and learning & development assistance Fun, collaborative culture with team engagement events, gifts, and recognition programs We are not just building a company; we re creating a movement. If you re driven by data and inspired to make a difference, come be a part of Meesho s journey to redefine e-commerce in India. Apply today and let's build the future of commerce, together. Qualification : Bachelors or Masters degree in Computer Science, Data Science, or a related technical field
Data Scientist III
Meesho
Data Scientist III Advanced Analytics Role at Meesho Location: Bangalore, Karnataka | Department: Tech About the Data Science Team at Meesho Our Data Science team is the engine driving intelligent decision-making at Meesho. Known internally as the Avengers to our S.H.I.E.L.D, we tackle mission-critical challenges using cutting-edge data science to empower millions of users and small businesses across Bharat. From fraud detection and inventory optimization to platform vernacularization, we re shaping the future of e-commerce in India through data innovation. As a Data Scientist III, you'll be solving complex problems in a rapidly evolving market. You ll lead initiatives that translate data into strategic insights and scalable models, impacting business across various functions. About the Role If you thrive on solving high-impact data problems and love deriving actionable solutions from large datasets, you may be the next Data Scientist III at Meesho. Your primary responsibility will be to increase the utility of business data through experimentation, modeling, and strategic insights. This role involves significant collaboration with cross-functional teams, mentorship, and ownership of critical analytics workflows. What You ll Do Build and deploy machine learning models to extract insights from complex data Run experiments to test hypotheses and evaluate product performance Drive product usability improvements and uncover new growth opportunities Analyze reseller preferences and personalize product offerings Create effective discount strategies to support reseller success Enhance understanding of end-user behavior for improved targeting Uncover supply chain inefficiencies and improve SLA performance Predict seasonal and regional demand to guide planning decisions Mentor junior data scientists and contribute to team development What You ll Need Bachelor s or Master s degree in Computer Science, Data Science, or a related technical field 4 7 years of experience as a Data Scientist, ideally in a fast-paced B2C company Proficiency with Neural Networks, supervised/unsupervised learning, and ML frameworks Expertise in Python, SQL, and R for data analysis and model development Strong knowledge of statistics, linear algebra, and model validation techniques Experience in designing, running, and analyzing A/B tests Exceptional problem-solving and communication skills Experience working closely with product and engineering teams Bonus Points For: Work on personalization systems or recommendation algorithms Familiarity with Big Data technologies like Apache Spark, Hadoop, or Redshift About Meesho Meesho is India s leading social commerce platform, empowering over 1.75 million sellers to grow their businesses online. We offer a unique business model with zero commission fees and the lowest shipping costs, supported by a powerful tech ecosystem and pan-India logistics network. Our platform is built for first-time internet users and small business owners alike, democratizing e-commerce across every corner of the country. Our Mission Democratizing Internet Commerce for Everyone Meesho s goal is to enable 100 million small businesses to succeed online. With relatable, affordable merchandise and innovative seller support tools, we help entrepreneurs reach new customers and scale efficiently. Our Culture and Total Rewards At Meesho, we cultivate a high-performance, people-first culture supported by our 11 guiding Mantras. We prioritize continuous learning, collaboration, and transparency, and back it up with industry-leading employee experiences. Our Total Rewards Include: Market-leading compensation with both cash and equity components Access to MeeCare Program for physical, mental, financial, and social wellness Comprehensive medical coverage for employees and families Parental benefits, generous leave policies, and retirement plans Support for learning and career development through structured programs Employee engagement, flexible benefits, relocation assistance, and much more We re more than just a company we re a movement redefining online commerce in India. If you re a passionate data expert ready to lead high-impact initiatives, apply now and become a part of Meesho s incredible journey. Qualification : Bachelors or Masters degree in Computer Science, Data Science, or a related technical field
Datascientist With Genai-2
Wipro Limited
Data Scientist with GenAI-2 Location: Bengaluru, India Company: Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) Company Overview Wipro Limited is a leading technology services and consulting company focused on building innovative solutions that address clients most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. Job Description Key Responsibilities: Research, design, develop, and modify computer vision and machine learning algorithms and models, leveraging technologies such as Caffe, Torch, or TensorFlow. Shape product strategy for highly contextualized applied ML/AI solutions by engaging with customers, solution teams, discovery workshops, and prototyping initiatives. Help build a high-impact ML/AI team by supporting recruitment, training, and development of team members. Serve as an evangelist by engaging in the broader ML/AI community through research, speaking/teaching, formal collaborations, and/or other channels. Design integrations of and tune machine learning and computer vision algorithms. Research and prototype techniques and algorithms for object detection and recognition. Use Convolutional Neural Networks (CNN) for performing image classification and object detection. Familiarity with Embedded Vision Processing systems. Work with open-source tools & platforms for statistical modeling, data extraction, and analysis. Construct, train, evaluate, and tune neural networks. Mandatory Skills: Proficiency in Java, C++, Python. Experience with Deep Learning frameworks such as Caffe, Torch, TensorFlow. Experience with image/video vision libraries like OpenCV, Clarifai, Google Cloud Vision. Expertise in Supervised & Unsupervised Learning. Development of feature learning, text mining, and prediction models (e.g., deep learning, collaborative filtering, SVM, random forest) on big data computation platforms (Hadoop, Spark, HIVE, Tableau). Familiarity with technologies such as Tableau, Hadoop, Spark, HBase, Kafka. Experience: 2-5 years of work or educational experience in Machine Learning or Artificial Intelligence. Experience in creating and applying Machine Learning algorithms to a variety of real-world problems with large datasets. Building scalable machine learning systems and data-driven products working with cross-functional teams. Experience with cloud services like AWS, Microsoft, IBM, and Google Cloud. Experience with Natural Language Processing, text understanding, classification, pattern recognition, recommendation systems, targeting systems, ranking systems, or similar fields. Nice to Have: Contribution to research communities and/or efforts, including publishing papers at conferences such as NIPS, ICML, ACL, CVPR, etc. Education: BA/BS (advanced degree preferable) in Computer Science, Engineering, or related technical field or equivalent practical experience. About Wipro Wipro is building a modern digital transformation business with bold ambitions. Join a team that values reinvention of yourself, your career, and your skills. Wipro is a place that empowers you to design your own career reinvention, evolve, and grow. Applications from people with disabilities are explicitly welcome. Qualification : BA/BS (advanced degree preferable) in Computer Science, Engineering, or related technical field or equivalent practical experience.
Machine Learning Engineer
Test Company
Machine Learning Engineer Full-Time - Bengaluru, India - Data Science / Artificial Intelligence / Engineering Join our dynamic Data Science / Artificial Intelligence / Engineering team in Bengaluru, India as a Full-Time Machine Learning Engineer and play a key role in driving data-driven innovation! We are seeking a skilled and results-oriented Machine Learning Engineer to design, build, and deploy scalable machine learning models that address real-world business challenges. You will collaborate closely with data scientists, engineers, and product managers to transform raw data into actionable insights and integrate intelligent features into our products. As a Machine Learning Engineer, you will be responsible for the complete lifecycle of machine learning models and pipelines, from design and development to seamless deployment for a variety of applications. This includes classification, regression, clustering, recommendation systems, and time-series forecasting. You will leverage your expertise to preprocess and analyze large and complex datasets, extracting meaningful features and valuable insights. Collaboration with cross-functional teams will be crucial as you identify strategic ML opportunities and define clear success metrics. A key aspect of this role involves optimizing machine learning models for peak performance, scalability, and accuracy within production environments. You will build robust APIs or efficient microservices to integrate these models seamlessly into our applications, utilizing tools such as Flask or FastAPI. Continuous improvement is paramount, and you will be responsible for the ongoing monitoring and retraining of models based on their performance and any signs of data drift. Staying at the forefront of the field is essential, and you will be expected to stay updated with the latest ML research and emerging technologies, applying them to continuously enhance our product capabilities. Key Responsibilities: Design, develop, and deploy machine learning models and pipelines for diverse applications including classification, regression, clustering, recommendation, and time-series forecasting. Preprocess and analyze large datasets to extract meaningful features and actionable insights. Collaborate effectively with cross-functional teams to identify strategic ML opportunities and define clear success metrics. Optimize models for maximum performance, scalability, and accuracy in production environments. Build robust APIs or efficient microservices to integrate ML models into applications using tools like Flask or FastAPI. Continuously monitor and retrain models based on performance metrics and potential data drift. Stay updated with the latest ML research and technologies and apply them to enhance product capabilities. Minimum Qualifications: Bachelor s or Master s degree in Computer Science, Data Science, Statistics, or a related field. 2+ years of proven experience as a Machine Learning Engineer or in a similar role. Strong proficiency in Python and key ML libraries such as Scikit-learn, XGBoost, TensorFlow, or PyTorch. Practical experience working with both SQL and NoSQL databases. Solid knowledge of essential data preprocessing, effective feature engineering, and robust model evaluation techniques. Familiarity with standard software engineering practices, including version control (Git), thorough code reviews, and efficient CI/CD pipelines. Preferred Qualifications: Prior experience with deep learning, natural language processing (NLP), or computer vision. Familiarity with major cloud services like AWS, GCP, or Azure (especially SageMaker, Vertex AI, etc.). Understanding of modern MLOps tools and practices (e.g., MLflow, Kubeflow, DVC). Practical experience with containerization and orchestration tools (Docker, Kubernetes). Knowledge of big data tools (e.g., Spark, Hadoop) is considered a significant plus. What We Offer: Competitive salary and performance-based incentives to reward your contributions. Comprehensive health insurance and valuable wellness benefits to support your well-being. Dedicated learning and development programs for continuous professional growth. Exciting opportunities to work on impactful, real-world AI/ML projects with significant scale. A collaborative, inclusive, and innovative work culture that fosters teamwork and creativity. Flexible working hours and a hybrid work model to promote a healthy work-life balance.
Sr. Data Engineer- Aws- Big Data
Infocepts
Sr. Data Engineer - AWS - Big Data Location:Bangalore Type of Employment: Full-Time Experience Required: 7 to 10 years Job Overview: We are seeking a highly skilled Sr. Data Engineer with expertise in AWS cloud technologies and Big Data to join our Cloud Data Architect Team at Infocepts. In this critical role, you will design and implement robust data solutions using technologies like EMR, Athena, PySpark, AWS Lambda, S3, and other AWS services. The ideal candidate will have a strong foundation in database concepts and SQL and will be responsible for building scalable data pipelines to support high-performance data processing. Key Responsibilities: Technology Assessment and Design: Study the existing technology landscape and evaluate current data integration frameworks. Assist in designing complex Big Data use cases leveraging AWS services. Documentation and Stakeholder Communication: Prepare and maintain comprehensive project documentation, adhering to quality guidelines and schedules. Work closely with Architects and Project Managers to provide accurate estimations, scoping, and scheduling assistance. Clearly communicate design decisions and conduct Proof-of-Concepts to validate new solutions before implementation. Process Improvement and Automation: Identify areas for process automation to improve efficiency and team productivity. Provide expert guidance and troubleshooting support to junior Data Engineers. Training and Knowledge Sharing: Develop and deliver technology-focused training sessions for the team, ensuring continuous knowledge sharing. Share expertise through Expert Knowledge Sharing sessions with Client Stakeholders. Essential Skills: AWS Services Expertise: In-depth knowledge of S3, EC2, EMR, Athena, AWS Glue, and Lambda. Big Data Technologies: Proficiency with Apache Spark, Databricks, and Big Data table formats such as Delta Lake (open-source). Data Warehousing: Strong understanding of data warehousing concepts and architectures. Programming Skills: Advanced programming skills in Python for building data pipelines. SQL Expertise: Strong SQL skills for data transformation, aggregation, and querying large datasets. ETL Workflow Development: Expertise in creating ETL workflows with complex transformations (e.g., SCD, deduplication, aggregation). Orchestration Tools: Familiarity with orchestration tools like Apache Airflow. MPP Databases: Experience with at least one MPP database (e.g., AWS Redshift, Snowflake, SingleStore). Cloud Databases: Exposure to cloud databases like Snowflake or AWS Aurora. Desirable Skills: Cloud Databases: Familiarity with Snowflake, AWS Aurora. Big Data Technologies: Experience with Hadoop and Hive. AWS Certification: Associate or Professional Level AWS Certification. Advanced Knowledge of Big Data Solutions: Exposure to big data tools and frameworks on cloud platforms. Qualifications: Experience: 7+ years of overall IT experience, with 5+ years specifically focused on AWS-related projects. Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree is a plus). Technical Certifications: Demonstrated commitment to continuous learning through certifications or relevant training. Qualities: Strong analytical and problem-solving skills to deep dive into complex technical challenges.
Senior Python Expert
Hashedin Technologies Pvt. Ltd.
Job Title: Senior Python Expert Experience: 3 to 8 years Overview of the Role: This role sets the benchmark for team software development processes and deployment procedures, while actively contributing to establishing best practices and methodologies within the team. Responsibilities: Develop backend services using Python Flask or similar web frameworks. Design and maintain data and pipeline management frameworks using open-source technologies such as Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud-based data engineering services like S3, Redshift, Athena, Kinesis. Design and develop efficient CRUD operations for large datasets with millions of records. Collaborate with teams to build and maintain innovative, reliable, secure, and cost-effective distributed solutions. Own and deliver complex application components within defined timelines. Ensure quality delivery using best practices in API development, performance, and scalability. Participate in customer communication, presentations, and resolution of critical issues. Contribute to architecture, feature set, and design decisions. Proactively recognize and address requirement inconsistencies and project risks. Break down work effectively and estimate accurately. Serve as a technical mentor and role model within the team. Required Skills: Strong knowledge of Python and a web framework like Flask. Experience with AWS services such as EC2, S3, Lambda, Step Functions, Glue, SNS, SQS, Secret Manager, and CodeBuild/CodePipeline. Solid understanding of SQL, including query writing, optimization, and database interaction tools. Experience with API development (RESTful services, Postman, API Gateway). Strong coding, debugging, and problem-solving skills. Understanding of architectural trade-offs and data engineering principles (data acquisition, ingestion, distributed processing, high availability). Ability to independently handle delivery of complex projects. Excellent team management and individual contributor skills. Good to Have Skills: Experience with Big Data frameworks like Hadoop and Spark. Knowledge of AWS Aurora. Familiarity with pip, setuptools, etc. Education: B.E./B.Tech, MCA, M.E./M.Tech.
Senior Data Scientist
Gameskraft
Senior Data Scientist Experience: 1-4 Years | Location: Bengaluru About Gameskraft: Founded in 2017, Gameskraft has rapidly become one of India s fastest-growing online gaming companies. Our mission is to build a safe, secure, and responsible gaming ecosystem while delivering unmatched experiences through cutting-edge technology and design. We are the only gaming company in the industry with ISO 27001 and ISO 9001 certifications. About the Role: As a Senior Data Scientist, you will play a key role in driving data-driven decision-making by developing and implementing advanced analytics and machine learning solutions. You will work on high-impact projects across different business units, collaborating with stakeholders to optimize business performance and user experience. Key Responsibilities: Data Strategy & Governance: Develop and execute a data strategy aligned with business goals. Identify and prioritize high-value data science opportunities. Ensure data accuracy, integrity, and governance by working with data engineering teams. Advanced Analytics & Machine Learning: Design, develop, and deploy machine learning models for regression, classification, clustering, and time-series forecasting. Stay updated with state-of-the-art algorithms and implement innovative solutions. Optimize data pipelines and model performance for scalable deployment. Collaboration & Innovation: Work closely with business leaders, product teams, and IT to integrate data science solutions into business processes. Foster a culture of innovation by exploring emerging technologies and methodologies. Translate complex technical concepts into actionable business insights for non-technical stakeholders. Performance Monitoring & Reporting: Define and track KPIs to measure the impact of data science initiatives. Continuously optimize models for improved accuracy and efficiency. Present insights and recommendations to senior management. What You Bring to the Table: Education: Master s or Ph.D. in Computer Science, Statistics, Machine Learning, or a related field. Experience: 2-4 years of hands-on experience in building and deploying data science solutions. Proven expertise in machine learning, statistical modeling, and analytics. Experience working with large-scale datasets and high-performance computing frameworks. Technical Skills: Proficiency in Python and libraries like scikit-learn, TensorFlow, Keras, PyTorch, Pandas, NumPy, Matplotlib. Experience with Big Data technologies (Hadoop, Spark, distributed computing frameworks). Familiarity with Cloud Platforms (AWS, Azure, GCP) and services like S3, Redshift, Databricks. Deep learning expertise is a plus. Soft Skills & Leadership: Strong communication and stakeholder management skills. Ability to simplify complex data science concepts for non-technical audiences. A proactive problem-solver and team player. Why Join Us? Work on cutting-edge AI & ML projects in one of India s fastest-growing tech companies. Collaborate with top industry leaders and work in a fast-paced, dynamic environment. Competitive compensation and growth opportunities. A diverse, inclusive, and innovation-driven work culture. If you re passionate about AI, Data Science, and driving real-world impact, we d love to hear from you! Qualification : Masters or Ph.D. in Computer Science, Statistics, Machine Learning, or a related field.
Data Engineer
Indium Software
Data Engineer Role Overview We are looking for a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will work closely with data scientists, analysts, and engineers to ensure efficient data processing and storage solutions that support business intelligence and analytics needs. This role requires expertise in SQL, big data technologies, and cloud platforms to build and optimize data workflows. Key Responsibilities Data Pipeline Development & Optimization Design and build scalable ETL/ELT processes for structured and unstructured data. Develop and maintain data ingestion frameworks to handle large datasets efficiently. Ensure data integrity, consistency, and security across multiple sources. Database & Data Warehouse Management Develop, optimize, and maintain relational and NoSQL databases. Implement data modeling best practices for performance and scalability. Work with cloud-based data warehouses (e.g., Snowflake, Redshift, BigQuery). Big Data & Cloud Technologies Leverage big data tools (e.g., Spark, Hadoop, Databricks) for data processing. Work with cloud platforms (e.g., AWS, Azure, GCP) to build and optimize data solutions. Develop real-time and batch processing workflows. Collaboration & Documentation Work closely with data scientists, engineers, and business teams to understand data requirements. Document data pipelines, architecture, and workflows for scalability and maintenance. Required Qualifications & Skills Technical Expertise: Strong experience with SQL and Python for data processing. Proficiency in ETL/ELT frameworks and data integration techniques. Hands-on experience with big data tools (e.g., Apache Spark, Hadoop, Kafka). Cloud & Database Management: Expertise in cloud data platforms (Azure, AWS, GCP). Experience with data warehousing solutions (Snowflake, Redshift, BigQuery). Understanding of data governance, security, and compliance. Performance Optimization & Troubleshooting: Ability to optimize SQL queries and improve data processing efficiency. Experience troubleshooting complex data pipeline issues. Apply Now & Be Part of an Innovative Data Team!
Data Scientist
Indium Software
Data Scientist Role Overview We are looking for a Data Scientist with a strong foundation in Python, hands-on experience with machine learning techniques, and excellent communication skills. The ideal candidate will work on data-driven solutions, develop predictive models, and collaborate with cross-functional teams to translate business challenges into actionable insights. Key Responsibilities Data Analysis & Modeling Conduct in-depth data analysis to identify trends and patterns. Develop and implement predictive models using ML algorithms (regression, classification, clustering, decision trees, neural networks). Utilize statistical techniques to derive insights and drive business decisions. Data Pipeline & Deployment Build and deploy ETL pipelines to extract, transform, and load data from multiple sources. Optimize machine learning models for efficiency and scalability. Collaboration & Communication Work closely with business stakeholders, engineers, and analysts to understand challenges and propose data-driven solutions. Effectively communicate complex technical concepts to both technical and non-technical audiences. Present findings using data visualization tools. Continuous Learning & Innovation Stay updated on the latest advancements in ML, AI, and data science. Contribute to the development and improvement of the data science infrastructure. Required Skills & Qualifications Technical Expertise: Strong proficiency in Python (pandas, NumPy, scikit-learn, TensorFlow/PyTorch). Experience with ML techniques (regression, classification, clustering). Solid understanding of statistical concepts and data analysis methodologies. Experience with data visualization and presentation tools. Soft Skills & Communication: Strong problem-solving and critical-thinking abilities. Excellent communication and interpersonal skills. Ability to work independently and in teams. Educational Background: Bachelor's degree in Computer Science, Statistics, Mathematics, or a related field. Preferred Skills (Nice to Have) Experience with cloud computing platforms (AWS, Azure, GCP). Exposure to big data technologies (Hadoop, Spark). Proficiency in data visualization tools (Tableau, Power BI). Master s degree in a relevant field. Apply Now & Be Part of an Innovative Data Science Team! Qualification : Bachelor's degree in Computer Science, Statistics, Mathematics, or a related field.
Incident Manager
Databricks
CSQ124R98 At Databricks, an Incident Manager utilizes their technical experience and resourcefulness to lead urgent customer situations to resolution. Responsible for managing frequent, high-quality updates to all internal and external stakeholders, Incident Managers advocate with engineering and leadership, on behalf of their customers, to ensure that escalations are handled with the appropriate level of urgency from stakeholders. The impact you will have: Drive critical customer escalations or widespread outages to conclusion and resolution. Escalate to on-call resources in support and engineering and establish checkpoint calls and action items to ensure that progress is made and status updates are delivered on time. Demonstrate cross-functional leadership while establishing ownership of escalations and outages. Compile and deliver frequent high-quality communications to internal and external stakeholders, including executive staff. Candidate should be comfortable creating concise and effective messaging that is tailored to a technical or executive audience with minimal assistance from others. Commence and lead war rooms while establishing other temporary communication channels as warranted for the duration of an outage. Ability to multi-task on several incidents and/or projects at once. Be a leader who identifies product and process improvements from every incident and submits necessary feedback for improvements. Participate in on-call rotations. What we look for: Minimum 8+ years of experience in customer support, support escalation and incident management is required. Excellent contextual interpretation and writing skill with an effective ability to summarize and communicate to technical and business audiences is required. Demonstrates strong ability to make timely decisions for both business and technical perspectives. Excellent analytical and troubleshooting skills are required. Candidate should be able to demonstrate technical excellence by applying engineering principles to solve complex problems. Hands-on experience developing any two or more of the following: Big Data, Hadoop, Spark, Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Hands-on experience in the performance tuning/troubleshooting of Spark-based applications at production scale. Proven and real-time experience in JVM and Memory Management techniques such as Garbage collection and Heap/Thread Dump Analysis is required. Working knowledge in Data Lakes and preferably on the SCD types use cases at production scale. Working and hands-on experience with any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server and MySQL Linux/Unix administration skills and hands-on experience with AWS or Azure or GCP is required. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Manager - Technical Solutions (spark)
Databricks
As a Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical solution engineers and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products. The impact you will have: As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year Be a hands on manager to assist the team members in resolving issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools/automation initiatives Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc What we look for: Min 10-12 years of experience in designing, building, testing, and maintaining Python/Java/Scala/Spark based applications in a typical project delivery and consulting environments with 4+ years working as a Manager 5+ years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark,Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Spark experience is mandatory Hands on experience in the performance tuning/troubleshooting of Hive and Spark based applications at production scale. Real time experience in JVM and Memory Management techniques such as Garbage collections, Heap/Thread Dump Analysis is preferred Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred Hands-on experience with AWS or Azure or GCP is preferred Experience in implementing CI/CD, Monitoring/alerting for Production Systems Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable Experience in leading and managing end-to-end projects and have reported and escalated to top levels Experience in managing and leading teams in an organisation involving multiple reporting lines Strong written and verbal communication skills; very good analytical, organisational, multi-tasking skills About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Senior Manager - Technical Solutions (spark)
Databricks
As a Senior Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical Solution Engineers (Spark) and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products. The impact you will have: As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year Be a hands on manager to assist the team members in resolving issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools/automation initiatives Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc What we look for: Min 10-12 years of experience in designing, building, testing, and maintaining Python/Java/Scala/Spark based applications in a typical project delivery and consulting environments with 4+ years working as a Manager 5+ years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark,Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Big Data / Spark hands on-experience is mandatory Hands on experience in the performance tuning/troubleshooting of Hive and Spark based applications at production scale. Real time experience in JVM and Memory Management techniques such as Garbage collections, Heap/Thread Dump Analysis is preferred Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred Hands-on experience with AWS or Azure or GCP is preferred Experience in implementing CI/CD, Monitoring/alerting for Production Systems Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable Experience in leading and managing end-to-end projects and have reported and escalated to top levels Experience in managing and leading teams in an organisation involving multiple reporting lines About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted