Streaming Technologies Jobs in Bengaluru
776 Jobs Found
Lead Software Engineer - Scale & Performance
Team Vunet Systems
Lead Software Engineer - Scale & Performance Location: Bengaluru Experience: 6 12 years About VuNet VuNet is a pioneer in Business Journey Observability, using Big Data and Machine Learning to revolutionize digital experiences in the financial services industry. Our platform delivers end-to-end visibility into customer journeys, helping organizations proactively resolve issues, ensure operational resilience, and deliver superior user satisfaction. With over 28 billion digital transactions monitored every month and serving more than 300 million users globally, VuNet is shaping the future of observability for some of the largest banks and financial institutions. We are Series B funded, part of NASSCOM s DeepTech Club, and recognized by global analysts such as Gartner and Omdia. Your Role: Lead Software Engineer - Scale & Performance As a Lead Software Engineer for Scale & Performance, you ll own the performance and scalability benchmarks for VuNet s observability platform. You will work with cutting-edge technologies, design robust test frameworks, and ensure that our platform scales seamlessly to meet the demands of millions of users. Roles & Responsibilities Own performance and scalability benchmarking for key platform components (ingestion pipelines, data storage, and query services). Design and execute load, stress, soak, and capacity tests across microservices, agents, and ingestion layers. Identify and resolve performance bottlenecks in both infrastructure (CPU/memory/IO) and application layers (API latency, throughput, GC behavior). Develop and maintain performance test frameworks, preferably using Kubernetes-based environments. Collaborate with DevOps and SRE teams to optimize system configurations (Kubernetes, Postgres/TimescaleDB, ClickHouse, Kafka) for scale. Implement OpenTelemetry for service instrumentation to monitor system health and latency (p50/p95/p99 metrics). Contribute to capacity planning, scaling strategies (horizontal/vertical), and resource optimization. Analyze production incidents related to scaling issues and drive permanent fixes. Work with engineering teams to design scalable architecture patterns and define SLIs/SLOs for system performance. Document performance baselines, tuning guides, and scalability best practices for internal use. What You Bring Mandatory Skills: Strong background in performance engineering for large-scale distributed systems or SaaS platforms. Expertise in Kubernetes, container runtimes (containerd/Docker), and resource profiling in containerized environments. Solid understanding of Linux internals, CPU/memory profiling, and network stack tuning. Hands-on experience with observability tools (Prometheus, Grafana, OpenTelemetry, Jaeger, Loki, Tempo, etc.). Familiarity with observability platform datastores like ClickHouse, PostgreSQL/TimescaleDB, Elasticsearch, or Cassandra. Experience with performance benchmarking tools such as k6, Locust, JMeter, or custom Golang/Python scripts. Ability to interpret system metrics (CPU usage, memory, GC, latency) and correlate across different layers. Nice-to-Have Skills: Experience with agent benchmarking (OpenTelemetry Collector, custom data shippers). Exposure to streaming systems like Kafka, NATS, or Pulsar. Familiarity with CI/CD pipelines for performance testing and regression tracking. Knowledge of cost optimization and capacity forecasting in cloud environments (AWS/GCP/Azure). Proficiency in Go, Python, or Bash scripting for automation and data analysis. Life at VuNet: At VuNet, we're building a world-class observability platform, and we re just getting started. You ll be part of a passionate, problem-solving team that embraces collaboration, fast learning, and staying ahead of emerging technologies like Gen AI. We foster a high-trust, inclusive culture where collaboration, ownership, and innovation are central to our success. If you're looking to work on cutting-edge tech, make a real impact, and grow with a supportive team you ll fit right in at VuNet. Benefits: Comprehensive health insurance coverage for you, your parents, and dependents. Mental wellness and 1:1 counseling support. A culture that promotes continuous learning, innovation, and career growth. Transparent, inclusive, and high-trust workplace. Opportunities for skill enhancement with training programs focused on new Gen AI technologies.
Senior Java Web Backend Engineer
Blueoptima
Position: Senior Java Web Backend Engineer Job Type: Full-time Location: Bengaluru Department: Engineering About BlueOptima: At BlueOptima, our vision is to become the global reference for optimizing the performance of software engineers across all industries. We provide industry-leading objective metrics in software development, enabling large organizations to deliver better software, faster, and at a lower cost through technology that pushes the limits of what has been done before. As a fast-growing global company, we ve consistently doubled our headcount and revenue year over year, without external investment. Our headquarters is in London, with additional offices in Mexico, India, and the US. Our diverse team consists of 210+ employees from 34+ nationalities and speaks over 25 languages. We foster an open-minded environment and encourage employees to create their own success stories within this high-performance atmosphere. Job Description: We are looking for a Senior Java Web Backend Engineer with extensive experience in designing, building, and maintaining scalable SaaS applications using Java/J2EE technologies. The ideal candidate will be a tech enthusiast, committed to excellence, and eager to take on a leadership role as a mentor to a team of talented engineers. You ll be part of a self-managed Agile team, where you will actively contribute to improving development processes, bringing new ideas to the table, and proposing improvements in methodology, management, and organization. Key Responsibilities: Application Development & Maintenance: Design, develop, implement, test, and maintain application software components. Requirements Analysis: Analyze client requirements and convert them into technical specifications, ensuring alignment with project goals. Feature Ownership: Take ownership of development for new features and continuous improvements to the platform. Performance Optimization: Identify and resolve performance bottlenecks, ensuring high scalability and efficiency of the system. Architecture Improvement: Identify architectural inefficiencies, and create and execute a roadmap to address and resolve them. Leadership & Mentorship: Lead and mentor junior developers, fostering their technical growth and career development. Client Interaction: Provide technical support to client-facing teams and occasionally interact with clients to resolve issues related to your component. What You Need to Succeed at BlueOptima: Education: Minimum Bachelor's degree in Computer Science or equivalent. Self-Sufficiency: Ability to work autonomously with minimal supervision. Problem-Solving Skills: Strong analytical and problem-solving capabilities, coupled with a can-do attitude. Agile Methodologies: Experience with Agile methodologies (e.g., SCRUM, Sprints) and leading small Scrum teams. Commitment to Excellence: Focused on completing tasks efficiently and reliably while identifying the best approach to solving complex problems. Must-Have Technical Skills: Java Expertise: 5+ years of experience with Java, J2EE/Java EE, Spring, and Spring Boot. Architectural Knowledge: Solid understanding of Monolithic, SOA, and Microservices architectures. Concurrency & Thread-Safety: Strong knowledge of Java concurrency patterns and experience building thread-safe applications. Database Skills: Expertise in relational databases, partitioning, indexing techniques, and SQL (PostgreSQL). System Design: Experience creating high and low-level design documents based on application architecture. Linux Proficiency: Familiarity with Linux shell and command-line tools. Testing Skills: Strong grasp of unit testing and integration testing frameworks. Cloud Platform Experience: Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud (e.g., S3, EC2, Lambda). Message Queues & Streaming: Familiarity with message queues (e.g., Kafka, RabbitMQ, SQS) for high-performance, scalable systems. Monitoring & Logging: Experience with monitoring and logging tools (e.g., Prometheus, Grafana, Datadog, ELK Stack, Splunk). At BlueOptima, we believe in accelerating your career progression. You ll have the opportunity to strengthen your skills, take on diverse challenges, and quickly grow within the organization. We support your development every step of the way, with a clear path to leadership and technical expertise in a fast-paced, innovative environment. Qualification : Bachelor's degree in Computer Science or equivalent
Data Engineer
Capital One
Data Engineer Location: Bangalore Company: Capital One India About Capital One At Capital One, we're redefining how technology solves real-world financial challenges. As a technology-driven company, we bring together talented engineers, data scientists, and designers to innovate at scale and deliver meaningful impact to millions of customers. If you're passionate about building powerful data solutions, exploring cutting-edge technologies, and working in a collaborative, fast-paced environment this is the place for you. About the Role As a Data Engineer at Capital One, you ll join a team of innovators who design and build next-generation data platforms and pipelines that power real-time decision-making. You ll collaborate across disciplines engineering, product, machine learning, and cloud infrastructure to transform how we leverage data at scale. What You ll Do Collaborate across Agile teams to design, develop, test, and deploy data-driven solutions. Build and support scalable data pipelines using modern data engineering tools and cloud services. Work on real-time and batch data processing systems that integrate with distributed microservices and ML platforms. Use programming languages such as Python, Java, or Scala with SQL, NoSQL, and cloud data warehouses like Redshift or Snowflake. Contribute to code reviews, unit testing, and performance optimization to ensure high-quality data systems. Partner with product managers and platform teams to deliver robust, cloud-native data solutions that power business decisions. Stay ahead of tech trends, share knowledge, and mentor junior engineers. Basic Qualifications Bachelor s degree in Computer Science, Engineering, or a related field. 1.5+ years of hands-on experience in application or data engineering (excluding internships). At least 1 year of experience working with big data technologies. Preferred Qualifications 3+ years of application/data engineering experience using Python, Scala, Java, or SQL. 1+ year of experience with cloud platforms (AWS, Azure, or GCP). 2+ years of experience with distributed computing tools (Spark, Hadoop, Hive, EMR, Kafka, etc.). 1+ year working on real-time streaming applications. 1+ year of experience with NoSQL databases (MongoDB, Cassandra). 1+ year of experience with data warehousing (Redshift, Snowflake). 2+ years working with Linux/Unix systems and shell scripting. Familiarity with Agile methodologies and modern DevOps practices. Why Join Capital One Work on high-impact data solutions at one of the world s most innovative financial institutions. Be part of a collaborative tech culture that values experimentation and learning. Access to top-tier tools, mentorship, and career development opportunities. Competitive compensation and benefits in a mission-driven environment. Qualification : Bachelors degree in Computer Science, Engineering, or a related field
Lead / Senior Software Engineer
Ultraviolette Automotive
Job Title: Lead / Senior Software Engineer (Microservices, IoT, Kafka, AWS) Location: Bengaluru Experience Required: 5 8 years Industry: Automotive (Electric Mobility) Employment Type: Full-time About Ultraviolette Join the Charge. Create the Future. At Ultraviolette, we re not just building electric vehicles we re redefining what mobility looks and feels like. From creating India s fastest electric motorcycle to designing the world s most advanced electric scooter, we're on a mission to engineer machines that are not only sustainable, but also exhilarating. Our team is a diverse mix of engineers, designers, dreamers, and doers, united by a bold vision to accelerate the global shift to electric mobility. If you're driven by innovation and looking to work on cutting-edge products that challenge the status quo, this is your platform to make a real impact. About the Role We are looking for a Senior/Lead Software Engineer who thrives in designing scalable, high-performance, and cloud-native microservices. This role is ideal for someone with hands-on experience in Java, Spring Boot, Kafka, and AWS, and a keen interest in IoT and real-time data architectures. You will work at the intersection of hardware and software helping us bring our vision of connected, intelligent, and high-performance electric vehicles to life. Key Responsibilities Design, develop, and deploy Java-based microservices using Spring Boot and related technologies. Architect and implement event-driven systems using Apache Kafka for real-time IoT data streaming. Build and manage RESTful APIs with AWS API Gateway for seamless service integration. Leverage AWS services such as Lambda, DynamoDB, and MemoryDB to build scalable, serverless solutions. Collaborate with cross-functional teams front-end developers, DevOps, and product managers to convert ideas into working features. Optimize application performance, troubleshoot issues, and ensure high reliability and availability. Mentor junior engineers, conduct code reviews, and enforce clean coding practices. Contribute to architecture decisions, technical roadmaps, and innovation initiatives. Stay on top of emerging technologies in cloud, microservices, and IoT ecosystems. Participate actively in Agile processes including sprint planning, stand-ups, and retrospectives. Required Qualifications Bachelor s or Master s degree in Computer Science, Engineering, or a related field. 5+ years of hands-on experience in Java development, with a strong foundation in Spring Boot. Proven experience designing and deploying microservices architectures. Strong knowledge of Kafka and real-time streaming/data pipeline architectures. Hands-on experience with Docker and Kubernetes for containerization and orchestration. Understanding of IoT protocols such as MQTT or CoAP and device connectivity. Proficiency with version control (Git) and Agile methodologies. Excellent problem-solving, communication, and collaboration skills. Nice to Have AWS Certifications (e.g., AWS Certified Developer or Solutions Architect). Experience with additional languages like Python or Rust. Familiarity with NoSQL databases such as MongoDB or Cassandra. Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure as Code (e.g., Terraform). Exposure to stream processing frameworks (e.g., Apache Flink, Spark Streaming). Experience in edge computing and distributed systems. Strong understanding of cloud security best practices. Work on India s most futuristic electric vehicles at the intersection of technology, performance, and sustainability. Be part of a mission-driven company shaping the future of mobility. Collaborate with some of the most talented engineers and designers in the industry. A fast-paced environment that celebrates innovation, learning, and growth. Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field
Principal Electronics Engineer - Embedded Hardware
Ultraviolette Automotive
Job Title: Principal Electronics Engineer Embedded Hardware Location: Bengaluru Experience: 8 14 years Industry: Automotive / EV / Manufacturing Employment Type: Full-time About Ultraviolette Join the Charge. Create the Future. At Ultraviolette, we are more than just a company we re a movement that s reshaping the future of electric mobility. From building India s fastest electric motorcycle to designing the world s most advanced electric scooter, we thrive on pushing the boundaries of what s possible. We are a team of engineers, designers, and trailblazers united by a passion to craft machines that are sustainable, intelligent, and exhilarating. Every bolt, every line of code, and every component is designed with a singular mission: to accelerate the global shift toward next-generation mobility. Role Overview We are looking for a Principal / Lead Electronics Engineer Embedded Hardware to take ownership of vehicle electronics architecture, embedded systems design, diagnostics, and system-level validation for our next-gen electric vehicles. In this role, you will be at the forefront of developing high-performance electronic control units, telematics, and connected systems for future-ready vehicles. You will drive architecture decisions, system integration, and compliance, working alongside cross-functional teams to bring innovation from concept to the street. Key Responsibilities 1. Vehicle Electronics Architecture Design and bring to production electronic hardware including ECUs, display clusters, and telematics modules. Develop high-speed embedded designs with RF, sensor integration, and communication interfaces (CAN, LIN, UART, SPI, I2C). Create and maintain system schematics, architecture documentation, and interface definitions. 2. Embedded Hardware Design Develop embedded platforms with high-performance microcontrollers/processors to support vision systems, graphics, radar/LiDAR, audio, and OS-based applications. Architect and validate connected systems involving GNSS, LTE, BLE, Wi-Fi. Lead the design and integration of vehicle subsystems like lighting, clusters, IMUs, and more. Collaborate closely with firmware teams on hardware-software integration, bootloaders, and OTA functionality. 3. Diagnostics & Compliance Implement UDS-based diagnostics, fault logging systems, and service tools. Ensure compliance with AIS-004, ISO 26262, and other automotive design standards. 4. Testing & Validation Define and execute component-level and vehicle-level validation test plans. Utilize tools like Vector CANoe, CANalyzer, ETAS INCA, oscilloscopes, and spectrum/network analyzers for debugging and validation. 5. Cross-functional Collaboration Partner with teams across mechanical, software, UX, powertrain, and wire harness for holistic system integration. Work with mobile and cloud teams to enable real-time data streaming, diagnostics, and OTA updates. Actively contribute in design reviews, DFMEAs, and root cause analyses of field issues. Required Qualifications & Skills B.E. / M.E. / B.Tech / M.Tech in Electronics, Electrical, Mechatronics, or related disciplines. 8+ years of embedded hardware design experience, preferably in 2W/EV/automotive domain. Strong understanding of embedded C and scripting languages (e.g., Python, MATLAB, Octave). Experience with circuit simulation tools (e.g., PSPICE, LTSPICE, SIMPLIS, Simetrix). Hands-on expertise in RF design, signal/power integrity, EMI/EMC compliant layouts. Proficiency in PCB design tools (e.g., OrCAD, Altium, Mentor Graphics). Demonstrated experience in designing systems with multi-core processors, memory chips, SoMs, and high-speed interfaces (USB, Ethernet, LVDS, MIPI). Deep knowledge of embedded communication protocols (CAN, LIN, SPI, UART, I2C). Strong debugging and problem-solving skills in hardware validation and field testing. Nice to Have Hands-on experience in vehicle electronics development for 2W, 4W, or electric vehicles. Familiarity with DFT/DFA (Design for Testing/Assembly) methodologies. Experience with manufacturing and compliance testing for embedded hardware. Background in developing connected vehicle ecosystems with OTA capabilities. Passionate about emerging technologies in mobility, EVs, and embedded systems. Be part of India s electric mobility revolution where engineering meets adrenaline. Work on world-class technologies that are pushing global boundaries. Join a culture that encourages innovation, learning, and ownership. Collaborate with passionate teams building next-gen mobility experiences. Qualification : B.E. / M.E. / B.Tech / M.Tech in Electronics, Electrical, Mechatronics, or related disciplines
Lead Design Engineer
Coreel Technologies
Position: Lead Design Engineer Location: Bangalore Education: B.E./B.Tech. in Computer Science or Electronics & Communication M.E./M.Tech. in Computer Science or Electronics & Communication Experience: 5 to 9 years Job Overview We are looking for a skilled and motivated Lead Design Engineer to join our embedded systems team in Bangalore. In this role, you will take ownership of designing and developing high-performance device drivers and embedded Linux applications for ARM and/or TI DSP platforms. You will play a critical role in end-to-end development from architecture and coding to testing and debugging while also supporting customer requirements and contributing to technical discussions. This role requires strong expertise in embedded Linux development, device drivers, and excellent problem-solving abilities. Key Responsibilities Design, develop, and optimize device drivers and protocol stacks for embedded Linux on ARM and/or TI DSPs. Perform kernel-level development, debugging, and performance tuning. Analyze and resolve issues reported in existing designs; provide timely support and fixes. Work on application and middleware development for embedded systems. Participate in architecture discussions, define module-level details, and write clean, efficient code. Conduct peer reviews and follow best practices in design, coding, and testing. Develop and maintain comprehensive design documents, user manuals, and test reports. Perform performance and dependency analysis of embedded components. Engage with customers in discussions, conference calls, and technical clarifications. Collaborate with technical leads and team members to ensure timely project delivery. Required Skills & Experience Strong hands-on experience in device driver development for embedded Linux on ARM and/or TI DSPs. Successfully delivered at least two embedded projects involving driver or kernel development. Solid understanding of operating system concepts, C/C++, data structures, and multithreading. Experience with Linux framework development, preferably on TI DSPs. Proficient in debugging and performance optimization in embedded environments. Knowledge of IPC mechanisms, task/thread management, and handling deadlocks. Experience working in a collaborative environment with code reviews and version control. Preferred (Nice-to-Have) Skills Familiarity with audio-video streaming technologies and codecs such as MPEG2/H.264. Understanding of high-speed interfaces like PCIe with DMA. Basic knowledge of networking protocols, especially TCP/IP stack. Soft Skills & Attributes Strong analytical and debugging skills Effective communicator, capable of working with cross-functional teams and clients Self-driven with a proactive mindset Strong organizational and documentation skills Ability to handle multiple priorities and deliver under tight deadlines Opportunity to work on cutting-edge embedded systems and real-time applications Collaborative and technically rich work environment Competitive compensation package Continuous learning and growth opportunities Exposure to high-performance embedded development in mission-critical domains Qualification : M.E./M.Tech. in Computer Science or Electronics & Communication
Assistant Manager - Performance Marketing
Mpokket Financial Services Private Limited
Job Title: Assistant Manager Performance Marketing Location: Bangalore Department: Performance Marketing Employee Type: Full-time Experience Required: 3 6 years Position Overview We are seeking a results-oriented Assistant Manager - Performance Marketing to lead our efforts across Google advertising (Web & App), SEO, ASO, and website performance optimization. This role is crucial to driving both paid and organic user growth, enhancing digital discoverability, improving user experience, and boosting conversion rates. The ideal candidate combines strategic vision with hands-on execution skills and has deep expertise in performance marketing, search optimization, and mobile growth strategies. Key Responsibilities Google Campaigns (Web & App): Strategize, execute, and optimize Google Ads campaigns across platforms including UAC, Performance Max, Search, and TROAS. Manage cross-channel ad campaigns to acquire high-intent users for both websites and mobile apps. Define audience segments, manage bidding strategies and budgets, and conduct creative testing to improve engagement and ROI. Collaborate with creative, product, and data teams to deliver targeted, performance-driven campaigns. Search Engine Optimization (SEO): Own and evolve the SEO roadmap to enhance organic rankings, traffic, and search visibility. Conduct technical, on-page, and off-page SEO audits and coordinate implementation with content and development teams. Develop content strategies aligned with keyword research, user intent, and business goals. Track and analyze key SEO metrics using tools such as Google Search Console, SEMrush, Ahrefs, and Screaming Frog. Hands-on experience managing CMS and web hosting platforms. App Store Optimization (ASO): Lead ASO initiatives for the Google Play Store to increase app visibility and installs. Optimize app metadata including titles, descriptions, keywords, screenshots, and videos based on data insights. Run A/B tests using Store Listing Experiments and ASO tools like AppTweak or SensorTower. Monitor app store rankings, user reviews, and competitor performance to inform strategy. Experience: 4+ years in digital marketing with proven success in Google Ads, SEO, ASO, and website performance optimization. Expertise: Deep understanding of web and app acquisition strategies, Google Ads platforms (including Firebase and GA4), and ASO/SEO tools. Analytical Skills: Strong ability to interpret data and translate insights into actionable marketing strategies. Technical Knowledge: Familiarity with web technologies, mobile user acquisition funnels, and performance measurement tools. Certifications: Google Ads and Google Analytics certifications preferred. Additional Tools: Experience with Firebase, Appsflyer or other Mobile Measurement Partners (MMPs), Google Play Console, Google AdMob, and Adsense. Soft Skills: Excellent communication, collaboration, and project management abilities. If you re passionate about driving growth through performance marketing and thrive in a fast-paced environment, we d love to connect with you.
Senior Associate Data Engineering L2
Publicis Sapient
Senior Associate Data Engineering L2 Location: Bengaluru, India Department: Engineering Data Employment Type: Full-Time About the Role As a Senior Associate Data Engineering (L2) at Publicis Sapient, you will lead technical solutions that drive digital transformation by building scalable, high-performance data platforms. You ll be responsible for translating business and technical requirements into modern, data-centric solutions using Big Data technologies, cloud services (Azure), and advanced data engineering practices. Key Responsibilities Design and implement data ingestion, integration, and transformation processes from multiple heterogeneous sources in both batch and real-time. Build scalable data platforms using Hadoop stack components such as HDFS, Kafka, Spark, Hive, NiFi, Oozie, Airflow, Flink, and Storm. Develop real-time analytics, aggregation, and search features to support various data-driven applications. Collaborate closely with cross-functional teams on data infrastructure, computation frameworks, and data visualization. Apply cloud-native principles and Azure services to build and deploy data pipelines. Ensure performance optimization and data pipeline tuning. Work with NoSQL and MPP platforms like MongoDB, Cassandra, Redshift, Azure SQL DW, HBase, BigQuery. Contribute to infrastructure, automation, and DevOps for data pipelines using CI/CD practices. Ensure data governance, lineage, and cataloging using tools like Collibra or Alation. Required Qualifications 6 8 years of professional experience in software/data engineering. Minimum of 3 years hands-on experience with Big Data technologies. Strong programming expertise in Java (preferred), Scala, or Python. Expertise in the Hadoop ecosystem and real-time stream processing tools (Kafka, Pulsar, Spark Streaming, etc.). Hands-on experience with Azure data services (e.g., Data Factory, Synapse, ADLS, Databricks). Experience working with modern ETL tools (Informatica, Talend, etc.) and traditional RDBMS platforms (Oracle, PostgreSQL, SQL Server, MySQL). Bachelor's degree in Computer Science, Engineering, or related field. Nice to Have Certifications in Azure Data Engineer, GCP Big Data, or related cloud specializations. Experience with distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace). Familiarity with microservices architecture and search technologies (Elasticsearch). Performance tuning of distributed data processing systems. Exposure to data governance, security, and metadata management. Benefits and Culture at Publicis Sapient Gender-neutral workplace policies 18 paid holidays annually Generous parental leave + new parent transition support Flexible work arrangements Access to Employee Assistance Programs (wellness & well-being) A dynamic culture focused on learning, creativity, and collaboration Qualification : Bachelor's degree in Computer Science, Engineering, or related field.
Senior Data Engineer
Synechron
Position Title: Senior Data Engineer Databricks, PySpark, Cloud Platforms Location: Bengaluru Bellandur (GTP) Employment Type: Full-time Job Summary Synechron is looking for a Senior Data Engineer to join our advanced analytics team in Bengaluru. In this role, you will architect and build scalable, high-performance data pipelines that power data science, analytics, and business intelligence initiatives. You ll work with modern tools including Databricks, PySpark, and cloud data platforms, while collaborating across teams to ensure high-quality, secure, and efficient data solutions. Key Responsibilities Design, develop, and maintain large-scale, secure, and efficient data pipelines using Databricks, PySpark, and cloud-native tools. Partner with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions. Integrate data from various structured, semi-structured, and streaming sources. Ensure high standards for data quality, performance optimization, security, and cost efficiency. Drive data pipeline automation, orchestration, and monitoring using tools like Airflow. Lead troubleshooting efforts, performance tuning, and enhancements of existing pipelines. Stay informed about emerging data technologies and recommend adoption where relevant. Technical Skills Core Expertise Programming: Python (expert), SQL (advanced), PySpark. Platforms: Databricks (clusters, notebooks, workflows), AWS/Azure/GCP. Data Orchestration: Apache Airflow (or similar). Data Warehousing: Snowflake (preferred), data modeling, ETL/ELT pipelines. Streaming: Kafka or other stream processing tools. DevOps: CI/CD (GitLab CI, Jenkins), version control (Git), containerization (Docker/Kubernetes preferred). Security: Familiarity with encryption, access controls, and compliance best practices. Experience 8+ years of experience in data engineering or related roles. Proven expertise in developing and deploying scalable data pipelines using Databricks, PySpark, and SQL. Hands-on experience with cloud platforms (AWS, Azure, or GCP). Strong background in data warehousing, especially with Snowflake. Exposure to real-time data processing and orchestration tools. Experience implementing CI/CD pipelines for data workflows is a plus. Daily Responsibilities Build and optimize data ingestion, transformation, and storage workflows. Collaborate with cross-functional teams to align data solutions with business objectives. Monitor, troubleshoot, and continuously improve pipeline performance. Conduct data quality checks, ensure governance and compliance standards. Contribute to technical documentation, code reviews, and team knowledge sharing. Qualifications Bachelor s or Master s degree in Computer Science, IT, or related field. Relevant certifications (e.g., Databricks Certified Data Engineer, AWS Certified Data Analytics) are preferred. Professional Competencies Strong problem-solving and analytical mindset. Effective communicator with ability to collaborate across technical and non-technical teams. Time management and prioritization skills under tight deadlines. Proactive leadership and a passion for innovation. Commitment to ethical data use and data security. Diversity & Inclusion at Synechron Synechron is committed to building an inclusive, diverse, and equitable workplace. Through our global Same Difference DEI initiative, we celebrate and support people from all backgrounds, including race, gender, sexual orientation, religion, age, disability, and more. We offer flexible work arrangements, continuous learning, internal mobility, and mentoring programs to support every employee s growth. Qualification : Bachelors or Masters degree in Computer Science, IT, or related field
Machine Learning Engineer III
Glance
Job Title: Machine Learning Engineer III Location: Bangalore, India Company: Glance An InMobi Group Company About Glance Founded in 2019, Glance is a cutting-edge consumer technology company operating innovative digital platforms including Glance, Roposo, and Nostra. Our flagship Glance Lock Screen reaches over 450 million smartphones worldwide, delivering personalized, context-driven content without requiring app downloads. Roposo redefines live streaming experiences with creator-led interactive content, and Nostra stands as the largest gaming platform in India and Southeast Asia, offering immersive gaming and social engagement. Headquartered in Singapore, Glance is an unconsolidated subsidiary of InMobi Group. At Glance, we believe in empowering you to dream big, innovate boldly, and own your impact from day one. Collaborate with talented peers on mission-critical projects leveraging bleeding-edge technology to disrupt consumer experiences. Enjoy perks including daily meals, gym access, training sessions, state-of-the-art tech tools, and a family-friendly workspace where your kids and pets are always welcome. Role Overview We are seeking a skilled Machine Learning Engineer III passionate about designing, developing, deploying, and scaling high-impact ML solutions. You will partner closely with data scientists, engineers, and product teams to build end-to-end ML systems, microservices, and APIs that power AI-driven products on Glance s platforms. Key Responsibilities Architect and implement scalable ML solutions to accelerate experimentation, model building, and deployment. Develop microservices and APIs for serving machine learning models and services efficiently. Design, prototype, and build new ML/AI products and proof-of-concepts in collaboration with cross-functional teams. Explore and adopt new platforms, algorithms, and technologies to enhance ML capabilities. Manage project priorities, deadlines, and deliverables while maintaining transparent communication across teams. Take ownership of end-to-end ML engineering lifecycle from research collaboration to production deployment. Preferred Qualifications 5+ years of professional experience as a Machine Learning Engineer with a proven track record of delivering impactful ML solutions. Bachelor s, Master s, or PhD degree in Computer Science, Mathematics, Statistics, or related analytical fields. Deep theoretical and practical knowledge of recommender systems, computer vision (CNNs), GPU optimization, and generative AI models. Proficiency in Python, Golang, Spark, and familiarity with popular data science and ML libraries. Strong background in advanced mathematics, statistics, and algorithmic problem solving. Excellent technical documentation skills and demonstrated leadership in driving cross-functional projects. Experience working in data science or research-oriented roles with a passion for solving complex challenges. Join Glance and contribute to building next-generation AI-driven consumer experiences. Apply now to be part of a visionary tech team in Bangalore! Qualification : Bachelors, Masters, or PhD degree in Computer Science, Mathematics, Statistics, or related analytical fields.
Machine Learning Engineer - Speech Ai (asr & Tts)
Sarvam
Machine Learning Engineer - Speech AI (ASR & TTS) Location: Bengaluru, Karnataka, India (On-Site) Department: Engineering Employment Type: Full-Time About Sarvam.ai Sarvam.ai is a pioneering generative AI startup headquartered in Bengaluru, India. We specialize in leading transformative research and development in speech and language technologies. Focused on building state-of-the-art ASR (Automatic Speech Recognition) and TTS (Text-to-Speech) models, particularly for Indic languages, we aim to redefine human-computer interaction with cutting-edge, AI-driven solutions. Join us as we push the boundaries of Speech AI to create inclusive, scalable, and intelligent voice-based applications for diverse communities worldwide. Role Overview We are seeking an experienced Machine Learning Engineer specializing in Speech AI (ASR & TTS). The ideal candidate will work on deep learning-based ASR and TTS models, improving accuracy, efficiency, and multilingual capabilities while deploying them at scale. The role involves developing and optimizing speech recognition and synthesis models with a focus on low-resource languages, real-time inference, and scalability. If you have a passion for speech processing and deep learning, this is a great opportunity to make a significant impact in a rapidly growing field. Key Responsibilities ASR (Automatic Speech Recognition) Develop, train, and optimize speech-to-text models using state-of-the-art architectures like Wav2Vec, Whisper, Conformer, and DeepSpeech. Implement techniques for low-latency ASR inference, including beam search, language model integration, and real-time transcription. Improve speech recognition accuracy for low-resource languages, especially Indic languages, using transfer learning and data augmentation. Optimize ASR pipelines for noise robustness, speaker adaptation, and domain-specific transcription. TTS (Text-to-Speech) Develop and fine-tune neural TTS models such as Tacotron, FastSpeech, VITS, or WaveNet for high-quality, natural-sounding speech synthesis. Implement multilingual and expressive TTS models with prosody and emotion control. Optimize TTS inference for deployment on edge devices, mobile, and cloud platforms. Improve speech synthesis quality through voice cloning, neural vocoders (HiFi-GAN, WaveGlow), and prosody modeling. General Speech AI Responsibilities Benchmark and profile ASR/TTS models to improve latency, efficiency, and deployment performance. Deploy scalable speech AI APIs on AWS, Azure, or GCP for real-world applications. Optimize ASR & TTS models for edge and offline inference. Stay updated with the latest advancements in speech AI, neural vocoders, and real-time inference techniques. Must-Have Qualifications Experience: 2-3 years of experience in speech AI, deep learning, or machine learning, with a focus on ASR & TTS. Education: Bachelor s or Master s degree in Computer Science, AI/ML, Speech Processing, or a related field. ML Frameworks: Proficiency in PyTorch or TensorFlow for training and deploying ASR/TTS models. ASR Expertise: Experience with speech-to-text architectures like Whisper, Wav2Vec, Conformer, or DeepSpeech. TTS Expertise: Experience with speech synthesis models like Tacotron, FastSpeech, or VITS. Speech Signal Processing: Understanding of MFCCs, STFT, phonemes, prosody modeling, and feature extraction. Inference Optimization: Hands-on experience with TensorRT, ONNX, or quantization (INT8, FP16) for ASR/TTS. Cloud & Edge Deployment: Experience deploying speech models on AWS, GCP, or Azure. Preferred Qualifications Experience with speech diarization, speaker recognition, or language modeling for ASR. Familiarity with zero-shot TTS, voice cloning, and multilingual speech modeling. Understanding of CUDA optimization and low-bit quantization for ASR/TTS models. Contributions to open-source speech AI projects or a strong GitHub portfolio showcasing relevant work. Experience with real-time streaming ASR/TTS applications and low-latency inference. Innovative Impact: Work on AI-driven speech solutions that are changing how people interact with technology, especially in low-resource languages. Cutting-Edge Technology: Contribute to the development of state-of-the-art speech AI models in a rapidly advancing field. Collaborative Environment: Work with a team of experts in AI, machine learning, and speech processing, in a startup culture. Growth Opportunities: Sarvam.ai offers exciting career growth in a fast-paced environment with opportunities for personal and professional development. Interested candidates are invited to submit their resume, cover letter, and any relevant project portfolios or GitHub links showcasing their experience in ASR, TTS, or Speech AI. Strong AI-related projects, whether in industry, research, or personal work, will be highly valued. Qualification : Bachelors or Masters degree in Computer Science, AI/ML, Speech Processing, or a related field.
Ai Platform Architect
Adobe
AI Platform Architect Location: Bangalore, Karnataka, India Employment Type: Full-Time About Adobe Adobe is changing the world through digital experiences. Whether you're an emerging artist or a global brand, our tools empower creativity and innovation across every screen. From powerful imaging and video solutions to immersive web and app design, Adobe s mission is to help people and businesses deliver exceptional digital experiences. We are committed to creating an inclusive workplace where everyone is respected and given equal opportunity. Innovation can come from anywhere and the next big idea could be yours. Job Description We are looking for a visionary AI Platform Architect with deep expertise in building and scaling cloud-native, AI-powered platforms. The ideal candidate will have experience deploying large-scale, customer-facing AI solutions and a deep understanding of modern cloud architecture, data systems, MLOps, and LLMOps. Responsibilities Design and develop scalable AI/ML platforms and pipelines across AWS, Azure, and GCP. Architect end-to-end LLM pipelines including model training, fine-tuning, serving, inference APIs, and monitoring. Lead cross-functional teams in delivering AI solutions from experimentation to production. Implement MLOps and LLMOps best practices using tools like MLFlow, SageMaker, Langchain, and LangGraph. Design GPU-optimized architectures for training and inference of LLMs using DeepSpeed, vLLM, and other modern frameworks. Support infrastructure automation and container orchestration with Kubernetes, Docker, and CI/CD pipelines. Collaborate with internal stakeholders and clients to understand requirements, evangelize platform solutions, and ensure successful delivery. Key Skills and Expertise Cloud and DevOps: Expertise in AWS, Azure, GCP especially VPC design, cloud databases, and serverless architecture. Certified in AWS Professional Solution Architect, AWS ML Specialty, or Azure Solutions Architect Expert (preferred). Proficient with Kubernetes, Docker, FluentD, Kibana, Grafana, Prometheus. Data and Streaming: Experience with OLTP/OLAP databases and cloud-native data warehouses like BigQuery, Aurora, Spanner. Hands-on with Kafka, Apache Flink, Spark, Airflow, Databricks, Apache Iceberg, Presto. AI/ML & LLM Expertise: In-depth understanding of LLMs (GPT, Gemini, Claude, Mixtral, Llama, Hugging Face OSS models). LLMOps frameworks: Langchain, Langgraph, Langflow, Flowise, LLamaIndex. ML lifecycle tools: MLFlow, SageMaker, Vertex AI, Azure AI, AWS Bedrock. Proven experience in model optimization, fine-tuning, and high-throughput inference systems. Programming Languages: Proficient in Python, SQL, and JavaScript. Preferred Qualifications 10+ years in cloud and AI/ML platform architecture roles. Experience delivering AI solutions for enterprise-scale clients. Hands-on experience with GPU architecture and parallel/distributed training. Strong communication skills with ability to influence technical and business stakeholders. Work on cutting-edge AI technologies and shape future product experiences used by millions. Collaborate with world-class engineers and scientists in a diverse, inclusive culture. Be part of a company that values creativity, innovation, and employee well-being. Adobe is proud to be an Equal Opportunity Employer. We welcome and encourage candidates from all backgrounds to apply.
Sr. Data Engineer
Trellissoft Engineering Services Pvt Ltd
Job Title: Data Engineer Location: Bengaluru, Karnataka Experience: 5 to 8 Years Work Modality: Full-time (Work from office) Job Description: We are looking for an experienced Data Engineer to join our team and take responsibility for designing, developing, and maintaining scalable ETL/ELT pipelines. This is a full-time position based in Bengaluru, Karnataka, and you will be collaborating with cross-functional teams to define data requirements and ensure data accuracy, consistency, and integrity. Your role will also involve optimizing data workflows, automating processes, and ensuring high availability and reliability of data pipelines. Key Responsibilities: ETL/ELT Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines to support data transformation and integration processes. Data Warehouse & Data Lake Optimization: Build and optimize data warehouses, data lakes, and real-time streaming solutions to support large-scale data operations. Collaboration & Data Requirements: Collaborate with cross-functional teams, such as product, data science, and analytics teams, to define data requirements and ensure data accuracy and consistency. Database Structure & Schema Management: Develop and maintain database structures and schemas to ensure efficient data storage and retrieval. Data Workflow Optimization: Optimize data workflows for performance, reliability, and scalability, ensuring the highest level of efficiency. Data Security & Compliance: Implement data security, governance, and compliance best practices to ensure that data is handled securely and meets industry standards. Pipeline Monitoring & Troubleshooting: Monitor, troubleshoot, and improve data pipelines to ensure uptime, reliability, and smooth data processing. Process Automation: Automate data-related processes to improve efficiency and reduce manual intervention, increasing the overall speed of data flow. Required Qualifications: Experience: 5+ years of experience in data engineering or 3-4 years of experience as a Data Engineer. Technical Skills: Strong proficiency in SQL and database management systems such as PostgreSQL, MySQL, SQL Server, etc. Experience with ETL tools such as Pentaho, Talend, Cdata, and SSIS. Exposure to Python, Java, or Scala for data processing is a plus. Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud services (AWS, Azure) and data storage solutions such as S3, Redshift, Snowflake, or BigQuery. Strong knowledge of data modeling, warehousing concepts, and data architecture best practices. Soft Skills: Excellent communication skills with the ability to collaborate effectively across teams. Strong problem-solving skills and the ability to work with large, complex datasets. What We Offer: Competitive Salary: Attractive salary based on experience and expertise. Collaborative Work Environment: Work in a dynamic and fast-paced environment with a team that fosters innovation and collaboration. Growth Opportunities: Opportunities to enhance your skills and career growth in the data engineering field. Comprehensive Benefits: Benefits package designed to support work-life balance and overall employee well-being.
Senior Python Expert
Hashedin Technologies Pvt. Ltd.
Job Title: Senior Python Expert Experience: 3 to 8 years Overview of the Role: This role sets the benchmark for team software development processes and deployment procedures, while actively contributing to establishing best practices and methodologies within the team. Responsibilities: Develop backend services using Python Flask or similar web frameworks. Design and maintain data and pipeline management frameworks using open-source technologies such as Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud-based data engineering services like S3, Redshift, Athena, Kinesis. Design and develop efficient CRUD operations for large datasets with millions of records. Collaborate with teams to build and maintain innovative, reliable, secure, and cost-effective distributed solutions. Own and deliver complex application components within defined timelines. Ensure quality delivery using best practices in API development, performance, and scalability. Participate in customer communication, presentations, and resolution of critical issues. Contribute to architecture, feature set, and design decisions. Proactively recognize and address requirement inconsistencies and project risks. Break down work effectively and estimate accurately. Serve as a technical mentor and role model within the team. Required Skills: Strong knowledge of Python and a web framework like Flask. Experience with AWS services such as EC2, S3, Lambda, Step Functions, Glue, SNS, SQS, Secret Manager, and CodeBuild/CodePipeline. Solid understanding of SQL, including query writing, optimization, and database interaction tools. Experience with API development (RESTful services, Postman, API Gateway). Strong coding, debugging, and problem-solving skills. Understanding of architectural trade-offs and data engineering principles (data acquisition, ingestion, distributed processing, high availability). Ability to independently handle delivery of complex projects. Excellent team management and individual contributor skills. Good to Have Skills: Experience with Big Data frameworks like Hadoop and Spark. Knowledge of AWS Aurora. Familiarity with pip, setuptools, etc. Education: B.E./B.Tech, MCA, M.E./M.Tech.
Tech Architect
Hashedin Technologies Pvt. Ltd.
Job Title: Tech Architect Experience: 7 to 10 years Education: B.E./B.Tech, MCA, M.E./M.Tech About HashedIn: We are software engineers solving business problems with a Product Mindset for leading global organizations. By combining engineering talent with business insight, we build software and products that create enterprise value. We thrive in a fast-paced learning environment, driven by extreme ownership and a fun, inclusive culture. If you are a problem solver who thrives in dynamic environments, enjoys working on cutting-edge technologies, and values collaboration and high performance, HashedIn is the place to be! Overview of the Role: As a Tech Architect, you will drive architecture and design decisions, ensuring scalability, performance, and reliability. You will play a critical role in setting up best practices, defining technical roadmaps, and ensuring high-quality delivery. This role requires hands-on technical leadership, a deep understanding of cloud platforms, architecture patterns, and modern engineering practices. Key Responsibilities: Design and deploy resilient APIs, bridging cloud infrastructure with software development. Build and manage data and pipeline management frameworks using Hadoop, Hive, Spark, HBase, Kafka Streaming, Tableau, Airflow, and cloud services like S3, Redshift, Athena, Kinesis, etc. Collaborate with cross-functional teams to build innovative, secure, and cost-effective distributed solutions. Design and develop big data solutions, real-time analytics, and streaming platforms using industry-standard technologies. Own delivery of complex components, ensuring adherence to technical and business requirements. Serve as a team lead or influential individual contributor, driving architecture decisions and best practices. Identify requirement inconsistencies, proactively highlight risks, and maintain clear communication with stakeholders. Create and maintain clear technical specifications, ensuring proper work breakdown and estimation. Support customer communication, handle critical issues, and contribute to client presentations. Set standards for software development processes and deployment methodologies, contributing to team-wide best practices. Desired Skills & Experience: 7-10 years of experience, including at least 4 years as an Application Architect or Data Architect. Strong expertise in Java, Python, UI Development, or Data Engineering. Hands-on experience with GCP, AWS, or Azure cloud platforms. Knowledge of Generative AI-enabled application design patterns is a plus. Strong understanding of cloud architecture, distributed applications, integration, and API design. Experience in technology stack selection and defining solution architectures for small to mid-sized cloud-hosted platforms. Strong grasp of design and architecture patterns, with experience in developing scalable architectures. Experience in setting up and governing engineering processes, tools, and standards. Proficient in effort estimation techniques, project planning, and defining test strategies. Experience responding to RFPs/RFIs and working directly with customers. Up-to-date with latest technology trends and engineering practices. Experience with PAAS and SAAS platforms hosted on cloud environments. Hands-on experience with infrastructure sizing and design for both on-premises and cloud platforms. Ability to understand business domains and translate requirements into scalable technical solutions. Excellent interpersonal skills, with the ability to engage and present to CXOs. Strong leadership, business communication, and consulting skills. Positive, service-oriented mindset. Qualification : B.E./B.Tech, MCA, M.E./M.Tech
Incident Manager
Databricks
CSQ124R98 At Databricks, an Incident Manager utilizes their technical experience and resourcefulness to lead urgent customer situations to resolution. Responsible for managing frequent, high-quality updates to all internal and external stakeholders, Incident Managers advocate with engineering and leadership, on behalf of their customers, to ensure that escalations are handled with the appropriate level of urgency from stakeholders. The impact you will have: Drive critical customer escalations or widespread outages to conclusion and resolution. Escalate to on-call resources in support and engineering and establish checkpoint calls and action items to ensure that progress is made and status updates are delivered on time. Demonstrate cross-functional leadership while establishing ownership of escalations and outages. Compile and deliver frequent high-quality communications to internal and external stakeholders, including executive staff. Candidate should be comfortable creating concise and effective messaging that is tailored to a technical or executive audience with minimal assistance from others. Commence and lead war rooms while establishing other temporary communication channels as warranted for the duration of an outage. Ability to multi-task on several incidents and/or projects at once. Be a leader who identifies product and process improvements from every incident and submits necessary feedback for improvements. Participate in on-call rotations. What we look for: Minimum 8+ years of experience in customer support, support escalation and incident management is required. Excellent contextual interpretation and writing skill with an effective ability to summarize and communicate to technical and business audiences is required. Demonstrates strong ability to make timely decisions for both business and technical perspectives. Excellent analytical and troubleshooting skills are required. Candidate should be able to demonstrate technical excellence by applying engineering principles to solve complex problems. Hands-on experience developing any two or more of the following: Big Data, Hadoop, Spark, Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Hands-on experience in the performance tuning/troubleshooting of Spark-based applications at production scale. Proven and real-time experience in JVM and Memory Management techniques such as Garbage collection and Heap/Thread Dump Analysis is required. Working knowledge in Data Lakes and preferably on the SCD types use cases at production scale. Working and hands-on experience with any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server and MySQL Linux/Unix administration skills and hands-on experience with AWS or Azure or GCP is required. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Manager - Technical Solutions (spark)
Databricks
As a Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical solution engineers and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products. The impact you will have: As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year Be a hands on manager to assist the team members in resolving issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools/automation initiatives Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc What we look for: Min 10-12 years of experience in designing, building, testing, and maintaining Python/Java/Scala/Spark based applications in a typical project delivery and consulting environments with 4+ years working as a Manager 5+ years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark,Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Spark experience is mandatory Hands on experience in the performance tuning/troubleshooting of Hive and Spark based applications at production scale. Real time experience in JVM and Memory Management techniques such as Garbage collections, Heap/Thread Dump Analysis is preferred Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred Hands-on experience with AWS or Azure or GCP is preferred Experience in implementing CI/CD, Monitoring/alerting for Production Systems Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable Experience in leading and managing end-to-end projects and have reported and escalated to top levels Experience in managing and leading teams in an organisation involving multiple reporting lines Strong written and verbal communication skills; very good analytical, organisational, multi-tasking skills About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Senior Manager - Technical Solutions (spark)
Databricks
As a Senior Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical Solution Engineers (Spark) and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products. The impact you will have: As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year Be a hands on manager to assist the team members in resolving issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools/automation initiatives Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc What we look for: Min 10-12 years of experience in designing, building, testing, and maintaining Python/Java/Scala/Spark based applications in a typical project delivery and consulting environments with 4+ years working as a Manager 5+ years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark,Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Big Data / Spark hands on-experience is mandatory Hands on experience in the performance tuning/troubleshooting of Hive and Spark based applications at production scale. Real time experience in JVM and Memory Management techniques such as Garbage collections, Heap/Thread Dump Analysis is preferred Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred Hands-on experience with AWS or Azure or GCP is preferred Experience in implementing CI/CD, Monitoring/alerting for Production Systems Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable Experience in leading and managing end-to-end projects and have reported and escalated to top levels Experience in managing and leading teams in an organisation involving multiple reporting lines About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visithttps://www.mybenefitsnow.com/databricks. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Senior Software Engineer - Backend
Nvidia
NVIDIA is searching for a highly motivated senior software engineer for the team that is building capabilities for a next generation Network management and Telemetry system in cloud using modern design principles at internet scale.The person will be will be responsible for building distributed cloud applications. It will be a highly scalable, modern network operations toolset that provides visibility, troubleshooting, validation and telemetry for Ethernet networks. What you'll be doing: Development of distributed cloud applications, micro services and SAAS platform with high throughput and reliability. Contribute to applications like data ingestion, distributed computing, near real time analytic engines, RESTful APIs and user interfaces. Drive requirement discussions, design and product improvements. Drive improvements in areas like performance, team productivity, automation, quality, monitoring and reliability of applications. Working closely with the system architects, UI/UX and test engineers What we need to see: Bachelors/Masters Degree in Computer Science/Engineering 5+ years of experience in complex microservices based architectures. Extensive programming experience in Scala, Go, Python Fluent in coding and rapid prototyping. Strong experience in developing, maintaining, and testing of scalable distributed applications. Experience with stream processing frameworks, such as Kafka,Flink , Spark Streaming, Samza etc. Background with NoSQL databases such as Cassandra, MongoDB. Experience with orchestration/scheduling technologies like Kubernetes, SLURM, Nomad etc Ways to stand out from the crowd: Experience with public clouds like AWS. Worked in Reactive application designs (https://www.reactivemanifesto.org/). Experience in network stacks, protocols, SDN. NVIDIA is widely considered to be one of the technology world s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative, passionate and self-motivated, we want to hear from you! NVIDIA is leading the way inground-breakingdevelopments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Qualification : Bachelors/Masters Degree in Computer Science/Engineering
Sr. Data Engineer
Orange Mantra
Skills Required: Should have a minimum 6+ years in Data Engineering, Data Analytics platform. Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements. Should be involved in Requirements Gathering and transforming them to into Functionally and technical design. Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources. Design, build and maintain batch or real-time data pipelines in production. Develop ETL/ELT Data pipeline (extract, transform, load) processes to help extract and manipulate data from multiple sources. Automate data workflows such as data ingestion, aggregation, and ETL processing and should have good experience with different types of data ingestion techniques: File-based, API-based, streaming data sources (OLTP, OLAP, ODS etc) and heterogeneous databases. Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders. Strong experience and implementation of Data lakes, Data warehousing, Data Lakehousing architectures. Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. Monitor data systems performance and implement optimization strategies. Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership. Experience of AWS tools (AWS S3, EC2, Athena, Redshift, Glue, EMR, Lambda, RDS, Kinesis, DynamoDB, QuickSight etc.). Strong experience with Python, SQL, pySpark, Scala, Shell Scripting etc. Strong experience with workflow management & Orchestration tools (Airflow, Should hold decent experience and understanding of data manipulation/wrangling techniques. Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit testing, version control, code review). Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR etc. Snowflake Data Warehouse/Platform. Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming. Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, Ansible etc Experience building and deploying solutions to AWS Cloud. Good experience on NoSQL databases like Dynamo DB, Redis, Cassandra, MongoDB, or Neo4j etc. Experience with working on large data sets and distributed computing (e.g., Hive/Hadoop/Spark/Presto/MapReduce). Good to have working knowledge on Data Visualization tools like Tableau, Amazon QuickSight, Power BI, QlikView etc. Experience in Insurance domain preferred.
1 - 20 of 0 jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted