BIG Data Automation Jobs in Hyderabad
183 Jobs Found
Data Governance Lead
Kanerika Software
Job Title: Data Governance Lead Job Location: Hyderabad Job Description As a Data Governance Lead at Kanerika, you will be responsible for defining, leading, and operationalizing the data governance framework, ensuring enterprise-wide alignment and regulatory compliance. Key Responsibilities: Governance Strategy & Stakeholder Alignment Develop and maintain enterprise data governance strategies, policies, and standards. Align governance with business goals: compliance, analytics, and decision-making. Collaborate across business, IT, legal, and compliance teams for role alignment. Drive governance training, awareness, and change management programs. Microsoft Purview Administration & Implementation Manage Microsoft Purview accounts, collections, and RBAC aligned to org structure. Optimize Purview setup for large-scale environments (50TB+). Integrate with Azure Data Lake, Synapse, SQL DB, Power BI, Snowflake. Schedule scans, set classification jobs, and maintain collection hierarchies. Metadata & Lineage Management Design metadata repositories and maintain business glossaries and data dictionaries. Implement ingestion workflows via ADF, REST APIs, PowerShell, Azure Functions. Ensure lineage mapping (ADF Synapse Power BI) and impact analysis. Data Classification & Security Governance Define classification rules and sensitivity labels (PII, PCI, PHI). Integrate with MIP, DLP, Insider Risk Management, and Compliance Manager. Enforce records management, lifecycle policies, and information barriers. Data Quality & Policy Management Define KPIs and dashboards to monitor data quality across domains. Collaborate on rule design, remediation workflows, and exception handling. Ensure policy compliance (GDPR, HIPAA, CCPA, etc.) and risk management. Business Glossary & Stewardship Maintain business glossary with domain owners and stewards in Purview. Enforce approval workflows, standard naming, and steward responsibilities. Conduct metadata audits for glossary and asset documentation quality. Automation & Integration Automate governance processes using PowerShell, Azure Functions, Logic Apps. Create pipelines for ingestion, lineage, glossary updates, tagging. Integrate with Power BI, Azure Monitor, Synapse Link, Collibra, BigID, etc. Monitoring, Auditing & Compliance Set up dashboards for audit logs, compliance reporting, metadata coverage. Oversee data lifecycle management across its phases. Support internal and external audit readiness with proper documentation. Requirements 7+ years of experience in data governance and data management. Proficient in Microsoft Purview and Informatica data governance tools. Strong in metadata management, lineage mapping, classification, and security. Experience with ADF, REST APIs, Talend, dbt, and automation via Azure tools. Knowledge of GDPR, CCPA, HIPAA, SOX and related compliance needs. Skilled in bridging technical governance with business and compliance goals. Benefits Employee Benefits Culture: Open Door Policy: Encourages open communication and accessibility to management. Open Office Floor Plan: Fosters a collaborative and interactive work environment. Flexible Working Hours: Allows employees to have flexibility in their work schedules. Employee Referral Bonus: Rewards employees for referring qualified candidates. Appraisal Process Twice a Year: Provides regular performance evaluations and feedback. Inclusivity and Diversity: Hiring practices that promote diversity: Ensures a diverse and inclusive workforce. Mandatory POSH training: Promotes a safe and respectful work environment. Health Insurance and Wellness Benefits: GMC and Term Insurance: Offers medical coverage and financial protection. Health Insurance: Provides coverage for medical expenses. Disability Insurance: Offers financial support in case of disability. Child Care & Parental Leave Benefits: Company-sponsored family events: Creates opportunities for employees and their families to bond. Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child. Family Medical Leave: Offers leave for employees to take care of family members' medical needs. Perks and Time-Off Benefits: Company-sponsored outings: Organizes recreational activities for employees. Gratuity: Provides a monetary benefit as a token of appreciation. Provident Fund: Helps employees save for retirement. Generous PTO: Offers more than the industry standard for paid time off. Paid sick days: Allows employees to take paid time off when they are unwell. Paid holidays: Gives employees paid time off for designated holidays. Bereavement Leave: Provides time off for employees to grieve the loss of a loved one. Professional Development Benefits: L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development. Mentorship Program: Offers guidance and support from experienced professionals. Job Training: Provides training to enhance job-related skills. Professional Certification Reimbursements: Assists employees in obtaining professional certifications.
Data Governance Architect
Kanerika Software
Job Title: Data Governance Architect Job Location: Hyderabad Job Description As a Data Governance Architect at Kanerika, you will play a pivotal role in shaping and executing the enterprise data governance strategy. Your responsibilities include: What You Will Do: Strategy, Framework, and Governance Operating Model Develop and maintain enterprise-wide data governance strategies, standards, and policies. Align governance practices with business goals like regulatory compliance and analytics readiness. Define roles and responsibilities within the governance operating model. Drive governance maturity assessments and lead change management initiatives. Stakeholder Alignment & Organizational Enablement Collaborate across IT, legal, business, and compliance teams to align governance priorities. Define stewardship models and create enablement, training, and communication programs. Conduct onboarding sessions and workshops to promote governance awareness. Architecture Design for Data Governance Platforms Design scalable and modular data governance architecture. Evaluate tools like Microsoft Purview, Collibra, Alation, BigID, Informatica. Ensure integration with metadata, privacy, quality, and policy systems. Microsoft Purview Solution Architecture Lead end-to-end implementation and management of Microsoft Purview. Configure RBAC, collections, metadata scanning, business glossary, and classification rules. Implement sensitivity labels, insider risk controls, retention, data map, and audit dashboards. Metadata, Lineage & Glossary Management Architect metadata repositories and ingestion workflows. Ensure end-to-end lineage (ADF Synapse Power BI). Define governance over business glossary and approval workflows. Data Classification, Access & Policy Management Define and enforce rules for data classification, access, retention, and sharing. Align with GDPR, HIPAA, CCPA, SOX regulations. Use Microsoft Purview and MIP for policy enforcement automation. Data Quality Governance Define KPIs, validation rules, and remediation workflows for enterprise data quality. Design scalable quality frameworks integrated into data pipelines. Compliance, Risk, and Audit Oversight Identify risks and define standards for compliance reporting and audits. Configure usage analytics, alerts, and dashboards for policy enforcement. Automation & Integration Automate governance processes using PowerShell, Azure Functions, Logic Apps, REST APIs. Integrate governance tools with Azure Monitor, Synapse Link, Power BI, and third-party platforms. Requirements 15+ years in data governance and management. Expertise in Microsoft Purview, Informatica, and related platforms. Experience leading end-to-end governance initiatives. Strong understanding of metadata, lineage, policy management, and compliance regulations. Hands-on skills in Azure Data Factory, REST APIs, PowerShell, and governance architecture. Familiar with Agile methodologies and stakeholder communication. Benefits Employee Benefits Culture: Open Door Policy: Encourages open communication and accessibility to management. Open Office Floor Plan: Fosters a collaborative and interactive work environment. Flexible Working Hours: Allows employees to have flexibility in their work schedules. Employee Referral Bonus: Rewards employees for referring qualified candidates. Appraisal Process Twice a Year: Provides regular performance evaluations and feedback. Inclusivity and Diversity: Hiring practices that promote diversity: Ensures a diverse and inclusive workforce. Mandatory POSH training: Promotes a safe and respectful work environment. Health Insurance and Wellness Benefits: GMC and Term Insurance: Offers medical coverage and financial protection. Health Insurance: Provides coverage for medical expenses. Disability Insurance: Offers financial support in case of disability. Child Care & Parental Leave Benefits: Company-sponsored family events: Creates opportunities for employees and their families to bond. Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child. Family Medical Leave: Offers leave for employees to take care of family members' medical needs. Perks and Time-Off Benefits: Company-sponsored outings: Organizes recreational activities for employees. Gratuity: Provides a monetary benefit as a token of appreciation. Provident Fund: Helps employees save for retirement. Generous PTO: Offers more than the industry standard for paid time off. Paid sick days: Allows employees to take paid time off when they are unwell. Paid holidays: Gives employees paid time off for designated holidays. Bereavement Leave: Provides time off for employees to grieve the loss of a loved one. Professional Development Benefits: L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development. Mentorship Program: Offers guidance and support from experienced professionals. Job Training: Provides training to enhance job-related skills. Professional Certification Reimbursements: Assists employees in obtaining professional certifications.
Azure Data Engineer (mid)
Syren Technologies
Azure Data Engineer (Mid-Level) Hyderabad Location: Hyderabad, India Job Type: Full-Time | On-site/Hybrid Experience Level: 5+ Years Industry: Information Technology / Cloud Data Engineering Job Overview We are hiring an experienced Azure Data Engineer (Mid-Level) to join our team in Hyderabad. In this role, you will work closely with business stakeholders, analysts, and IT teams to design, implement, and manage scalable, high-performance data solutions on the Azure Cloud Platform. Your expertise in data modeling, ETL development, and cloud-based data warehousing will be critical in supporting data-driven decision-making across the organization. Key Responsibilities Analyze large datasets and deliver clear, actionable reports using statistical techniques. Design and implement data pipelines, data collection systems, and analytics strategies that enhance operational efficiency. Develop and maintain data systems, ensuring high data quality, consistency, and integrity. Collaborate with business stakeholders, analysts, and developers to translate business requirements into technical solutions. Design, build, and manage distributed data systems and applications on the Azure Cloud. Lead and execute ETL development, including data extraction, transformation, and loading using tools like Informatica or SSIS. Conduct technical design reviews, performance tuning, and testing of data workflows. Adapt to changing priorities and contribute as an individual contributor or team leader depending on project scope. Required Qualifications & Skills Bachelor s degree in Computer Science, Information Systems, or a related field. Minimum 5+ years of experience in data engineering, data analysis, or database design. Proficient in SQL and T-SQL for querying and managing relational databases. Hands-on experience with ETL frameworks such as Informatica or SSIS. Strong understanding of data modeling, data mining, and segmentation techniques. Experience working with structured and unstructured data sources. Proficient in statistical tools and packages (Excel, SSIS, SAS, etc.). Strong analytical mindset with excellent attention to detail and data accuracy. Preferred Skills (Good to Have) Experience with Python and Apache Spark for data manipulation and automation. Experience with modern data platforms: Azure Synapse Analytics Azure Databricks Amazon Redshift Prior experience in developing automation solutions using Python or similar scripting languages. Knowledge of Enterprise Data Warehousing (EDW) concepts and solutions. Competitive compensation package with benefits. Work with cutting-edge cloud technologies in real-world environments. Collaborative, fast-paced, and innovation-driven workplace. Career development support with continuous learning opportunities. A chance to make a tangible impact on enterprise-level data systems. Apply Now If you are a data-driven professional with a strong command of Azure and ETL tools, and you re looking to advance your career in data engineering, apply now and become part of a forward-thinking tech team based in Hyderabad! Qualification : Bachelors degree in Computer Science, Information Systems, or a related field.
Sr. Database Developer
Wallero Technologies
Job Title: Senior Database Developer Location: Hyderabad / Chennai, India Experience Required: 3+ Years Open Positions: 1 Job Type: Full-Time | Permanent About the Role: We are seeking a detail-oriented and skilled Senior Database Developer to join our team in Hyderabad or Chennai. The ideal candidate will have strong expertise in database design, development, and integration with Microsoft SQL Server and proficiency across the Microsoft Business Intelligence (BI) stack. Key Responsibilities: Design, develop, and maintain robust databases and data warehouses using Microsoft SQL Server. Work extensively with the full Microsoft BI stack including SSIS (SQL Server Integration Services), SSAS (SQL Server Analysis Services), SSRS (SQL Server Reporting Services), and Power BI. Develop, optimize, and deploy complex reports and dashboards for business stakeholders. Collaborate with cross-functional teams to design scalable data solutions aligned with business goals. Use strong SQL skills to write efficient queries and manage relational database systems. Participate in solution design and data warehouse architecture. Communicate technical concepts clearly and effectively to both technical and non-technical audiences. Required Skills & Qualifications: Minimum 3 years of experience working with SQL Server databases and Microsoft BI tools. Hands-on expertise in SSIS, SSAS, SSRS, and Power BI. Strong knowledge of relational database concepts and SQL language. Experience in data warehouse and solution design. Proven ability to develop insightful reports and dashboards. Excellent verbal and written communication skills in English. Bachelor s degree or higher in Computer Science, Information Technology, or related field. Perks & Benefits: Competitive salary with performance-based interim hikes. Comprehensive corporate group medical insurance for employees. Supportive, inclusive, and employee-friendly work culture.
Data Analyst/bi Developer
Milestone Technologies
Data Analyst/BI Developer Location: Hyderabad, India Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure, and services to drive specific business outcomes, including digital transformation, innovation, and operational agility. With a culture focused on building an employee-first, performance-based environment, Milestone has a history of supporting category-defining enterprise clients. We provide solutions in Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. For over 25 years, Milestone has been at the forefront of transforming the IT industry, applying best practices to deliver both short-term and long-term value to clients. By utilizing Intelligent Automation, we help businesses accelerate their IT transformation while improving operational efficiency. With a team of over 3,000 employees serving 200+ companies worldwide, we are committed to delivering innovation and improving productivity in business operations. Job Overview Milestone is seeking a talented and dynamic Data Analyst/BI Developer to join our team. This role involves developing and maintaining interactive dashboards and reports, optimizing SQL queries, and designing data models to support business needs. The ideal candidate will have a strong background in Tableau, SQL, and Power Apps, and will be responsible for transforming business requirements into technical solutions while ensuring data quality and integrity. Responsibilities: Develop and maintain interactive dashboards and reports using Tableau (strong experience required). Write and optimize SQL queries to extract, transform, and load (ETL) data from various sources. Design and implement data models and databases to support business needs. Work with cross-functional teams to understand business requirements and translate them into technical solutions. Create and manage Power Apps to automate workflows and improve business processes. Perform data validation to ensure data quality and integrity. Provide training and support to end-users on data tools and applications. Stay updated with the latest trends and best practices in data analytics and visualization. Qualifications: Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field. 7+ years of proven experience with Tableau for data visualization. 5+ years of strong proficiency in MS SQL Server and experience with relational databases. 2+ years of experience with Power Apps for creating business applications. Excellent problem-solving skills and attention to detail. Strong communication and interpersonal skills. Ability to work independently and as part of a team. Experience with other data tools and technologies is a plus. At Milestone, we empower our employees to achieve their full potential in a collaborative and inclusive environment. As a Data Analyst/BI Developer, you will have the opportunity to work on innovative data solutions, enhance business decision-making, and drive meaningful change. Join us and be part of a dynamic team that is revolutionizing the way IT is deployed worldwide. Qualification : Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
Database Management Specialist
Iqvia
Database Management Specialist Location: Hyderabad Job Overview: The Database Management Specialist will design or modify database designs to solve processing issues, ensuring that the databases meet operational standards and performance levels. The role involves database administration, analysis, tuning, and support, contributing to the overall efficiency and reliability of the production environment. Key Responsibilities: Database Design & Modifications: Design or modify database systems to address database processing problems, taking into account computer equipment capacity, limitations, operating time, and desired outcomes. Database Analysis & Design: Perform database analysis and design tasks, ensuring the production environment operates smoothly. Participate in database consultations and design reviews to enhance system performance and reliability. Performance Monitoring & Optimization: Ensure that databases meet required performance metrics, including reliability, response time, and query execution time. Administer, monitor, tune, and support databases in the production environment to optimize performance. Backup & Recovery Strategies: Develop and implement effective backup and recovery strategies to safeguard data and ensure minimal disruption in case of system failures. Data Integrity & Security: Ensure the enforcement of referential integrity and database security. Handle tasks like denormalization, data archival schemes, and the creation of data definition languages and database objects. Qualifications: Education: Bachelor s Degree in Computer Science, a related field, or equivalent experience. Experience: Two (2) years of information technology experience. At least one (1) year of experience in database administration. Skills & Competencies: Ability to proactively identify complex database-related problems and develop effective solutions. Strong understanding of database performance tuning and optimization techniques. Knowledge of backup, recovery, and security strategies for databases. Experience in denormalization, data archival, and referential integrity enforcement. This role is ideal for a professional with hands-on experience in database administration who is looking to contribute to a high-performing team in a dynamic environment. If you have the required skills and are eager to make a significant impact, we invite you to apply for this exciting opportunity. Qualification : Bachelors Degree in Computer Science, a related field, or equivalent experience.
Senior Data Engineer
Zessta Software Services Pvt.ltd.
Job Title: Senior Data Engineer Company Name: Zessta Job Type: Full-time Responsibilities: Analyze customer data to enhance customer experience and provide actionable insights. Build and maintain integrations to support advanced data science workflows, ensuring seamless interaction with the Product API. Actively participate in onboarding and training clients on how to use the product effectively. Provide insights into client-to-business interactions, ensuring that the data can be leveraged for strategic decisions. Act as a liaison between the client and the organization, ensuring both parties' needs and expectations are met. Identify opportunities for clients to expand their usage of the product, driving engagement and long-term value. Address customer complaints and requests, offering product support to improve overall satisfaction and experience. Skills and Experience: Excellent communication and interpersonal skills to work effectively with clients and internal teams. Strong understanding of data modeling and architecture. Hands-on experience with data integrations and data pipelining tools to connect systems and enable smooth data flow. Proficiency in programming languages, preferably Python or R, to process and analyze data. Experience with container orchestration platforms like Docker and Kubernetes. Familiarity with distributed computing frameworks such as Spark, Hadoop, and Dask to handle large-scale data processing. Experience with version control software such as Git to manage code and collaborate with teams. Knowledge of project management tools such as JIRA to track and manage project progress and tasks. Familiarity with tools like Figma and Mixpanel is a plus. Education and Experience: Bachelor s or Master s degree from premier institutes (preferred). 4-12 years of relevant experience in data engineering, data science, or related fields. What We Offer: Competitive salary and benefits package. Opportunities for career growth and skill development. The chance to work on cutting-edge technologies and impactful projects. If you have a passion for data engineering and improving customer experience, and you're ready to take on new challenges, we'd love to hear from you. Apply now to join our team at Zessta and contribute to driving innovation and business success! Qualification : Bachelors or Masters degree from premier institutes (preferred).
Data Engineer-data Platforms
International Business Machines Corporation
Introduction In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients globally. Our centers provide locally-based skills and technical expertise to drive innovation and the adoption of new technologies. A career at IBM Consulting involves building long-term relationships and collaborating closely with clients across industries. You'll work alongside visionaries to help them on their hybrid cloud and AI journeys, enhancing the value and impact of some of the most innovative companies in the world. With access to IBM s strategic partner ecosystem and cutting-edge technology platforms, including IBM Software and Red Hat, you will be empowered to accelerate client transformations and create meaningful change. Curiosity and a constant quest for knowledge serve as the foundation for success at IBM. In your role, you'll be encouraged to challenge the status quo, explore ideas beyond your current role, and come up with creative solutions that will make a significant impact across a wide network of clients. Our culture of evolution and empathy is centered on long-term career growth and development opportunities in an environment that celebrates your unique skills and experience. Your Role and Responsibilities As a Data Engineer at IBM, you will be a critical player in designing and developing applications, while also providing guidance to project teams on complex coding, troubleshooting, and execution. Your key responsibilities include: Solution Design and Construction: Lead the design and construction of new data solutions using the latest technologies, ensuring business value and meeting user requirements. Continuous Improvement: Advocate for continuous improvement by testing solutions and working within an Agile framework to enhance and iterate the developed solutions. Innovation: Stay current with the latest technology trends, discovering and implementing creative solutions to solve business problems. Collaboration: Work with diverse teams to deliver impactful data solutions while ensuring scalability, quality, and performance. Required Education Bachelor s Degree in a relevant field Required Technical and Professional Expertise Apache Spark (PySpark): In-depth knowledge of Spark s architecture, core APIs, and using PySpark for distributed data processing. Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts. Proficiency in Python: Expertise in Python programming, particularly focused on data processing and manipulation. Data Processing Frameworks: Experience with Pandas, NumPy, and other data processing libraries. SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation. Cloud Platforms: Experience working with cloud platforms such as AWS, Azure, or GCP, including working with cloud storage systems. Preferred Technical and Professional Experience Architecture Strategy: Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring of data solutions. Cross-Team Collaboration: Partnering with technology teams, including application development, enterprise architecture, testing services, and network engineering. Security: Familiarity with detection and prevention tools for company products and customer-facing platforms. How You ll Grow At IBM, we offer opportunities for career development and provide an environment where you are encouraged to continuously grow, learn, and expand your expertise. Working with cutting-edge technologies and a diverse set of clients, you will be able to stay ahead of industry trends and make meaningful contributions that have a real impact. About IBM Consulting IBM Consulting helps organizations tackle their most pressing challenges through innovative and agile solutions. By partnering with clients, we drive technology transformations, helping them optimize their operations and leverage new technologies like AI, cloud, and data. Our team s expertise spans across many industries, delivering solutions that enable clients to navigate digital transformations. This role offers an exciting opportunity to work with leading technologies while contributing to client success in a highly dynamic environment. If you re passionate about solving complex data problems and delivering impactful solutions, IBM Consulting is the place to grow your career. Qualification : Bachelors Degree in a relevant field
Ai/ml Developer
Infor
Summary: As an AI/ML Developer, you ll play a pivotal role in creating and delivering cutting-edge enterprise applications and automations using Infor s AI, RPA, and OS platform technology. Your mission will be to identify innovative use cases, develop proof of concepts (PoCs), and deliver enterprise automation solutions that elevate workforce productivity and improve business performance for our customers. Title: Software Engineer Experience: 2-5 years. Skill: AI/ML, Python, AWS, SQL Location: Hyderabad Key Responsibilities: Use Case Identification: Dive deep into customer requirements and business challenges. Identify innovative use cases that can be addressed through AI/ML solutions. Data Insights: Perform exploratory data analysis on large and complex datasets. Assess data quality, extract insights, and share findings. Data Preparation: Gather relevant datasets for training and testing. Clean, preprocess, and augment data to ensure suitability for AI tasks. Model Development: Train and fine-tune AI/ML models. Evaluate performance using appropriate metrics and benchmarks, optimizing for efficiency. Integration and Deployment: Collaborate with software engineers and developers to seamlessly integrate AI/ML models into enterprise systems and applications. Handle production deployment challenges. Continuous Improvement: Evaluate and enhance the performance and capabilities of deployed AI products. Monitor user feedback and iterate on models and algorithms to address limitations and enhance user experience. Proof of Concepts (PoCs): Develop PoCs to validate the feasibility and effectiveness of proposed solutions. Showcase the art of the possible to our clients. Collaboration with Development Teams: Work closely with development teams on new use cases. Best Practices and Requirements: Collaborate with team members to determine best practices and requirements. Innovation: Contribute to our efforts in enterprise automation and cloud innovation. Key Requirements: Experience: A minimum 3 years of hands-on experience in implementing AI/ML models in enterprise systems. AI/ML Concepts: In-depth understanding of supervised and unsupervised learning, reinforcement learning, deep learning, and probabilistic models. Programming Languages: Proficiency in Python or R, along with querying languages like SQL. Data Handling: Ability to work with large datasets, perform data preprocessing, and wrangle data effectively. Cloud Infrastructure: Experience with AWS Sagemaker or Azure ML for implementing ML solutions is highly preferred. Frameworks and Libraries: Familiarity with scikit-learn, Keras, TensorFlow, PyTorch, or NLTK is a plus. Analytical Skills: Strong critical thinking abilities to identify problems, formulate hypotheses, and design experiments. Business Process Understanding: Good understanding of business processes and how they can be automated. Domain Expertise: Familiarity with Demand Forecasting, Anomaly Detection, Pricing, Recommendation, or Analytics solutions. Global Project Experience: Proven track record of working with global customers on multiple projects. Customer Interaction: Experience facing customers and understanding their needs. Communication Skills: Excellent verbal and written communication skills. Analytical Mindset: Strong analytical and problem-solving skills. Collaboration: Ability to work independently and collaboratively. Educational Background: Bachelor s or Master s degree in Computer Science, Mathematics, Statistics, or a related field. Specialization: Coursework or specialization in AI, ML, Statistics & Probability, Deep Learning, Computer Vision, or NLP/NLU is advantageous. About Infor: Infor is a global leader in business cloud software products for companies in industry specific markets. Infor builds complete industry suites in the cloud and efficiently deploys technology that puts the user experience first, leverages data science, and integrates easily into existing systems. Over 60,000 organizations worldwide rely on Infor to help overcome market disruptions and achieve business-wide digital transformation.
Senior Data Engineer
Omniwyse Technologies
Job Description We are looking for a passionate engineer interested in working at an early-stage startup building innovative cloud-native data protection solutions. The ideal candidate must be comfortable learning and scoping business requirements to develop effective solutions. This is a great opportunity for engineers who are eager to step out of their comfort zone and solve impactful modern data security concerns. Desired Background and Experience: Must be a problem solver with the ability to think critically and creatively. Minimum of 8 years of experience building products using Java and/or Python. Prior experience in startups is a huge plus. Comfortable with rapid prototyping and implementation of products in an agile team environment. Data engineering experience with implementation of data ingestion, ETL, data pipeline/workflows. Experience implementing database views and UDFs to control access to data using row and column filters. Working experience in databases and data warehouses. Proficient in one or more of the following: AWS RDS, AWS Data Lake, Redshift, Athena, Databricks, and Snowflake. Experience implementing data solutions using Spark. Ability to write and tune complex SQL queries.
Data Engineer
Wallero Technologies
Job Description Location: Hyderabad, Telangana, India Job Type: Permanent (full-time) Experience: 6+ years No. of Openings: 2 Key Responsibilities: Tech Stack Expertise: Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. Innovative Problem-Solving: Demonstrate technical expertise by thinking creatively and providing innovative solutions to complex data-related challenges, pushing boundaries in Supply Chain data analytics. Communication Skills: Exceptional communication abilities to effectively convey technical concepts, collaborate with cross-functional teams, and articulate solutions to non-technical stakeholders. Autonomous Work: Ability to work independently and proactively, taking ownership of projects, and delivering high-quality solutions with minimal supervision. Guidance and Best Practices: Lead the team by setting coding standards, advocating for reusable and modularized code, implementing design patterns, and guiding on best practices in data engineering. Perks and Benefits: Strong expertise in Python, Pyspark, and Databricks, with hands-on experience in developing and optimizing data pipelines for complex data transformations. Exceptional problem-solving skills, with a demonstrated ability to think creatively and develop innovative solutions for data-related issues. Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders. Self-driven and autonomous work style, capable of taking ownership of projects and delivering high-quality results independently. Experience in guiding and mentoring teams on coding standards, design patterns, and best practices in data engineering.
AI/ML Developer
Infor
Position: AI/ML Developer Company: Infor Location: Hyderabad, India Experience: 2-5 years Skills: AI/ML, Python, AWS, SQL Role Summary: As an AI/ML Developer at Infor, you will be at the forefront of creating and delivering state-of-the-art enterprise applications and automation solutions powered by Infor s AI, RPA, and OS platform technologies. Your primary mission will be to identify impactful AI/ML use cases, develop proof of concepts (PoCs), and deliver automation solutions that drive workforce productivity and enhance business outcomes for our clients. Key Responsibilities: Use Case Identification: Work closely with customers to understand their business challenges and identify opportunities for AI/ML solutions to address these needs. Data Insights: Perform exploratory data analysis on large, complex datasets to uncover key insights. Assess data quality and share findings that can inform decision-making. Data Preparation: Collect, clean, preprocess, and augment datasets for training and testing AI models, ensuring they are ready for AI tasks. Model Development: Design, train, and fine-tune AI/ML models, evaluating them against appropriate performance metrics and optimizing for maximum efficiency. Integration & Deployment: Partner with software engineers to integrate AI/ML models seamlessly into enterprise applications and systems. Address deployment challenges to ensure smooth production workflows. Continuous Improvement: Monitor the performance of deployed AI models, gather user feedback, and iterate to improve models, algorithms, and user experience. Proof of Concepts (PoCs): Develop PoCs to demonstrate the feasibility and effectiveness of AI/ML solutions, showcasing the potential of new technologies to clients. Collaboration: Work closely with development teams to explore and implement new use cases for AI and automation. Best Practices: Collaborate with your team to establish best practices and ensure high-quality development standards. Innovation: Contribute to the innovation of cloud-based enterprise automation solutions and the development of cutting-edge AI technologies. Key Requirements: Experience: Minimum 3 years of hands-on experience in implementing AI/ML models in enterprise environments. AI/ML Knowledge: Strong understanding of supervised and unsupervised learning, reinforcement learning, deep learning, and probabilistic models. Programming Skills: Proficiency in Python or R, with experience in SQL for querying databases. Data Handling: Expertise in working with large datasets, performing data preprocessing, and effectively managing data pipelines. Cloud Infrastructure: Experience with AWS Sagemaker or Azure ML is preferred for deploying machine learning solutions. Frameworks & Libraries: Familiarity with machine learning libraries like scikit-learn, Keras, TensorFlow, PyTorch, or NLTK is a plus. Analytical Skills: Strong critical thinking and problem-solving abilities, with the capacity to design and run experiments to validate hypotheses. Business Process Understanding: Knowledge of business processes and how they can be automated through AI and ML. Domain Expertise: Experience or interest in areas like Demand Forecasting, Anomaly Detection, Pricing, Recommendations, or Analytics. Global Experience: Proven experience in working with global customers on diverse projects, understanding their needs, and delivering tailored solutions. Communication Skills: Excellent verbal and written communication skills, with the ability to clearly explain complex AI concepts to clients and team members. Collaboration & Independence: Ability to work both independently and as part of a team, collaborating with cross-functional teams to drive success. Educational Background: A Bachelor's or Master's degree in Computer Science, Mathematics, Statistics, or a related field. Specialization: Coursework or expertise in AI, ML, Deep Learning, NLP/NLU, Computer Vision, or similar domains is highly desirable.
Senior Sde - M365 Security Engineering
Microsoft
Overview If so, the M65 Security Engineering at Microsoft have a great opportunity for you. We are looking for candidates to work on solutions that protect Microsoft services against cyberattacks. We are a team that values diversity of multiple fronts and believes in deep collaboration bringing the best side of technology. Our team consists of engineers with expertise in large-scale software systems, security analysis, big data, and machine learning. We delight in digging in deep to analyse the billions of events and terabytes of data generated each day by all Microsoft products and services (e.g., Azure, M365) services for evidence of suspicious activities. We ensure that critical security components are present throughout the infrastructure powering these services and that these components are kept up to date. Qualifications Required Qualifications: 8+ years of professional software engineering experience designing, building, and running cloud services at large scale in C#, .Net or any high-level programming language. Excellent coding skills, strong understanding in OOPS, design patterns and their application. Self-learner with passion for technologies. Must know Secure by Design principles. Outstanding ability to both work independently and coordinate across geographies. Outstanding ability to communicate complex ideas and concepts to a variety of cross-group stakeholders. Strong organization skills, a bias for action, and ability to deliver results. Proven ability to deal with ambiguity and drive for clarity. Excellent ability to work efficiently, prioritize workflow, ramp quickly, and meet demanding deadlines. Outstanding communication skills and collaboration capabilities. Self-learner with passion for technologies. Able to deep dive in complex areas and self-drive. Preferred Qualifications: Proficient working knowledge of cloud-computing environments like Microsoft Azure, AWS, GCP - Azure preferred. Hands on experience in an object-oriented programming language such as C#, Java or Scala. Strong software design and problem-solving skills. Experience with modern software services engineering practices such as testing in production, live monitoring, data driven engineering. Rapid prototyping and iteration skills the next line. Experience with web service development and familiar with related technologies. Basic automation scripting skills with PowerShell and developing modules. Experience building and shipping production grade software or services. Experience using agile methodologies or test-driven development (TDD) Rapid prototyping and iteration skills. Background Check: Ability to meet Microsoft, customer and/or Government security screening requirements are required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud background check: This position will be required to pass the Microsoft Cloud background check upon higher/transfer and every 2 years they are after. Microsoft is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, gender, sexual orientation, gender identity or expression, religion, national origin, middle status, age, disability, veteran status, genetic information, or any other protected status. Our Culture: Growth mindset we practice a learn it all vs a know-it-all attitude. Wins are cheered, failures are celebrated and viewed as learning opportunities. Candour we believe in transparency and receiving and providing regular constructive feedback across the hierarchy. Diverse and Inclusive every voice matters and is appreciated. This is a safe environment where you can express yourself without fear of retribution. Leadership oriented each of us are leaderswho strive to create clarity, generateenergy,and deliver success.We believe in leading withempathy,trust,andcontext rather than control. Responsibilities Write well designed code with an emphasis on quality, maintainability, scalability, and performance. Analyse security threats to M365 and build monitoring components to address those threats. Solid understanding of Design and implement to enable real time, highly scalable, performant, and sustainable solutions. Deliver automated and well-tested features across different services and platforms. Use engineering best practices throughout the software development lifecycle to establish maintainable, reliable, and secure systems. Collaborate with teammates in various roles to plan and execute on key deliverables. Work in a culture of continuous improvement, adaptation, reflection, and growth. Learn quickly from your peers, projects, and interactions with customers. Provide on call support and monitor the health of services in production as part of DevOps culture. Execute the Dev-Sec-Ops approach to software delivery by designing, coding, testing, deploying and operating components of Microsoft 365 security monitoring system.
Big Data Platform Automation Engineer/senior Software Engineer
Hsbc
About HSBC If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you're aiming to reach the top or seeking an exciting new direction, HSBC offers opportunities, support, and rewards to take you further. As one of the largest banking and financial services organizations globally, with operations across 64 countries and territories, HSBC is committed to enabling businesses to thrive, economies to prosper, and ultimately, helping people fulfill their ambitions. The Role We are seeking an experienced Senior Software Engineer to join our team. You will become part of HSBC s Data Provisioning Technologies team, responsible for managing and working on the cutting edge of CDP (Cloudera Data Platform) and ODP (Open Data Platform) platforms. As part of one of the largest Big Data estates in the banking industry, you will be instrumental in creating engineering solutions for Hadoop platform pipelines and utilizing industry-leading cloud technologies. Responsibilities Contribute to Hadoop Engineering tasks, developing solutions for data pipeline management on CDP/ODP platforms. Work with Python, Ansible, and Kubernetes to create scalable, efficient solutions within a Big Data environment. Collaborate with the Data/Analytics teams to ensure the smooth operation of data systems and platforms. Design and implement technical solutions while adhering to best practices for CI/CD, DevOps, and GitOps methodologies. Develop and support solutions utilizing cloud technologies, ensuring the scalability and robustness of platforms. Contribute to debugging, troubleshooting, and maintaining the high-quality performance of data systems. Utilize Shell scripting, YAML, and modern automation tools to improve deployment and operational efficiency. Work with GitHub, Jenkins, Ansible for version control, continuous integration, and deployment. Requirements To be successful in this role, you should meet the following requirements: 3-6 years of experience in Hadoop Engineering with practical expertise in Python, Ansible, and DevOps methodologies. Strong knowledge of HDP (Hadoop Distribution), CDP, Linux, Python, Ansible, and Kubernetes. Proficient in Shell scripting, YAML, and technical design. Strong understanding of CI/CD concepts and hands-on experience with tools like GitHub, Jenkins, and Ansible. Familiarity with Test automation tools such as JUnit, Selenium, and Cucumber. Experience with industry-leading Cloud technologies and hands-on development in cloud environments. Working knowledge of GitOps and DevSecOps principles. Knowledgeable in Agile methodologies and ideally, certified in one of the frameworks. Strong communication and networking skills, with the ability to collaborate across teams. Ability to work autonomously, take accountability, and drive results in a high-pressure environment. A strong commitment to high-quality standards, and ownership of individual contributions. You ll have the opportunity to work on innovative projects at the forefront of the banking industry. A global platform with exposure to diverse teams and technologies. Join a company committed to professional development and career growth. Achieve more when you join HSBC. Qualification : 3-6 Years Experience in Hadoop Engineering with working experience on Python, Ansible DevOps methodologies.
Software Developer _ Ai/ml
Ibm India
Introduction At IBM, work is more than a job it s a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you ve never thought possible. Are you ready to lead in this new era of technology and solve some of the world s most challenging problems? If so, lets talk. Your Role and Responsibilities We re looking for software development candidates that want to turn ideas into reality, focus on innovation and development in our modernization journey. Our Strategic Product Development team creates and delivers exciting product features that impact the business to be successful. You ll work alongside global and local multidisciplinary teams of Developers, Architects and Analysts focused on the next generation of solutions. Do you enjoy working and thrive in a Challenging yet collaborative team environment? Passionate about technology and software? You have extremely strong analytical, problem-solving and troubleshooting skills? If so, you ll fit right in with our team. You employ creative thinking and collaboration as the foundation of your daily approach towards our Product development team. At IBM, job is more than work! It offers you thrive on career as well as on skills to be latest with a perfect work-life balance. Required Technical and Professional Expertise 2 10 years of relevant industry experience in Artificial Intelligence and Machine Learning Platforms with specialization in Generative AI. Solid experience of Python Programming Language. Experience with Large Language Models and Natural Language Processing Familiarity with the Pytorch framework Experience with software development lifecycle Excellent problem determination skills Excellent written and oral communication skills Excellent organizational skills Preferred Technical and Professional Expertise Design experience for supporting new requirements. Willingness to learn new skills and technologies. Experience using git and github Familiarity with Node.js and creating VS Code extensions Flexible to work between development/test/support roles. Knowledge on other programming languages (C/C++, Java, Open-Source Programming Languages) is added advantage.
Senior Data Devops - Mlops Expertise
Epam Systems
We are seeking a skilled and driven Senior Data DevOps Engineer with strong MLOps expertise to join our team. The ideal candidate will have a deep understanding of data engineering, automation in data pipelines, and operationalizing machine learning models. The role requires a collaborative professional capable of designing, deploying, and managing scalable data and ML pipelines that align with business goals. #LI-DNI#EasyApply Responsibilities Develop, deploy, and manage CI/CD pipelines for data integration and machine learning model deployment Implement and maintain infrastructure for data processing and model training using cloud-based tools and services Automate data validation, transformation, and workflow orchestration processes Collaborate with data scientists, software engineers, and product teams to ensure seamless integration of ML models into production Optimize model serving and monitoring to enhance performance and reliability Maintain data versioning, lineage tracking, and reproducibility of ML experiments Proactively identify opportunities to improve deployment processes, scalability, and infrastructure resilience Ensure robust security measures are in place to protect data integrity and compliance with regulations Troubleshoot and resolve issues across the data and ML pipeline lifecycle Requirements Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field 4+ years of experience in Data DevOps, MLOps, or related roles Strong proficiency in cloud platforms such as Azure, AWS, or GCP Experience with Infrastructure as Code (IaC) tools like Terraform, CloudFormation, or Ansible Expertise in containerization and orchestration technologies (e.g., Docker, Kubernetes) Hands-on experience with data processing frameworks (e.g., Apache Spark, Databricks) Proficiency in programming languages such as Python, with knowledge of data manipulation and ML libraries (e.g., Pandas, TensorFlow, PyTorch) Familiarity with CI/CD tools (e.g., Jenkins, GitLab CI/CD, GitHub Actions) Experience with version control tools (e.g., Git) and MLOps platforms (e.g., MLflow, Kubeflow) Strong understanding of monitoring, logging, and alerting systems (e.g., Prometheus, Grafana) Excellent problem-solving skills and the ability to work independently and as part of a team Strong communication and documentation skills Nice to have Experience with DataOps concepts and tools (e.g., Airflow, dbt) Knowledge of data governance and tools like Collibra Familiarity with Big Data technologies (e.g., Hadoop, Hive) Certifications in cloud platforms or data engineering We offer Opportunity to work on technical challenges that may impact across geographies Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications Opportunity to share your ideas on international platforms Sponsored Tech Talks & Hackathons Unlimited access to LinkedIn learning solutions Possibility to relocate to any EPAM office for short and long-term projects Focused individual development Benefit package: Health benefits Retirement benefits Paid time off Flexible benefits Forums to explore beyond work passion (CSR, photography, painting, sports, etc.) Qualification : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field
Manager Of Software Engineering
Jpmorganchase
This is your chance to change the path of your career and guide multiple teams to success at one of the world's leading financial institutions. As a Manager of Software Engineering at JPMorgan Chase within the Consumer and Community Banking, Digital Tech Team, youlead multiple teams and manage day-to-day implementation activities by identifying and escalating issues and ensuring your team s work adheres to compliance standards, business requirements, and tactical best practices. Job responsibilities Manage engineering teams and be responsible for the technology delivery of the product priorities. A strong technical focus on building the right thing in the right way to enable high quality solutions that meet customers' needs Engage with business stakeholders to break down complex and ambiguous problems into technical design that an engineering team can implement under your guidance Champion engineering practices; Improve the effectiveness of the Engineering teams through coaching, mentoring and resolution of impediments Partner with leadership team for driving NFR, Modernization initiatives and controls Influence peer leaders and senior stakeholders across the business, product, and technology teams Ensure successful collaboration across teams and stakeholders Identify and mitigates issues to execute a book of work while escalating issues as necessary Provides input to leadership regarding budget, approach, and technical considerations to improve operational efficiencies and functionality for the team Creates a culture of diversity, equity, inclusion, and respect for team members and prioritizes diverse representation Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 5+ years applied experience Experience leading technology projects Experience managing technologists Proficient in automation and continuous delivery methods Proficient in all aspects of the Software Development Life Cycle Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security Experience with hiring, developing, and recognizing talent Experience working at code level Expertise with NoSQL databases (Cassandra, MongoDB, etc.) Proficiency in multiple modern programming languages including Java, Spring, Spring Boot, Kafka and Spark Experience inAgile development and good understanding of SDLC methodologies/guidelines Preferred qualifications, capabilities, and skills Experience in Flink Experience in working with cloud native applications, AWS patterns and services for big data processing, stream processing, application serving Experience in working with high through put and scalable messaging technologies like Kafka, Kinesis Qualification : Proficiency in multiple modern programming languages including Java, Spring, Spring Boot, Kafka and Spark
Data Scientist
Sanofi
Job title: Data Scientist Location : IN / Hyderabad About the job An exciting opportunity to join our risk-based monitoring team. Risk-based monitoring (RBM) is an adaptive approach to clinical trial monitoring that directs focus and activities to critical data and processes that have the most potential to impact patient safety and data quality. In this context, the RBM team is responsible for designing, executing, and optimizing the Sanofi RBM approach to align with regulatory requirements and Sanofi's objective to drive quality, efficiency, and speed of clinical trials. The D ata Scientist (DS) is responsible for setting up and refreshing the RBM application for assigned studies, ensuring a seamless data flow, and configuring the system to meet RBM specifications and industry standards. You will work closely with Central Monitors and study Lead DS together to delivery RBM activities. If you are passionate about leveraging data to drive excellence in clinical trials, this is the opportunity for you. Main responsibilities: Data Extraction and Processing:Extract data from various systems and ensure it is preprocessed correctly, supporting the accuracy and reliability of our monitoring processes.. Dashboard Management:You will be in charge of setting up and updating KRI, DQA, QTL, and SPOT dashboards with precision and within the set timelines, adhering to established processes and standards. Script Execution and Updates:Execute SAS or Python scripts, updating parameters as required to meet the specific needs of each study. Collaborative Problem Solving:Provide a clear explanation of results and signals, working closely with Central Monitors and Lead Data Scientists to deliver effective RBM activities. About you Experience: Experience in a Clinical Research environment (CRO or Pharma). Experience in clinical data programming (SAS, Python, R, ) Soft and technical skills: Learns and adapts quickly when facing new problems. Think critically and use rigorous, objective, and pragmatic methods to solve multidimensional problems with effective and timely solutions. Good at SAS programming skills, it s better be able to develop from scratch. Execute Python script with updating parameters based on studies. Understand clinical trial-related documents with basic clinical knowledge, e.g., Protocol, SDS, CRF. Good interpersonal, communication, and negotiation skills (verbal and written). Able to acquire and apply new technical skills. Education: Bachelor s degree or above, preferably in a life science or mathematics-related area (e.g., computer sciences) Languages: Strong English skills (verbal and written), ability to exchange fluently in a global environment. Bring the miracles of science to life alongside a supportive, future-focused team. Discover endless opportunities to grow your talent and drive your career, whether it s through a promotion or lateral move, at home or internationally. Enjoy a thoughtful, well-crafted rewards package that recognizes your contribution and amplifies your impact. Take good care of yourself and your family, with a wide range of health and wellbeing benefits including high-quality healthcare, prevention and wellness programs and at least 14 weeks gender-neutral parental leave. An international work environment, in which you can develop your talent and realize ideas and innovations within a competent team A team that drives the innovation of the monitoring activities that align with future need W e believe that a Data Scientist is not just a job title; it's a role that embodies innovation, curiosity, and the power to transform data into actionable insights. You are the architects of our data-driven future, equipped with the latest technologies and a supportive environment that fosters growth and collaboration. Qualification : Bachelors degree or above, preferably in a life science or mathematics-related area (e.g., computer sciences)
Data Modeler
Gspann
Position Title: Data Modeler Location: Hyderabad Department: Data & Analytics Experience Required: 4+ Years Employment Type: Full-Time Company: GSPANN Technologies Job Description: GSPANN is seeking a highly skilled and detail-oriented Data Modeler to join our Hyderabad team. In this role, you will be responsible for developing and optimizing conceptual, logical, and physical data models that support business intelligence and decision-making processes. You will work closely with business stakeholders and technical teams to turn complex data into meaningful insights. Roles and Responsibilities: Translate business requirements into well-structured data models. Design and implement conceptual, logical, and physical data models for enterprise applications. Collaborate with cross-functional teams including data engineers, analysts, and business users. Ensure data integrity and consistency across various data sources and systems. Use data modeling tools (e.g., ERwin, ER/Studio) to document metadata and relationships. Participate in data profiling, analysis, and cleansing initiatives. Provide technical leadership on data structure standards and best practices. Support data governance, cataloging, and quality assurance efforts. Work in Agile environments and contribute to sprint planning and execution. Required Skills and Experience: Bachelor s or Master s degree in Computer Science, Information Technology, or related field. 4+ years of experience in data modeling (relational, dimensional, or NoSQL). Hands-on experience with tools such as ERwin, ER/Studio, or equivalent. Strong SQL skills and ability to handle large datasets. Experience with RDBMS systems (e.g., Oracle, SQL Server, PostgreSQL). Familiarity with cloud data platforms such as AWS, GCP, or Azure. Strong analytical skills and attention to detail. Excellent communication and stakeholder management skills. Nice to Have: Experience with Snowflake, BigQuery, or Redshift. Exposure to ETL tools and data pipeline development. Knowledge of metadata and data lineage tools. Experience in domains such as retail, healthcare, or finance. Be part of a forward-thinking company at the cutting edge of data and digital transformation. Work in a collaborative environment that encourages learning and growth. Gain exposure to global projects and next-gen technologies. Qualification : Bachelors or Masters degree in Computer Science, Information Technology, or related field.
Data Governance Developer
Kanerika Software
Job Title: Data Governance Developer Job Location: Hyderabad Job Description As a Data Governance Developer, you will be responsible for setting up, managing, and optimizing our data governance frameworks, primarily leveraging Microsoft Purview. Your role will involve integrating various data sources, ensuring robust metadata management, and implementing compliance policies to maintain data quality, security, and accessibility across the enterprise. Key Responsibilities: Set up and manage Microsoft Purview accounts, collections, and access controls (RBAC). Integrate Purview with diverse data sources, including Azure Data Lake, Synapse, SQL DB, Power BI, and Snowflake. Schedule and monitor metadata scanning and classification jobs. Implement and maintain collection hierarchies aligned with data ownership. Design metadata ingestion workflows for technical, business, and operational metadata. Enrich data assets with business context: descriptions, glossary terms, tags. Synchronize metadata across tools using REST APIs, PowerShell, or ADF. Validate end-to-end lineage for datasets and reports (ADF Synapse Power BI). Resolve lineage gaps or failures using mapping corrections or scripts. Perform impact analysis to support downstream data consumers. Create custom classification rules for sensitive data (PII, PCI, PHI). Apply and manage Microsoft Purview sensitivity labels and policies. Integrate with Microsoft Information Protection (MIP) for DLP. Manage business glossary in collaboration with domain owners and stewards. Implement approval workflows and term governance. Conduct audits for glossary and metadata quality and consistency. Automate Purview operations using: PowerShell, Azure Functions, Logic Apps, REST APIs Build pipelines for dynamic source registration and scanning. Automate tagging, lineage, and glossary term mapping. Enable operational insights using Power BI, Synapse Link, Azure Monitor, and governance APIs. Tools & Technologies: Microsoft Purview, Collibra, Atlan, Informatica Axon, IBM IG Catalog Experience in Microsoft Purview areas: - Label creation and policy management Publish/Auto-labeling Data Loss Prevention & Compliance handling Compliance Manager, Communication Compliance, Insider Risk Management Records Management, Unified Catalog, Information Barriers eDiscovery, Data Map, Lifecycle Management, Compliance Alerts, Audit DSPM, Data Policy Requirements 4 6 years of experience in data governance or data management. Strong experience in Microsoft Purview and Informatica governance tools. Proficient in tracking and visualizing data lineage across systems. Familiar with Azure Data Factory, Talend, dbt, and other integration tools. Understanding of data regulations: GDPR, CCPA, SOX, HIPAA. Ability to translate technical data governance concepts for business stakeholders. Benefits Employee Benefits Culture: Open Door Policy: Encourages open communication and accessibility to management. Open Office Floor Plan: Fosters a collaborative and interactive work environment. Flexible Working Hours: Allows employees to have flexibility in their work schedules. Employee Referral Bonus: Rewards employees for referring qualified candidates. Appraisal Process Twice a Year: Provides regular performance evaluations and feedback. Inclusivity and Diversity: Hiring practices that promote diversity: Ensures a diverse and inclusive workforce. Mandatory POSH training: Promotes a safe and respectful work environment. Health Insurance and Wellness Benefits: GMC and Term Insurance: Offers medical coverage and financial protection. Health Insurance: Provides coverage for medical expenses. Disability Insurance: Offers financial support in case of disability. Child Care & Parental Leave Benefits: Company-sponsored family events: Creates opportunities for employees and their families to bond. Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child. Family Medical Leave: Offers leave for employees to take care of family members' medical needs. Perks and Time-Off Benefits: Company-sponsored outings: Organizes recreational activities for employees. Gratuity: Provides a monetary benefit as a token of appreciation. Provident Fund: Helps employees save for retirement. Generous PTO: Offers more than the industry standard for paid time off. Paid sick days: Allows employees to take paid time off when they are unwell. Paid holidays: Gives employees paid time off for designated holidays. Bereavement Leave: Provides time off for employees to grieve the loss of a loved one. Professional Development Benefits: L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development. Mentorship Program: Offers guidance and support from experienced professionals. Job Training: Provides training to enhance job-related skills. Professional Certification Reimbursements: Assists employees in obtaining professional certifications.
1 - 20 of 183 BIG Data Automation in Hyderabad jobs
* No exact matches found. Showing closest results insteadNo results found
Modify search criteria or create an alert to get relevant jobs as soon as they’re posted
1 - 20 of 183