Senior Manager - Data Engineering (Databricks)

Bread Financial; Bengaluru; Hybrid; INR 4,500,000 - 6,500,000; Full time

Job summary

Bread Financial Group seeks a Senior Manager, Data Engineering to lead a high-impact team responsible for building scalable data infrastructure and guiding a data strategy aligned with business goals.

You will mentor engineers, manage complex initiatives, ensure data quality, and partner with stakeholders to deliver reliable pipelines using SQL, Python, Hadoop, and CDP in a fast-paced environment.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 1 cloud certification (AWS, Azure or Google Cloud).
• 10–13 years of experience in data analysis, cloud data platform architectures and related infrastructure.
• 3+ years of leadership experience.

Responsibilities

• Lead, coach, motivate and guide the team; develop training and career plans.
• Provide continuous feedback and conduct performance evaluations.
• Stay updated on emerging technologies and industry trends to boost efficiency and innovation.
• Analyze source data, perform QA and debug data quality issues using SQL, Hadoop, Spark, Python.
• Act as liaison for Data Engineering with internal and external partners; ensure governance and security policies.
• Prioritize critical initiatives, collaborate with stakeholders to resolve issues and drive consensus.

Skills

Data Engineering

Leadership

People Management

Team Management

Strategic Thinking

Data Governance

Big Data

Cloud Strategy

Education

Bachelor's Degree in Computer Science/Mathematics or related field

Master's Degree in Computer Science/Mathematics or related field

Cloud Certification (AWS/Azure/GCP)

Tools

Apache Hadoop

Cloudera Data Platform (CDP)

Hadoop Distributed File System (HDFS)

Python

SQL

Job description

Job Summary

• The Senior Manager, Data Engineering is a strategic leader responsible for overseeing a Data Engineering team to drive the efficient use of data across the organization. This role involves developing and executing a comprehensive data strategy, ensuring robust and scalable data infrastructure, and aligning data initiatives with business objectives. Key responsibilities include managing complex project timelines, optimizing data systems for performance, and ensuring the reliability of data pipelines. This position requires strong leadership, excellent communication, and problem-solving Skills, with a focus on mentoring and developing talent within the team. The ideal candidate has extensive experience in data engineering, a deep understanding of relevant technologies, and a proven track record in managing diverse teams. This role is crucial in advancing the organization's data capabilities and supporting its strategic goals.

Essential Job Functions

• Lead, Coach, motivate, challenge and provide managerial guidance to the team. Develop and execute training programs and career development plans for the teams and individual associates. Utilize excellent communication Skills to articulate a strategic vision to the team. Solve problems and make decisions with sound judgement. - (20%)
• Provide continuous feedback and completes formal performance evaluations as directed by the organization. Value associate recognition and celebrating the accomplishments of individual team members as well as the overall team. Lead both direct reports and other associates to accomplish company initiatives. - (15%)
• Continuously assess and integrate emerging technologies and industry trends to enhance the data engineering team's efficiency and innovation capabilities. Gain domain knowledge of the data sources and associated business processes ingested by the Data Engineering team. Act as subject matter expert in projects and initiatives throughout the enterprise. - (15%)
• Use various technologies and tools to analyze source data, perform QA analysis and debug possible data quality issues. May use technologies such as SQL, Hadoop, Spark, SAS, R, python, etc. Monitor jobs and data pipelines for possible issues. Understand high-level functionality of many technologies and is able to navigate systems and help identify root causes. - (15%)
• Act as an internal and external-facing liaison for Data Engineering. Ensure data ingestion projects adhere to Bread Financial policies and procedures, such as data governance, information security, data retention, etc. Demonstrates outstanding Verbal and Written Communication Skills when working with internal and external partners. - (10%)
• Prioritize efforts on critical initiatives and works to identify opportunities and problem solve. Utilize critical thinking Skills to help analyze business issues, collaborates with stakeholders to resolve problems and gains consensus on the best solution. - (10%)
• Ensure data security and compliance with relevant regulations (e.g., GDPR, CCPA) and internal policies. Develop and implement data security measures to protect sensitive information. Identify potential risks in data engineering processes and develop strategies to mitigate them, ensuring continuity and reliability of data services. - (15%)

Minimum Qualifications

• Bachelors Degree in Computer Science, Mathematics, related technical field or equivalent practical experience.
• 1 cloud certification- AWS cloud practitioner, Microsoft Azure Fundamentals or Google Cloud- Cloud Digital Leader
• 10-13 years of experience across data analysis, cloud data platform architectures and infrastructure platforms such as Azure or AWS, SQL queries, support of Big Data and Analytics development.
• 3+ years of leadership experience.

Preferred Qualifications

• Masters Degree in Computer Science, Mathematics, or related field of study.
• 13-15 years of Project management, data governance, data management, associate engagement and career planning.
• 5+ years of leadership experience

Skills

• Agile Methodology
• Apache Hadoop
• Cloudera Data Platform (CDP)
• Data Engineering
• Hadoop Distributed File System (HDFS)
• Platform Technologies
• Python (Programming Language)
• Solutions Design
• Structured Query Language (SQL)
• People Management
• Team Management
• Strategic Thinking