Manager, Data Engineering

Vanguard; Hyderabad; On-site; INR 2,000,000 - 3,000,000; Full time

Benefits offered by this job

Financial wellness programs

Physical wellness benefits

Personal wellness resources

Job summary

Vanguard is looking for a Manager of Data Engineering in Hyderabad, Telangana. The successful candidate will lead a team focused on building and optimizing scalable data pipelines, fostering a high-performance culture while ensuring effective data integration.

This role demands strong leadership, extensive experience in data engineering, and the ability to communicate effectively across diverse teams. Candidates should possess a Bachelor's degree in a related field and substantial experience using Python, AWS, and Agile methodologies.

Qualifications

• Minimum 8 years of relevant work experience, including 5 in leadership.
• Strong experience in managing data engineering teams.
• First-hand experience in building end-to-end data pipelines.

Responsibilities

• Lead a team of data engineers to optimize data pipelines.
• Consult with department heads on implementation plans.
• Manage automation of ETL processes for large data volumes.

Skills

Leadership experience

Data/DataOps Engineering

Communication skills

Python/Pyspark

AWS resource management

SCRUM-AGILE experience

Education

Bachelor's degree in Computer Science, IT, or related field

Tools

Jira

Azure DevOps

Job description

Role Summary

The Manager, Data Engineering is responsible for leading a team of data engineers to design, develop, and optimize scalable data pipelines and infrastructure. This role focuses on enabling high-performance data workflows, ensuring seamless data integration and driving automation to enhance data accessibility.

Core Responsibilities

• Partners with internal and external clients to gain an expert understanding of business functions and informational needs. Works closely with other technical and data analytics experts across the business and external vendors to implement data solutions.
• Hires, evaluates, and supervises crew. Provides guidance and training as necessary to develop crew. Sets performance standards, reviews performance, and makes informed compensation decisions in accordance with all applicable Human Resources policies and procedures.
• Manages and optimizes the automation of key ETL (Extract / Transform / Load) and quality assurance processes for large volumes of data.
• Consults with department or function heads on the implementation, transition, and operating plans. Executes and adjusts plans for team of Data Engineers. Develops a clear understanding of Data Analytics and Management work across Vanguard businesses and how they connect.
• Manages the planning, prioritization, and execution of data production projects and processes.
• Manages and troubleshoots the design and development of software and processes to support large scale, efficient data pipelines. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions. Supports dashboarding efforts, data science and engagement projects, and production support as needed.
• Translates business specifications into design specifications and code. Responsible for writing complex programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
• Develops and exercises cross-functional data delivery to support business needs. Manages data integrity and quality standards.
• Educates and develops junior data engineers on the team while applying quality control to their work. Develops data engineering standards and contributes expertise to other data expert teams across Vanguard.
• Participates in special projects and performs other duties as assigned.

Qualifications and Skills

• Minimum 8 years of relevant work experience, with at least 5 years in a leadership role managing data engineering teams and large-scale data infrastructure.
• Bachelors degree (B.E./B.Tech) in Computer Science, IT, or a related field or Diploma in Data Science/Data Engineering.
• Strong people leadership experience (teams with more than five people would be advantageous)
• Strong Data/DataOps Engineering experience
• Experience in medium to large business that consume large amounts of data
• Excellent communication and storytelling skills; Ability to articulate complex problems in a simple manner.
• First‑hand experience with Python/Pyspark in building end‑to‑end data pipelines
• Understanding DBA concepts; Prior experience working in/with DevOps or Data Engineers teams; Comfortable with DevOps/SRE thinking.
• Knowledge and experience in designing, implementing, deploying and configuring AWS resources;
• Experience with SCRUM‑Agile mindset and implementation tools such as Jira, Azure DevOps
• DataLake, Lakehouse EDW methodologies; Data analysis, data modelling, data integration, data warehousing and database design; AWS Stack
• Understanding of GIT, post/pre‑scripting and CI/CD workflow under TDD using Jira/Azure DevOps
• Support multiple environments (Dev, UAT, Prod) and a strong understanding of SDLC concepts.
• Degree qualified in a relevant commercial, analytical or mathematical discipline or equivalent experience

Location

This role is based in Hyderabad, Telangana at Vanguards India office. Only qualified external applicants will be considered.

Benefits

Vanguard takes the same long‑term view of your success at work and in life with benefits and rewards packages that reflect what you care about, throughout all the phases and stages of your life. Our Total Rewards programs provide you and your loved ones with wellness support for key areas in your life:

Financial wellness We’re committed to enabling your financial success and provide competitive offers and programs.

Physical wellness We’re committed to providing benefits that support your physical health and wellness.

Personal wellness We’re committed to providing resources that help support the full scope of your life.