Data Engineer, Specialist

Vanguard; Hyderabad; On-site; INR 1,200,000 - 2,500,000; Full time

Job summary

Vanguard's India office in Hyderabad invites a Data Engineer, Specialist to design and maintain scalable data pipelines using Databricks, Python and SQL, aligning data models with business needs and analytics goals.

You will deploy data solutions on AWS/GCP, apply Terraform for infrastructure, ensure security, and collaborate with engineering and business teams to deliver trusted datasets for reporting.

Qualifications

• 5+ years of relevant work experience with data pipelines, ETL, and data modeling.
• Bachelor’s degree in CS/IT or Data Science, Statistics, or related field.
• Hands‑on Databricks experience, including development and deployment.
• Strong programming in Python (FP and OOP).
• Advanced SQL for data processing, transformation, and analytics.
• Experience with AWS and/or GCP cloud platforms; cloud security knowledge
• Infrastructure deployment and automation using Terraform.
• Nice to have: big data tech, cloud data services, relational and NoSQL DBs.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Python, and SQL.
• Manage end-to-end data modeling with business stakeholders.
• Build and optimize data ingestion, transformation, and processing workflows.
• Develop reusable solutions using Python (FP and OOP).
• Deploy and manage data infra and workflows with Terraform and cloud services.
• Work with AWS and/or GCP environments for scalable data solutions with security best practices.
• Partner with engineering and business teams to deliver trusted datasets for analytics.
• Monitor and optimize data pipelines for performance and reliability.
• Contribute to modern data engineering practices and platform improvements.

Skills

Analytical thinking

Stakeholder collaboration

Problem solving

Education

Bachelor's degree in CS/IT/Data Science

Tools

Python

SQL

Databricks

Terraform

AWS/GCP

Cloud security principles

Job description

Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data.

About Vanguard

Founded in 1975, Vanguard is one of the world's leading investment management companies. The firm offers investments, advice, and retirement services to tens of millions of individual investors around the globe—directly, through workplace plans, and through financial intermediaries.

Vanguard’s India Office

Vanguard’s office in India is a significant milestone in our global expansion. We are committed to establishing an enduring technology center in Hyderabad, Telangana and are excited to be adding talent who will focus on Artificial Intelligence (AI), mobile, and cloud-based technologies that drive our business outcomes and deliver a world-class experience for our clients.

Role Summary

The Data Engineer, Specialist is responsible for building and maintaining scalable data solutions using Databricks, Python, SQL, and cloud technologies. The role focuses on designing and optimizing data pipelines, implementing end-to-end data models in collaboration with business stakeholders, and deploying reliable data solutions that enable analytics, reporting, and business decision-making.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Python, and SQL to support enterprise data needs.
• Manage end-to-end data modeling in collaboration with business stakeholders, translating business requirements into scalable and efficient data models.
• Build and optimize data ingestion, transformation, and processing workflows across multiple data sources and platforms.
• Develop reusable and maintainable solutions using Python (Functional Programming and Object‑Oriented Programming principles).
• Deploy and manage data infrastructure and workflows using Terraform and cloud‑native services.
• Work with AWS and/or GCP environments to build scalable and secure data solutions, with adherence to cloud security best practices.
• Partner with engineering teams and business stakeholders to deliver high‑quality, trusted datasets that support reporting, analytics, and business initiatives.
• Monitor, troubleshoot, and optimize data pipelines to ensure performance, reliability, and data integrity.
• Contribute to the adoption of modern data engineering practices, automation, and platform enhancements within the organization.

Qualifications And Skills

• Minimum 5 years of relevant work experience, with at least 2 years in designing and maintaining data pipelines, ETL processes and database architectures.
• Bachelor’s degree (B.E./B.Tech) in Computer Science or IT, or Bachelor’s in Data Science, Statistics, or related field.
• Hands‑on experience with Databricks, including development and deployment using Asset Bundles.
• Strong programming expertise in Python, including Functional Programming and Object‑Oriented Programming (OOP) concepts.
• Advanced proficiency in SQL for data processing, transformation, optimization, and analytics.
• Experience managing end-to‑end data modeling and collaborating with business stakeholders to design effective data solutions.
• Experience working with AWS and/or GCP cloud platforms; understanding of cloud security principles is highly preferred.
• Experience with infrastructure deployment and automation using Terraform.
• Good to Have: Experience with big data technologies, cloud data services, relational and NoSQL databases, and exposure to data architecture modernization, platform migration, and advanced analytics initiatives.

Location

This role is based in Hyderabad, Telangana at Vanguard’s India office. Only qualified external applicants will be considered.

Our mission

Vanguard adheres to a simple purpose: To take a stand for all investors, to treat them fairly, and to give them the best chance for investment success.

Our commitment to you

Vanguard takes the same long‑term view of your success—at work and in life—with Benefits and Rewards packages that reflect what you care about, throughout all the phases and stages of your life. Our Total Rewards programs provide you and your loved ones with wellness support for key areas in your life:

• Financial wellness: We're committed to enabling your financial success and provide competitive offers and programs.
• Physical wellness: We're committed to providing benefits that support your physical health and wellness.
• Personal wellness: We're committed to providing resources that help support the full scope of your life.

How we work

Vanguard has implemented a hybrid working model for most of our employees (crew members), designed to capture the benefits of enhanced flexibility while enabling in‑person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long‑term client outcomes and enrich the employee experience.