Data Engineer, Specialist (PITech- Core - Middle Office Team 1)

The Vanguard Group; Hyderabad; Hybrid; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards program

Job summary

Vanguard India in Hyderabad, Telangana, is hiring a Data Engineer, Specialist to build and maintain scalable data pipelines for analytics and BI initiatives. You will design and optimize ETL processes, manage databases, and work with cloud platforms such as AWS, Google Cloud, and Azure to deliver reliable data solutions.

The role requires strong experience in data engineering, data integration, and collaboration with BI analysts and data scientists to enable data-driven decision making.

Qualifications

• Minimum 5 years of data engineering experience.
• Bachelor's degree in CS/IT or related field.
• Experience designing and maintaining data pipelines and databases.

Responsibilities

• Design, develop and maintain scalable ETL processes.
• Architect and manage large-scale database systems.
• Integrate data from APIs, on-premise and cloud sources.
• Collaborate with BI analysts and data scientists to meet data needs.
• Monitor and optimize data pipelines for performance and integrity.
• Develop automation frameworks for data ingestion and reporting.

Skills

ETL design

Data pipelines

Python

SQL

Airflow

Education

B.E./B.Tech in Computer Science or IT

Data science / Statistics a related field

Tools

AWS

Databricks

Airflow

Kafka

Docker

Terraform

GitHub Actions

Spark

Job description

About Vanguard

Founded in 1975, Vanguard is one of the world's leading investment management companies. The firm offers investments, advice, and retirement services to tens of millions of individual investors around the globe—directly, through workplace plans, and through financial intermediaries.

Vanguard India

Vanguard’s office in India is a significant milestone in our global expansion. We are committed to establishing an enduring technology center in Hyderabad, Telangana and are excited to be adding talent who will focus on Artificial Intelligence (AI), mobile, and cloud-based technologies that drive our business outcomes and deliver a world-class experience for our clients.

Role Summary

The Data Engineer, Specialist is responsible for building and maintaining scalable data pipelines to ensure seamless integration and efficient data flow across various platforms. This role involves designing, developing, and optimizing ETL (Extract, Transform, Load) processes, managing databases and leveraging big data technologies to support analytics and business intelligence initiatives.

Responsibilites

• Design, develop and maintain scalable ETL (Extract, Transform, Load) processes to efficiently extract data from various structured and unstructured sources, ensuring accuracy, consistency and performance optimization.
• Architect and manage database systems to support large-scale data storage and retrieval, ensuring high availability, security and efficiency in handling complex datasets.
• Integrate and transform data from multiple sources including APIs, on-premises databases and cloud storage, creating unified datasets to support data-driven decision-making across the organization.
• Collaborate with business intelligence analysts, data scientists and other stakeholders to understand specific data needs, ensuring the delivery of high-quality, business-relevant datasets.
• Monitor, troubleshoot and optimize data pipelines and workflows to resolve performance bottlenecks, improve processing efficiency and ensure data integrity.
• Develop automation frameworks for data ingestion, transformation and reporting to streamline data operations and reduce manual effort.
• Work with cloud-based data platforms and technologies such as AWS (Redshift, Glue, S3), Google Cloud (Big Query, Dataflow), or Azure (Synapse, Data Factory) to build scalable data solutions.
• Optimize data storage, indexing, and query performance to support real-time analytics and reporting, ensuring cost-effective and high-performing data solutions.
• Lead or contribute to special projects involving data architecture improvements, migration to modern data platforms, or advanced analytics initiatives.

Qualifications and Skills

Minimum 5 years of relevant work experience, with at least 2 years in designing and maintaining data pipelines, ETL processes and database architectures. Bachelor’s degree (B.E./B.Tech) in Computer Science or IT, or bachelor’s in data science, Statistics, or related field cloud Platforms AWS (S3, EMR, Glue, Lambda, Kinesis, Athena, Iceberg, Step Functions, SNS/SQS, IAM, CloudWatch Databricks: Delta Lake, Unity catalog volumes, Lakeflow connect, Dataframes, Apache Spark Database: Redshift, Aurora, Languages & Frameworks: Pyspark, Python/ Pandas/ NumPy/SQL Orchestration & Streaming: Airflow, Kafka, Lakeflow declarative pipelines Monitoring & DevOps: Docker / Terraform, GitHub Actions, Code Pipeline, spark UI, Git integration Product Build skills: Data design: Exposure to Medallion architecture, DWH and data mart build Should have functional domain exposure from Wealth and asset management / investments / Banking domain. AI Exposure: Claude Code / GitHub copilot

Location

This role is based in Hyderabad, Telangana at Vanguard India. Only qualified external applicants will be considered.

Our mission

Vanguard adheres to a simple purpose: To take a stand for all investors, to treat them fairly, and to give them the best chance for investment success.

Our commitment to you

Vanguard takes the same long-term view of your success—at work and in life—with Benefits and Rewards packages that reflect what you care about, throughout all the phases and stages of your life. Our Total Rewards programs provide you and your loved ones with wellness support for key areas in your life.

Benefits

• Financial wellness: We're committed to enabling your financial success and provide competitive offers and programs.
• Physical wellness: We're committed to providing benefits that support your physical health and wellness.
• Personal wellness: We're committed to providing resources that help support the full scope of your life.

How we work

Vanguard has implemented a hybrid working model for most of our employees (crew members), designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.

Our culture

Vanguard, one of the world's leading investment management companies, serves individual investors, institutions, employer-sponsored retirement plans, and financial professionals. We have a diverse and talented crew with a culture that promotes teamwork, along with an unwavering focus on serving our clients' best interests.