Senior Data Engineer: AI-Driven Pipelines & Cloud

Vanguard; Malvern (Chester County); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Vanguard is seeking an experienced Data Engineer to join the B2B AI and Data Engineering team in Malvern. You will design, build, and operate scalable data pipelines and data products to support analytics, AI, and critical business functions, while guiding best practices and security standards.

You will work with AWS Glue, Redshift Serverless, Lambda, S3, and Airflow, develop semantic models and KPI frameworks, and contribute to CI/CD and IaC with GitHub Actions and Terraform, mentoring

Qualifications

• 5+ years of experience in data engineering or closely related field.
• Hands-on experience with Python and advanced SQL in production.
• Experience with AWS data engineering and serverless data architectures.
• Experience designing scalable data pipelines across ingestion, transformation, and storage.

Responsibilities

• Design, build, and operate scalable data pipelines and data products.
• Develop and optimize data solutions using Python and SQL with performance and reliability in mind.
• Build cloud-native data solutions using AWS technologies (Glue, Redshift Serverless, etc.).
• Develop data models, semantic models, KPI frameworks, and curated data layers for analytics and AI.

Skills

Python

SQL

AWS

Airflow

Data modeling

CI/CD

Terraform

GitHub Actions

Data governance

AI/LLM

Education

Bachelor's degree or equivalent

Tools

AWS Glue

Redshift Serverless

S3

Lambda

Step Functions

Airflow

Job description

Vanguard is seeking an experienced Data Engineer to join the B2B AI and Data Engineering team in Malvern. You will design, build, and operate scalable data pipelines and data products to support analytics, AI, and critical business functions, while guiding best practices and security standards.

You will work with AWS Glue, Redshift Serverless, Lambda, S3, and Airflow, develop semantic models and KPI frameworks, and contribute to CI/CD and IaC with GitHub Actions and Terraform, mentoring