Hybrid Data Engineer - AWS, Spark & BI Insights

The Vanguard Group; Malvern (Chester County); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Vanguard is seeking a senior data engineer in Malvern, PA, with 8+ years in data engineering to design and optimize ETL processes and data pipelines. You will work in a hybrid environment, collaborating across compliance, analytics, and technology teams to deliver scalable data solutions.

You will build and optimize AWS-based data infrastructure (Glue, Redshift, Step Functions, Lambda, Sagemaker) and develop Spark applications, dashboards, and automated reporting using Power BI and Python.

Qualifications

• 8+ years in data engineering or related data-focused disciplines.
• Undergraduate degree or equivalent.
• Experience developing and optimizing ETL processes and data pipelines from multiple sources.
• Experience using SQL for data querying and data-quality analysis.
• Experience using Python to develop data solutions and automate workflows.
• Experience developing reports or dashboards using Power BI or similar platforms.
• Experience translating business requirements into technical solutions and communicating with stakeholders.
• Experience with cloud-based data platforms or large-scale data-processing environments, preferred.
• Experience supporting financial crimes or regulatory reporting, preferred.

Responsibilities

• Designs, develops, and optimizes ETL processes, data pipelines, and cloud-based data infrastructure.
• Integrates large datasets from multiple sources and ensures data quality and availability.
• Translates requirements into technical designs and reusable code and data solutions.
• Builds AWS cloud services and data processing apps (Glue, Redshift, Spark, etc.).
• Builds Spark data processing applications and automates dashboards and reports.
• Automates data analysis and reporting workflows using Python, SQL, and other tools.
• Collaborates with business, compliance, analytics, and tech teams to understand data needs.
• Communicates findings to technical and non-technical audiences.
• Mentors less-experienced data professionals and contributes to engineering standards.
• Supports production deployment following governance and release practices.

Skills

ETL design

Data pipelines

SQL

Python

Power BI

AWS

Spark

Communication

Mentoring

Regulatory data

Education

Bachelor's degree or equivalent

Tools

AWS Glue

Redshift

Step Functions

IAM

CloudWatch

CloudFormation

Lambda

Secrets Manager

Sagemaker

Job description

Vanguard is seeking a senior data engineer in Malvern, PA, with 8+ years in data engineering to design and optimize ETL processes and data pipelines. You will work in a hybrid environment, collaborating across compliance, analytics, and technology teams to deliver scalable data solutions.

You will build and optimize AWS-based data infrastructure (Glue, Redshift, Step Functions, Lambda, Sagemaker) and develop Spark applications, dashboards, and automated reporting using Power BI and Python.