Senior Data Engineer: AWS ETL, Spark & Power BI (Hybrid)

Vanguard; Malvern (AR); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Vanguard in Malvern, PA is seeking an experienced Data Engineer to design, build, and optimize ETL pipelines and cloud-based data infrastructure.

You will integrate large-scale datasets, ensure data quality, and develop reusable code and dashboards with Power BI, collaborating with compliance, analytics, and tech teams.

This hybrid role requires 8+ years in data engineering and a strong command of SQL, Python, Spark, and AWS services to support regulatory reporting and business insights.

Qualifications

• 8+ years of experience in data engineering, programming, database development or administration, data management, or related data-focused disciplines.
• Undergraduate degree or an equivalent combination of education, training, and relevant experience.
• Experience developing and optimizing ETL processes, data pipelines, and solutions that integrate data from multiple sources.
• Experience using SQL for data querying, transformation, troubleshooting, and data-quality analysis.
• Experience using Python or other programming languages to develop data solutions and automate workflows.
• Experience developing reports, dashboards, or data visualizations using Power BI or similar platforms.
• Experience translating business requirements into technical solutions and communicating with technical and non-technical stakeholders.
• Experience with cloud-based data platforms or large-scale data-processing environments, preferred.

Responsibilities

• Designs, develops, and optimizes ETL processes, data pipelines, database solutions, and cloud-based data infrastructure to support scalable, reliable data processing and analytical needs.
• Integrates large and complex datasets from multiple sources and troubleshoots data and software issues to maintain data consistency, quality, availability, and integrity.
• Translates business and regulatory requirements into technical designs and develops maintainable, reusable code, queries, and data solutions.
• Expert building AWS cloud supporting services and technologies (Eg: Glue, Redshift, Step Functions, Amazon Q Foundational Services like IAM, Cloud Watch, Cloud formation, Lambda, Secrets Manager, Sagemaker).
• Expert in building Spark data processing applications.
• Builds and automates dashboards, reports, and data visualizations using Power BI or similar platforms to make data and insights accessible to business partners.
• Automates recurring data analysis and reporting workflows using Python, SQL, and other programming tools to improve efficiency, reliability, and reduce manual effort.
• Partners with business, compliance, analytics, and technology teams to understand data needs, develop solutions, and communicate technical considerations.
• Collaborates with leadership and business partners to translate data and analytical findings into clear insights for technical and non-technical audiences
• Assesses data quality, tests solutions for their intended purpose, and supports implementation into production using established engineering and release practices.
• Serves as a subject matter expert across data engineering and analytics, mentoring less-experienced data professionals and contributing to engineering standards and reusable practices.
• Participates in special projects and performs other duties as assigned.

Skills

ETL design

SQL

Python

Power BI

Data pipelines

Data quality

Stakeholder communication

Cloud platforms

Education

Bachelor's degree or equivalent

Tools

AWS

Spark

Glue

Redshift

Step Functions

IAM

CloudWatch

CloudFormation

Lambda

Sagemaker

Job description

Vanguard in Malvern, PA is seeking an experienced Data Engineer to design, build, and optimize ETL pipelines and cloud-based data infrastructure.

You will integrate large-scale datasets, ensure data quality, and develop reusable code and dashboards with Power BI, collaborating with compliance, analytics, and tech teams.

This hybrid role requires 8+ years in data engineering and a strong command of SQL, Python, Spark, and AWS services to support regulatory reporting and business insights.