Senior Data Engineer — AI-Driven Data Platforms

Vanguard; Malvern (Chester County); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Vanguard is seeking a Senior Data Engineer to design scalable data platforms, build trusted data products, and apply AI-assisted engineering practices across the enterprise. You will work with data scientists, analysts, and business partners to power analytics and advanced AI capabilities.

You’ll collaborate with engineers to lead initiatives from design through deployment, mentor teammates, and continuously improve data quality, observability, and security while leveraging AWS/Azure/GCP and

Qualifications

• 8+ years of experience in data engineering, software engineering, analytics engineering, or related technical disciplines.
• Proven experience designing and implementing scalable data pipelines and cloud-based data platforms.
• Strong expertise in SQL, data modeling, and relational and non-relational database technologies.
• Strong programming skills in Python and at least one additional language such as Scala or Java.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Hands-on experience with Spark, Databricks, Snowflake, Kafka, Hadoop, or similar modern data platforms.
• Strong understanding of data quality, governance, security, observability, lineage, and operational excellence practices.

Responsibilities

• Design scalable data platforms, pipelines, and services powering analytics, ML, and AI-enabled solutions.
• Transform high-volume, messy datasets into trusted, well-governed data products.
• Create reusable frameworks, APIs, and self-service capabilities to boost data accessibility.
• Design data models and architectures optimized for analytics, reporting, AI, and advanced workloads.
• Improve platform performance, scalability, reliability, observability, and security.
• Lead initiatives from design through deployment and operational support.
• Mentor engineers and contribute to innovation and technical excellence.

Skills

SQL & data modeling

Python

Scala

Java

Spark

Databricks

Snowflake

Kafka

Data governance

Observability

Tools

Databricks

Snowflake

Kafka

Spark

Job description

Vanguard is seeking a Senior Data Engineer to design scalable data platforms, build trusted data products, and apply AI-assisted engineering practices across the enterprise. You will work with data scientists, analysts, and business partners to power analytics and advanced AI capabilities.

You’ll collaborate with engineers to lead initiatives from design through deployment, mentor teammates, and continuously improve data quality, observability, and security while leveraging AWS/Azure/GCP and