Senior Data Platform Engineer — AI-Driven Pipelines

Vanguard; Charlotte (NC); Hybrid; USD 130,000 - 180,000; Full time

Job summary

Vanguard seeks a Senior Data Engineer to design scalable data platforms, pipelines, and trusted data products powering analytics and AI-enabled solutions. You will transform high-volume data into governed, accessible data products and collaborate with analysts, data scientists, and engineers to accelerate AI initiatives.

The role emphasizes AI-augmented engineering, continuous learning, and delivering measurable business value across enterprise data workloads. Hybrid work model is offered.

Qualifications

• 8+ years of experience in data engineering, software engineering, analytics engineering, or related technical disciplines.
• Proven experience designing and implementing scalable data pipelines and cloud-based data platforms.
• Strong expertise in SQL, data modeling, and relational and non-relational database technologies.
• Strong programming skills in Python and at least one additional language such as Scala or Java.
• Experience with modern cloud platforms such as AWS, Azure, or GCP.
• Hands-on experience with technologies such as Spark, Databricks, Snowflake, Kafka, Hadoop, or similar modern data platforms.
• Strong understanding of data quality, governance, security, observability, lineage, and operational excellence practices.

Responsibilities

• Design scalable data platforms, pipelines, and services powering analytics, business decisions, ML, and AI-enabled solutions.
• Transform complex, high-volume datasets into trusted data products used daily.
• Create reusable frameworks, APIs, and self-service data access to improve developer productivity.
• Design data models and architectures optimized for analytics, reporting, AI, and advanced data workloads.
• Continuously improve platform performance, scalability, reliability, observability, and security.
• Collaborate with analysts, data scientists, engineers, and business partners to power analytics and AI capabilities across the enterprise.

Skills

SQL

Data modeling

Python

Scala/Java

Cloud platforms

Spark / Databricks

Kafka / Hadoop

Data governance & security

Tools

Spark

Databricks

Snowflake

Kafka

Hadoop

Job description

Vanguard seeks a Senior Data Engineer to design scalable data platforms, pipelines, and trusted data products powering analytics and AI-enabled solutions. You will transform high-volume data into governed, accessible data products and collaborate with analysts, data scientists, and engineers to accelerate AI initiatives.

The role emphasizes AI-augmented engineering, continuous learning, and delivering measurable business value across enterprise data workloads. Hybrid work model is offered.