VP, Principal Data Engineer — Cloud-Scale Data Architect

LPL Financial; New York (NY); On-site; USD 160,000 - 267,000; Full time

Job summary

LPL Financial is seeking a VP, Principal Data Engineer to lead modernization of investor data platforms across Reporting, Statements and Letters, serving over 2.4 million investors. You will architect high-performance pipelines, real-time streaming, and cloud-native services while setting engineering standards and best practices.

You will influence technical strategy, accelerate cloud transformation, mentor engineers, and partner with business leaders to deliver scalable data products that

Qualifications

• 10+ years of experience designing and developing large-scale ETL/ELT pipelines and data platforms using AWS, Glue, S3, RDS/Aurora, Snowflake, DBT, and Airflow.
• 8+ years of hands-on experience developing data solutions with Python.
• 6+ years of experience building event-driven and streaming architectures using Kafka, EventBridge, SQS, and related technologies.
• 6+ years of experience with relational and NoSQL databases, including performance tuning and optimization.
• 6+ years of experience with source control, CI/CD, and DevOps practices using GitHub, TeamCity, Jenkins, Octopus, or similar tools.

Responsibilities

• Lead the delivery of scalable, high-quality data solutions aligned to business priorities.
• Own end-to-end execution across engineering pods, balancing resources to optimize delivery and mitigate risk.
• Partner with business and technology leaders to prioritize initiatives and improve engineering productivity.
• Mentor engineers and promote engineering excellence and continuous improvement.
• Architect and build cloud-native data platforms supporting large-scale data ingestion, transformation, and distribution.
• Design, develop, and optimize ETL/ELT pipelines using Python, AWS, Snowflake, DBT, Airflow.
• Develop event-driven and real-time data processing solutions leveraging Kafka, EventBridge, SQS, SNS.
• Modernize legacy platforms through secure, reusable cloud-native architectures and patterns.
• Define technical roadmaps, engineering standards, and best practices for enterprise data capabilities.
• Ensure platform reliability, scalability, performance, and SLO compliance.
• Drive CI/CD adoption, DevOps automation, and operational best practices for resiliency.
• Lead root-cause analysis of complex production issues and optimize cloud performance and cost.
• Partner with architects, product teams, and stakeholders to deliver modern data products and platform capabilities.
• Influence technical strategy and automation initiatives across the data ecosystem.

Skills

ETL/ELT pipelines

Python development

Event-driven streaming

Relational & NoSQL databases

CI/CD DevOps practices

Tools

AWS

Snowflake

DBT

Airflow

Kafka

EventBridge/SQS/SNS

Job description

LPL Financial is seeking a VP, Principal Data Engineer to lead modernization of investor data platforms across Reporting, Statements and Letters, serving over 2.4 million investors. You will architect high-performance pipelines, real-time streaming, and cloud-native services while setting engineering standards and best practices.

You will influence technical strategy, accelerate cloud transformation, mentor engineers, and partner with business leaders to deliver scalable data products that