Senior Data Platform Architect & Engineering Leader

LPL Financial LLC; Fort Mill (SC); On-site; USD 160,000 - 267,000; Full time

Benefits offered by this job

401K matching

Health benefits

Employee stock options

Paid time off

Volunteer time off

Job summary

LPL Financial seeks a VP, Principal Data Engineer to modernize investor data platforms across Reporting, Statements and Letters for 2.4M+ investors. You will architect high-performance pipelines, real-time processing, and cloud-native services with strict standards and best practices.

Lead engineering pods, mentor teams, and drive cloud transformation while partnering with business leaders to prioritize initiatives and ensure reliability, security, and cost efficiency across the data ecosystem.

Qualifications

• 10+ years of experience designing and developing large-scale ETL/ELT pipelines and data platforms using AWS, Glue, S3, RDS/Aurora, Snowflake, DBT, and Airflow.
• 8+ years of hands-on experience developing data solutions with Python.
• 6+ years of experience building event-driven and streaming architectures using Kafka, EventBridge, SQS, and related technologies.
• 6+ years of experience with relational and NoSQL databases, including performance tuning and optimization.
• 6+ years of experience with source control, CI/CD, and DevOps practices using GitHub, TeamCity, Jenkins, Octopus, or similar tools.

Responsibilities

• Lead the delivery of scalable, high-quality data solutions aligned to business priorities.
• Own end-to-end execution across engineering pods, balancing resources to optimize delivery and mitigate risk.
• Partner with business and technology leaders to prioritize initiatives and improve productivity.
• Mentor engineers and promote engineering excellence and continuous improvement.
• Architect and build cloud-native data platforms supporting large-scale ingestion, transformation, validation, and distribution.
• Design, develop, and optimize ETL/ELT pipelines using Python, AWS, Snowflake, DBT, Airflow.
• Develop event-driven and real-time data processing solutions leveraging Kafka, EventBridge, SQS, SNS.
• Modernize legacy platforms with secure, reusable cloud-native architectures and patterns.
• Define technical roadmaps, standards, and best practices for enterprise data capabilities.
• Ensure platform reliability, performance, and SLA compliance.

Skills

Technical leadership

Architectural decision-making

Data engineering

ETL/ELT design

Cloud-native platforms

Python development

Real-time streaming

CI/CD and DevOps

Stakeholder management

Mentoring engineering teams

Tools

Python

AWS

Snowflake

DBT

Airflow

Kafka

EventBridge

SQS

SNS

GitHub

Terraform

Data lake architectures

Job description

LPL Financial seeks a VP, Principal Data Engineer to modernize investor data platforms across Reporting, Statements and Letters for 2.4M+ investors. You will architect high-performance pipelines, real-time processing, and cloud-native services with strict standards and best practices.

Lead engineering pods, mentor teams, and drive cloud transformation while partnering with business leaders to prioritize initiatives and ensure reliability, security, and cost efficiency across the data ecosystem.