Cloud & AI Data Engineer II: Scalable Pipelines

LPL Financial LLC; Fort Mill (SC); Hybrid; USD 114,903,000 - 191,495,000; Full time

Benefits offered by this job

401K matching

Health benefits

Employee stock options

Paid time off

Volunteer time off

Job summary

LPL Financial Holdings Inc. is seeking an Engineer II, Data to design, build, and operate cloud-native data solutions at enterprise scale within EDIF.

The role blends AWS cloud engineering, data pipelines, and AI-assisted software development to improve productivity and platform reliability. Responsibilities include ingesting and transforming data, implementing automated quality checks, developing Terraform infrastructure, CI/CD pipelines, and observability.

Qualifications

• Bachelor’s degree in Computer Science, Engineering or related field with minimum 3 years of software engineering, cloud engineering, platform engineering, or data engineering experience.
• Master’s degree in Computer Science, Data Engineering, Artificial Intelligence, Information Systems, Engineering, or related field with minimum 1 year of relevant experience.
• Hands-on experience with AWS services including S3, Lambda, Glue, CloudWatch, IAM, EventBridge, and Athena.
• Proficiency in Python and/or PySpark for data transformation, SQL, API Integrations, and Git/GitHub.
• Experience in ETL/ELT pipeline development, Data validation frameworks, Data quality practices, and Batch and event-driven processing.

Responsibilities

• Design, develop, and maintain cloud-based data ingestion and transformation pipelines.
• Support onboarding of new vendor and enterprise data sources.
• Optimize processing performance for large-volume datasets.
• Develop automated data quality validation processes.
• Collaborate with product managers, architects, analysts, and business stakeholders.

Skills

AWS Cloud

Python

PySpark

SQL

Git/GitHub

Education

Bachelor’s degree in Computer Science or related field

Master’s degree in Computer Science/Data/AI or related field

Tools

Terraform

Infrastructure as Code

CI/CD pipelines

Job description

LPL Financial Holdings Inc. is seeking an Engineer II, Data to design, build, and operate cloud-native data solutions at enterprise scale within EDIF.

The role blends AWS cloud engineering, data pipelines, and AI-assisted software development to improve productivity and platform reliability. Responsibilities include ingesting and transforming data, implementing automated quality checks, developing Terraform infrastructure, CI/CD pipelines, and observability.