Cloud & AI Data Engineer II: Build Scalable Pipelines

LPL Financial; Town of Charlotte (NY); Hybrid; USD 55,000 - 91,000; Full time

Job summary

LPL Financial is seeking an Engineer II, Data to design and operate cloud-native data solutions at enterprise scale. This role blends AWS cloud engineering, data pipeline development, platform reliability, and AI-assisted software development.

You will work on ingestion, validation, transformation, enrichment, and standardization of enterprise data, leveraging cloud and AI to boost productivity and observability across production systems.

Qualifications

• Bachelor's degree or higher in CS/Engineering or related field with 3+ years of software/cloud/data engineering experience or Master's with 1+ year experience.
• Experience building cloud-based data platforms, pipelines, and production systems.
• Hands-on with AWS (S3, Lambda, Glue, CloudWatch, IAM, EventBridge, Athena).
• Proficiency in Python and/or PySpark, SQL, APIs, and Git workflows.
• Experience with ETL/ELT pipelines, data validation, data quality, and batch/event-driven processing.

Responsibilities

• Design, develop, and maintain cloud-based data ingestion and transformation pipelines.
• Onboard new data sources and optimize processing for large datasets.
• Build reusable ingestion, validation, and transformation frameworks.

Skills

AWS

Python

PySpark

SQL

Git/GitHub

ETL/ELT

Education

Bachelor's degree in CS/Engineering

Master's degree in CS/Data/AI

Tools

Terraform

CI/CD

CloudFormation

Airflow

Job description

LPL Financial is seeking an Engineer II, Data to design and operate cloud-native data solutions at enterprise scale. This role blends AWS cloud engineering, data pipeline development, platform reliability, and AI-assisted software development.

You will work on ingestion, validation, transformation, enrichment, and standardization of enterprise data, leveraging cloud and AI to boost productivity and observability across production systems.