Data Engineer II: Cloud, AI & Pipelines

LPL Financial; Charlotte (NC); On-site; USD 55,000 - 92,000; Full time

Job summary

LPL Financial is seeking an Engineer II, Data to design, build, and operate cloud-native data solutions at enterprise scale. You will work across AWS cloud engineering, data pipelines, and AI-assisted development to enhance productivity and reliability.

The role involves ingesting, validating, transforming, enriching, and standardizing enterprise data while leveraging modern AI technologies to improve engineering outcomes and observability.

Qualifications

• Bachelor’s degree or higher with relevant experience in software/cloud/data engineering.
• Hands-on experience with AWS services including S3, Lambda, Glue, CloudWatch, IAM, EventBridge, and Athena.
• Proficiency in Python and PySpark for data transformation, SQL, API integrations, and Git/GitHub.
• Experience in ETL/ELT pipeline development, data validation, data quality practices, and batch/event-driven processing.

Responsibilities

• Design, develop, and maintain cloud-based data ingestion and transformation pipelines.
• Onboard new vendor and enterprise data sources.
• Optimize processing performance for large-volume datasets.
• Build reusable ingestion, validation, and transformation frameworks.
• Develop automated data quality validation processes.
• Develop and support AWS-based solutions.
• Build infrastructure using Terraform and Infrastructure as Code practices.
• Support CI/CD deployment pipelines.
• Improve platform scalability, resiliency, and disaster recovery readiness.
• Implement monitoring and observability capabilities.
• Utilize AI coding assistants to improve development velocity.
• Develop proof-of-concept solutions leveraging LLMs and generative AI services.
• Build intelligent operational tooling for monitoring, troubleshooting, and support workflows.
• Identify opportunities where AI can reduce engineering effort or improve service delivery.
• Evaluate and implement AI-driven automation capabilities within governance standards.
• Participate in application support and incident response processes.
• Troubleshoot and resolve production pipeline failures.
• Conduct root cause analysis and drive preventative improvements.
• Support platform monitoring and operational reporting.
• Contribute to runbooks and operational documentation.
• Participate in Agile ceremonies and sprint activities.
• Collaborate with product managers, architects, analysts, and business stakeholders.

Skills

Python

PySpark

SQL

APIs

Git/GitHub

AWS data services

ETL/ELT pipelines

Data quality practices

Education

Bachelor’s degree in Computer Science/Engineering or related

Master’s degree in Computer Science/Data Engineering/AI or related

Tools

AWS S3

AWS Lambda

AWS Glue

CloudWatch

IAM

EventBridge

Athena

Terraform

CI/CD pipelines

Bedrock / OpenAI APIs

Job description

LPL Financial is seeking an Engineer II, Data to design, build, and operate cloud-native data solutions at enterprise scale. You will work across AWS cloud engineering, data pipelines, and AI-assisted development to enhance productivity and reliability.

The role involves ingesting, validating, transforming, enriching, and standardizing enterprise data while leveraging modern AI technologies to improve engineering outcomes and observability.