Cloud Data Engineer II – AI-Driven Pipelines

Relha LLC; Fort Mill, Northern (SC, KY); Hybrid; USD 55,000 - 92,000; Full time

Job summary

LPL Financial is seeking an Engineer II, Data (Cloud & AI) to design and operate cloud-native data solutions at enterprise scale. You will work on ingestion, transformation, validation, and enrichment of enterprise data using AWS and AI tools to boost productivity and observability.

The role focuses on building scalable data pipelines, implementing AI-enabled engineering practices, and improving platform reliability and disaster recovery readiness within the Enterprise Data Integration Framework.

Qualifications

• Bachelor’s degree or Master’s with relevant experience in software/cloud/data engineering.
• Hands-on experience with AWS services (S3, Lambda, Glue, CloudWatch, IAM, EventBridge, Athena).
• Proficiency in Python and/or PySpark for data transformation, SQL, API integrations, and Git/GitHub.
• Experience in ETL/ELT pipelines, data validation frameworks, data quality, and batch/event-driven processing.

Responsibilities

• Design, develop, and maintain cloud-based data ingestion and transformation pipelines.
• Support onboarding of new vendor and enterprise data sources.
• Optimize processing performance for large-volume datasets.
• Build reusable ingestion, validation, and transformation frameworks.
• Develop automated data quality validation processes.
• Develop and support AWS-based solutions.
• Build infrastructure using Terraform and IaC practices.
• Improve platform scalability, resiliency, and disaster recovery readiness.
• Implement monitoring and observability capabilities.
• Utilize AI coding assistants to improve development velocity and engineering efficiency.
• Develop proof-of-concept solutions leveraging LLMs and generative AI services.
• Build intelligent operational tooling for monitoring, troubleshooting, and support workflows.
• Identify opportunities where AI can reduce engineering effort or improve service delivery.
• Evaluate and implement AI-driven automation within governance standards.

Skills

AWS

Python

PySpark

Data pipelines

SQL

Git/GitHub

Education

Bachelor's degree in Computer Science or related field

Master's degree in CS/AI/Info Systems or related

Tools

Terraform

Job description

LPL Financial is seeking an Engineer II, Data (Cloud & AI) to design and operate cloud-native data solutions at enterprise scale. You will work on ingestion, transformation, validation, and enrichment of enterprise data using AWS and AI tools to boost productivity and observability.

The role focuses on building scalable data pipelines, implementing AI-enabled engineering practices, and improving platform reliability and disaster recovery readiness within the Enterprise Data Integration Framework.