API & Data Engineer II: AWS Microservices

LPL Financial; Fort Mill (SC); On-site; USD 5,524,000 - 9,207,000; Full time

Job summary

LPL Financial is seeking a Data Engineer II to design, build, and maintain scalable data platforms that support advisor and client workflows. You will develop Python-based services, construct data pipelines with PySpark and AWS Glue, and deploy containerized apps on AWS EKS in a fast-paced Agile environment.

You will collaborate with architecture and product teams, implement APIs with API Gateway and Lambda, work with DynamoDB and PostgreSQL, and apply TDD practices to deliver reliable software.

Qualifications

• 3+ years proficiency in Python and related frameworks (Flask, FastAPI, Django).
• 2+ years with AWS services: Lambda, API Gateway, Glue, EKS, DynamoDB, S3.
• Experience with PySpark for data processing.
• Relational & NoSQL databases (PostgreSQL, DynamoDB).
• Hands-on experience with GitHub and CI/CD workflows.

Responsibilities

• Design, develop, and maintain Python-based applications and services.
• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DynamoDB, PostgreSQL, and other data stores.

Skills

Python

AWS services (Lambda, API Gateway,Glue

PySpark

GitHub CI/CD

OOP & Data Modeling

Agile Development

Microservices Design

Architecture Discussions

Communication & Documentation

Distributed Systems

TDD & Testing (pytest/unittest)

Tools

Flask/FastAPI/Django

Terraform

Kubernetes

Confluence & JIRA

GitHub

Kafka

Job description

LPL Financial is seeking a Data Engineer II to design, build, and maintain scalable data platforms that support advisor and client workflows. You will develop Python-based services, construct data pipelines with PySpark and AWS Glue, and deploy containerized apps on AWS EKS in a fast-paced Agile environment.

You will collaborate with architecture and product teams, implement APIs with API Gateway and Lambda, work with DynamoDB and PostgreSQL, and apply TDD practices to deliver reliable software.