AWS Data & API Engineer II

lplfinancial; Fort Mill (SC); On-site; USD 55,000 - 92,000; Full time

Benefits offered by this job

401K matching

Health benefits

Paid time off

Job summary

LPL Financial is seeking a Data Engineer II to design and maintain scalable data pipelines and services. You will build Python-based applications, deploy on AWS EKS, and implement API/microservices patterns while ensuring security and performance.

Responsibilities include developing with PySpark, integrating DynamoDB and PostgreSQL, and collaborating in an Agile environment with clear documentation and CI/CD workflows.

Qualifications

• Proficiency in Python and related frameworks.
• Strong experience with AWS services and data tools.
• Hands-on with PySpark, relational and NoSQL databases.

Responsibilities

• Design, develop, and maintain Python-based applications and services.
• Build data pipelines using AWS Glue and PySpark.
• Deploy containerized apps on AWS EKS and implement microservices patterns.
• Integrate AWS data stores (DynamoDB, PostgreSQL) and Kafka messaging.
• Write clean, testable code with TDD in an Agile Scrum setting.
• Document designs in Confluence and manage tasks in JIRA.

Skills

Python

AWS services

PySpark

API Gateway

AWS Lambda

EKS

DynamoDB

PostgreSQL

Kafka

GitHub CI/CD

Terraform

OOP / design patterns

Agile / Scrum

RESTful services

Testing (TDD)

Tools

GitHub

CI/CD

Jira

Confluence

Docker

Kubernetes / EKS

Terraform

Job description

LPL Financial is seeking a Data Engineer II to design and maintain scalable data pipelines and services. You will build Python-based applications, deploy on AWS EKS, and implement API/microservices patterns while ensuring security and performance.

Responsibilities include developing with PySpark, integrating DynamoDB and PostgreSQL, and collaborating in an Agile environment with clear documentation and CI/CD workflows.