API & Data Engineer II

LPL Financial; Town of Charlotte (NY); On-site; USD 83,000 - 139,000; Full time

Job summary

LPL Financial is seeking a Data Engineer II to design and maintain scalable data capabilities that support the highest standards of software for Advisors and End Clients.

You will build Python-based applications, data pipelines with PySpark, and containerized services on AWS, including EKS, DynamoDB, and PostgreSQL, while following CI/CD and Agile practices.

Qualifications

• 3+ years in Python and related frameworks (Flask, FastAPI, Django).
• 2+ years with AWS services: Lambda, API Gateway, Glue, EKS, DynamoDB, S3.
• Experience with PySpark for data processing.
• Relational and NoSQL databases (PostgreSQL, DynamoDB).
• Hands-on with GitHub and CI/CD workflows.

Responsibilities

• Design, develop, and maintain Python-based applications and services.
• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DynamoDB, PostgreSQL, and other data stores.

Skills

Python

AWS

PySpark

APIs

DynamoDB

PostgreSQL

GitHub

CI/CD

Terraform

Kafka

EKS

S3

REST

OO Design

TDD

Tools

Confluence

JIRA

GitHub Actions

Docker

Kubernetes

Terraform

Job description

Where Ambition Meets Innovation

Build a career that matches all your initiative with an impressive dose of innovation. From cutting-edge resources and a collaborative environment to the freedom to make an impact and more, you’ll find the ingredients you need at LPL Financial to shape your success while helping clients pursue their financial goals.

Job Overview:

At LPL Financial we consider it our mission to take care of our advisors so they can take care of their client. Joining as a Data Engineer II, you will be responsible for building and maintaining the sustainable, scalable capabilities that support delivery of the highest standards of software products, processes for our Advisors and End Clients.

Responsibilities:

• Design, develop, and maintain Python-based applications and services.
• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DynamoDB, PostgreSQL, and other data stores.
• Implement messaging and streaming solutions using Kafka.
• Write clean, maintainable, and testable code following Test Driven Development (TDD) principles.
• Collaborate in an Agile Scrum environment, participating in sprint planning, daily stand-ups, and retrospectives.
• Document technical designs and processes in Confluence and manage tasks in JIRA.
• Work with GitHub for version control and CI/CD pipelines.
• Apply basic Terraform skills for infrastructure as code.
• Ensure application security, scalability, and performance.
• Communicate effectively with stakeholders and team members, providing clear documentation and status updates.

What are we looking for?

We want strong collaborators who can deliver a world-class client experience. We are looking for people who thrive in a fast-paced environment, are client-focused, team-oriented , and are able to execute in a way that encourages creativity and continuous improvement.

Requirements:

• Minimum of 3 years of Proficiency in Python and related frameworks (e.g., Flask, FastAPI, Django).
• Minimum of 2 Strong experience with AWS services: Lambda, API Gateway, Glue, EKS, DynamoDB, S3.
• Experience with PySpark for data processing.
• Solid understanding of relational and NoSQL databases (PostgreSQL, DynamoDB).
• Hands-on experience with GitHub and CI/CD workflows.

Core Competencies:

• Excellent knowledge of OOP concepts, data modeling design patterns/frameworks using Search, Index, and Distribute Caching tools such as Coherence, Apache Solr, etc.
• Experience with Agile development process
• Excellent knowledge in designing and developing micro services
• Ability to lead design discussions with Architecture Team
• Good analytical, problem solving skills, communication, and documentation skills
• Ability to handle multiple projects and with strong interpersonal skills and ability to work in a collaborative team environment
• Great track record of implementing the distributed systems with legacy and modern technical tools
• Problem-solving mindset with attention to detail.
• Ability to adapt to changing priorities and technologies.
• Strong collaboration and proactive communication.
• Eagerness to learn new technologies and continuously improve skills.

Preferences:

• AWS Associate-level certifications (e.g., AWS Certified Developer - Associate, AWS Certified Solutions Architect - Associate).
• Additional AWS or cloud-related certifications are a plus.
• Experience with Kong API Gateway.
• Familiarity with GitHub Copilot and other AI-assisted development tools.
• Basic knowledge of Terraform for infrastructure automation.
• Experience with Agile Scrum methodology and tools like JIRA.
• Familiarity with Kafka for event-driven architectures.
• Strong understanding of TDD and unit testing frameworks (pytest, unittest).

Pay Range:

$40.10-$66.83/hour

Actual base salary varies based on factors, including but not limited to, relevant skill, prior experience, education, base salary of internal peers, demonstrated performance, and geographic location. Additionally, LPL Total Rewards package is highly competitive, designed to support your success at work, at home, and at play – such as 401K matching, health benefits, employee stock options, paid time off, volunteer time off, and more. Your recruiter will be happy to discuss all that LPL has to offer!

Company Overview:

LPL Financial Holdings Inc. (Nasdaq: LPLA) is among the fastest growing wealth management firms in the U.S. As a leader in the financial advisor-mediated marketplace(6) , LPL supports over 32,000 financial advisors and the wealth management practices of approximately 1,100 financial institutions, servicing and custodying approximately $2.3 trillion in brokerage and advisory assets on behalf of approximately 8 million Americans. The firm provides a wide range of advisor affiliation models, investment solutions, fintech tools and practice management services, ensuring that advisors and institutions have the flexibility to choose the business model, services, and technology resources they need to run thriving businesses. For further information about LPL, please visit www.lpl.com.

At LPL, independence means that advisors and institution leaders have the freedom they deserve to choose the business model, services, and technology resources that allow them to run a thriving business. They have the flexibility to do business their way. And they have the freedom to manage their client relationships, because they know their clients best. Simply put, we take care of our advisors and institutions, so they can take care of their clients.

For further information about LPL, please visit www.lpl.com.

Join the LPL team and help us make a difference by turning life’s aspirations into financial realities. Principals only. EOE.

Information on Interviews:

LPL will only communicate with a job applicant directly from an @lplfinancial.com email address and will never conduct an interview online or in a chatroom forum. During an interview, LPL will not request any form of payment from the applicant, or information regarding an applicant’s bank or credit card. Should you have any questions regarding the application process, please contact LPL’s Human Resources Solutions Center at(855) 575-6947.

EAC 5.19.26