API & Data Engineer II

LPL Financial LLC; Charlotte, Fort Mill (NC, SC); On-site; USD 55,000 - 92,000; Full time

Benefits offered by this job

401K matching

Health benefits

Employee stock options

Paid time off

Volunteer time off

Job summary

LPL Financial is seeking a Data Engineer II to build scalable data capabilities supporting advisors and clients. You will design Python-based services, optimize pipelines with AWS Glue and PySpark, and deploy containerized apps on AWS EKS. Collaboration in Agile environments and strong coding practices are expected.

The role emphasizes API/microservices, database integration (DynamoDB, PostgreSQL), Kafka messaging, and Terraform for IaC. Strong communication and documentation skills are required.

Qualifications

• Minimum of 3 years of proficiency in Python and related frameworks (e.g., Flask, FastAPI, Django).
• Minimum of 2 strong experience with AWS services: Lambda, API Gateway, Glue, EKS, DynamoDB, S3.
• Experience with PySpark for data processing.
• Solid understanding of relational and NoSQL databases (PostgreSQL, DynamoDB).
• Hands-on experience with GitHub and CI/CD workflows.

Responsibilities

• Design, develop, and maintain Python-based applications and services.
• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DynamoDB, PostgreSQL, and other data stores.
• Implement messaging and streaming solutions using Kafka.
• Write clean, maintainable, and testable code following Test Driven Development (TDD) principles.
• Collaborate in an Agile Scrum environment, participating in sprint planning, daily stand-ups, and retrospectives.
• Document technical designs and processes in Confluence and manage tasks in JIRA.
• Work with GitHub for version control and CI/CD pipelines.
• Apply basic Terraform skills for infrastructure as code.
• Ensure application security, scalability, and performance.
• Communicate effectively with stakeholders and team members, providing clear documentation and status updates.

Skills

Python

PySpark

OOP / Data Modeling

Agile

Microservices

Communication

Tools

AWS

GitHub

Terraform

Kafka

DynamoDB / PostgreSQL

CI/CD

Job description

Where Ambition Meets Innovation Build a career that matches all your initiative with an impressive dose of innovation. From cutting-edge resources and a collaborative environment to the freedom to make an impact and more, you'll find the ingredients you need at LPL Financial to shape your success while helping clients pursue their financial goals.

Job Overview: At LPL Financial we consider it our mission to take care of our advisors so they can take care of their client. Joining as a Data Engineer II, you will be responsible for building and maintaining the sustainable, scalable capabilities that support delivery of the highest standards of software products, processes for our Advisors and End Clients.

Responsibilities

• Design, develop, and maintain Python-based applications and services.
• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DynamoDB, PostgreSQL, and other data stores.
• Implement messaging and streaming solutions using Kafka.
• Write clean, maintainable, and testable code following Test Driven Development (TDD) principles.
• Collaborate in an Agile Scrum environment, participating in sprint planning, daily stand-ups, and retrospectives.
• Document technical designs and processes in Confluence and manage tasks in JIRA.
• Work with GitHub for version control and CI/CD pipelines.
• Apply basic Terraform skills for infrastructure as code.
• Ensure application security, scalability, and performance.
• Communicate effectively with stakeholders and team members, providing clear documentation and status updates.

What are we looking for?

We want strong collaborators who can deliver a world-class client experience. We are looking for people who thrive in a fast-paced environment, are client-focused, team oriented, and are able to execute in a way that encourages creativity and continuous improvement.

Requirements

• Minimum of 3 years of Proficiency in Python and related frameworks (e.g., Flask, FastAPI, Django).
• Minimum of 2 Strong experience with AWS services: Lambda, API Gateway, Glue, EKS, DynamoDB, S3.
• Experience with PySpark for data processing.
• Solid understanding of relational and NoSQL databases (PostgreSQL, DynamoDB).
• Hands-on experience with GitHub and CI/CD workflows.

Core Competencies

• Excellent knowledge of OOP concepts, data modeling design patterns/frameworks using Search, Index, and Distribute Caching tools such as Coherence, Apache Solr, etc.
• Experience with Agile development process
• Excellent knowledge in designing and developing micro services
• Ability to lead design discussions with Architecture Team
• Good analytical, problem solving skills, communication, and documentation skills
• Ability to handle multiple projects and with strong interpersonal skills and ability to work in a collaborative team environment
• Great track record of implementing the distributed systems with legacy and modern technical tools
• Problem-solving mindset with attention to detail.
• Ability to adapt to changing priorities and technologies.
• Strong collaboration and proactive communication.
• Eagerness to learn new technologies and continuously improve skills.

Preferences

• AWS Associate-level certifications (e.g., AWS Certified Developer - Associate, AWS Certified Solutions Architect - Associate).
• Additional AWS or cloud-related certifications are a plus.
• Experience with Kong API Gateway.
• Familiarity with GitHub Copilot and other AI-assisted development tools.
• Basic knowledge of Terraform for infrastructure automation.
• Experience with Agile Scrum methodology and tools like JIRA.
• Familiarity with Kafka for event-driven architectures.
• Strong understanding of TDD and unit testing frameworks (pytest, unittest).

Pay Range: $40.10-$66.83/hour Actual base salary varies based on factors, including but not limited to, relevant skill, prior experience, education, base salary of internal peers, demonstrated performance, and geographic location.

Additionally, LPL Total Rewards package is highly competitive, designed to support your success at work, at home, and at play - such as 401K matching, health benefits, employee stock options, paid time off, volunteer time off, and more.

Company Overview

LPL Financial Holdings Inc. (Nasdaq: LPLA) is among the fastest growing wealth management firms in the U.S. As a leader in the financial advisor-mediated marketplace(6) , LPL supports over 32,000 financial advisors and the wealth management practices of approximately 1,100 financial institutions, servicing and custodying approximately $2.3 trillion in brokerage and advisory assets on behalf of approximately 8 million Americans.

The firm provides a wide range of advisor affiliation models, investment solutions, fintech tools and practice management services, ensuring that advisors and institutions have the flexibility to choose the business model, services, and technology resources they need to run thriving businesses.

For further information about LPL, please visit www.lpl.com. At LPL, independence means that advisors and institution leaders have the freedom they deserve to choose the business model, services, and technology resources that allow them to run thriving businesses. They have the flexibility to do business their way. And they have the freedom to manage their client relationships, because they know their clients best. Simply put, we take care of our advisors and institutions, so they can take care of their clients.

For further information about LPL, please visit www.lpl.com. Join the LPL team and help us make a difference by turning life's aspirations into financial realities.

Principals only.

Information on Interviews

LPL will only communicate with a job applicant directly from an @lplfinancial.com email address and will never conduct an interview online or in a chatroom forum. During an interview, LPL will not request any form of payment from the applicant, or information regarding an applicant’s bank or credit card. Should you have any questions regarding the application process, please contact LPL's Human Resources Solutions Center at [phone].

EAC 5.19.26 LPL Financial is the nation’s largest independent broker-dealer.* Our company is widely known for its financial strength, exceptional service, and favorable industry reputation among financial professionals.

To understand who we are, it's important to know our core belief: financial guidance is a fundamental need for everyone. LPL Financial creates the space to let you do what you do best - create personal, long-term client relationships that turn financial aspirations into realities. Each year, thousands of financial professionals successfully manage billions of dollars in assets. Because our company is not too big and not too small, you can seize the opportunity to make a real impact. To learn more about our organization visit our About LPL page.

* As reported by Financial Planning magazine, June 1996-2019, based on total revenue.