Lead Data Engineer, Reference Data & APIs (Cloud)

LPL Financial; Fort Mill (SC); On-site; USD 119,068 - 198,378; Full time

Benefits offered by this job

401K matching

Health benefits

Employee stock options

Paid time off

Volunteer time off

Job summary

LPL Financial is seeking an AVP, Data Services – Reference Data Engineering Lead to join our Data & Analytics organization and support the Reference Data Master team. This role designs, develops, and enhances party reference data solutions across onboarding, KYC/AML, regulatory reporting, and operations.

The ideal candidate brings hands-on data engineering expertise, cloud-native platforms, and Agile delivery, partnering with stakeholders and governance teams to deliver scalable, secure data

Qualifications

• Minimum of 7 years of experience in data engineering, software engineering, cloud engineering, or related technical disciplines.
• Minimum of 2 years of experience serving as a technical lead, project lead, or people leader.
• Experience developing and supporting cloud-native applications, APIs, and data platforms.
• Experience developing event-driven architectures, data pipelines, and distributed data services.
• Bachelor’s degree in Computer Science, Information Technology, Engineering, Mathematics, or a related technical field (or equivalent combination of education and relevant work experience).

Responsibilities

• Lead the design, development, and support of party reference data applications, APIs, and data services.
• Partner with business stakeholders, architects, and engineering teams to deliver reference data solutions supporting client, counterparty, issuer, and legal entity domains.
• Develop and maintain cloud-native data pipelines utilizing AWS services such as Glue, Lambda, EventBridge, S3, RDS, and Kafka/MSK.
• Support the modernization of legacy reference data platforms through migration to scalable cloud-based solutions.
• Integrate third-party reference data sources including Dun & Bradstreet, S&P Global, and other data providers to support enrichment, validation, and compliance requirements.
• Develop and support APIs and data services consumed by CRM, compliance, reporting, operations, and trading platforms.
• Implement data quality controls, validation rules, matching and deduplication processes, survivorship logic, and lineage tracking capabilities.
• Collaborate with data governance and architecture teams to support reference data standards, metadata management, and best practices.
• Participate in Agile planning, backlog refinement, estimation, sprint execution, and delivery activities using Jira.
• Provide technical leadership and mentorship to junior engineers and project team members.
• Support platform observability, performance tuning, resiliency, operational excellence, and incident resolution activities.

Skills

Data engineering

Cloud engineering

Technical lead

Agile delivery

SQL

Data governance

Education

Bachelor’s degree in Computer Science, Information Technology, Engineering, Mathematics, or a related technical field

Tools

AWS Glue

AWS Lambda

Kafka/MSK

Snowflake

Terraform

Aurora/Postgres

RDS

Job description

LPL Financial is seeking an AVP, Data Services – Reference Data Engineering Lead to join our Data & Analytics organization and support the Reference Data Master team. This role designs, develops, and enhances party reference data solutions across onboarding, KYC/AML, regulatory reporting, and operations.

The ideal candidate brings hands-on data engineering expertise, cloud-native platforms, and Agile delivery, partnering with stakeholders and governance teams to deliver scalable, secure data