Lead AI Retrieval & Knowledge Platform Engineer

LPL Financial; New York (NY); On-site; USD 115,000 - 192,000; Full time

Benefits offered by this job

401K matching

Health benefits

Stock options

Job summary

LPL Financial is hiring a Principal Engineer, AI Retrieval & Knowledge Platform to design and build core AI knowledge infrastructure powering intelligent applications across the enterprise. You will work on distributed systems, retrieval architectures, and AI platform services enabling real-time data and scalable inference.

The role emphasizes RAG, semantic search, vector stores, and multi-tenant platform patterns, with leadership in design, code quality, and collaboration with product teams.

Qualifications

• Minimum of 8 years building large-scale backend, platform, or distributed systems.
• Hands-on experience building search platforms, retrieval systems, indexing pipelines, knowledge systems, or recommendation platforms.
• Strong knowledge of APIs, microservices, Kubernetes, containers, CI/CD, and distributed data processing.

Responsibilities

• Design and build high-scale retrieval systems combining keyword search, semantic search, and vector-based retrieval.
• Develop RAG infrastructure including indexing, retrieval, ranking, and context assembly.
• Build and optimize search indices, vector stores, and hybrid retrieval systems for relevance, latency, and scale.
• Implement advanced ranking, relevance tuning, and personalization pipelines.

Skills

Backend engineering

Distributed systems

Kubernetes

APIs & microservices

Java/Python/Go

Search platforms

LLM integration

Tools

Elasticsearch/OpenSearch

Vector databases

Kafka

CI/CD

Job description

LPL Financial is hiring a Principal Engineer, AI Retrieval & Knowledge Platform to design and build core AI knowledge infrastructure powering intelligent applications across the enterprise. You will work on distributed systems, retrieval architectures, and AI platform services enabling real-time data and scalable inference.

The role emphasizes RAG, semantic search, vector stores, and multi-tenant platform patterns, with leadership in design, code quality, and collaboration with product teams.