Principal GPU AI Retrieval Architect

LinkedIn; California (MO); Hybrid; USD 207,000 - 340,000; Full time

Job summary

LinkedIn is seeking a Principal Staff Software Engineer to lead the GPU-Based Retrieval Platform, an AI infrastructure stack powering candidate generation and retrieval across core products. You will own end-to-end technical direction, oversee large-scale indexing, GPU scheduling, memory optimizations, and cross-team collaboration to drive throughput and quality.

You will mentor senior engineers, influence architecture across multiple organizations, and help drive cost efficiency while scaling

Qualifications

• BS in Computer Science or equivalent.
• 10+ years of industry experience in software design, development, and algorithm related solutions.
• 5+ years in experience as an architect, or technical leadership position.
• Experience in developing and scaling large scale databases or analytics systems
• Experience with coding in Java, C++, or Rust; knowledge of query execution, indexing, and concurrency.
• Hands on experience developing distributed systems, large-scale systems, databases and/or Backend APIs

Responsibilities

• Set the long-term technical strategy and architecture for LinkedIn’s GPU-Based Retrieval Platform.
• Lead the design and evolution of large-scale indexing, candidate generation, vector search, and retrieval-serving systems.
• Optimize GPU performance across CUDA, Triton, memory hierarchies, batching, scheduling, and multi-GPU communication.
• Improve throughput, QPS per GPU, tail latency, recall quality, reliability, and infrastructure cost.
• Build scalable, observable, and highly available multi-tenant serving systems for high-QPS production workloads.
• Make critical architectural trade-offs across latency, quality, capacity, model complexity, and cost.
• Partner with Feed, Ads, Search, Talent, Modeling, and Infrastructure teams to shape the platform roadmap.
• Evaluate emerging GPU technologies, retrieval architectures, and serving frameworks for adoption at LinkedIn.
• Lead complex cross-organizational initiatives from architecture and design through production rollout and adoption.
• Mentor senior engineers, raise the technical bar, and influence AI infrastructure strategy across LinkedIn.

Skills

AI / MLInfrastructure

Technical Strategy

Distributed Systems

Stakeholder Management

Education

BS in Computer Science or equivalent

Tools

CUDA

Triton

NCCL

Job description

LinkedIn is seeking a Principal Staff Software Engineer to lead the GPU-Based Retrieval Platform, an AI infrastructure stack powering candidate generation and retrieval across core products. You will own end-to-end technical direction, oversee large-scale indexing, GPU scheduling, memory optimizations, and cross-team collaboration to drive throughput and quality.

You will mentor senior engineers, influence architecture across multiple organizations, and help drive cost efficiency while scaling