Senior LLM Platform Engineer: Enterprise AI & RAG Systems

Socket.dev; United States; Remote; USD 150,000 - 230,000; Full time

Job summary

Parallel Wireless is seeking a hands-on technical leader to build and operate a secure local LLM platform within our controlled infrastructure. You will turn prototypes into a dependable enterprise capability, selecting models, building retrieval, APIs, and tooling.

You will design with strong access controls, observability, and canary release capabilities, evaluating safety, latency, and business value across use cases from engineering knowledge discovery to documentation and QA.

Qualifications

• Experience shipping LLM-powered systems.
• Strong Python engineering skills.
• Experience with APIs and data pipelines.

Responsibilities

• Own architecture and roadmap for secure local LLM platform.
• Collaborate with cross-functional teams to translate use cases into requirements.
• Build modular inference and model-gateway layer.
• Evaluate open-weight models and document provenance.

Skills

Python

APIs design

Go

Java

C/C++

LLM platforms

Security

Education

BSc/MSc in CS/CE/EE data science

Tools

Docker

Kubernetes

Git

Python tooling

Job description

Parallel Wireless is seeking a hands-on technical leader to build and operate a secure local LLM platform within our controlled infrastructure. You will turn prototypes into a dependable enterprise capability, selecting models, building retrieval, APIs, and tooling.

You will design with strong access controls, observability, and canary release capabilities, evaluating safety, latency, and business value across use cases from engineering knowledge discovery to documentation and QA.