Senior LLM Platform Engineer - Secure Enterprise AI

parallel wireless

United States

Remote

USD 150,000 - 190,000

Full time

10 days ago
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive health benefits
Hybrid or on-site collaboration

Job summary

Parallel Wireless is seeking a senior technical leader to build and operate a secure, local LLM platform. You will own architecture, model routing, and retrieval systems, aiming to enable engineering and business teams with proven internal data and code while preserving security and governance.

The role spans applied LLM engineering, platform architecture, and production operations. You will optimize models, APIs, and tooling, ensuring correctness, safety, and measurable business value in a

Qualifications

  • Experience building production LLM-powered systems.
  • Strong API and data pipeline design skills.
  • Experience deploying containerized services on Linux.

Responsibilities

  • Own architecture and roadmap for a local LLM platform.
  • Build modular inference and model-gateway layer with stable APIs.
  • Design and operate RAG and enterprise-search pipelines.
  • Implement end-to-end observability for model and agent workflows.
  • Enforce source-system permissions and integrate with identity systems.

Skills

Python engineering
APIs/services design
Data pipelines
Observability
CI/CD
Docker
Kubernetes
LLM platforms
Security posture
Retrieval augmented generation
Search

Education

BSc or MSc in Computer Science or related field

Tools

Git
LLM serving runtimes
Terraform/IaC

Job description

Parallel Wireless is seeking a senior technical leader to build and operate a secure, local LLM platform. You will own architecture, model routing, and retrieval systems, aiming to enable engineering and business teams with proven internal data and code while preserving security and governance.

The role spans applied LLM engineering, platform architecture, and production operations. You will optimize models, APIs, and tooling, ensuring correctness, safety, and measurable business value in a

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior LLM Platform Engineer – Enterprise AI Systems
Senior LLM Platform Engineer – Enterprise AI Systems

Parallel Wireless • United States

On-site
USD 180,000 - 280,000
Senior Enterprise LLM Platform Engineer
Senior Enterprise LLM Platform Engineer

Parallel Wireless • Northern (KY)

Hybrid
USD 150,000 - 210,000
Senior LLM Platform Engineer: Enterprise AI & RAG Systems
Senior LLM Platform Engineer: Enterprise AI & RAG Systems

Socket.dev • United States

Remote
USD 150,000 - 230,000
Open RAN LLM Platform Lead
Open RAN LLM Platform Lead

Parallelwireless • United States

On-site
USD 140,000 - 210,000
LLM Ops Engineer: Build & Scale a Secure AI Platform
LLM Ops Engineer: Build & Scale a Secure AI Platform

FREEDOM SOLUTIONS GR • Denver (CO)

Hybrid
USD 105,000 - 130,000
Senior/Principal Local LLM & Generative AI Platform Engineer
Senior/Principal Local LLM & Generative AI Platform Engineer

Parallelwireless • United States

On-site
USD 140,000 - 210,000
Remote AI/ML Engineer for Secure LLM & Multi-Agent Systems
Remote AI/ML Engineer for Secure LLM & Multi-Agent Systems

YO AI Labs • Town of Texas (WI)

Remote
USD 120,000 - 180,000
Senior Security Engineer — AI/LLM Security for Healthcare
Senior Security Engineer — AI/LLM Security for Healthcare

Translucent • New York (NY)

On-site
USD 180,000 - 250,000
Equity
In-office 4 days/week
Competitive compensation
Staff AI Engineer: Lead LLM-Powered Platform & Architecture
Staff AI Engineer: Lead LLM-Powered Platform & Architecture

Worky • West Palm Beach (FL)

On-site
USD 155,000 - 176,000
Senior AI Platform Engineer - Remote, Production-Ready LLMs
Senior AI Platform Engineer - Remote, Production-Ready LLMs

CyberCoders • United States

Remote
USD 180,000 - 230,000
Medical benefits
401(k) with employer match
Paid time off
+1