Senior Enterprise LLM Platform Engineer

Parallel Wireless; Northern (KY); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Parallel Wireless seeks a senior individual‑contributor to build and operate a secure local LLM platform for internal engineering and business teams. You will lead architecture, model routing, and retrieval pipelines while enforcing strict access controls and observability.

The role covers end‑to‑end operations from model selection to production deployment, with emphasis on safety, provenance, and scalable infra within company-controlled environments.

Qualifications

• Advanced degree or equivalent practical experience in CS or related field.
• 7+ years in production software/ML platform or related infra engineering.
• Strong Python and API design skills; containerized services experience.

Responsibilities

• Own the architecture and roadmap for a secure local LLM platform.
• Design modular inference, model gateway, and retrieval pipelines.
• Ensure strict access controls, auditable workflows, and compliance.
• Build observability, performance optimization, and release gates.
• Collaborate with cross-functional teams to prioritize value.

Skills

Python

APIs

Distributed systems

Security and IAM

Docker & Kubernetes

LLM/AI systems

RAG/Enterprise-search

Code/Model provenance

Education

BSc/MSc Computer Science or related

Tools

Docker

Kubernetes

Git

CI/CD

vLLM/TensorRT-LLM

Job description

Parallel Wireless seeks a senior individual‑contributor to build and operate a secure local LLM platform for internal engineering and business teams. You will lead architecture, model routing, and retrieval pipelines while enforcing strict access controls and observability.

The role covers end‑to‑end operations from model selection to production deployment, with emphasis on safety, provenance, and scalable infra within company-controlled environments.