Open RAN LLM Platform Lead

Parallelwireless; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Parallel Wireless seeks a hands-on senior technical leader to build and operate a secure local LLM platform for engineering and business teams. You will select models, optimize retrieval, and expose reusable APIs while ensuring safety, grounding, and compliance within company environments.

You will own architecture, drive platform development across data pipelines, security, and observability, and collaborate with product, IT, and security teams to deliver measurable business value.

Qualifications

• 7+ years of hands-on production software or ML platform experience.
• Strong Python engineering with API/service design.
• Experience shipping LLM-powered systems in production.
• Docker and Kubernetes in production environments.
• Knowledge of transformer models, inference, and quantization.
• Experience building RAG or enterprise-search systems with embeddings.
• Security, identity, and data lifecycle controls in practice.
• Ability to lead cross-functional initiatives and ship safely.

Responsibilities

• Own architecture and technical roadmap for a secure LLM platform.
• Build modular inference and model-gateway layers with stable APIs.
• Evaluate open-weight models and document provenance & licenses.
• Optimize serving across CPU, GPU, and accelerators.
• Design RAG and enterprise-search pipelines with metadata and citations.
• Enforce source-system permissions and integrate with SSO/ABAC.
• Establish offline/online evaluation for grounding and safety.
• Create release gates, tests, canary releases, and rollback paths.
• Implement end-to-end observability: traces, latency, throughput.
• Develop safe tool-calling workflows with least-privilege access.
• Integrate platform with dev tools, CI workflows, and knowledge systems.
• Build production readiness: CI/CD, backups, disaster recovery.
• Protect data with encryption, redaction, and audit logging.

Skills

Python

Go

C/C++

APIs

LLM platforms

Distributed systems

Security & RBAC

Observability

CI/CD

GPU acceleration

NVIDIA CUDA

Git & MLOps

Education

BSc in CS/Engineering

MS in a related field

Tools

Docker

Kubernetes

TensorRT-LMM

LLM tooling

Job description

Parallel Wireless seeks a hands-on senior technical leader to build and operate a secure local LLM platform for engineering and business teams. You will select models, optimize retrieval, and expose reusable APIs while ensuring safety, grounding, and compliance within company environments.

You will own architecture, drive platform development across data pipelines, security, and observability, and collaborate with product, IT, and security teams to deliver measurable business value.