LLM Platform Engineer: AI Infra & Orchestration

Sierra Nevada Corporation; Lone Tree (CO); Hybrid; USD 108,000 - 149,000; Full time

Benefits offered by this job

401(k) with 150% match up to 6%

Medical, dental, and vision plans

Tuition reimbursement

Paid time off

Job summary

Sierra Nevada Corporation seeks a mid-level AI/ML Engineer II to design, deploy, and optimize AI/ML solutions for mission-critical applications. You will own projects, analyze data, and scale models while collaborating with multidisciplinary teams to meet objectives.

Responsibilities include building platform services, integrating LLMs with enterprise systems, and ensuring reliability, cost efficiency, and security compliance across the stack.

Qualifications

• Bachelor’s degree in computer science, mathematics, applied statistics, engineering, or related STEM discipline.
• 2+ years of experience in a related field.
• Higher level degree may substitute for experience.
• Experience building and operating APIs at scale in a cloud environment (AWS, Azure, or GCP).
• Hands-on experience integrating with at least one major LLM provider (OpenAI, Anthropic, Cohere, Mistral, etc.).
• Proficiency in Python and at least one additional language (TypeScript or Go).
• Familiarity with containerization (Docker, Kubernetes) and GitOps workflows.

Responsibilities

• Design, implement, and optimize platform services such as the LLM gateway, model routing, and workflow orchestration systems.
• Develop and maintain integrations that connect LLMs to enterprise systems, data sources, and APIs.
• Conduct performance testing and validation of platform services, including prompt evaluation frameworks.
• Write and deploy efficient, modular code to integrate LLMs and AI agents into enterprise systems, ensuring reliability and compatibility with existing platforms.
• Test platform changes in staging environments to evaluate performance under real-world load.
• Collaborate with the Forward Deployed AI team, software developers, and platform architects to align platform capability with business and enterprise requirements
• Document technical designs, workflows, and testing procedures for internal and external use. Share findings and best practices with team members.
• Explore and integrate emerging LLM providers, agent frameworks, and orchestration tools to enhance platform capabilities.
• Monitor model performance, cost, and usage; continuously optimize routing logic to balance capability vs. spend
• Execute validation procedures and support platform compliance with CMMC, FIPS, and SNC security policy requirements.
• Implement prompt management, versioning, and evaluation frameworks to ensure AI output quality and reliability
• Maintain platform SLOs and participate in on-call rotation for AI infrastructure.

Skills

Python

TypeScript

Go

APIs at scale

Cloud environments

Docker

Kubernetes

GitOps

LLM providers

Performance optimization

Education

Bachelor’s degree in CS/Math/Stats/Engineering

Tools

LangChain

LlamaIndex

MLflow

Job description

Sierra Nevada Corporation seeks a mid-level AI/ML Engineer II to design, deploy, and optimize AI/ML solutions for mission-critical applications. You will own projects, analyze data, and scale models while collaborating with multidisciplinary teams to meet objectives.

Responsibilities include building platform services, integrating LLMs with enterprise systems, and ensuring reliability, cost efficiency, and security compliance across the stack.