LLM Platform Engineer: AI Infra & Orchestration

snc; Lone Tree (CO); Hybrid; USD 108,000 - 149,000; Full time

Job summary

SNC is seeking an experienced AI/ML Engineer II to design, implement, and optimize enterprise AI platform services, focusing on LLM gateway, model routing, and orchestration. You will build integrations, perform performance testing, and ensure reliability at scale within a hybrid environment.

You will collaborate with cross-functional teams to deliver production-ready AI solutions, maintain documentation, and explore new LLM providers and orchestration tools to advance platform capabilities.

Qualifications

• Bachelor's degree in computer science, mathematics, applied statistics, various engineering disciplines, or related STEM discipline.
• 2+ years of experience in a related field.
• Practical experience building and operating APIs at scale in a cloud environment (AWS, Azure, or GCP).
• Hands-on experience integrating with at least one major LLM provider (OpenAI, Anthropic, Cohere, Mistral, etc.).
• Proficiency in Python and at least one additional language (TypeScript or Go preferred).
• Familiarity with containerization (Docker, Kubernetes) and GitOps workflows.

Responsibilities

• Design, implement, and optimize platform services such as the LLM gateway, model routing, and workflow orchestration systems.
• Develop and maintain integrations that connect LLMs to enterprise systems, data sources, and APIs. Identify gaps in platform capability and propose solutions.
• Conduct performance testing and validation of platform services, including prompt evaluation frameworks. Optimize for reliability, cost, and scalability.
• Write and deploy efficient, modular code to integrate LLMs and AI agents into enterprise systems, ensuring reliability and compatibility with existing platforms.
• Test platform changes in staging environments to evaluate performance under real-world load. Contribute to system-level debugging and troubleshooting.
• Collaborate with the Forward Deployed AI team, software developers, and platform architects to align platform capability with business and enterprise requirements
• Document technical designs, workflows, and testing procedures for internal and external use. Share findings and best practices with team members.
• Document technical designs, workflows, and testing procedures for internal and external use. Share findings and best practices with team members.
• Explore and integrate emerging LLM providers, agent frameworks, and orchestration tools to enhance platform capabilities.
• Monitor model performance, cost, and usage; continuously optimize routing logic to balance capability vs. spend
• Execute validation procedures and support platform compliance with CMMC, FIPS, and SNC security policy requirements.
• Implement prompt management, versioning, and evaluation frameworks to ensure AI output quality and reliability
• Maintain platform SLOs and participate in on-call rotation for AI infrastructure.

Job description

SNC is seeking an experienced AI/ML Engineer II to design, implement, and optimize enterprise AI platform services, focusing on LLM gateway, model routing, and orchestration. You will build integrations, perform performance testing, and ensure reliability at scale within a hybrid environment.

You will collaborate with cross-functional teams to deliver production-ready AI solutions, maintain documentation, and explore new LLM providers and orchestration tools to advance platform capabilities.