AI/ML Production Reliability Engineer

Peraton; Chantilly (VA); Presencial; USD 112 000 - 179 000; Tempo integral

Resumo da oferta

Peraton is seeking an AI/ML Operations & Assurance Engineer to monitor, evaluate, and maintain production AI-enabled applications, foundation-model integrations, and agentic workflows at an on-site Chantilly, VA location. The role emphasizes operational reliability, workflow performance, evaluation, and safe introduction of AI changes into production environments.

The ideal candidate brings cloud and application operations experience, knowledge of LLM-based applications, and collaboration with

Qualificações

• Active TS/SCI clearance with CI Polygraph.
• BS/BA and 5 years of experience.
• Approximately 5–8 years of experience in platform operations, site reliability engineering, cloud engineering, software operations, applied AI/ML operations, or production application support.
• Experience operating and troubleshooting production software applications or cloud services.
• Experience with monitoring, logging, metrics, incident response, and configuration or change management.
• Working knowledge of foundation-model or LLM-based applications, including prompts, model endpoints, tool calls, and retrieval-augmented applications.
• Experience with AWS or comparable cloud platforms.
• Strong analytical, troubleshooting, documentation, and communication skills.

Responsabilidades

• Monitor availability, latency, error rates, model and token usage, service costs, tool-call failures, and workflow completion metrics for production AI services.
• Integrate AI service health and agent-workflow telemetry into observability dashboards, monitoring systems, and alerting processes.
• Investigate failed, stalled, repetitive, or abnormal AI workflows and coordinate remediation with software, platform, and AI engineering teams.
• Maintain operational runbooks, escalation procedures, troubleshooting guidance, and recovery processes for AI-enabled applications.
• Distinguish infrastructure and application failures from issues associated with model behavior, prompts, retrieval sources, or agent orchestration.

Conhecimentos

Analytical skills

Troubleshooting

Documentation

Communication

Formação académica

BS/BA

Ferramentas

AWS

Kubernetes

OpenTelemetry

CloudWatch

OpenSearch

Grafana

Descrição da oferta de emprego

Peraton is seeking an AI/ML Operations & Assurance Engineer to monitor, evaluate, and maintain production AI-enabled applications, foundation-model integrations, and agentic workflows at an on-site Chantilly, VA location. The role emphasizes operational reliability, workflow performance, evaluation, and safe introduction of AI changes into production environments.

The ideal candidate brings cloud and application operations experience, knowledge of LLM-based applications, and collaboration with