Senior ML Engineer, LLM Systems — TS/SCI Cleared

Cynnovative; Arlington (VA); On-site; USD 120,000 - 150,000; Full time

Job summary

Cynnovative is seeking a Senior ML Engineer in Arlington, Virginia to develop and manage tools for LLM experimentation and deployment. You will design scalable LLM systems and ensure the reliability of these systems in production environments. The ideal candidate must have strong expertise in ML frameworks like PyTorch, containerization, and cloud platforms, alongside a B.S. in a related field. A TS/SCI security clearance is mandatory. This role plays a pivotal role in supporting U.S. national security efforts.

Qualifications

• U.S. Citizenship and active TS/SCI security clearance required.
• Experience with high-performance LLM inference frameworks is a plus.
• Understanding of ML system tradeoffs (latency vs throughput vs cost) is beneficial.

Responsibilities

• Design and build scalable LLM systems for high-throughput experimentation and inference.
• Lead development of experimentation infrastructure.
• Ensure production readiness and operational reliability of LLM systems.
• Collaborate cross-functionally with applied mathematicians and research engineers.

Skills

Strong communication skills and cross-functional collaboration

Deep understanding of transformer architectures and LLM inference workflows

Hands-on experience building scalable ML systems

Proficiency in Python and ML frameworks (e.g., PyTorch, Hugging Face)

Experience with distributed systems or large-scale compute environments

Experience with containerization and cloud platforms (Docker, Kubernetes, AWS/GCP/Azure)

Familiarity with CI/CD workflows for ML systems

Experience with version control systems (Git)

Education

B.S. in Computer Science, Software Engineering, or related field (M.S. or Ph.D. preferred)

Tools

Docker

Kubernetes

AWS

GCP

Azure

PyTorch

Hugging Face

vLLM

SGLang

Job description

Cynnovative is seeking a Senior ML Engineer in Arlington, Virginia to develop and manage tools for LLM experimentation and deployment. You will design scalable LLM systems and ensure the reliability of these systems in production environments. The ideal candidate must have strong expertise in ML frameworks like PyTorch, containerization, and cloud platforms, alongside a B.S. in a related field. A TS/SCI security clearance is mandatory. This role plays a pivotal role in supporting U.S. national security efforts.