ML Engineer: Evaluation & Experimentation (TS/SCI, NOVA)

Cynnovative; Arlington (VA); On-site; USD 100,000 - 130,000; Full time

Job summary

Cynnovative is seeking a Machine Learning Engineer (Evaluation & Experimentation) in Arlington, VA. The ideal candidate will design evaluation pipelines, run large-scale experiments, and ensure data quality. This role requires U.S. Citizenship and an active TS/SCI security clearance. Candidates should have a B.S. in a relevant field, proficiency in Python, and experience with data processing and statistical methods. Collaborate across teams to support national security efforts.

Qualifications

• Strong communication skills and ability to collaborate cross-functionally.
• Experience building experiment, evaluation, or analytics pipelines.
• Familiarity with experiment tracking tools such as MLflow.

Responsibilities

• Design and implement evaluation pipelines for LLM experimentation.
• Execute statistical analysis and testing over experimental results.
• Collaborate with ML systems engineers to ensure data capture.

Skills

Python

Data processing

Statistical methods

Version control systems (Git)

Collaboration

Experiment tracking tools (MLflow)

Education

B.S. in Computer Science, Data Science, or related field

M.S. or Ph.D. preferred

Tools

Statistical analysis tools

Job description

Cynnovative is seeking a Machine Learning Engineer (Evaluation & Experimentation) in Arlington, VA. The ideal candidate will design evaluation pipelines, run large-scale experiments, and ensure data quality. This role requires U.S. Citizenship and an active TS/SCI security clearance. Candidates should have a B.S. in a relevant field, proficiency in Python, and experience with data processing and statistical methods. Collaborate across teams to support national security efforts.