ML Engineer: LLM Benchmarking & AI Model Validation

Sabree Software Services, Inc.; McLean (VA); On-site; USD 110,000 - 170,000; Full time

Job summary

Sabree Software Services, Inc. is seeking a Machine Learning Engineer to design experiments that benchmark LLMs, implement deep learning models, and validate AI systems. The role emphasizes GPU-accelerated computing, Python programming, and building robust ML pipelines in a United States context.

The candidate should have hands-on experience with model ensembles, Transformers libraries, and data preprocessing while delivering reliable analytics and visualizations for stakeholders.

Qualifications

• Experience designing experiments to test LLM performance.
• Experience with DL frameworks (PyTorch, TensorFlow, Keras).
• Experience testing/validating AI systems, focusing on LLMs.
• Experience using GPUs for accelerated computing.
• Experience tuning neural networks/LLMs on custom data and applying results.
• Experience developing models/ensembles, selecting Python libraries, preprocessing, analyzing performance.

Skills

Experiment design

DL frameworks

LLM evaluation

GPU acceleration

NN tuning

Model ensembles

Python

SQL

Git/Jenkins

Education

Master's in CS/ML

Tools

Tableau

Flask

HuggingFace Transformers

ONNX

SciKit-Learn

Job description

Sabree Software Services, Inc. is seeking a Machine Learning Engineer to design experiments that benchmark LLMs, implement deep learning models, and validate AI systems. The role emphasizes GPU-accelerated computing, Python programming, and building robust ML pipelines in a United States context.

The candidate should have hands-on experience with model ensembles, Transformers libraries, and data preprocessing while delivering reliable analytics and visualizations for stakeholders.