Senior ML Engineer: On-Prem Training & RAG Expert

The Bison Group

El Paso (TX)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical insurance
Dental insurance
Vision insurance
Life insurance
Disability insurance
Paid time off

Job summary

The Bison Group is seeking a Machine Learning Engineer in the United States to lead the model training lifecycle from data preparation to evaluation and deployment. You will fine-tune open-weight language models, build domain-specific datasets, and validate performance against baselines.

Expect work across offline evaluation, regression tests, and on-prem GPU deployment with constrained hardware. The role emphasizes collaboration with product, UX, and analysts to shape model behavior, and

Qualifications

  • 3+ years of hands-on neural network training or fine-tuning.
  • Hands-on fine-tuning of a 7B+ parameter open-weight language model using supervised fine-tuning (SFT), LoRA/QLoRA or full fine-tuning, with PyTorch and Hugging Face Transformers/PEFT, NeMo or equivalent tools.
  • Dataset construction skills, including cleaning, deduplication, formatting and labeling of text data, and judgment about whether data is suitable for training.
  • Experience designing task-specific metrics and test sets, and diagnosing overfitting, catastrophic forgetting and data leakage.
  • GPU training fundamentals, including mixed precision, gradient accumulation, checkpointing, memory budgeting and multi-GPU basics.
  • Strong Python and Linux skills, including command-line work, CUDA environment management and dependency management without internet access.
  • U.S. citizenship and eligibility to obtain and maintain a U.S. security clearance.

Responsibilities

  • Train and fine-tune open-weight language models with supervised fine-tuning and parameter-efficient methods.
  • Build instruction and preference datasets from transcripts and reference materials.
  • Label, clean and deduplicate data; generate synthetic examples with subject matter.
  • Train or fine-tune embedding and reranker models for retrieval-augmented generation (RAG).
  • Measure retrieval quality for specialized terminology and acronyms.
  • Adapt speech recognition, speaker diarization and voice activity detection models for noisy audio and multi-speaker scenarios.
  • Create reproducible training workflows with experiment tracking, versioned datasets and model cards.
  • Package models and dependencies for deployment on on-premises GPUs and constrained hardware.
  • Collaborate with product/UX/analysts to define useful model behavior and document experiments.
  • Document decisions so teams can retrain and maintain models.

Skills

Neural network training
Fine-tuning LoRA/QLoRA
Python
Linux
Dataset construction
PyTorch
Hugging Face Transformers/PEFT
CUDA & multi-GPU
Security clearance eligibility

Tools

NVIDIA NeMo
TensorRT-LLM
llama.cpp
GGUF
vLLM
NIM/TensorRT-LLM

Job description

The Bison Group is seeking a Machine Learning Engineer in the United States to lead the model training lifecycle from data preparation to evaluation and deployment. You will fine-tune open-weight language models, build domain-specific datasets, and validate performance against baselines.

Expect work across offline evaluation, regression tests, and on-prem GPU deployment with constrained hardware. The role emphasizes collaboration with product, UX, and analysts to shape model behavior, and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer II: Open-Weight LMs, On-Prem Deploy
ML Engineer II: Open-Weight LMs, On-Prem Deploy

The Bison Group LLC • El Paso (TX)

On-site
USD 120,000 - 180,000
Senior ML Engineer: Build & Deploy Scalable Models
Senior ML Engineer: Build & Deploy Scalable Models

GSB • Los Angeles (CA)

On-site
USD 140,000 - 220,000
Lead ML Systems Engineer — Production-Ready
Lead ML Systems Engineer — Production-Ready

Sarsfield Group • United States

Remote
USD 195,000 - 300,000
Health and Dental
Life insurance
401(k) matching
+1
Senior ML Engineer: LLMs, RAG & Production-Grade Systems
Senior ML Engineer: LLMs, RAG & Production-Grade Systems

Flagship Pioneering, Inc. • Cambridge (MA)

On-site
USD 150,000 - 190,000
Healthcare coverage
Annual incentive program
Retirement benefits
+1
Senior ML Engineer: Scalable Training & RL Systems
Senior ML Engineer: Scalable Training & RL Systems

Nebius Group • Palo Alto (CA)

On-site
USD 195,000 - 262,000
Health insurance
401(k) plan with match
Parental leave
+2
Remote Senior ML Research & Engineering Specialist
Remote Senior ML Research & Engineering Specialist

Gramian Consulting Group • United States

Remote
USD 120,000 - 180,000
Machine Learning Engineer II (Model Training)
Machine Learning Engineer II (Model Training)

The Bison Group • El Paso (TX)

On-site
USD 120,000 - 180,000
Medical insurance
Dental insurance
Vision insurance
+3
Machine Learning Engineer II (Model Training)
Machine Learning Engineer II (Model Training)

The Bison Group LLC • El Paso (TX)

On-site
USD 120,000 - 180,000
Senior ML Engineer — Production ML & Cloud (GCP Certified)
Senior ML Engineer — Production ML & Cloud (GCP Certified)

Aimlroles • Vermont

On-site
USD 100,000 - 160,000
Senior ML Engineer
Senior ML Engineer

Data Essentia • United States

Remote
USD 130,000 - 170,000