ML Engineer II: Open-Weight LMs, On-Prem Deploy

The Bison Group LLC

El Paso (TX)

On-site

USD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

The Bison Group LLC is seeking a Machine Learning Engineer to own the model training lifecycle—from data prep through evaluation and deployment. You will fine-tune open-weight language models, build RAG-ready pipelines, and optimize for accuracy and latency on on‑prem GPUs.

You will collaborate with product and domain experts to shape model behavior, document experiments, and create reproducible training workflows that work offline without internet access.

Qualifications

  • Hands-on training and fine-tuning of neural models end-to-end.
  • Experience building/maintaining training pipelines and reproducible workflows.
  • Ability to design robust evaluation and ablation studies.

Responsibilities

  • Train and fine-tune open-weight language models using supervised fine-tuning and parameter-efficient methods.
  • Build and curate instruction datasets from transcripts and reference materials.
  • Label, clean and deduplicate data; generate synthetic examples for robust evaluation.
  • Train embedding/retriever models for retrieval-augmented generation (RAG).
  • Develop offline evaluation suites to measure accuracy, hallucinations and latency.
  • Package models for deployment on constrained hardware and on-prem GPUs.
  • Collaborate with product teams to define useful model behavior and document experiments.

Skills

Hands-on neural network training
Fine-tuning open-weight LLMs
Python
PyTorch
Linux
CUDA/GPU training
Data preparation
Experiment tracking

Education

Bachelor's or higher in CS/Math/EE

Tools

NVIDIA NeMo
TensorRT
LoRA/QLoRA tooling
RAG pipelines

Job description

The Bison Group LLC is seeking a Machine Learning Engineer to own the model training lifecycle—from data prep through evaluation and deployment. You will fine-tune open-weight language models, build RAG-ready pipelines, and optimize for accuracy and latency on on‑prem GPUs.

You will collaborate with product and domain experts to shape model behavior, document experiments, and create reproducible training workflows that work offline without internet access.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Engineer: On-Prem Training & RAG Expert
Senior ML Engineer: On-Prem Training & RAG Expert

The Bison Group • El Paso (TX)

On-site
USD 120,000 - 180,000
Medical insurance
Dental insurance
Vision insurance
+3
ML Engineer — Build, Deploy & Optimize Models
ML Engineer — Build, Deploy & Optimize Models

Birch Atlantic Group • Tampa (FL)

On-site
USD 140,000 - 210,000
Health insurance
Dental insurance
Vision insurance
+5
Remote LLM Engineer: Fine-Tune & Deploy
Remote LLM Engineer: Fine-Tune & Deploy

Partner Company • United States

Remote
USD 79,000 - 124,000
Paid leave days 20
Health insurance allowance
Equipment budget
+2
LLM Post-Training Engineer - RL, SFT & Data Pipelines
LLM Post-Training Engineer - RL, SFT & Data Pipelines

News Break • Mountain View (CA)

On-site
USD 150,000 - 230,000
Health, dental, and vision care for you and your family
Top-tier 401(K) plan with company matching
Paid time off and paid holidays
+2
ML Engineer II — Production AI & Enterprise Systems
ML Engineer II — Production AI & Enterprise Systems

Press Ganey Associates LLC • United States

Hybrid
USD 110,000 - 130,000
Discretionary bonus
Hybrid work model
Machine Learning Engineer II (Model Training)
Machine Learning Engineer II (Model Training)

The Bison Group • El Paso (TX)

On-site
USD 120,000 - 180,000
Medical insurance
Dental insurance
Vision insurance
+3
Applied Machine Learning Engineer
Applied Machine Learning Engineer

Vidman AI • United States

Remote
USD 150,000 - 230,000
Machine Learning Engineer II (Model Training)
Machine Learning Engineer II (Model Training)

The Bison Group LLC • El Paso (TX)

On-site
USD 120,000 - 180,000
MLO Engineer (Machine Learning Operations)
MLO Engineer (Machine Learning Operations)

Stratolaunch • United States

Remote
USD 140,000 - 190,000
9/80 schedule
Healthcare coverage
Paid parental leave
+2
Senior AI Platform Engineer – Scale ML & Open-Weight LLMs
Senior AI Platform Engineer – Scale ML & Open-Weight LLMs

Workday, Inc. (old) • Boulder (CO)

On-site
USD 150,000 - 200,000