ML Engineer / Researcher — LLM Fine-Tuning & Post-Training

Serus

New York (NY)

Hybrid

USD 140,000 - 210,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Anon AI Labs, the company behind Serus, seeks an ML Engineer/Researcher to lead LLM fine-tuning and post-training for its customer-facing intelligence product. You will design training pipelines from base model selection to data prep, training, evaluation and production deployment, working with engineers across teams in New York or San Francisco.

You will evaluate open-weight models, build datasets, fine-tune for domain knowledge and complex task execution, and develop rigorous evaluations for

Qualifications

  • Hands-on experience fine-tuning or post-training language models.
  • Strong Python and practical knowledge of modern training frameworks.
  • Experience preparing high-quality datasets and designing meaningful evaluations.
  • The ability to diagnose model failures and run disciplined experiments.
  • An understanding of inference and production deployment.
  • Experience with tool-using models, security-domain data or agent training is particularly relevant.

Responsibilities

  • Evaluate suitable open-weight models and establish strong baselines.
  • Build training datasets for intelligence research, tool use and agent behavior.
  • Fine-tune models for domain knowledge, decision-making and task execution.
  • Develop evaluations that measure performance on realistic customer workflows.
  • Improve the handling of complex security material and sensitive context.
  • Investigate supervised fine-tuning, preference optimization, distillation and other relevant techniques.
  • Work with agent and backend engineers to deploy trained models.
  • Measure quality, latency, inference cost and operational requirements.

Skills

Fine-tuning LM
Python & ML frameworks
Data preparation & evaluation
Model debugging
Deployment knowledge
Tool-using models

Job description

ML Engineer / Researcher — LLM Fine-Tuning & Post-Training

You will help determine which models should power Serus and develop the training processes that make them better at our work.

Anon AI Labs, the company behind Serus. Location: San Francisco / New York. UK, Sweden and other locations considered.

About us

Anon AI Labs builds Serus, a personal AI product that combines intelligence research with actions that reduce digital exposure.

We’re exploring specialized models to power our customer-facing intelligence engine and agents. We want models with deep capability in security and privacy, strong tool use and the judgment to handle demanding research tasks appropriately.

The role

The goal is to deploy models inside the customer-facing product. Your work will influence the quality of investigations, the agent’s decisions and its ability to complete complex tasks.

You should understand the full path from choosing a base model to preparing data, training, evaluation and production deployment.

What you’ll do
  • Evaluate suitable open-weight models and establish strong baselines.
  • Build training datasets for intelligence research, tool use and agent behavior.
  • Fine-tune models for domain knowledge, decision-making and task execution.
  • Develop evaluations that measure performance on realistic customer workflows.
  • Improve the handling of complex security material and sensitive context.
  • Investigate supervised fine-tuning, preference optimization, distillation and other relevant techniques.
  • Work with agent and backend engineers to deploy trained models.
  • Measure quality, latency, inference cost and operational requirements.
What we’re looking for
  • Hands-on experience fine-tuning or post-training language models.
  • Strong Python and practical knowledge of modern training frameworks.
  • Experience preparing high-quality datasets and designing meaningful evaluations.
  • The ability to diagnose model failures and run disciplined experiments.
  • An understanding of inference and production deployment.
  • Experience with tool-using models, security-domain data or agent training is particularly relevant.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Fine-Tuning & Research Engineer
LLM Fine-Tuning & Research Engineer

Serus • New York (NY)

Hybrid
USD 140,000 - 210,000
Senior AI Agent Engineer
Senior AI Agent Engineer

Serus • New York (NY)

On-site
USD 180,000 - 260,000
Artificial Intelligence Researcher - Post Training
Artificial Intelligence Researcher - Post Training

Velocity Tech • San Francisco (CA)

On-site
USD 120,000 - 180,000
Research Engineer - LLM Post-Training & Agents
Research Engineer - LLM Post-Training & Agents

Kaon (prev. FlowGPT) • San Francisco (CA)

On-site
USD 200,000 - 500,000
Machine Learning Researcher
Machine Learning Researcher

Multicoin • San Francisco (CA)

Hybrid
USD 250,000 - 350,000
Competitive compensation
Equity in a high-growth startup
Comprehensive benefits
Senior AI Engineer (LLM Training & RLHF) - Remote
Senior AI Engineer (LLM Training & RLHF) - Remote

Prolific • Mesa (AZ)

On-site
USD 140,000 - 230,000
AI Engineer/ML Engineer - Senior Developers - AI Training - Memphis, US
AI Engineer/ML Engineer - Senior Developers - AI Training - Memphis, US

Prolific • Memphis (TN)

Hybrid
USD 90,000 - 130,000
Competitive pay rates
Flexible hours
Ability to work from home
MTS, Post-Training (Enterprise)
MTS, Post-Training (Enterprise)

Bespoke Labs • United States

Hybrid
USD 300,000 - 350,000
Health/dental/vision coverage
401(k) plan
Daily onsite lunch
+2
Product ML Engineer
Product ML Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 140,000 - 200,000
AI Engineer/ML Engineer - Senior Developers - AI Training - Mesa, US
AI Engineer/ML Engineer - Senior Developers - AI Training - Mesa, US

Prolific • Mesa (AZ)

Remote
USD 140,000 - 230,000
Work from home
Flexible hours
Competitive pay