Remote Staff ML Engineer, LLM Infra for Real-Time Matching

Smithspektrum

United States

On-site

USD 220,000 - 280,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Equity package: 0.15% – 0.3% with 4-year vesting
Fully remote with $5,000 home office budget
Unlimited PTO (minimum 4 weeks required)
Premium health, dental, vision for dependents
$5,000 annual learning budget
Latest MacBook Pro or Linux workstation
Annual team offsite in interesting locations

Job summary

Smithspektrum is seeking a Staff ML Engineer to architect and scale LLM infrastructure for talent-matching technology. You will tackle challenges like semantic understanding of skills and real-time matching algorithms.

The ideal candidate has at least 8 years of software engineering experience, including production with LLMs. This fully remote position offers a competitive salary and substantial benefits, including equity, unlimited PTO, and a home office budget.

Qualifications

  • 8+ years of software engineering experience, with 4+ years focused on ML/AI.
  • Production experience with LLMs including fine-tuning and RAG implementations.
  • Deep expertise in Python, PyTorch or TensorFlow, and ML infrastructure.

Responsibilities

  • Design and implement LLM-powered skill extraction and matching pipeline.
  • Build and maintain RAG systems for contextual understanding.
  • Develop evaluation frameworks to measure and improve model performance.

Skills

Software engineering
Machine Learning
LLMs (GPT-4, Claude, Llama)
Python
PyTorch
TensorFlow
ML infrastructure (MLflow, Weights & Biases)
Vector databases (Pinecone, Weaviate, Milvus)
Technical project leadership
Excellent written communication

Job description

Smithspektrum is seeking a Staff ML Engineer to architect and scale LLM infrastructure for talent-matching technology. You will tackle challenges like semantic understanding of skills and real-time matching algorithms.

The ideal candidate has at least 8 years of software engineering experience, including production with LLMs. This fully remote position offers a competitive salary and substantial benefits, including equity, unlimited PTO, and a home office budget.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineering Manager - LLM Serving (Remote - US)
Machine Learning Engineering Manager - LLM Serving (Remote - US)

Jobgether • United States

On-site
USD 176,166 - 251,666
Competitive salary range
Comprehensive health insurance
Paid parental leave
+4
Senior ML Engineer (Remote, USA) - LLMs, RAG & Multimodal
Senior ML Engineer (Remote, USA) - LLMs, RAG & Multimodal

SupportFinity™ • Washington

Remote
USD 140,000 - 190,000
Senior Applied ML Engineer-Remote, GenAI & LLM Deployments
Senior Applied ML Engineer-Remote, GenAI & LLM Deployments

Upstart • United States

Remote
USD 167,000 - 232,000
401(k) match
ESPP
Health coverage
+1
Staff ML Systems Engineer - LLM Serving & RL
Staff ML Systems Engineer - LLM Serving & RL

Prime Intellect • San Francisco (CA), Northern (KY)

Hybrid
USD 150,000 - 300,000
Remote option
Visa sponsorship
Relocation support
+2
Senior LLM & ML Infrastructure Engineer (Remote)
Senior LLM & ML Infrastructure Engineer (Remote)

artificial intelligence and robotics laboratory (itu air lab) • Arlington (VA)

Hybrid
USD 140,000 - 210,000
ML Infra Engineer — Open-Source LLM Performance
ML Infra Engineer — Open-Source LLM Performance

well-funded deeptech startup • San Francisco (CA)

Hybrid
USD 225,000 - 275,000
Bonus
Medical
Dental
+4
Staff Engineer - LLM Serving & Inference at Scale
Staff Engineer - LLM Serving & Inference at Scale

Primeintellect • San Francisco (CA)

Hybrid
USD 150,000 - 300,000
Remote or SF office
Visa sponsorship
Relocation support
+3
Senior ML Engineer: LLMs & AI Platform (Remote)
Senior ML Engineer: LLMs & AI Platform (Remote)

Traveltechessentialist • United States

On-site
USD 248,000 - 310,000
Bonus
Equity
Employee Travel Credits
Remote Staff ML Engineer — AI Systems Leader
Remote Staff ML Engineer — AI Systems Leader

Primer • Pasadena (CA)

Remote
USD 180,000 - 240,000
Full medical, dental, vision coverage
Remote work stipend
401(k)
+2
Staff Machine Learning Engineer, LLM Fine‑Tuning (Verilog/RTL Applications)
Staff Machine Learning Engineer, LLM Fine‑Tuning (Verilog/RTL Applications)

Highbrow Technology Inc • San Jose (CA)

On-site
USD 150,000 - 200,000