Remote Senior AI LLM Engineer Self-Hosted Production-Ready

RMG Talent

United States

Remote

USD 89,000 - 134,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote in Europe
Long-term collaboration with B2B
20 working days paid leave
100 USD monthly health insurance
Equipment budget
Access to AI dev tools
Learning and development support
Annual team gathering
Work on self-hosted LLMs

Job summary

RMG Talent is seeking a hands-on Mid/Senior AI LLM Engineer to improve self-hosted models powering consumer-facing AI products. You will fine-tune open-weight LLMs, build datasets, and ensure robust deployment from data to evaluation and production, not via third-party APIs.

The role is fully remote within Europe with ASAP start. Salary is 80,000–120,000 EUR gross per year, with long-term B2B collaboration preferred.

Qualifications

  • Hands-on experience fine-tuning open-weight language models and deploying them into production.
  • Strong Python skills and practical experience with PyTorch and Hugging Face.
  • Experience with supervised fine-tuning and LoRA/QLoRA.
  • Familiarity with preference-based training methods such as DPO or GRPO.
  • Practical GPU training and debugging experience.
  • Ability to build training datasets and evaluate model performance independently.
  • Experience working on consumer-facing AI products.
  • Comfortable with unrestricted AI models and adult content as part of the product.
  • A hands-on engineering profile — not an AI researcher or ChatGPT API-only developer.

Responsibilities

  • Fine-tune and post-train open-weight models and deploy to production.
  • Build training datasets and evaluate model performance independently.
  • Work on long-context consistency, personalization, multilingual quality, and evaluation.
  • Debug and optimise GPU training workloads.
  • Measure and ship improvements for consumer-facing AI products.
  • Contribute to ongoing moderation and safety evaluations.

Skills

Fine-tune LLMs
Python
PyTorch
Hugging Face
LoRA
Preference training
GPU training
Dataset building
Model evaluation
Consumer AI
Production deployment

Tools

Hugging Face
PyTorch
CUDA

Job description

RMG Talent is seeking a hands-on Mid/Senior AI LLM Engineer to improve self-hosted models powering consumer-facing AI products. You will fine-tune open-weight LLMs, build datasets, and ensure robust deployment from data to evaluation and production, not via third-party APIs.

The role is fully remote within Europe with ASAP start. Salary is 80,000–120,000 EUR gross per year, with long-term B2B collaboration preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Mid/Senior AI LLM Engineer (Fully Remote)
Mid/Senior AI LLM Engineer (Fully Remote)

Partner Company • United States

Remote
USD 79,000 - 124,000
Paid leave days 20
Health insurance allowance
Equipment budget
+2
Mid/Senior AI LLM Engineer - Remote (Europe)
Mid/Senior AI LLM Engineer - Remote (Europe)

RMG Talent • United States

Remote
USD 89,000 - 134,000
Fully remote in Europe
Long-term collaboration with B2B
20 working days paid leave
+6
Remote AI LLM Engineer: Fine-Tune & Deploy Self-Hosted Models
Remote AI LLM Engineer: Fine-Tune & Deploy Self-Hosted Models

David Kennedy Recruitment • United States

Remote
USD 101,000 - 169,000
Health insurance allowance
Equipment budget
Access to AI development tools
+2
Remote LLM Engineer: Fine-Tune & Deploy
Remote LLM Engineer: Fine-Tune & Deploy

Partner Company • United States

Remote
USD 79,000 - 124,000
Paid leave days 20
Health insurance allowance
Equipment budget
+2
Senior AI Engineer - Build Production LLMs (Remote)
Senior AI Engineer - Build Production LLMs (Remote)

Brainfullstack Ltd. • San Francisco (CA), Northern (KY)

Hybrid
USD 185,000 - 235,000
Remote: Senior AI Platform Lead for Production LLMs
Remote: Senior AI Platform Lead for Production LLMs

CyberCoders, Inc. • United States

Remote
USD 180,000 - 280,000
Medical/Dental/Vision
HSA/FSA options
Family and pet benefits
+3
Senior Open-Weight LLM Engineer — Fully Remote
Senior Open-Weight LLM Engineer — Fully Remote

OpenKrill • United States

Remote
USD 180,000 - 260,000
Fully remote work
4 weeks PTO per year
Annual gathering
+5
AI / LLM Software Engineer - 100% remote - W2 only (no sponsorship)
AI / LLM Software Engineer - 100% remote - W2 only (no sponsorship)

Clear Point Consultants • United States

On-site
USD 140,000 - 200,000
Senior AI Engineer - LLM Platform in Production (Remote)
Senior AI Engineer - LLM Platform in Production (Remote)

Stable10 • Boston (MA)

Remote
USD 150,000 - 190,000
Remote-friendly
Startup environment
AI LLM Engineer
AI LLM Engineer

David Kennedy Recruitment • United States

Remote
USD 101,000 - 169,000
Health insurance allowance
Equipment budget
Access to AI development tools
+2