Remote LLM Platform Engineer — Build & Scale AI Infra

sumersports

Germany (OH)

Hybrid

USD 100,000 - 130,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive Salary and Bonus Plan
Comprehensive health insurance plan
Retirement savings plan (401k) with company match
Remote working environment
Flexible, unlimited time off policy
Generous paid holiday schedule - 13 in total

Job summary

sumersports is seeking an ML/AI Engineer to build and operate core infrastructure for our AI-first product organization. You will design and scale LLM-based applications and work with cross-functional teams to ensure rapid, safe deployments. Ideal candidates will have over 5 years of experience in ML and NLP, strong Python skills, and expertise with frameworks like LangChain and LlamaIndex. Benefits include competitive salary, comprehensive health insurance, and a flexible remote working environment.

Qualifications

  • 5+ years of experience in applied ML, NLP, or ML infrastructure engineering.
  • Strong coding skills in Python and experience with frameworks like LangChain, LlamaIndex, or Haystack.
  • Solid understanding of retrieval-augmented generation (RAG), embeddings, vector databases, and evaluation methodologies.
  • Experience deploying models or AI systems in production environments (AWS, GCP, or Azure).
  • Familiarity with prompt management, LLM observability, and CI/CD automation for AI workflows.

Responsibilities

  • Build and operate the LLM Platform for multi-model workflows.
  • Implement automated evaluation pipelines with rigorous standards.
  • Collaborate with product pods and data teams for optimized LLM workflows.
  • Profile performance for latency, token usage, and caching strategies.
  • Implement guardrails for safety in AI usage.

Skills

Applied ML
NLP
Infrastructure engineering
Python coding
LangChain
LlamaIndex
Haystack

Tools

AWS
GCP
Azure
vLLM
Triton
Ray Serve
KServe

Job description

sumersports is seeking an ML/AI Engineer to build and operate core infrastructure for our AI-first product organization. You will design and scale LLM-based applications and work with cross-functional teams to ensure rapid, safe deployments. Ideal candidates will have over 5 years of experience in ML and NLP, strong Python skills, and expertise with frameworks like LangChain and LlamaIndex. Benefits include competitive salary, comprehensive health insurance, and a flexible remote working environment.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote LLM Systems Engineer: Build Scalable AI Pipelines
Remote LLM Systems Engineer: Build Scalable AI Pipelines

NewtonX, Inc. • New York (NY)

Remote
USD 180,000 - 220,000
Competitive compensation
Medical, dental, and vision insurance
401k match with immediate vesting
+2
Remote LLM Platform Engineer - AI Infra & Scale
Remote LLM Platform Engineer - AI Infra & Scale

Whatnot • San Francisco (CA)

Hybrid
USD 245,000 - 345,000
Health insurance
Remote work options
Home office stipend
+5
Remote LLM Platform Engineer: Scale AI Systems
Remote LLM Platform Engineer: Scale AI Systems

SupportFinity™ • San Francisco (CA)

Hybrid
USD 245,000 - 345,000
Flexible time off
Health insurance
WFH support
+10
LLM Platform Engineer: Scale AI Infra & Grounded LLMs
LLM Platform Engineer: Scale AI Infra & Grounded LLMs

Apply • California (MO)

On-site
USD 245,000 - 345,000
Flexible time off
Health Insurance
Work From Home Support
+8
Founding ML Infra Engineer — Production-Grade LLMs
Founding ML Infra Engineer — Production-Grade LLMs

Realmlabs • Sunnyvale (CA)

On-site
USD 210,000 - 350,000
Market aligned compensation
Founding engineer equity
Medical, Dental, Vision, and Life insurance
+2
Senior Backend Engineer, AI Platform Infra & LLM
Senior Backend Engineer, AI Platform Infra & LLM

Databricks • New York (NY)

On-site
USD 190,000 - 262,000
Staff Engineer, LLM Inference & Infra
Staff Engineer, LLM Inference & Infra

Prime Intellect • United States

Hybrid
USD 120,000 - 150,000
Competitive compensation
Flexible work arrangement
Full visa sponsorship
+2
Senior AI Platform Engineer: Scale LLM Infrastructure
Senior AI Platform Engineer: Scale LLM Infrastructure

Gusto • Denver (CO)

Hybrid
USD 245,000 - 272,000
Remote LLM Platform Engineer — Scale AI & ML Systems
Remote LLM Platform Engineer — Scale AI & ML Systems

Whatnot • San Francisco (CA), Los Angeles (CA)

Hybrid
USD 245,000 - 345,000
Remote Applied AI Engineer - Build Production LLM Systems
Remote Applied AI Engineer - Build Production LLM Systems

SherlockTalent • Miami (FL)

Hybrid
USD 120,000 - 140,000
Solid Benefits
Referral bonus of $2,500