Remote Senior AI & LLM Systems Engineer - High-Throughput

Syscov

United States

Remote

USD 140,000 - 220,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Syscov is hiring a senior AI/ML engineer to design custom model routing engines and autonomous multi-agent systems. This remote, full-time role targets experienced professionals with a focus on scalable LLM backends and high-throughput inference for global deployments.

Ideal candidates have strong Python systems programming, CUDA/PyTorch memory management, and hands-on experience with vector databases and contextual retrieval systems.

Qualifications

  • 3+ years of AI/ML engineering experience with production exposure to LLMs and embedding architectures.

Responsibilities

  • Develop custom LLM orchestration backends with multi-model failover and speculative routing.
  • Build high-precision RAG pipelines using hybrid semantic/dense embeddings and reranking.

Skills

AI/ML engineering
Python systems programming
CUDA memory management
Vector databases
Inference throughput optimization

Job description

Syscov is hiring a senior AI/ML engineer to design custom model routing engines and autonomous multi-agent systems. This remote, full-time role targets experienced professionals with a focus on scalable LLM backends and high-throughput inference for global deployments.

Ideal candidates have strong Python systems programming, CUDA/PyTorch memory management, and hands-on experience with vector databases and contextual retrieval systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI & LLM Systems Engineer
Senior AI & LLM Systems Engineer

Syscov • United States

Remote
USD 140,000 - 220,000
Remote AI/ML Engineer: LLMs, APIs & Production Systems
Remote AI/ML Engineer: LLMs, APIs & Production Systems

Crossing Hurdles • United States

Remote
USD 220,000 - 300,000
Remote Senior AI Engineer: AI Agents & LLM Systems
Remote Senior AI Engineer: AI Agents & LLM Systems

Bolt.new • Town of Poland (NY)

Hybrid
USD 120,000 - 160,000
Remote GenAI/LLM Engineer - Build Scalable AI
Remote GenAI/LLM Engineer - Build Scalable AI

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 41,000 - 77,000
Referral Bonus $150
Remote AI Systems Engineer: LLMs & Agent Orchestration
Remote AI Systems Engineer: LLMs & Agent Orchestration

Innovative Consulting Inc (ICI) • United States

Remote
USD 130,000 - 190,000
Senior AI Engineer (Remote) — LLMs & Multi-Agent Systems
Senior AI Engineer (Remote) — LLMs & Multi-Agent Systems

Software Mind • United States

Remote
USD 90,000 - 130,000
Language classes
Private healthcare
Multisport card
Remote AI Infrastructure Engineer (LLM & Vector Tech)
Remote AI Infrastructure Engineer (LLM & Vector Tech)

BairesDev • United States

Remote
USD 140,000 - 210,000
Remote work
USD payment
Hardware provided
+4
Senior Applied AI Engineer - Remote LLM Systems
Senior Applied AI Engineer - Remote LLM Systems

FLYPS • United States

Remote
USD 74,000 - 94,000
Private medical care
Remote setup
Flexible hours
+2
LLM Systems Engineer | Remote
LLM Systems Engineer | Remote

Crossing Hurdles • United States

Remote
USD 350,000 - 500,000
Remote Senior Backend Engineer - AI, RAG & Vectors
Remote Senior Backend Engineer - AI, RAG & Vectors

web • United States

Remote
USD 120,000 - 210,000
Remote work
Health coverage
Retirement matching
+1