Senior AI Engineer - Build Scalable LLM Infra (Remote, US)

TMTG

Sarasota (FL)

On-site

USD 150,000 - 210,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

TMTG is seeking a Senior AI Engineer to build and own the core AI infrastructure for a high-scale platform with millions of users. You will work closely with the platform architect and developers to implement LLM-backed features, ensure reliability, and shape engineering practices as the team expands.

Ideal candidates bring 5+ years of backend experience in statically typed languages, hands-on LLM serving, and strong API design skills, with US work authorization.

Qualifications

  • 5+ years of backend engineering in a statically typed language (Go, Java, Kotlin, C#).
  • Shipped production LLM-backed features — retrieval-augmented generation, streaming responses, tool use — and lived with them after launch.
  • Hands-on experience with the LLM serving stack: routing across multiple model providers, failover, token streaming, and cost/usage metering.
  • Experience building retrieval systems: vector search, embedding pipelines, context assembly, and citation-backed answers.
  • You think in failure modes: hallucination, retrieval misses, provider outages, cost blowouts — and you build instrumentation to catch them.
  • Pragmatic about evaluation — you know how to measure whether AI answers are actually good with simple tests.
  • Strong API design instincts; comfortable owning a service end to end, from schema to deploy to on-call.
  • US-based and authorized to work in the United States.

Responsibilities

  • Stand up the core AI infrastructure for a platform with millions of active users.
  • Collaborate with the platform architect and other developers to bring deep LLM-stack expertise.
  • Shape engineering practices as the team grows and own services end to end.

Skills

Go
Java
Kotlin
C#

Tools

LiteLLM
vLLM
TGI
Qdrant
pgvector

Job description

TMTG is seeking a Senior AI Engineer to build and own the core AI infrastructure for a high-scale platform with millions of users. You will work closely with the platform architect and developers to implement LLM-backed features, ensure reliability, and shape engineering practices as the team expands.

Ideal candidates bring 5+ years of backend experience in statically typed languages, hands-on LLM serving, and strong API design skills, with US work authorization.

Get your free, confidential resume review.
or drag and drop your file here.