Staff Machine Learning Engineer

Themuralgroup; United States; Remote; USD 230,000 - 300,000; Full time

Job summary

Theuralgroup is seeking a Staff ML Engineer to define the technical direction for agent systems and ship model and systems work to large enterprise customers.

We are a remote US-based team hiring a Staff ML Engineer who will design multi-step LLM systems, own evaluation from offline benchmarks to online experiments, and mentor senior engineers while shaping how the group operates.

Qualifications

• 7+ years shipping ML in production, including LLMs at scale.
• Led the design of complex, multi-step LLM systems.
• Depth in transformers, embeddings and retrieval.
• Evaluation experience beyond single prompts.
• PyTorch or similar, on distributed cloud infrastructure.
• BS in CS or related field; MS or PhD a plus.

Responsibilities

• Design multi-step LLM systems: reasoning, retrieval, planning and tool use.
• Own evaluation, from offline benchmarks to online experiments and model-graded review.
• Find and fix failure modes such as hallucination and tool misuse.
• Set the quality, latency and cost targets the team builds against.
• Mentor senior engineers and shape how the group works.

Skills

LLM system design

Evaluation leadership

Mentor engineers

Quality latency cost

Retrieval/tool use

Production ML experience

Education

BS in CS

MS/PhD a plus

Tools

PyTorch

Cloud infra

Job description

Location: Remote (US)

Pay: $230,000–$300,000 + bonus + equity

A late-stage, venture-backed enterprise AI company is hiring a Staff ML Engineer to set the technical direction for its agent systems. This is model and systems work that ships to large enterprise customers, not a thin layer over someone else's API.

What you'll do

• Design multi-step LLM systems: reasoning, retrieval, planning and tool use
• Own evaluation, from offline benchmarks to online experiments and model-graded review
• Find and fix failure modes such as hallucination and tool misuse
• Set the quality, latency and cost targets the team builds against
• Mentor senior engineers and shape how the group works

What you bring

• 7+ years shipping ML in production, including LLMs at scale
• Led the design of complex, multi-step LLM systems
• Depth in transformers, embeddings and retrieval
• Evaluation experience beyond single prompts
• PyTorch or similar, on distributed cloud infrastructure
• BS in CS or a related field; MS or PhD a plus

Nice to have:

• ML shipped before LLMs, then moved into generative AI
• Detailed retrieval work (chunking, reranking, evals)