Staff Machine Learning Engineer

Mural Group; Oregon; Hybrid; USD 230,000 - 300,000; Full time

Benefits offered by this job

Bonus

Equity

Remote US

Job summary

Mural Group is hiring a Staff ML Engineer to set the technical direction for its agent systems. You will design multi-step LLM systems, oversee evaluation from offline benchmarks to live experiments, and fix issues like hallucinations and tool misuse.

You will lead and mentor engineers, shaping how the team operates while delivering high-quality, scalable ML solutions for enterprise customers. Remote US work with strong equity options.

Qualifications

• 7+ years shipping ML in production
• Led the design of complex, multi-step LLM systems
• Depth in transformers, embeddings and retrieval
• Evaluation experience beyond single prompts
• PyTorch or similar, on distributed cloud infrastructure
• BS in CS or a related field; MS or PhD a plus

Responsibilities

• Design multi-step LLM systems: reasoning, retrieval, planning and tool use
• Own evaluation, from offline benchmarks to online experiments and model-graded review
• Find and fix failure modes such as hallucination and tool misuse
• Set the quality, latency and cost targets the team builds against
• Mentor senior engineers and shape how the group works

Skills

LLM systems design

Distributed cloud infra

Transformer tech

Evaluation methodology

Mentoring engineers

Education

BS in CS or related field

MS or PhD a plus

Tools

PyTorch

LLM frameworks

Job description

Location: Remote (US)Pay: $230,000-$300,000 + bonus + equity

A late-stage, venture-backed enterprise AI company is hiring a Staff ML Engineer to set the technical direction for its agent systems. This is model and systems work that ships to large enterprise customers, not a thin layer over someone else's API.

What you’ll do

• Design multi-step LLM systems: reasoning, retrieval, planning and tool use
• Own evaluation, from offline benchmarks to online experiments and model-graded review
• Find and fix failure modes such as hallucination and tool misuse
• Set the quality, latency and cost targets the team builds against
• Mentor senior engineers and shape how the group works

What you bring

• 7+ years shipping ML in production, including LLMs at scale
• Led the design of complex, multi-step LLM systems
• Depth in transformers, embeddings and retrieval
• Evaluation experience beyond single prompts
• PyTorch or similar, on distributed cloud infrastructure
• BS in CS or a related field; MS or PhD a plus

Nice to have: ML shipped before LLMs, then moved into generative AI; detailed retrieval work (chunking, reranking, evals)