AI Platform Engineer: LLM Orchestration & Scalable Backend

Jobtailor; San Francisco (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

Jobtailor in San Francisco is seeking a seasoned software engineer to design core backend services, APIs, and microservices that empower product teams to leverage AI models securely and efficiently. You will lead agent orchestration, evaluate AI reasoning, and build observability into production systems, collaborating with designers and PMs while mentoring junior engineers.

This role favors someone who thrives in ambiguous environments, owns deliverables, and champions best practices across

Qualifications

• Bachelor's degree in CS, Math or related field or equivalent practical experience.
• 2+ years of professional software engineering experience.
• Strong full-stack fundamentals across frontend, backend, and data layers.
• Excellent debugging and technical investigation skills.
• Strong technical communication, including async collaboration.
• Ability to move fast and iterate in ambiguous environments, owning value delivery.
• Hands-on experience integrating and orchestrating LLMs and agents.
• Experience building AI-native systems and scaling them in production.
• Familiarity with eval frameworks, agent tooling, vector search, context engineering, and prompt engineering.

Responsibilities

• Platform Architecture: design and develop backend services and APIs with scalable microservices.
• Agent Orchestration: build frameworks to support multi-step agent workflows and persistent memory.
• Evaluation & Reliability: create robust evaluation systems for reasoning quality and task success.
• Operational Excellence: architect high-performance serving infra with latency, throughput, and cost controls.
• Observability & MLOps: implement monitoring, structured logging, and distributed tracing across models.
• Collaboration: work with designers, PMs, and engineers to build self-serve infrastructure.
• Leadership: conduct design/code reviews and mentor junior engineers.

Skills

Platform Architecture

LLM Orchestration

Full-Stack Development

Debugging

Technical Communication

Mentoring

Education

Bachelor's Degree in Computer Science

Bachelor's Degree in Mathematics

Tools

MLOps

Observability Tools

Distributed Tracing

Structured Logging

Job description

Jobtailor in San Francisco is seeking a seasoned software engineer to design core backend services, APIs, and microservices that empower product teams to leverage AI models securely and efficiently. You will lead agent orchestration, evaluate AI reasoning, and build observability into production systems, collaborating with designers and PMs while mentoring junior engineers.

This role favors someone who thrives in ambiguous environments, owns deliverables, and champions best practices across