Software Engineer, AI Platform

Triwill Group; San Francisco (CA); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Jobtailor in San Francisco is seeking a seasoned software engineer to design core backend services, APIs, and microservices that empower product teams to leverage AI models securely and efficiently. You will lead agent orchestration, evaluate AI reasoning, and build observability into production systems, collaborating with designers and PMs while mentoring junior engineers.

This role favors someone who thrives in ambiguous environments, owns deliverables, and champions best practices across

Qualifications

• Bachelor's degree in CS, Math or related field or equivalent practical experience.
• 2+ years of professional software engineering experience.
• Strong full-stack fundamentals across frontend, backend, and data layers.
• Excellent debugging and technical investigation skills.
• Strong technical communication, including async collaboration.
• Ability to move fast and iterate in ambiguous environments, owning value delivery.
• Hands-on experience integrating and orchestrating LLMs and agents.
• Experience building AI-native systems and scaling them in production.
• Familiarity with eval frameworks, agent tooling, vector search, context engineering, and prompt engineering.

Responsibilities

• Platform Architecture: design and develop backend services and APIs with scalable microservices.
• Agent Orchestration: build frameworks to support multi-step agent workflows and persistent memory.
• Evaluation & Reliability: create robust evaluation systems for reasoning quality and task success.
• Operational Excellence: architect high-performance serving infra with latency, throughput, and cost controls.
• Observability & MLOps: implement monitoring, structured logging, and distributed tracing across models.
• Collaboration: work with designers, PMs, and engineers to build self-serve infrastructure.
• Leadership: conduct design/code reviews and mentor junior engineers.

Skills

Platform Architecture

LLM Orchestration

Full-Stack Development

Debugging

Technical Communication

Mentoring

Education

Bachelor's Degree in Computer Science

Bachelor's Degree in Mathematics

Tools

MLOps

Observability Tools

Distributed Tracing

Structured Logging

Job description

• Platform Architecture: Design and develop the core backend services, APIs, and microservices that enable product teams to easily and securely leverage AI models.
• Agent Orchestration: Build scalable frameworks and tools to support multi-step agent workflows, including task decomposition, tool invocation, and persistent memory.
• Evaluation & Reliability: Build robust evaluation systems to continuously measure reasoning quality, hallucination rates, and task success.
• Operational Excellence: Architect high-performance serving infrastructure with strict guarantees around latency, throughput, cost-efficiency, and error handling.
• Observability & MLOps: Ensure comprehensive monitoring, structured logging, and distributed tracing across all deployed AI models.
• Collaboration: Partner with designers, product managers, and other engineers to build self-serve infrastructure that transforms our AI development cycle.
• Leadership: Advocate for software engineering best practices, conduct thorough design and code reviews, and mentor junior engineers.

Requirements

• Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience
• 2+ years of professional software engineering experience
• Strong full-stack fundamentals: you're comfortable working across frontend, backend, and data layers
• Excellent debugging and technical investigation skills
• Strong technical communication, ideally with experience collaborating in an asynchronous remote environment
• Ability to move fast and iterate in ambiguous environments: you take ownership and focus on delivering value to users
• Hands on experience integrating and orchestrating LLMs and agents
• Experience building AI native systems, including iteratively improving and scaling them in production
• Familiarity with techniques used to optimize AI agents: eval frameworks, agent tooling, vector search engines, context engineering, and prompt engineering.
• A desire to be on the forefront of leveraging AI to drive product improvement, observability and product analytics at scale.

Core Competencies

Demonstrates expertise in Platform Architecture, including the design and development of backend services and APIs, while ensuring operational excellence in AI systems. Proficient in collaborating with cross-functional teams and mentoring junior engineers to uphold software engineering best practices.

Highest-signal resume keywords

• Platform Architecture
• AI Native Systems Development
• LLM Integration and Orchestration
• Debugging and Technical Investigation
• Technical Communication

Hard Skills

• Backend Development
• API Development
• Microservices
• Full-Stack Fundamentals
• Evaluation Frameworks
• Agent Tooling
• Vector Search Engines
• Context Engineering
• Prompt Engineering

Soft Skills

• Collaboration
• Mentoring
• Ownership
• Adaptability

Certifications & Qualifications

• Bachelor's Degree in Computer Science
• Bachelor's Degree in Mathematics

Industry Keywords

• AI Models
• Task Decomposition
• Agent Workflows
• Operational Excellence
• Cost-Efficiency

Tools & Technologies

• MLOps
• Observability Tools
• Distributed Tracing
• Structured Logging