AI Agent Architect - Production-Grade LLMs (Hybrid)

Goliath Partners Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 220,000 - 275,000; Full time

Benefits offered by this job

Hybrid work model

Ownership in technical direction

Significant autonomy

Job summary

Goliath Partners Inc. is seeking an AI engineering leader to own the core agent infrastructure and model orchestration. You will translate advances in foundation models into scalable, dependable products for enterprise clients, spanning research and software engineering.

You’ll design and implement evaluation pipelines, multi-model routing, and a reusable AI infrastructure that adapts to changing model capabilities. Hybrid SF location with significant ownership awaits.

Qualifications

• Proven background in building and deploying LLM-based products and autonomous agents.
• Experience turning AI concepts into robust, production-grade systems.
• Strong software engineering skills in fast-moving, ambitious teams.

Responsibilities

• Architect and maintain infrastructure powering AI agents, including tool execution and workflow coordination.
• Build agent systems capable of multi-stage business process execution.
• Develop model orchestration and routing to select best models/strategies.
• Create adaptable AI infrastructure supporting multiple providers and evolving models.
• Design evaluation pipelines to measure quality, reliability, and performance.
• Establish benchmarks for complex agent workflows and catch regressions early.
• Translate advances in LLMs and agent frameworks into scalable production capabilities.
• Prototype prompting, retrieval, fine-tuning, and model selection to improve outcomes.
• Influence architectural direction and broader technical roadmap as the company scales.
• Contribute to building and expanding a high-performing AI engineering team.

Skills

LLM APIs

Agent architectures

Software engineering

Education

Bachelor’s/Master’s/PhD in CS/EE or related field

Tools

Tool calling

Model orchestration

Retrieval systems

Job description

Goliath Partners Inc. is seeking an AI engineering leader to own the core agent infrastructure and model orchestration. You will translate advances in foundation models into scalable, dependable products for enterprise clients, spanning research and software engineering.

You’ll design and implement evaluation pipelines, multi-model routing, and a reusable AI infrastructure that adapts to changing model capabilities. Hybrid SF location with significant ownership awaits.