Head of Agentic AI Platform & Production Orchestration

Fruition Group US; San Jose (CA); On-site; USD 190,000 - 260,000; Full time

Job summary

Fruition Group US seeks a Principal AI Systems Architect to define and build a reusable agentic AI platform and its execution infrastructure for enterprise-scale automation. This hands-on role blends AI agents, distributed systems, and platform engineering to deliver secure, production-grade capabilities powering multiple teams.

You will architect the core orchestration, memory, retrieval, and tool interfaces, enabling diverse use cases without rebuilding foundational layers.

Qualifications

• 8+ years in software engineering, distributed systems, platform engineering, or systems architecture.
• Strong hands-on Python and production software development experience.
• Proven experience architecting and deploying production AI/agentic systems.
• Deep understanding of tool-using LLMs, multi-step workflows, agent orchestration, and modern LLM architectures.
• Strong distributed-systems fundamentals: state, concurrency, messaging, idempotency, fault tolerance, and recovery.
• Experience with APIs, service integration, MCP/function calling, structured outputs, and agent-to-tool interfaces.
• Strong experience with Linux, Docker, cloud/on-prem infrastructure, and GPU-based AI workloads.
• Experience with production observability, security, CI/CD, and enterprise software deployment.
• Ability to translate architectural concepts into working, production-grade systems.

Responsibilities

• Architect and implement a reusable agentic AI harness supporting planning, routing, tool use, delegation, iteration, and multi-agent coordination.
• Design durable workflow execution including state management, checkpointing, retries, concurrency, failure recovery, and asynchronous processing.
• Establish secure interfaces for agents to interact with APIs, databases, enterprise applications, engineering tools, and external services using MCP, function calling, or equivalent technologies.
• Develop model abstraction and routing across commercial, open-source, and privately hosted LLMs.
• Architect AI inference environments across Linux, containers, GPU infrastructure, private cloud, and on-premises environments.
• Define architectures for context, memory, retrieval, knowledge access, provenance, and human-in-the-loop workflows.
• Establish evaluation, guardrail, observability, and monitoring frameworks covering agent decisions, tool execution, reliability, latency, and resource utilization.
• Own security architecture spanning identity, authorization, secrets, data isolation, auditability, and controlled system access.
• Establish CI/CD, testing, versioning, deployment, rollback, and lifecycle-management standards for AI agents and applications.
• Build reusable APIs, SDKs, tool registries, templates, and development frameworks for engineering teams.
• Evaluate emerging agent frameworks and AI infrastructure technologies, making pragmatic build-vs-buy decisions.
• Remain hands-on across architecture, prototyping, implementation, debugging, and production deployment.

Skills

Python

Distributed systems

AI infrastructure

Docker

Linux

Cloud platforms

Security

Tools

Kubernetes

OpenAI API

LLM orchestration

Job description

Fruition Group US seeks a Principal AI Systems Architect to define and build a reusable agentic AI platform and its execution infrastructure for enterprise-scale automation. This hands-on role blends AI agents, distributed systems, and platform engineering to deliver secure, production-grade capabilities powering multiple teams.

You will architect the core orchestration, memory, retrieval, and tool interfaces, enabling diverse use cases without rebuilding foundational layers.