Staff AI Architect — Lead Production Agentic AI

Modernizing Medicine, Inc.; Boca Raton (FL); Hybrid; USD 170,000 - 250,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) with company matching

Paid time off & parental leave

Tuition reimbursement and professional

Job summary

Modernizing Medicine seeks a Staff AI Engineer to define and drive AI/agentic system architectures across multiple product domains. This senior IC role influences high-impact decisions, evolves AI practices, and turns experimental AI into reliable production systems.

You will guide multi-agent orchestration, production RAG, tool and MCP integration, and the observability stack to ensure dependable delivery.

Qualifications

• Master’s or Ph.D. in Computer Science/Software Engineering or related field.
• 10+ years in ML/AI or software engineering with 4+ years in senior roles with production ownership.
• Proven engineering leadership driving strategy and cross-team decisions.
• Expertise in platform and distributed-systems architecture at scale: model serving, APIs, data platforms, and AI/LLM infra.
• Hands-on experience architecting/operating production agentic AI/LLM systems (multi-agent workflows).
• Deep understanding of embeddings and vector DB internals; experience with RAG.
• Strong production debugging, reliability, and incident-response skills.
• Cost-aware for cloud AI/LLM workloads; capacity planning and cost optimization.
• Mentor mid/senior engineers; strong cross-functional communication.

Responsibilities

• Define and drive technical direction for AI/agentic systems and contribute to AI platform roadmap.
• Lead architecture decisions for compute, cloud, and AI infrastructure across teams.
• Design large-scale AI/LLM systems: inference platforms, APIs, distributed architectures.
• Architect production multi-agent systems end-to-end: orchestration, state, tool integration.
• Establish best practices for AI/LLM systems: evaluation, observability, reliability.
• Lead production debugging and incident response; harden fixes into guardrails.
• Mentor engineers; lead architecture reviews and ADRs for AI infra.
• Contribute to capacity planning and cost optimization for AI/LLM workloads.

Skills

Engineering leadership

Platform architecture

Distributed systems

Model serving

APIs

Data platforms

AI/LLM infrastructure

Agentic AI

Production debugging

Cost optimization

Mentorship

Communication

Education

Master’s or Ph.D. degree in CS/SE

Job description

Modernizing Medicine seeks a Staff AI Engineer to define and drive AI/agentic system architectures across multiple product domains. This senior IC role influences high-impact decisions, evolves AI practices, and turns experimental AI into reliable production systems.

You will guide multi-agent orchestration, production RAG, tool and MCP integration, and the observability stack to ensure dependable delivery.