Staff AI Platform Architect

Modernizing Medicine, Inc.; United States; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical benefits

401(k) match

PTO & parental leave

Life & disability insurance

Flexible Spending Account

Employee assistance programs

Tuition reimbursement

LinkedIn Learning

Job summary

ModMed is seeking a Staff AI Engineer to define and drive the architecture of AI and agentic systems across multiple teams and product domains. This senior IC role influences architectural decisions, evolves practices for agentic AI, and turns experimental AI into reliable production systems.

You will mentor senior engineers, shape the AI platform roadmap, and lead evaluations, observability, and cost optimization for AI/LLM infrastructure.

Qualifications

• Master’s/Ph.D. required in CS, SE, or related field.
• 10+ years in ML/AI or software engineering with production ownership.
• Proven leadership shaping technical strategy across teams.
• Expertise in platform and large-scale AI/LLM infra.
• Hands-on with production agentic AI or LLM systems.
• Deep embedding and vector database knowledge.
• Strong debugging, reliability, and incident response skills.
• Cost awareness for cloud AI/LLM workloads.

Responsibilities

• Define the technical direction for AI/agentic systems and roadmap.
• Lead large-scale AI/LLM systems architecture and orchestration.
• Design production multi-agent systems end-to-end with tool integration.
• Establish standards for evaluation, observability, and reliability.
• Guide incident response and harden platform guardrails.
• Mentor engineers and technical leaders across teams.
• Drive ADRs and architectural decision records.
• Contribute to capacity planning and cost optimization.

Skills

Advanced ML/AI leadership

Production system ownership

Platform & distributed-systems

Multi-agent AI & LLM infra

Embedding models & vector DB

Debugging & incident response

Evaluation for non-deterministic AI

Cloud cost optimization

Mentoring senior engineers

Executive/cross-functional comms

Education

Master’s or Ph.D. in CS/SE or related

Job description

ModMed is seeking a Staff AI Engineer to define and drive the architecture of AI and agentic systems across multiple teams and product domains. This senior IC role influences architectural decisions, evolves practices for agentic AI, and turns experimental AI into reliable production systems.

You will mentor senior engineers, shape the AI platform roadmap, and lead evaluations, observability, and cost optimization for AI/LLM infrastructure.