Senior AI Platform Architect & Strategy Leader

Madison-Davis, LLC; New York (NY); On-site; USD 240,000 - 420,000; Full time

Job summary

Madison-Davis, LLC is seeking a Head of AI Architecture & Strategy to guide the architecture of a shared AI technology platform and set long-term technical direction. This senior, hands-on role blends enterprise AI architecture, platform engineering, and technical leadership to build scalable, secure AI infrastructure for research, investment, and internal teams.

You will own AI services architecture, establish standards, evaluate new technologies, and mentor engineering teams while

Qualifications

• 10+ years of relevant engineering experience with senior technical leadership responsibilities.
• Hands-on architecture experience with complex enterprise or shared platforms.
• Strong knowledge of LLMs, AI agents, RAG, model serving, and enterprise AI systems.
• Strong Python software development expertise.
• Experience with distributed systems, APIs, Kubernetes, containerization, and cloud or hybrid infrastructure.
• Proven engineering leadership and ownership of production technology platforms.
• Understanding of platform security, access management, reliability, and observability.
• Strong technical judgment, architecture decision-making, and stakeholder communication.
• Bachelor's degree in a related technical discipline or equivalent practical experience.

Responsibilities

• Own the architecture of shared AI services, including model gateways, inference, agent runtimes, orchestration, and retrieval.
• Guide the engineering of AI platform capabilities, agent frameworks, MCP integrations, APIs, and reusable developer tools.
• Establish architectural standards, design patterns, and implementation guidelines.
• Evaluate AI technologies and contribute to platform strategy and roadmap development.
• Provide hands-on technical architecture, prototyping, engineering reviews, and implementation guidance.
• Ensure production platforms incorporate appropriate security, access controls, observability, evaluation, and reliability.
• Lead and mentor technical engineering teams while promoting adoption of shared platform capabilities.
• Work closely with software engineering, research, investment, infrastructure, cybersecurity, and technology leadership.

Skills

LLMs & AI agents

Python

Distributed systems

Kubernetes

APIs

Cloud / hybrid infrastructure

Security & access management

Observability

Platform leadership

Stakeholder communication

Education

Bachelor's degree in a related technical discipline

Job description

Madison-Davis, LLC is seeking a Head of AI Architecture & Strategy to guide the architecture of a shared AI technology platform and set long-term technical direction. This senior, hands-on role blends enterprise AI architecture, platform engineering, and technical leadership to build scalable, secure AI infrastructure for research, investment, and internal teams.

You will own AI services architecture, establish standards, evaluate new technologies, and mentor engineering teams while