Senior AI Engineering Leader — Scale Production AI

Magnitude Consulting; New York (NY); On-site; USD 225,000 - 275,000; Full time

Benefits offered by this job

Equity

Bonus potential

Job summary

Magnitude Consulting is seeking an Engineering Manager to lead and scale an AI engineering team in New York. This is a technical leadership role combining people management, architecture and hands-on oversight of production‑grade AI products.

You will mentor engineers, own delivery across key AI initiatives, define technical architecture, build scalable AI services, lead the implementation of LLMs, RAG, AI agents and orchestration frameworks, and partner with Product, Data Science and Security.

Qualifications

• 8+ years of software engineering experience.
• 3+ years leading engineering teams.
• Experience leading AI/ML engineering teams.
• Strong experience delivering production software systems at scale.
• Deep knowledge of LLMs, RAG, AI agents and orchestration frameworks.
• Experience with LangChain, LangGraph or similar.
• Experience with AWS, Docker, CI/CD, PostgreSQL and distributed systems.

Responsibilities

• Lead, mentor and grow a team of AI-focused software engineers.
• Own engineering execution and delivery across key AI initiatives.
• Define technical architecture and engineering direction.
• Build and scale production-grade AI services and applications.
• Lead the implementation of LLMs, RAG, AI agents and orchestration frameworks.
• Partner with Product, Design, Data Science, Security and wider teams.
• Establish and maintain strong engineering practices across testing, code quality and CI/CD.
• Remain technically engaged through architecture reviews and mentoring.
• Recruit, coach and develop engineering talent.
• Balance immediate product delivery with longer-term architecture and scalability.

Skills

AI/ML leadership

Team leadership

Software architecture

Production systems

AWS/Docker/CI/CD

LangChain/LangGraph

Recruiting/Mentoring

Cross-functional collaboration

Education

Bachelor's degree in a technical field

Tools

LangChain

LangGraph

AWS

Docker

PostgreSQL

CI/CD

Job description

Magnitude Consulting is seeking an Engineering Manager to lead and scale an AI engineering team in New York. This is a technical leadership role combining people management, architecture and hands-on oversight of production‑grade AI products.

You will mentor engineers, own delivery across key AI initiatives, define technical architecture, build scalable AI services, lead the implementation of LLMs, RAG, AI agents and orchestration frameworks, and partner with Product, Data Science and Security.