Director of AI Engineering — Generative & Agentic AI

plymouthrock

Boston (MA)

Hybrid

USD 205,000 - 282,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

4 weeks PTO + 9 holidays
Onsite gym in Boston
Tuition Reimbursement
Premium health insurance from day 1
401(k) with company match
Paid family leave
Professional development support
Pre-Tax commuter benefits

Job summary

Plymouth Rock is seeking a Director of AI Engineering to architect and scale Generative and Agentic AI solutions across the enterprise, including AI-native products and scalable platforms.

The role requires a strong AI stack background, leadership experience, and collaboration with technology, data, product, and business teams. Hybrid work in Boston with a focus on measurable business impact.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field.
  • 10+ years of experience in software engineering, platform engineering, or data science, with 2+ years in AI systems development.
  • 5+ years of engineering leadership experience.
  • Proven experience delivering LLM-powered applications and AI/ML systems into production at enterprise scale.
  • Deep understanding of AI supporting infrastructure, security, testing, and monitoring/maintenance pipelines.
  • Strong knowledge of Python and AI/ML tools (NumPy, Pandas, SciPy, Scikit-learn).

Responsibilities

  • Define and lead AI engineering strategy, target architecture, and roadmap for Generative and Agentic AI.
  • Lead and scale a high-performing AI engineering team with coaching and mentoring.
  • Design, build, and deploy scalable LLM-powered applications and AI-native products for multiple domains.
  • Develop AI agents and agentic platforms with autonomous workflows and multi-step task execution.
  • Implement RAG architectures/pipelines leveraging proprietary data and knowledge bases.
  • Establish MCP servers, tool integrations, and secure orchestration across systems.
  • Set standards for prompt design, model evaluation, guardrails, observability, testing, and production readiness.
  • Lead MLOps and LLMOps pipelines for lifecycle management and continuous improvement.
  • Utilize CI/CD and Agile methods for AI product development.
  • Collaborate with architecture, security, legal, and data teams to meet privacy and governance requirements.

Skills

Leadership
Python
LLM ecosystems
RAG pipelines
MLOps/LLMOps
AWS/Azure/GCP
APIs
Governance & security

Education

Bachelor/Master in CS/AI/ML

Tools

LangChain
LlamaIndex
CrewAI
OpenAI/Anthropic/Google LLMs

Job description

Plymouth Rock is seeking a Director of AI Engineering to architect and scale Generative and Agentic AI solutions across the enterprise, including AI-native products and scalable platforms.

The role requires a strong AI stack background, leadership experience, and collaboration with technology, data, product, and business teams. Hybrid work in Boston with a focus on measurable business impact.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Director of AI Engineering — Generative & Agentic AI Hybrid
Director of AI Engineering — Generative & Agentic AI Hybrid

Plymouth Rock Assurance • Massachusetts

Hybrid
USD 205,000 - 282,000
Hybrid work Boston
401(k) matching
Tuition reimbursement
+1
Director of Generative AI & Agentic Engineering
Director of Generative AI & Agentic Engineering

Plymouth Rock Assurance Corporation • Boston (MA)

Hybrid
USD 205,000 - 282,000
Hybrid work environment
Boston location
Competitive compensation
+2
Generative AI Engineer – Agentic Systems & LLMs
Generative AI Engineer – Agentic Systems & LLMs

plymouthrock • Boston (MA)

On-site
USD 110,000 - 160,000
PTO 4 weeks
Gym on-site
Tuition reimbursement
+5
Senior AI Architect for LLM & Agentic Platforms
Senior AI Architect for LLM & Agentic Platforms

plymouthrock • Boston (MA)

On-site
USD 135,000 - 200,000
Paid time off
401(k) matching
Tuition reimbursement
+3
Generative AI Engineer: Agentic & LLM Systems
Generative AI Engineer: Agentic & LLM Systems

Plymouth Rock Assurance • Boston (MA)

On-site
USD 110,000 - 160,000
4 weeks PTO + 9 holidays
Free onsite gym
Tuition reimbursement
+6
Senior AI Architect: LLMs, Agentic AI & RAG Platforms
Senior AI Architect: LLMs, Agentic AI & RAG Platforms

Plymouth Rock Assurance • Boston (MA)

On-site
USD 135,000 - 200,000
Paid time off
Holiday pay
Gym access (Boston)
+6
GenAI Engineering Lead — Build Production-Grade AI Agents
GenAI Engineering Lead — Build Production-Grade AI Agents

New York Technology Partners • Boston (MA)

On-site
USD 130,000 - 180,000
Senior AI Architect — Generative & Agentic Solutions
Senior AI Architect — Generative & Agentic Solutions

Boston Scientific • Marlborough (MA)

Hybrid
USD 107,000 - 203,000
Lead Generative AI Engineer — Scale & Agentic AI
Lead Generative AI Engineer — Scale & Agentic AI

TechDigital Group • New York (NY)

On-site
USD 140,000 - 210,000
GenAI Architect & Agentic AI Leader
GenAI Architect & Agentic AI Leader

Citi • New York (NY)

Hybrid
USD 37,000 - 74,000