Director of AI Engineering — Generative & Agentic AI

plymouthrock; Boston (MA); Hybrid; USD 205,000 - 282,000; Full time

Benefits offered by this job

4 weeks PTO + 9 holidays

Onsite gym in Boston

Tuition Reimbursement

Premium health insurance from day 1

401(k) with company match

Paid family leave

Professional development support

Pre-Tax commuter benefits

Job summary

Plymouth Rock is seeking a Director of AI Engineering to architect and scale Generative and Agentic AI solutions across the enterprise, including AI-native products and scalable platforms.

The role requires a strong AI stack background, leadership experience, and collaboration with technology, data, product, and business teams. Hybrid work in Boston with a focus on measurable business impact.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field.
• 10+ years of experience in software engineering, platform engineering, or data science, with 2+ years in AI systems development.
• 5+ years of engineering leadership experience.
• Proven experience delivering LLM-powered applications and AI/ML systems into production at enterprise scale.
• Deep understanding of AI supporting infrastructure, security, testing, and monitoring/maintenance pipelines.
• Strong knowledge of Python and AI/ML tools (NumPy, Pandas, SciPy, Scikit-learn).

Responsibilities

• Define and lead AI engineering strategy, target architecture, and roadmap for Generative and Agentic AI.
• Lead and scale a high-performing AI engineering team with coaching and mentoring.
• Design, build, and deploy scalable LLM-powered applications and AI-native products for multiple domains.
• Develop AI agents and agentic platforms with autonomous workflows and multi-step task execution.
• Implement RAG architectures/pipelines leveraging proprietary data and knowledge bases.
• Establish MCP servers, tool integrations, and secure orchestration across systems.
• Set standards for prompt design, model evaluation, guardrails, observability, testing, and production readiness.
• Lead MLOps and LLMOps pipelines for lifecycle management and continuous improvement.
• Utilize CI/CD and Agile methods for AI product development.
• Collaborate with architecture, security, legal, and data teams to meet privacy and governance requirements.

Skills

Leadership

Python

LLM ecosystems

RAG pipelines

MLOps/LLMOps

AWS/Azure/GCP

APIs

Governance & security

Education

Bachelor/Master in CS/AI/ML

Tools

LangChain

LlamaIndex

CrewAI

OpenAI/Anthropic/Google LLMs

Job description

Plymouth Rock is seeking a Director of AI Engineering to architect and scale Generative and Agentic AI solutions across the enterprise, including AI-native products and scalable platforms.

The role requires a strong AI stack background, leadership experience, and collaboration with technology, data, product, and business teams. Hybrid work in Boston with a focus on measurable business impact.