GenAI Architect for Enterprise AI & Agentic Systems

Plymouth Rock Assurance; Boston (MA); On-site; USD 135,000 - 200,000; Full time

Benefits offered by this job

4 weeks PTO + 9 holidays

Onsite gym in Boston

Tuition Reimbursement

Health, dental, vision insurance from

Wellness program and reimbursements

Insurance discounts

401(k) with match

Paid family leave

Professional development resources

Pre-Tax Commuter Benefits

Job summary

Plymouth Rock Assurance seeks a highly skilled AI Engineer to design and build Generative and Agentic AI systems across the enterprise, including internal processes and customer-facing applications.

Responsibilities include creating LLM-powered solutions, agentic platforms, and MCP servers, with a focus on security, compliance, and robust production-grade design. Boston-based role with strong cross-functional collaboration.

Qualifications

• Bachelor’s or Master’s degree in a relevant field.
• 5+ years of software engineering experience in ML/AI systems.
• Hands-on experience building LLM-powered apps in production.

Responsibilities

• Design, build, and deploy scalable LLM-powered applications and digital products for customer support and internal use.
• Develop AI agents, agentic platforms, and systems capable of multi-step workflows.
• Implement RAG architectures and pipelines using proprietary data and knowledge bases.
• Build MCP servers and multi-modal Agentic platforms to support internal teams and customers.
• Integrate AI/ML solutions with enterprise APIs and data platforms.
• Design prompt strategies, evaluation frameworks, and guardrails for accuracy and compliance.
• Optimize LLM performance via fine-tuning and orchestration; develop MLOps/LLMOps pipelines.
• Assist buy-vs-build decisions and collaborate with vendors and internal teams.

Skills

Python

LLM architectures

RAG

MCP servers

Prompt engineering

Agentic AI

APIs

Cross-functional collaboration

AI tooling

Education

Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field

Tools

LangChain

LlamaIndex

Hugging Face

OpenAI / Anthropic / Google

Job description

Plymouth Rock Assurance seeks a highly skilled AI Engineer to design and build Generative and Agentic AI systems across the enterprise, including internal processes and customer-facing applications.

Responsibilities include creating LLM-powered solutions, agentic platforms, and MCP servers, with a focus on security, compliance, and robust production-grade design. Boston-based role with strong cross-functional collaboration.