Senior AI Architect: LLMs, Agentic AI & RAG Platforms

Plymouth Rock Assurance; Boston (MA); On-site; USD 135,000 - 200,000; Full time

Benefits offered by this job

Paid time off

Holiday pay

Gym access (Boston)

Tuition reimbursement

Health insurance (Day 1)

401(k) employer contribution

Parental leave

Licensure assistance

Commuter benefits

Job summary

Plymouth Rock Assurance is seeking an AI Engineer to design and build Generative and Agentic AI systems that power customer-facing and internal processes. You will work with LLMs, RAG, MCP servers, and multi-modal agents to deliver scalable AI solutions across the enterprise.

The role emphasizes Python-based development, production-grade AI systems, and collaboration with technology, data, and business teams to improve operational efficiency and innovation. Boston-area presence is expected.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field.
• 5+ years of software engineering experience, including work with machine learning (ML) or AI systems.
• Hands-on experience building LLM-powered applications in production environments.
• Strong programming skills in Python, and familiarity with AI/ML relevant packages such as NumPy, Pandas, SciPy and Scikit-learn.
• Experience with LLM ecosystems such as OpenAI / Anthropic / Google, Open-source LLMs; Hugging Face; LangChain, LlamaIndex, or similar orchestration frameworks.

Responsibilities

• Design, build, and deploy scalable LLM-powered applications, solutions, and digital products for customer support, business use cases, and internal productivity.
• Develop AI agents, Agentic Platforms, and Agentic AI systems capable of reasoning, planning, and executing multi-step workflows.
• Implement Retrieval-Augmented Generation (RAG) architectures and pipelines to leverage proprietary data, and internal knowledge bases.
• Build MCP servers, multi-connectivity enabled and multi-modal Agentic platforms, and AI assistants to support internal teams and customer facing.
• Integrate AI/ML solutions with enterprise systems, APIs, and data platforms.
• Design prompt strategies, evaluation frameworks, and guardrails to ensure accuracy, security, and regulatory compliance.
• Optimize LLM performance through fine-tuning, prompt engineering, and model orchestration.
• Develop MLOps and LLMOps pipelines for monitoring, evaluation, and continuous improvement of AI systems.
• Help in forming buy or build decisions and work with external vendors, consultants and internal teams to deliver scalable top-quality AI solutions timely.
• Stay up to date with emerging advancements in AI/ML, Generative AI, Agentinc frameworks, and model architectures.

Skills

Python programming

LLM frameworks

Prompt engineering

RAG pipelines

MCP servers

API design

Cloud experience

Team collaboration

Education

Bachelor’s or Master’s degree in CS/AI

Tools

NumPy

Pandas

SciPy

Scikit-learn

LangChain

Hugging Face

Vector databases

Job description

Plymouth Rock Assurance is seeking an AI Engineer to design and build Generative and Agentic AI systems that power customer-facing and internal processes. You will work with LLMs, RAG, MCP servers, and multi-modal agents to deliver scalable AI solutions across the enterprise.

The role emphasizes Python-based development, production-grade AI systems, and collaboration with technology, data, and business teams to improve operational efficiency and innovation. Boston-area presence is expected.