Senior AI Engineer: LLM Architect & Agentic Platforms

Plymouth Rock Assurance; Massachusetts; On-site; USD 135,000 - 200,000; Full time

Benefits offered by this job

4 weeks accrued paid time off + 9 paid

Free onsite gym at our Boston Location

Tuition Reimbursement

Health insurance from Day 1

401(k) Employer Contribution

Paid Family leave

Professional development resources

Pre-Tax Commuter Benefits

Job summary

Plymouth Rock Assurance is seeking an experienced AI Engineer to design and deploy scalable, production-grade LLM-powered applications and agentic platforms. You will develop AI agents, RAG pipelines, and multi-modal systems that support internal teams and customer-facing services.

You will work across cross-functional teams, implement governance and guardrails, optimize model performance, and drive MLOps practices.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, AI, ML, applied math, or related field.
• 5+ years of software engineering experience, incl. ML/AI systems.
• Hands-on experience building LLM-powered applications in production.
• Strong Python programming skills and familiarity with AI/ML packages (NumPy, Pandas, SciPy, Scikit-learn).
• Experience with LLM ecosystems (OpenAI/Anthropic/Google, Open-source LLMs) and Hugging Face.
• Experience building RAG pipelines and working with vector databases.

Responsibilities

• Design, build, and deploy scalable LLM-powered applications and digital products.
• Develop AI agents, agentic platforms, and multi-step workflows.
• Implement RAG architectures and leverage proprietary data and knowledge bases.
• Build MCP servers, multi-connectivity agentic platforms, and AI assistants.
• Integrate AI/ML solutions with enterprise systems and data platforms.
• Design prompts, evaluation frameworks, and guardrails for accuracy and security.
• Optimize LLM performance via fine-tuning and model orchestration.
• Develop MLOps/LLMOps pipelines for monitoring and improvement.

Skills

Python

LLM/AI production

API design

Cross-functional collaboration

Education

Bachelor's or Master's in CS/AI/ML/Applied Mathematics

Tools

NumPy

Pandas

SciPy

Scikit-learn

LangChain

Hugging Face

Vector databases

Job description

Plymouth Rock Assurance is seeking an experienced AI Engineer to design and deploy scalable, production-grade LLM-powered applications and agentic platforms. You will develop AI agents, RAG pipelines, and multi-modal systems that support internal teams and customer-facing services.

You will work across cross-functional teams, implement governance and guardrails, optimize model performance, and drive MLOps practices.