Senior AI Engineer - Generative & Agentic LLM Systems

Plymouth Rock Assurance

Boston (MA)

On-site

USD 135,000 - 200,000

Full time

1 hour ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Free onsite gym at our Boston Location
Tuition Reimbursement
Health insurance from Day 1
401(k) Employer Contribution
Paid time off and holidays

Job summary

Plymouth Rock Assurance seeks an AI Engineer to design and build Generative and Agentic AI systems powering internal and customer-facing capabilities. You will lead development of LLM-powered applications, RAG pipelines, MCP servers, and multi-modal agents, collaborating with cross-functional teams to deliver scalable AI solutions for efficiency and innovation.

The ideal candidate has strong Python experience, experience with AI/ML packages, LLM architectures, prompt engineering, and

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, AI, ML, Applied Math or related field.
  • 5+ years of software engineering experience including ML/AI systems.
  • Hands-on experience building LLM-powered applications in production.
  • Strong Python and AI/ML package skills (NumPy, Pandas, SciPy, Scikit-learn).
  • Experience with LLM ecosystems and orchestration frameworks (LangChain, LlamaIndex).
  • Experience building RAG pipelines and vector databases.
  • Understanding of prompt engineering, embeddings, model evaluation.
  • Experience building APIs, MCPs, scalable backends, and MLOps/LLMOps tools.

Responsibilities

  • Design, build, and deploy scalable LLM-powered applications and digital products for customer support and internal use.
  • Develop AI agents and Agentic platforms capable of reasoning, planning, and multi-step workflows.
  • Implement RAG architectures and pipelines leveraging proprietary data and knowledge bases.
  • Build MCP servers and multi-modal Agentic platforms to support teams and customers.
  • Integrate AI/ML solutions with enterprise systems and data platforms.
  • Design prompt strategies, evaluation frameworks, and guardrails for accuracy, security, and compliance.
  • Tune LLMs and orchestrate model workflows for performance.

Skills

LLM architectures
Prompt engineering
RAG
Agentic AI
MLOps
API design
Collaboration
AI governance
Leadership

Education

Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field

Tools

Python
NumPy
Pandas
SciPy
Scikit-learn
LangChain
LlamaIndex
OpenAI
Anthropic

Job description

Plymouth Rock Assurance seeks an AI Engineer to design and build Generative and Agentic AI systems powering internal and customer-facing capabilities. You will lead development of LLM-powered applications, RAG pipelines, MCP servers, and multi-modal agents, collaborating with cross-functional teams to deliver scalable AI solutions for efficiency and innovation.

The ideal candidate has strong Python experience, experience with AI/ML packages, LLM architectures, prompt engineering, and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer: Generative & Agentic LLM Systems
AI Engineer: Generative & Agentic LLM Systems

Plymouth Rock Assurance • Boston (MA)

On-site
USD 110,000 - 160,000
Paid time off
Health insurance
401(k)
+3
Senior AI Engineer: LLM Architect & Agentic Platforms
Senior AI Engineer: LLM Architect & Agentic Platforms

Plymouth Rock Assurance • Massachusetts

On-site
USD 135,000 - 200,000
4 weeks accrued paid time off + 9 paid
Free onsite gym at our Boston Location
Tuition Reimbursement
+5
Director, AI Engineering - Generative & Agentic AI
Director, AI Engineering - Generative & Agentic AI

Plymouth Rock Assurance • Boston (MA)

Hybrid
USD 205,000 - 282,000
Hybrid work environment in Boston
401(k) matching
Competitive compensation
+5
Senior AI Engineer - GenAI & LLM Systems Lead
Senior AI Engineer - GenAI & LLM Systems Lead

US based SaaS company that offers AI-powered business operating system • United States

Remote
USD 180,000 - 280,000
Senior AI Engineer: Generative AI & LLMs
Senior AI Engineer: Generative AI & LLMs

Cognizant Technology Solutions Corporation • Washington

Hybrid
USD 130,000 - 155,000
Medical insurance
Dental insurance
Vision insurance
+7
Senior AI Engineer: Generative AI & LLMs (Remote)
Senior AI Engineer: Generative AI & LLMs (Remote)

Ethereum Technologies LLC • Chicago (IL)

Remote
USD 86,000 - 123,000
GenAI & LLM Architect for Agentic AI & RAG
GenAI & LLM Architect for Agentic AI & RAG

Compunnel Inc. • Phoenix (AZ)

Hybrid
USD 120,000 - 190,000
Hybrid work arrangement
AI Engineer
AI Engineer

ClinDCast LLC • Warren Township (NJ)

Remote
USD 120,000 - 155,000
Remote Generative AI Engineer – LLM & Agentic Systems
Remote Generative AI Engineer – LLM & Agentic Systems

Computer Task Group • United States

Remote
USD 90,000 - 96,000
Remote Generative AI Engineer: LLM & Agentic Systems
Remote Generative AI Engineer: LLM & Agentic Systems

Computer Task Group, Inc • United States

Remote
USD 90,000 - 96,000