AI Engineer: Generative & Agentic LLM Systems

Plymouth Rock Assurance

Boston (MA)

On-site

USD 110,000 - 160,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Paid time off
Health insurance
401(k)
Gym access
Tuition reimbursement
Commuter benefits

Job summary

Plymouth Rock Assurance seeks a seasoned AI Engineer to design and build Generative and Agentic AI systems. You will develop LLM-powered applications, RAG pipelines, and MCP-based servers to transform operations and customer service across the enterprise.

The role requires strong Python expertise, experience with LLM ecosystems, and hands-on production AI. You will collaborate with technology, data, and business teams to deliver scalable, secure AI solutions while advancing governance and

Qualifications

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field.
  • 2+ years of software engineering experience, including work with ML/AI systems.
  • Hands-on experience building LLM-powered applications in production environments.
  • Strong programming skills in Python and AI/ML packages (NumPy, Pandas, SciPy, Scikit-learn).
  • Experience with LLM ecosystems (OpenAI/Anthropic/Google, Open-source LLMs).
  • Familiarity with LangChain, LlamaIndex, or similar orchestration frameworks.
  • Experience building RAG pipelines and working with vector databases.
  • Understanding of prompt engineering, embeddings, and model evaluation.
  • Experience building APIs, MCPs, and scalable backend services.

Responsibilities

  • Design, build, and deploy scalable LLM-powered applications and digital products for customer support and internal use.
  • Develop AI agents and Agentic platforms capable of reasoning, planning, and multi-step workflows.
  • Implement RAG architectures and pipelines leveraging proprietary data and internal knowledge bases.
  • Build MCP servers and multi-modal Agentic platforms to support internal teams and customers.
  • Integrate AI/ML solutions with enterprise systems, APIs, and data platforms.
  • Design prompt strategies and guardrails for accuracy, security, and compliance.
  • Optimize LLM performance via fine-tuning, prompt engineering, and model orchestration.
  • Develop MLOps/LLMOps pipelines for monitoring, evaluation, and improvement.
  • Collaborate with cross-functional teams and external vendors to deliver scalable AI solutions.

Skills

Python
LLM frameworks
RAG pipelines
Prompt engineering
APIs
MCP
Agentic AI
Vector databases
Cloud platforms
Teamwork

Education

Bachelor's or Master's in CS

Tools

LangChain
LlamaIndex
GitHub Copilot

Job description

Plymouth Rock Assurance seeks a seasoned AI Engineer to design and build Generative and Agentic AI systems. You will develop LLM-powered applications, RAG pipelines, and MCP-based servers to transform operations and customer service across the enterprise.

The role requires strong Python expertise, experience with LLM ecosystems, and hands-on production AI. You will collaborate with technology, data, and business teams to deliver scalable, secure AI solutions while advancing governance and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer - Generative & Agentic LLM Systems
Senior AI Engineer - Generative & Agentic LLM Systems

Plymouth Rock Assurance • Boston (MA)

On-site
USD 135,000 - 200,000
Free onsite gym at our Boston Location
Tuition Reimbursement
Health insurance from Day 1
+2
Senior AI Engineer: LLM Architect & Agentic Platforms
Senior AI Engineer: LLM Architect & Agentic Platforms

Plymouth Rock Assurance • Massachusetts

On-site
USD 135,000 - 200,000
4 weeks accrued paid time off + 9 paid
Free onsite gym at our Boston Location
Tuition Reimbursement
+5
Director, AI Engineering - Generative & Agentic AI
Director, AI Engineering - Generative & Agentic AI

Plymouth Rock Assurance • Boston (MA)

Hybrid
USD 205,000 - 282,000
Hybrid work environment in Boston
401(k) matching
Competitive compensation
+5
Senior AI Engineer: Generative AI & LLMs
Senior AI Engineer: Generative AI & LLMs

Cognizant Technology Solutions Corporation • Washington

Hybrid
USD 130,000 - 155,000
Medical insurance
Dental insurance
Vision insurance
+7
Generative AI Engineer & LLM Solutions Architect
Generative AI Engineer & LLM Solutions Architect

Ethereum Technologies LLC • Raleigh (NC)

On-site
USD 120,000 - 170,000
GenAI & LLM Architect for Agentic AI & RAG
GenAI & LLM Architect for Agentic AI & RAG

Compunnel Inc. • Phoenix (AZ)

Hybrid
USD 120,000 - 190,000
Hybrid work arrangement
AI Engineer — Production-Grade LLM & Agent Systems
AI Engineer — Production-Grade LLM & Agent Systems

Awareson Sp. z o.o. • United States

Remote
USD 120,000 - 160,000
GenAI Engineer: Enterprise AI & LLM Solutions
GenAI Engineer: Enterprise AI & LLM Solutions

Robotic Process Automation LLC • Salt Lake City (UT)

On-site
USD 97,000 - 138,000
GenAI Software Engineer: LLM & Agentic AI, Python Pro
GenAI Software Engineer: LLM & Agentic AI, Python Pro

Ethereum Technologies • New York (NY)

On-site
USD 120,000 - 180,000
AI Engineer
AI Engineer

ClinDCast LLC • Warren Township (NJ)

Remote
USD 120,000 - 155,000