Sr. Artificial Intelligence Engineer

Plymouth Rock Company

Boston (MA)

On-site

USD 135,000 - 200,000

Full time

36 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Free onsite gym at our Boston Location
Tuition Reimbursement
Health insurance from Day 1
401(k) Employer Contribution
Paid time off and holidays

Job summary

Plymouth Rock Assurance seeks an AI Engineer to design and build Generative and Agentic AI systems powering internal and customer-facing capabilities. You will lead development of LLM-powered applications, RAG pipelines, MCP servers, and multi-modal agents, collaborating with cross-functional teams to deliver scalable AI solutions for efficiency and innovation.

The ideal candidate has strong Python experience, experience with AI/ML packages, LLM architectures, prompt engineering, and

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, AI, ML, Applied Math or related field.
  • 5+ years of software engineering experience including ML/AI systems.
  • Hands-on experience building LLM-powered applications in production.
  • Strong Python and AI/ML package skills (NumPy, Pandas, SciPy, Scikit-learn).
  • Experience with LLM ecosystems and orchestration frameworks (LangChain, LlamaIndex).
  • Experience building RAG pipelines and vector databases.
  • Understanding of prompt engineering, embeddings, model evaluation.
  • Experience building APIs, MCPs, scalable backends, and MLOps/LLMOps tools.

Responsibilities

  • Design, build, and deploy scalable LLM-powered applications and digital products for customer support and internal use.
  • Develop AI agents and Agentic platforms capable of reasoning, planning, and multi-step workflows.
  • Implement RAG architectures and pipelines leveraging proprietary data and knowledge bases.
  • Build MCP servers and multi-modal Agentic platforms to support teams and customers.
  • Integrate AI/ML solutions with enterprise systems and data platforms.
  • Design prompt strategies, evaluation frameworks, and guardrails for accuracy, security, and compliance.
  • Tune LLMs and orchestrate model workflows for performance.

Skills

LLM architectures
Prompt engineering
RAG
Agentic AI
MLOps
API design
Collaboration
AI governance
Leadership

Education

Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field

Tools

Python
NumPy
Pandas
SciPy
Scikit-learn
LangChain
LlamaIndex
OpenAI
Anthropic

Job description

We are seeking a highly skilled AI Engineer to design and build Generative and Agentic AI systems that transform how our company operates and serves customers. This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the enterprise for internal and customer facing use cases.

The ideal candidate has strong experience with a modern AI/ML stack, including a profound Python experience, including AI relevant packages and tools, LLM architectures and frameworks, RAG, MCP, prompt engineering, use of AI tools, budling teams of AI agents, and production-grade AI systems design and development.

You will work closely with technology, data, and business teams to build scalable AI solutions that drive operational efficiency and innovation across the enterprise.

Key Responsibilities:

  • Design, build, and deploy scalable LLM-powered applications, solutions, and digital products for customer support, business use cases, and internal productivity.
  • Develop AI agents, Agentic Platforms, and Agentic AI systems capable of reasoning, planning, and executing multi-step workflows.
  • Implement Retrieval-Augmented Generation (RAG) architectures and pipelines to leverage proprietary data, and internal knowledge bases.
  • Build MCP servers, multi-connectivity enabled and multi-modal Agentic platforms, and AI assistants to support internal teams and customer facing.
  • Integrate AI/ML solutions with enterprise systems, APIs, and data platforms.
  • Design prompt strategies, evaluation frameworks, and guardrails to ensure accuracy, security, and regulatory compliance.
  • Optimize LLM performance through fine-tuning, prompt engineering, and model orchestration.
  • Develop MLOps and LLMOps pipelines for monitoring, evaluation, and continuous improvement of AI systems.
  • Help in forming buy or build decisions and work with external vendors, consultants and internal teams to deliver scalable top-quality AI solutions timely.
  • Stay up to date with emerging advancements in AI/ML, Generative AI, Agentinc frameworks, and model architectures.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field.
  • 5+ years of software engineering experience, including work with machine learning (ML) or AI systems.
  • Hands-on experience building LLM-powered applications in production environments.
  • Strong programming skills in Python, and familiarity with AI/ML relevant packages such as NumPy, Pandas, SciPy and Scikit-learn.
  • Experience with LLM ecosystems such as:
  • OpenAI / Anthropic / Google, Open-source LLMs
  • LangChain, LlamaIndex, or similar orchestration frameworks
  • Experience building RAG pipelines and working with vector databases.
  • Understanding of prompt engineering, embeddings, and model evaluation.
  • Experience building APIs, MCPs, and scalable backend services.
  • Experience with Claude Code, Codex, Cursor, GitHub Copilot, or similar.
  • Ability to collaborate with cross-functional teams.
  • Passion for technology and AI.

Preferred Qualifications:

  • Experience building AI agents, agentic platforms, or autonomous workflows.
  • Familiarity with agent frameworks (LangGraph, AutoGen, CrewAI, Semantic Kernel, Frontier, etc.).
  • Experience with fine-tuning LLMs or parameter-efficient training methods (LoRA, PEFT).
  • Experience with cloud-based AI infrastructure (AWS, Azure, or GCP).
  • Familiarity with Java, JS, and Java applications and environments.
  • Experience with MLOps / LLMOps tools and evaluation pipelines.
  • Experience implementing AI governance, observability, and guardrails.

Salary Range:

The pay range for this position is $135,000 to $200,000 annually. Actual compensation will vary based on multiple factors, including employee knowledge and experience, role scope, business needs, geographical location, and internal equity.

Perks and Benefits:

  • 4 weeks accrued paid time off + 9 paid national holidays per year
  • Free onsite gym at our Boston Location
  • Tuition Reimbursement
  • Low cost and excellent coverage health insurance options that start on Day 1 (medical, dental, vision)
  • Robust health and wellness program and fitness reimbursements
  • Auto and home insurance discounts
  • Matching gift opportunities
  • Annual 401(k) Employer Contribution (up to 7.5% of your base salary)
  • Various Paid Family leave options including Paid Parental Leave
  • Resources to promote Professional Development (LinkedIn Learning and licensure assistance)
  • Convenient location directly across from South Station and Pre-Tax Commuter Benefits

About the Company

The Plymouth Rock Company and its affiliated group of companies write and manage over $2.3 billion in personal and commercial auto and homeowner’s insurance throughout the Northeast and mid-Atlantic, where we have built an unparalleled reputation for service. We continuously invest in technology, our employees thrive in our empowering environment, and our customers are among the most loyal in the industry. The Plymouth Rock group of companies employs more than 1,900 people and is headquartered in Boston, Massachusetts. Plymouth Rock Assurance Corporation holds an A.M. Best rating of "A-/Excellent"

#LI-DF1

Location(s)

695 Atlantic Avenue, Boston , Massachusetts 02111 , United States

Plymouth Rock is committed to a policy ofnon-discrimination and equal opportunity for all qualified applicants andemployees without regard to race, color, religion, gender, sexual orientation,age, national origin, ancestry or disability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Artificial Intelligence Engineer
Artificial Intelligence Engineer

Plymouth Rock Company • Boston (MA)

On-site
USD 110,000 - 160,000
Paid time off
Health insurance
401(k)
+3
Director, Artificial Intelligence Engineering
Director, Artificial Intelligence Engineering

Plymouth Rock Company • Boston (MA)

Hybrid
USD 205,000 - 282,000
Hybrid work environment in Boston
401(k) matching
Competitive compensation
+5
Sr. Artificial Intelligence Engineer
Sr. Artificial Intelligence Engineer

Plymouth Rock Company • Massachusetts

On-site
USD 135,000 - 200,000
4 weeks accrued paid time off + 9 paid
Free onsite gym at our Boston Location
Tuition Reimbursement
+5
Lead Product Analyst
Lead Product Analyst

Plymouth Rock Assurance Corporation • Boston (MA)

On-site
USD 110,000 - 145,000
4 weeks PTO
9 paid holidays
Tuition reimbursement
+7
Lead Product Analyst
Lead Product Analyst

Plymouth Rock Company • Boston (MA)

On-site
USD 110,000 - 145,000
4 weeks paid time off + 9 holidays
Free onsite gym in Boston
Tuition reimbursement
+7
Marketing Cloud and Automation Specialist
Marketing Cloud and Automation Specialist

Plymouth Rock Assurance Corporation • Boston (MA)

On-site
USD 78,000 - 104,000
4 weeks PTO + holidays
Onsite gym
Tuition reimbursement
+5
Lead Data Scientist
Lead Data Scientist

ODSC • Boston (MA)

On-site
USD 152,000 - 217,000
4 weeks PTO + 9 holidays
Free onsite gym
Tuition reimbursement
+2
Associate Product Manager
Associate Product Manager

Plymouth Rock Company • Boston (MA)

On-site
USD 123,000 - 164,000
4 weeks paid time off
Onsite gym
Tuition Reimbursement
+2
Senior Power BI Data Engineer
Senior Power BI Data Engineer

Plymouth Rock Company • Boston (MA)

On-site
USD 100,000 - 120,000
Bonus
Lead Product Analyst
Lead Product Analyst

Plymouth Rock Company • Boston (MA)

On-site
USD 110,000 - 145,000
4 weeks accrued paid time off + 9 paid
Free onsite gym at our Boston Location
Tuition Reimbursement
+5