Senior AI Architect for LLM & Agentic Platforms

plymouthrock; Boston (MA); On-site; USD 135,000 - 200,000; Full time

Benefits offered by this job

Paid time off

401(k) matching

Tuition reimbursement

Health insurance

Gym access

Parental leave

Job summary

Plymouth Rock seeks a highly skilled AI Engineer to design and build Generative and Agentic AI systems that transform how the company operates and serves customers. Focus areas include LLMs, RAG, MCP servers, and Agentic AI across the enterprise for internal and customer-facing use cases.

You will work with technology, data, and business teams to create scalable AI solutions that drive efficiency and innovation, with production-grade AI systems and careful attention to security and compliance.

Qualifications

• 5+ years of software engineering experience with ML/AI systems.
• Hands-on experience building LLM-powered applications in production.

Responsibilities

• Design, build, and deploy scalable LLM-powered applications and AI agents.
• Develop Agentic Platforms and MCP servers for internal and customer use cases.
• Implement RAG architectures and data pipelines.
• Integrate AI/ML with enterprise systems and APIs.
• Define prompt strategies, guardrails, and evaluation frameworks.
• Develop MLOps/LLMOps pipelines for monitoring and improvement.
• Collaborate with cross-functional teams to deliver scalable AI solutions.

Skills

Python programming

LLM experience

System design

Collaboration

Education

Bachelor’s or Master’s degree in CS/AI/ML

Tools

NumPy

Pandas

SciPy

Scikit-learn

LangChain

LlamaIndex

Hugging Face

OpenAI/Anthropic/Google ecosystems

Codex/Copilot/Cursor tooling

Job description

Plymouth Rock seeks a highly skilled AI Engineer to design and build Generative and Agentic AI systems that transform how the company operates and serves customers. Focus areas include LLMs, RAG, MCP servers, and Agentic AI across the enterprise for internal and customer-facing use cases.

You will work with technology, data, and business teams to create scalable AI solutions that drive efficiency and innovation, with production-grade AI systems and careful attention to security and compliance.