Agentic AI/LLM Engineer, Coverage Intelligence

Bold Penguin Inc

United States

Remote

USD 150,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, Dental, and Vision
Flexible PTO Policy
401(k) with company match
Employee Assistance Program
Parental Leave
Disability and Life Benefits

Job summary

Bold Penguin Inc. is seeking an Agentic AI / LLM Engineer for the Coverage Intelligence team. The role focuses on designing and building AI systems that interpret unstructured insurance documents into reliable, explainable coverage intelligence within the Digital Exchange.

The position is fully remote, with onboarding and optional in-office events. You will own end-to-end problems, collaborate with domain experts, and evolve the tech direction as AI capabilities advance.

Qualifications

  • 5+ years’ experience in software engineering or applied machine learning, including 2+ years building LLM applications in production.
  • Strong Python skills, including typed schemas for structured output (e.g., Pydantic).
  • Hands-on experience extracting structured data from complex documents using PDF parsing, OCR and Vision-language models.
  • Experience with agentic patterns such as tool use, multi-step workflows, self-verification and self-in-the-loop review.
  • Experience with retrieval-augmented generation, embeddings and source-grounded output.
  • A rigorous approach to evaluation: defining metrics, building test sets and doing systematic error analysis.
  • Excellent written and verbal communication skills, including working directly with domain experts.
  • Works autonomously with minimal direction, sets a clear path through ambiguity, and holds a high bar for quality.
  • Thrives on the energy of a start up: comfortable with pace, changing priorities, and building the function while running it.
  • Experience with insurance, legal, financial or other contract-heavy documents (strongly preferred).
  • Experience with LangGraph or similar agent frameworks (preferred).
  • Experience with LLM observability and evaluation tooling (preferred).

Responsibilities

  • Design, build and own production AI systems for document understanding and coverage analysis.
  • Build agentic workflows that combine models, tools and human review, and recognize when a decision needs an expert.
  • Ground outputs in source documents and domain knowledge so every result is traceable and explainable.
  • Drive accuracy through evaluation, experimentation and error analysis against expert-labeled data.
  • Make sound trade-offs across models and providers on accuracy, cost and latency.
  • Partner with domain experts and engineers to turn expert judgment into durable system behavior.
  • Help set the team’s technical direction as LLM and agent capabilities evolve.
  • Other duties and responsibilities as assigned.

Skills

Python
LLM applications in production
Document understanding
Agentic workflows
Evaluation and error analysis
Domain knowledge collaboration
Autonomy and ambiguity handling
Insurance/document-heavy domains
LangGraph or agent frameworks
LLM observability tooling

Tools

Pydantic
PDF parsing
OCR
Vision-language models

Job description

YOUR ROLE

As an Agentic AI / LLM Engineer on the Coverage Intelligence team, you design and build the AI systems that turn complex insurance documents into reliable, explainable coverage intelligence inside the Digital Exchange, powered by DeX ai. You own problems end to end, from understanding unstructured documents to building agents that reason about coverage, and you hold that work to a measurable standard of accuracy. You work alongside our coverage and ontology specialists and help shape how the team builds with AI as the technology evolves.

WHAT YOU'LL DO

Design, build and own production AI systems for document understanding and coverage analysis. Build agentic workflows that combine models, tools and human review, and recognize when a decision needs an expert. Ground outputs in source documents and domain knowledge so every result is traceable and explainable. Drive accuracy through evaluation, experimentation and error analysis against expert-labeled data. Make sound trade-offs across models and providers on accuracy, cost and latency. Partner with domain experts and engineers to turn expert judgment into durable system behavior. Help set the team’s technical direction as LLM and agent capabilities evolve. Other duties and responsibilities as assigned.

YOUR LOCATION

This is a fully remote role, with the exception of onboarding and optional in-office events.

SKILLS AND QUALIFICATIONS
  • 5+ years’ experience in software engineering or applied machine learning, including 2+ years building LLM applications in production.
  • Strong Python skills, including typed schemas for structured output (e.g., Pydantic).
  • Hands-on experience extracting structured data from complex documents using PDF parsing, OCR and Vision-language models.
  • Experience with agentic patterns such as tool use, multi-step workflows, self-verification and self-in-the-loop review.
  • Experience with retrieval-augmented generation, embeddings and source-grounded output.
  • A rigorous approach to evaluation: defining metrics, building test sets and doing systematic error analysis.
  • Excellent written and verbal communication skills, including working directly with domain experts.
  • Works autonomously with minimal direction, sets a clear path through ambiguity, and holds a high bar for quality.
  • Thrives on the energy of a start up: comfortable with pace, changing priorities, and building the function while running it.
  • Experience with insurance, legal, financial or other contract-heavy documents (strongly preferred).
  • Experience with LangGraph or similar agent frameworks (preferred).
  • Experience with LLM observability and evaluation tooling (preferred).
Physical Requirements

Must be able to sit/stand/walk for prolonged periods of time (up to 8 hours per day), at a desk working on a computer. Must be able to use standard office equipment for extended periods of time, including but not limited to, a mouse, keyboard, phone and video conferencing. Must be able to travel to the Bold Penguin office in Dublin, Ohio for New Hire Onboarding & Orientation (2 days, 2 nights); travel costs are covered by Bold Penguin. Must be able to travel occasionally (up to 10%) for corporate events and team planning sessions.

Bold Penguin is the premier digital broker for commercial insurance.

Their technology expands top-of-funnel demand and increases yield for enterprise partners. Through digital distribution, wholesale capabilities, and AI-driven insights, they transform the lifecycle of both simple and complex risks, from prospecting to placement.

Benefits
  • Medical, Dental, and Vision
  • Flexible PTO Policy
  • 401(k) with a company match
  • Employee Assistance Program
  • Parental Leave
  • Disability and Life Benefits
Bold Penguin believes in inclusion.

That’s why we’re proud to be an equal opportunity employer that considers all qualified applicants regardless of race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

To learn more about our results-focused culture and employee-focused perks, read more on our careers page.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Agentic AI/LLM Engineer, Coverage Intelligence
Agentic AI/LLM Engineer, Coverage Intelligence

OhioX • United States

Remote
USD 140,000 - 190,000
Medical, Dental, Vision
Flexible PTO
401(k) with company match
+2
Agentic AI/LLM Engineer, Coverage Intelligence
Agentic AI/LLM Engineer, Coverage Intelligence

Bold Penguin • Dublin (OH)

Remote
USD 140,000 - 190,000
Medical/Dental/Vision
Flexible PTO
401(k) match
+3
Agentic AI/LLM Engineer, Coverage Intelligence
Agentic AI/LLM Engineer, Coverage Intelligence

Bold Penguin, Inc. • Dublin (OH)

Remote
USD 140,000 - 200,000
Annual Performance Bonus Eligible
Medical, Dental, and Vision
Flexible PTO Policy
+3
Agentic AI/LLM Engineer, Coverage Intelligence
Agentic AI/LLM Engineer, Coverage Intelligence

OhioX • Dublin (OH)

Remote
USD 97,000 - 134,000
Medical, Dental, and Vision
Flexible PTO
401(k) with company match
+3
Staff Software Engineer - Ruby on Rails
Staff Software Engineer - Ruby on Rails

Bold Penguin • United States

Remote
USD 180,000 - 280,000
Medical, Dental, Vision
Flexible PTO
401(k) with company match
+3
Senior Agentic AI Engineer
Senior Agentic AI Engineer

OhioX • Dublin (OH)

Remote
USD 130,000 - 155,000
Annual performance bonus
Ontology Specialist, Coverage Intelligence
Ontology Specialist, Coverage Intelligence

Bold Penguin • Dublin (OH)

Remote
USD 120,000 - 180,000
Medical, Dental, and Vision
Flexible PTO Policy
401(k) with a company match
+3
Backend/Data Engineer, Coverage Intelligence
Backend/Data Engineer, Coverage Intelligence

Bold Penguin • Dublin (OH)

Remote
USD 120,000 - 180,000
Medical benefits
Dental benefits
Vision benefits
+2
Backend/Data Engineer, Coverage Intelligence
Backend/Data Engineer, Coverage Intelligence

OhioX • Dublin (OH)

Hybrid
USD 105,000 - 140,000
Medical, Dental, and Vision
Flexible PTO Policy
401(k) with company match
+3
Staff Agentic AI Engineer
Staff Agentic AI Engineer

OhioX • Dublin (OH)

Remote
USD 150,000 - 185,000
Medical, Dental, and Vision
401(k) with company match
Employee Assistance Program
+2