Senior AI Systems Engineer — Retrieval & Context

Boodlebox

United States

Remote

USD 175,000 - 185,000

Full time

7 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Unlimited PTO
Health coverage
401(k)
Remote

Job summary

BoodleBox is a VC-backed GenAI platform delivering context assembly, retrieval, and document intelligence to high-education customers. You’ll own how information is retrieved, assembled, and handed to models, with a focus on latency, quality, and cost.

This senior IC role requires deep expertise in production retrieval systems and measurable impact across our product suite. You’ll guide architecture decisions, quantify improvements with datasets and metrics, and operate at scale on Kubernetes.

Qualifications

  • You've run retrieval or context systems in production.
  • You know how models actually behave: context ordering, length, and window edges.
  • You measure with explicit eval datasets and metrics.
  • You've thought about permissions and tenant boundaries in retrieval correctness.
  • You write production Python with testing, packaging, observability, and paging in real incidents.

Responsibilities

  • Context assembly: decide what goes into the window and in what order, compressed when needed.
  • Retrieval architecture: chunking, indexing, hybrid search, re-ranking, grounding in production at scale.
  • The evaluation harness: build repeatable datasets and metrics for relevance, groundedness and answer quality.
  • Quality-cost-latency tradeoffs: assess where long-context models or memory help.
  • Reusability: provide retrieval and context capabilities used across products.
  • Productions services on Kubernetes with backup and governance for legal document workflows.
  • Document processing and document creation on the shared foundation.

Job description

Full-time Remote, United States


Own how information gets retrieved, assembled, and handed to models across every BoodleBox product, and prove the improvements with numbers.


About BoodleBox

BoodleBox is a VC-backed GenAI platform built for higher education. With 100,000+ users across 1,200+ colleges and universities, we partner with faculty, staff, and students to make responsible AI adoption practical, impactful, and lasting. We're guided by three core values: service, education, and collaboration.


The Role

You know that the model is rarely the problem. The context is. You've built retrieval or context-management systems that real users depended on, you've been burned by a chunking decision or a context-ordering choice, and you measured your way out instead of guessing. You can explain why a hybrid search beat pure vector search on a particular corpus without reaching for a framework name.


BoodleBox's AI foundation — context assembly, retrieval, document intelligence, model routing — is shared by every experience we ship. You'd be the deepest person in the building on how information gets retrieved, selected, assembled, and handed to a model, and your job is to make that layer measurably better: quality, latency, cost, with the numbers to prove it.


This is a senior individual-contributor role. You'll be the technical authority on retrieval and context.


What You'll Own


  • Context assembly. What goes in the window, in what order, compressed how, when it won't all fit. Every product we ship depends on you getting this right.

  • Retrieval architecture. Chunking, indexing, hybrid search, re-ranking, citation and grounding — in production, at scale, on messy real documents from universities and law firms.

  • The evaluation harness. Repeatable datasets and metrics for relevance, groundedness, and answer quality. Decisions get made on these numbers.

  • The quality-cost-latency trade. Including an honest read on where long-context models, agentic retrieval, or memory approaches actually help.

  • Reusability. Retrieval and context capabilities that Chat, Classroom, Boxes, and the next vertical all use.

  • Your services in production. A set of AI services on Kubernetes you steward with a named backup.

  • The legal document workflows. Document processing and document creation on the shared foundation.


Who You Are


  • You've run retrieval or context systems in production. Real users, real scale, real regressions. Not a notebook, not a demo.

  • You know how models actually behave. What context ordering does. What length does. What happens at the edges of the window.

  • You measure. You can name your eval dataset, your metric, and the time the eval disagreed with your gut.

  • You've thought about permissions. Tenant boundaries and document access are part of retrieval correctness to you.

  • You write production Python. Tested, packaged, observable, and you've been paged for it at least once.

  • You're motivated by depth. You'd rather be the person every engineer asks about retrieval than the person who runs the meeting.


What We Offer


  • Competitive base salary of $175,000–$185,000, plus bonus and equity.

  • Unlimited PTO.

  • Medical, dental, and vision coverage. BoodleBox covers 75% of premiums.

  • 401(k).

  • Fully remote work environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Systems Engineer — Retrieval & Context
Senior AI Systems Engineer — Retrieval & Context

Boodlebox • Colorado Springs (CO)

Hybrid
USD 175,000 - 185,000
Competitive base salary
Unlimited PTO
Healthcare coverage
+3
Senior Software Engineer — AI Systems & Scalability
Senior Software Engineer — AI Systems & Scalability

Boodlebox • United States

Remote
USD 175,000 - 185,000
Unlimited PTO
Medical, dental, and vision coverage
401(k)
+1
Engineering Lead — Delivery & Release
Engineering Lead — Delivery & Release

Boodlebox • United States

Remote
USD 195,000 - 205,000
Competitive base salary
Unlimited PTO
Healthcare coverage
+2
Remote Senior AI Retrieval & Context Engineer
Remote Senior AI Retrieval & Context Engineer

Boodlebox • Colorado Springs (CO)

Hybrid
USD 175,000 - 185,000
Competitive base salary
Unlimited PTO
Healthcare coverage
+3
Deal Desk & Contracts Specialist
Deal Desk & Contracts Specialist

BoodleBox • United States

Remote
USD 105,000 - 120,000
Unlimited PTO
Medical coverage
Dental coverage
+4
Senior Native Experience Engineer — iOS & Android
Senior Native Experience Engineer — iOS & Android

Boodlebox • United States

Remote
USD 175,000 - 185,000
Unlimited PTO
Medical, dental, and vision coverage
75% premiums covered by BoodleBox
+4
Account Manager
Account Manager

Boodlebox • United States

Remote
USD 100,000 - 120,000
Unlimited PTO
Medical, dental, and vision coverage
401(k)
+1
Solutions Engineer / Customer Success Manager — Law
Solutions Engineer / Customer Success Manager — Law

Boodlebox • Colorado Springs (CO)

Hybrid
USD 120,000 - 140,000
Base salary included (120k–140k USD)
Company equity
Unlimited PTO
+5
VP, Legal Market Strategy & Growth
VP, Legal Market Strategy & Growth

Boodlebox • Colorado Springs (CO)

Hybrid
USD 310,000 - 335,000
Unlimited PTO
Medical coverage
Dental coverage
+5
Engagement Associate
Engagement Associate

Garuda Ventures • New York (NY)

Hybrid
USD 100,000 - 125,000
Unlimited AI
Build your own toolkit
Ramp card for success
+5