Senior AI Systems Engineer (RAG)

Jobot

United States

Remote

USD 170,000 - 200,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully Remote
Well-funded
Equity
Great healthcare benefits
Autonomy and upward mobility

Job summary

Jobot is a fully remote, well-funded AI startup hiring a Senior AI Systems Engineer. The role focuses on RAG, information retrieval, and context engineering to deliver high-quality model interactions. Strong production experience is required and equity is offered.

You will own architectures for retrieval, document ingestion, and context assembly, ensuring accuracy, scalability, and secure data handling for real users.

Qualifications

  • Experience with production AI systems and software engineering.
  • Expertise in RAG, information retrieval, semantic search or LLM context engineering.
  • Experience operating retrieval/context systems for real users in production.

Responsibilities

  • Design and optimize retrieval systems across large datasets.
  • Advance LLM context engineering and token utilization for better responses.
  • Build evaluation pipelines measuring retrieval relevance, factual grounding, and performance.
  • Engineer secure, production-ready AI systems with traceable content.

Skills

RAG
Information retrieval
Semantic search
LLM context engineering

Tools

Vector search
Embedding strategies

Job description

Fully remote, well-funded AI startup. Excellent benefits, stable future, room for growth! This Jobot Job is hosted by: Grant Greenhalgh.

Salary: $170,000 - $200,000 per year

A bit about us: We're an early-stage AI startup on a mission to redefine how users interact with intelligent systems. We're building something brand new and we're looking for talent to help us scale our platform services.

Why join us?
  • Fully Remote
  • Well-funded
  • Senior team of proven engineers
  • Autonomy and upward mobility
  • Competitive compensation
  • Lucrative Equity
  • Great healthcare benefits
Job Details

We're seeking a Senior AI Systems Engineer with deep expertise in RAG, information retrieval, and LLM context engineering. This position focuses on LLMS receive the right information, in the right format, at the right time. You'll take technical ownership of the systems responsible for identifying relevant information, retrieving it efficiently, and constructing high-quality context for downstream language models. The ideal candidate has built and optimized these systems in production, and understands the limitations of modern LLMs.

What You'll Do
  • Design and Optimize Retrieval Systems: Architect and improve RAG pipelines supporting complex AI applications. Develop sophisticated retrieval strategies using semantic search, optimize document ingestion, indexing, and retrieval across large datasets.
  • Advance LLM Context Engineering: Design intelligent context assembly strategies that determine which information reaches the model and how it's organized. Optimize context selection, ordering, compression, and token utilization to improve LLM response quality.
  • Build Evaluation and Measurement Frameworks: Develop repeatable evaluation pipelines to measure retrieval relevance, answer quality, factual grounding, and system performance. Establish benchmarks and datasets to identify regressions and guide technical improvements.
  • Engineer Secure, Production-Ready AI Systems: Implement retrieval architecture, ensure retrieved content is accurate, traceable, and appropriately grounded in source material.
What We’re Looking For
  • Strong software engineering background with hands-on experience developing and maintaining production AI systems.
  • Demonstrated expertise in RAG, information retrieval, semantic search, or LLM context engineering.
  • Experience designing and operating retrieval or context management systems serving real users in production.
  • Deep understanding of document chunking, embedding strategies, vector search, hybrid retrieval, indexing, and re-ranking.
  • Strong knowledge of LLM behavior, including context-window limitations, information ordering, token management, and grounding.
  • Ability to measure and optimize tradeoffs involving quality, latency, scalability, and infrastructure cost.
  • Understanding of document-level authorization, data isolation, and secure information retrieval.

Jobot is an Equal Opportunity Employer.

We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, age (40 and over), disability, military status, genetic information or any other basis protected by applicable federal, state, or local laws. Jobot also prohibits harassment of applicants or employees based on any of these protected categories.

It is Jobot’s policy to comply with all applicable federal, state and local laws respecting consideration of unemployment status in making hiring decisions.

Sometimes Jobot is required to perform background checks with your authorization.

Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Information collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at jobot.com/legal.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Jobot, and/or its agents and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: jobot.com/privacy-policy

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Systems Engineer (RAG)
Senior AI Systems Engineer (RAG)

Jobot • South Salt Lake (UT)

Remote
USD 170,000 - 200,000
Healthcare benefits
Equity
Remote work
Engineering Lead (Delivery)
Engineering Lead (Delivery)

Jobot • United States

Remote
USD 170,000 - 200,000
Fully remote
Well-funded
Senior engineering team
+4
Senior .NET Software Engineer
Senior .NET Software Engineer

Jobot • Ashburn (VA)

Remote
USD 180,000 - 200,000
401(k) match
Health insurance
Dental/vision
+3
Senior / Staff Software Engineer (Agentic AI Infrastructure)
Senior / Staff Software Engineer (Agentic AI Infrastructure)

Jobot • New York (NY)

On-site
USD 200,000 - 250,000
Equity
Onsite office
Remote days
Senior Software Engineer (AI Infra + Systems)
Senior Software Engineer (AI Infra + Systems)

Jobot • Atlanta (GA)

Remote
USD 170,000 - 200,000
Fully Remote
Equity
Healthcare benefits
+1
Senior Software Engineer (AI Infra + Systems)
Senior Software Engineer (AI Infra + Systems)

Jobot • United States

Remote
USD 170,000 - 200,000
Fully remote
Competitive compensation
Lucrative Equity
+1
Senior AI Systems Engineer - Remote, RAG & LLM Context
Senior AI Systems Engineer - Remote, RAG & LLM Context

Jobot • South Salt Lake (UT)

Remote
USD 170,000 - 200,000
Healthcare benefits
Equity
Remote work
Senior MLOps Engineer
Senior MLOps Engineer

Jobot • United States

Remote
USD 150,000 - 175,000
Competitive base salary
Equity options
Medical, dental, and vision insurance
+6
Software Engineering Manager
Software Engineering Manager

Jobot • Boston (MA)

Remote
USD 130,000 - 160,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Jobot • Richmond (VA)

Remote
USD 180,000 - 225,000
Meaningful equity
Unlimited PTO
WFH Stipend
+2