Staff Software Engineer, AI Retrieval & Grounded Answers

Datasite; New York (NY); Hybrid; USD 170,000 - 297,000; Full time

Benefits offered by this job

Health insurance

Retirement plan

Paid time off

Job summary

Datasite is hiring a hands-on Staff Software Engineer to own the retrieval layer used by live-deal AI agents. You will ensure grounded, current context using Python in backend services, APIs, and large-scale data pipelines.

Work with Product and Data Science to balance quality, latency, and cost while scaling document processing and vector search. You will mentor engineers, shape context across teams, and support secure multi-tenant access in a hybrid setup with in-office collaboration on

Qualifications

• 6+ years of building and operating production software with a track record of leading complex technical work across teams.
• Strong hands-on Python, with experience in backend services, APIs, and large-scale data pipelines.
• Experience with production LLM applications that depend on retrieval: tool calling, embeddings, vector search, or context management.
• Strong foundations in permissions, multi-tenant data, and access control on what an agent can retrieve.
• Clear product and technical judgment; balancing answer quality, latency, and cost, with ability to explain tradeoffs to engineering/product leaders.

Responsibilities

• Own retrieval for agents that work on live deals.
• Ground each answer in the right documents and data, balancing quality, speed, and cost.
• Scale platform to process large documents and data tables so an agent can reason over content beyond a single pass.
• Shape the context agents depend on and evolve it as deal workflows grow.
• Build the search tools agents call and support content indexed and not yet indexed.
• Return the snippet, citation, and location a dealmaker can trust.
• Ensure agent context aligns with data rooms and access controls; prevent reading restricted content.
• Decide when models may answer from retrieved context and when to re-check results.
• Mentor engineers and set technical direction for retrieval across teams.

Skills

Python

Backend APIs

Data pipelines

LLM retrieval

Permissions & access

Product judgment

Tools

Vector store

Embeddings

RAG

Tool interfaces

Job description

Datasite is hiring a hands-on Staff Software Engineer to own the retrieval layer used by live-deal AI agents. You will ensure grounded, current context using Python in backend services, APIs, and large-scale data pipelines.

Work with Product and Data Science to balance quality, latency, and cost while scaling document processing and vector search. You will mentor engineers, shape context across teams, and support secure multi-tenant access in a hybrid setup with in-office collaboration on