Senior Founding AI Software Engineer

Deffai; San Francisco (CA); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Equity

Remote work

Job summary

Deffai seeks a Senior Founding AI Software Engineer to own the architecture and delivery of an AI platform simulating FDA regulatory intelligence. You’ll build from 0 to 1 with a small team, shaping product direction and collaborating with former FDA decision-makers.

Expect rapid shipping, high-stakes compliance, and equity upside. You’ll work across the stack from data ingestion to multi-agent workflows, ensuring traceability, reproducibility, and scalable cloud infrastructure in a regulated

Qualifications

• 5+ years building and operating production software.
• Experience shipping LLM systems to production.
• Experience evaluating against expert judgment, such as golden datasets and precision/recall.
• Strong Python and data engineering experience: schema design, migrations, pipelines.

Responsibilities

• Build the eval pipeline for model benchmarking and regression suites.
• Document ingestion and retrieval across regulatory documents with traceable provenance.
• Develop multi-agent review workflows on LangGraph engine.
• Collaborate with FDA experts to translate feedback into product changes.
• Own architectural decisions balancing innovation, scalability, and cost.

Skills

Python

Data engineering

AWS

Terraform

CI/CD

LLM systems

Tools

FastAPI

SQLAlchemy

PostgreSQL

Docker

GitHub Actions

Job description

This is a rare and exciting opportunity for a hands-on builder who wants to take ownership and build 0 to 1 at a VC-backed, fast-growing startup. Build with former FDA decision-makers to define the future of biotech industry standards.

You don't have to know FDA or biotech, but you believe in vertical AI solutions and want to push the boundary of what is possible. Work across our entire stack from document ingestion to agents and evals, build 0 to 1 and grow with a young team. We're looking for a Senior Founding AI Software Engineer who is passionate about solving challenging problems in a highly regulated industry.

Headquartered in San Francisco, Deffai is an AI-native VC-backed seed-stage startup building AI platform for simulating FDA regulatory intelligence, built together with former FDA reviewers. We help therapeutics companies and their investors anticipate regulatory outcomes.

Backed by top-tier tech investors in the SF bay area, with advisors from GitHub, OpenAI, and Mercor.

You get market standard comp, equity, viable path to Head of Engineering or beyond.

You will work closely with 2 engineers on the team, build, ship quickly and shape our product vision.

Key responsibilities

• Evals & Benchmarks: Build the eval pipeline for model benchmarking and regression suites. Use them to gate prompt, model and agent changes, measure precision and recall against expert judgment, and benchmark our performance with frontier models.
• Document Ingestion & Retrieval: Build ingestion and retrieval over diverse, long, and complex regulatory documents (scanned PDFs, Word files, tables, slide decks): parsing, structure-aware chunking, hybrid search, reranking, context assembly under token budgets, and knowledge graphs. Keep every answer traceable to a cited source, with provenance and versioning.
• Agents: Build and operate our multi-agent review workflows as they move to a shared LangGraph engine: tool use, memory, tracing, and handling cost, latency, and failures in long-running runs.
• Expert Collaboration: Work with former FDA experts to accelerate their regulatory review workflows. Turn their feedback into product changes and new evaluation cases.
• Build & Ship: Own architectural decisions that balance innovation, scalability, cost, and long-term maintainability in a high-stakes domain. Review AI-generated code for what a diff does not show: migration locks, environment boundaries, and tenant scope.
• Data Engineering: Work with the team on the data pipelines behind our product: document ingestion, background jobs, and the PostgreSQL schemas. Make every pipeline idempotent and observable.
• Infrastructure: Support the team on our AWS infrastructure: Terraform-managed ECS services, CI/CD, and separate development and production environments.
• Security & Tenant Isolation: Support the team with tenant isolation, role-based access control, encryption, audit logging, and data retention controls in every service that handles customer documents.

Who you are

• Cracked: You love to build.
• Strong opinions: You have strong opinions and strong product taste, and you're not afraid of pushing back.
• Relentless: You are tough, can handle the speed and execute quickly.
• Execution-Oriented: You move fast and focus on solving real problems.
• Clear Communicator: You collaborate well across functions and push decisions forward.

Requirements

• 5+ years building and operating production software, including owning the architecture of a production system
• Experience building evaluations against expert judgment, such as golden datasets and precision and recall, and using them to decide what ships
• Experience shipping LLM systems to production, such as retrieval over complex documents or agent workflows
• Daily use of AI coding tools, with the judgment to catch what they get wrong in migrations, infrastructure changes, and data-access code
• Strong Python and data engineering experience: schema design, zero-downtime migrations, and reliable pipelines and background jobs on a relational database
• Experience running production systems on a major cloud with infrastructure as code, CI/CD, and separate development and production environments

Nice to have

• Worked directly with domain experts (clinicians, lawyers, scientists) to turn their judgment into requirements and test cases
• Retrieval techniques: hybrid search, reranking, parsing scanned PDFs and tables, or knowledge graphs (GraphRAG or similar)
• Agent frameworks and runtimes: LangGraph, MCP, Claude Agent SDK, or sandboxed agent execution
• Post-training or fine-tuning (SFT, preference tuning, LoRA), and judgment on when it beats prompt and retrieval work
• Experience building secure multi-tenant systems: tenant isolation, access control, and audit logging
• AWS (ECS, RDS, S3) and Terraform

Our stack

You don't need prior experience with every tool in our stack. We value strong engineering fundamentals and the ability to take ownership of production systems.

• Frontend: React, TypeScript, Vite, Tailwind CSS, Vercel AI SDK
• Backend and persistence: Python, FastAPI, SQLAlchemy, PostgreSQL, Alembic
• Cloud: AWS ECS/Fargate, ECR, RDS, S3, Application Load Balancer, Secrets Manager; Cloudflare for DNS
• Delivery and infrastructure: Docker, GitHub Actions, Terraform and OpenTofu
• AI and orchestration: Claude via the Anthropic API; application-managed skill packs, tool use, retrieval, streaming, and evaluation workflows
• Data and documents: FDA corpus ingestion and SQL analytics, PDF parsing with PyMuPDF, DOCX processing and report generation with python-docx

Job details

• Location: Remote (US)
• Work authorization: We currently do not provide visa sponsorship.
• 30min intro with CEO & cofounder
• 40min technical interview with one of our engineers, including a short hands-on exercise
• Short paid take-home (5-8 hr), followed by a walkthrough where you explain your thought process
• Final round: meet one of our former FDA decision makers

We aim to decide within 2 weeks of your final round. Don't miss this rare opportunity to define the next generation of medicine approvals.