Founding AI Platform Engineer

Zipdev

United States

Remote

USD 190,000 - 260,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Zipdev seeks a Senior AI Platform Engineer to own the core platform powering our enterprise AI products. You will shape architecture, own the AI orchestration layer, and work directly with the CEO and forward‑deployed engineers to deliver reusable platform capabilities for real estate clients.

You will design multi‑tenant graphs, LLM gateways, evaluation frameworks, and governance tools, turning client engagements into scalable solutions.

Qualifications

  • 5–10 years of software/backend/AI engineer experience.
  • Production AI experience building AI-centric systems for real users.
  • Architectural ownership designing a platform or major system end-to-end.
  • LLM evaluation and reliability with guardrails and QA.
  • Backend engineering with APIs, data pipelines, and services.
  • Cloud infrastructure design and deployment in production.
  • Data and systems thinking for complex unstructured data.
  • Enterprise readiness handling sensitive enterprise data with balance of accuracy, cost, and latency.

Responsibilities

  • Build and own the core AI orchestration platform, from document ingestion and processing to grounded, source‑cited answers.
  • Design and maintain a multi‑provider LLM gateway with prompt caching, record‑replay capabilities, and evaluation‑gated model routing to optimize cost, quality, and latency.
  • Develop evaluation frameworks and guardrails to measure LLM output quality, prevent hallucinations, and ensure reliable production performance.
  • Build fact‑extraction pipelines and semantic matching systems for complex commercial real estate documents, including loan documents and rent rolls.
  • Map extracted information to a commercial real estate semantic field dictionary to improve consistency, accuracy, and data reliability.
  • Lead the architecture of a multi‑tenant knowledge graph and retrieval layer.
  • Implement enterprise governance capabilities, including PII detection, policy checks, human escalation workflows, and cryptographic audit trails.
  • Identify reusable functionality across client‑specific implementations and incorporate it into the shared platform.
  • Design and build reusable integrations with enterprise real estate platforms such as DealCloud and Yardi.
  • Collaborate directly with the CEO and forward‑deployed engineers to influence product architecture and technical direction.

Skills

Backend engineering
Cloud infrastructure
Data & systems thinking
Enterprise readiness
LLM evaluation
Knowledge graphs

Tools

Node.js
TypeScript
PostgreSQL
AWS
LLMs
Knowledge graphs
Data pipelines
API design

Job description

Our client is a seed-stage enterprise AI company building an AI platform specifically for the commercial real estate industry. Its platform transforms a firm's documents and data into a structured knowledge graph that AI agents can reason over, helping investors, owners, operators, and developers automate workflows and access reliable answers backed by source citations. The company combines a recurring platform subscription with forward-deployed engineers who build custom workflows within client environments. Its vision is to become the foundational AI platform for the commercial real estate industry, bringing agentic workflows, transparency, and governance to a traditionally underserved market. Backed by a real‑estate‑focused venture fund with strong industry relationships, the company already works with established commercial real estate firms. This is an opportunity to join a small, five‑person team, work directly with the CEO, and take founding‑level ownership of a product with significant growth potential.

About the Role

Our client is looking for a Senior AI Platform Engineer to build and own the core platform powering its enterprise AI products. While forward‑deployed engineers focus on developing custom applications for individual clients, this role focuses on identifying common patterns across those engagements and turning them into reusable platform capabilities. This is a highly technical, hands‑on engineering position with significant architectural ownership. You will work closely with the CEO and engineering team to build the AI orchestration layer, LLM infrastructure, document intelligence pipelines, and knowledge graph that power reliable AI workflows across commercial real estate clients.

Key Responsibilities
  • Build and own the core AI orchestration platform, from document ingestion and processing to grounded, source‑cited answers.
  • Design and maintain a multi‑provider LLM gateway with prompt caching, record‑replay capabilities, and evaluation‑gated model routing to optimize cost, quality, and latency.
  • Develop evaluation frameworks and guardrails to measure LLM output quality, prevent hallucinations, and ensure reliable production performance.
  • Build fact‑extraction pipelines and semantic matching systems for complex commercial real estate documents, including loan documents and rent rolls.
  • Map extracted information to a commercial real estate semantic field dictionary to improve consistency, accuracy, and data reliability.
  • Lead the architecture of a multi‑tenant knowledge graph and retrieval layer.
  • Implement enterprise governance capabilities, including PII detection, policy checks, human escalation workflows, and cryptographic audit trails.
  • Identify reusable functionality across client‑specific implementations and incorporate it into the shared platform.
  • Design and build reusable integrations with enterprise real estate platforms such as DealCloud and Yardi.
  • Collaborate directly with the CEO and forward‑deployed engineers to influence product architecture and technical direction.
Experience
  • Experience: 5–10 years of professional experience as a software, backend, machine learning, or applied AI engineer.
  • Production AI Experience: Proven experience building and shipping AI‑centric systems used by real users in production. Relevant experience includes agentic workflows, LLM pipelines, document extraction, or retrieval systems over unstructured data.
  • Architectural Ownership: Demonstrated experience designing and building a platform or major system end to end, making key architectural and technical decisions. This could include founding or early engineering roles, owning a service independently, leading a 0‑to‑1 build, or leading a small engineering team.
  • LLM Evaluation & Reliability: Experience owning the quality of production LLM systems, including building evaluation frameworks, implementing guardrails, and measuring and preventing hallucinations or unreliable outputs. Hands‑on experience with evaluations is required.
  • Backend Engineering: Strong experience building APIs, backend services, and data pipelines.
  • Cloud Infrastructure: Experience designing and deploying production systems in cloud environments.
  • Data & Systems Thinking: Ability to work with complex, unstructured data and design reliable systems for extraction, retrieval, and information management.
  • Enterprise Readiness: Comfortable handling sensitive enterprise data and making engineering decisions that balance accuracy, security, cost, and latency.
Technologies & Tools
  • Backend: Node.js, TypeScript
  • Database: PostgreSQL
  • Cloud: AWS
  • AI/ML: LLMs, agentic workflows, RAG, document extraction, evaluation frameworks, semantic search
  • Data Architecture: Knowledge graphs, data pipelines, multi‑tenant systems
  • Integrations: Enterprise APIs and third‑party software connectors
Nice to Have
  • Nice to Have Experience working at an early‑stage startup, ideally seed to Series B, as an early or founding engineer.
  • Experience with LLM gateways, document AI, knowledge graphs, or advanced retrieval systems.
  • Fine‑tuning or computer vision experience.
  • Familiarity with financial or commercial real estate documents, such as loan agreements, rent rolls, and investment materials.
  • Experience integrating with commercial real estate platforms such as DealCloud or Yardi.
  • Experience in forward‑deployed engineering environments, particularly companies that combine a shared platform with custom client implementations.

Based in or near Chicago.

What Success Looks Like

A reliable AI platform that supports multiple enterprise clients and their workflows. Production LLM systems with measurable quality, strong evaluations, and effective hallucination prevention. Reusable platform capabilities developed from patterns identified across client engagements. Efficient model routing that balances output quality, cost, and latency. A scalable knowledge graph and retrieval architecture designed for complex commercial real estate data. Strong governance, security, and auditability across enterprise workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding AI Platform Engineer
Founding AI Platform Engineer

Zipdev • Chicago (IL)

On-site
USD 150,000 - 230,000
Founding AI Engineer Role at CRE AI Startup | LLM
Founding AI Engineer Role at CRE AI Startup | LLM

Zipdev • Chicago (IL)

Hybrid
USD 160,000 - 230,000
AI Engineer
AI Engineer

Radley James • United States

On-site
USD 150,000 - 190,000
Lead Engineer - AI Developer Platform
Lead Engineer - AI Developer Platform

Raymond James & Associates • Saint Petersburg (FL)

Hybrid
USD 150,000 - 230,000
AI Engineer
AI Engineer

Covalent Resource Group • Southfield (MI)

On-site
USD 140,000 - 200,000
Founding AI Engineer — Build & Own Core AI Systems
Founding AI Engineer — Build & Own Core AI Systems

GreenSand • United States

Remote
USD 120,000 - 180,000
Staff AI Engineer
Staff AI Engineer

Harnham • San Francisco (CA)

On-site
USD 180,000 - 240,000
Principal Engineer & Architect - AI Agent Plaform
Principal Engineer & Architect - AI Agent Plaform

DevSavant Inc. • United States

Remote
USD 180,000 - 240,000
Founding AI Engineer
Founding AI Engineer

a16z • San Francisco (CA)

On-site
USD 180,000 - 240,000
Founding Engineer - Data
Founding Engineer - Data

Mason • San Francisco (CA)

On-site
USD 150,000 - 230,000