Founding AI Platform Engineer

Zipdev

Chicago (IL)

On-site

USD 150,000 - 230,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Zipdev is seeking a Senior AI Platform Engineer in Chicago to build and own the core platform powering its enterprise AI products. You will identify common patterns across client engagements and turn them into reusable platform capabilities.

The role involves architecting the AI orchestration layer, LLM infrastructure, document intelligence pipelines, and a knowledge graph to power reliable workflows for commercial real estate clients.

Qualifications

  • 5–10 years of professional software/AI engineering experience.
  • Experience owning platform-level architecture end-to-end.
  • Backend API, data pipelines, and cloud deployment experience.
  • Experience with LLM-based workflows and evaluation frameworks.
  • Familiarity with knowledge graphs and semantic data models.
  • Ability to derive reusable platform capabilities from client work.

Responsibilities

  • Build and own the core AI orchestration platform, from ingestion to grounded, source-cited answers.
  • Design a multi-provider LLM gateway with caching, routing, and cost controls.
  • Develop evaluation frameworks and guardrails to ensure reliable outputs.
  • Build fact-extraction pipelines and semantic matching for complex real estate documents.
  • Map extracted data to a commercial real estate semantic field dictionary.
  • Lead the architecture of a multi-tenant knowledge graph and retrieval layer.
  • Implement governance features: PII detection, policy checks, escalation workflows.
  • Identify reusable functionality across client implementations for the shared platform.
  • Design reusable integrations with enterprise platforms (DealCloud, Yardi).
  • Collaborate with CEO and engineers on product architecture and direction.

Skills

Experience 5-10y
Architectural ownership
LLM pipelines
Backend engineering
Cloud infra
Knowledge graphs
API design

Tools

Node.js
TypeScript
PostgreSQL
AWS
LLMs
RAG
Semantic search

Job description

Our client is a seed-stage enterprise AI company building an AI platform specifically for the commercial real estate industry. Its platform transforms a firm's documents and data into a structured knowledge graph that AI agents can reason over, helping investors, owners, operators, and developers automate workflows and access reliable answers backed by source citations.

The company combines a recurring platform subscription with forward-deployed engineers who build custom workflows within client environments. Its vision is to become the foundational AI platform for the commercial real estate industry, bringing agentic workflows, transparency, and governance to a traditionally underserved market.

Backed by a real-estate-focused venture fund with strong industry relationships, the company already works with established commercial real estate firms. This is an opportunity to join a small, five-person team, work directly with the CEO, and take founding-level ownership of a product with significant growth potential.

About the Role

Our client is looking for a Senior AI Platform Engineer to build and own the core platform powering its enterprise AI products. While forward-deployed engineers focus on developing custom applications for individual clients, this role focuses on identifying common patterns across those engagements and turning them into reusable platform capabilities.

This is a highly technical, hands-on engineering position with significant architectural ownership. You will work closely with the CEO and engineering team to build the AI orchestration layer, LLM infrastructure, document intelligence pipelines, and knowledge graph that power reliable AI workflows across commercial real estate clients.

Key Responsibilities
  • Build and own the core AI orchestration platform, from document ingestion and processing to grounded, source-cited answers.

  • Design and maintain a multi-provider LLM gateway with prompt caching, record-replay capabilities, and evaluation-gated model routing to optimize cost, quality, and latency.

  • Develop evaluation frameworks and guardrails to measure LLM output quality, prevent hallucinations, and ensure reliable production performance.

  • Build fact-extraction pipelines and semantic matching systems for complex commercial real estate documents, including loan documents and rent rolls.

  • Map extracted information to a commercial real estate semantic field dictionary to improve consistency, accuracy, and data reliability.

  • Lead the architecture of a multi-tenant knowledge graph and retrieval layer.

  • Implement enterprise governance capabilities, including PII detection, policy checks, human escalation workflows, and cryptographic audit trails.

  • Identify reusable functionality across client-specific implementations and incorporate it into the shared platform.

  • Design and build reusable integrations with enterprise real estate platforms such as DealCloud and Yardi.

  • Collaborate directly with the CEO and forward-deployed engineers to influence product architecture and technical direction.

  • Experience: 5-10 years of professional experience as a software, backend, machine learning, or applied AI engineer.

  • Production AI Experience: Proven experience building and shipping AI-centric systems used by real users in production. Relevant experience includes agentic workflows, LLM pipelines, document extraction, or retrieval systems over unstructured data.

  • Architectural Ownership: Demonstrated experience designing and building a platform or major system end to end, making key architectural and technical decisions. This could include founding or early engineering roles, owning a service independently, leading a 0-to-1 build, or leading a small engineering team.

  • LLM Evaluation & Reliability: Experience owning the quality of production LLM systems, including building evaluation frameworks, implementing guardrails, and measuring and preventing hallucinations or unreliable outputs. Hands‑on experience with evaluations is required.

  • Backend Engineering: Strong experience building APIs, backend services, and data pipelines.

  • Cloud Infrastructure: Experience designing and deploying production systems in cloud environments.

  • Data & Systems Thinking: Ability to work with complex, unstructured data and design reliable systems for extraction, retrieval, and information management.

  • Enterprise Readiness: Comfortable handling sensitive enterprise data and making engineering decisions that balance accuracy, security, cost, and latency.

Technologies & Tools

The ideal candidate will have experience with some of the following:

  • Backend: Node.js, TypeScript

  • Database: PostgreSQL

  • Cloud: AWS

  • AI/ML: LLMs, agentic workflows, RAG, document extraction, evaluation frameworks, semantic search

  • Data Architecture: Knowledge graphs, data pipelines, multi-tenant systems

  • Integrations: Enterprise APIs and third-party software connectors

Nice to Have
  • Experience working at an early-stage startup, ideally seed to Series B, as an early or founding engineer.

  • Experience with LLM gateways, document AI, knowledge graphs, or advanced retrieval systems.

  • Fine‑tuning or computer vision experience.

  • Familiarity with financial or commercial real estate documents, such as loan agreements, rent rolls, and investment materials.

  • Experience integrating with commercial real estate platforms such as DealCloud or Yardi.

  • Experience in forward-deployed engineering environments, particularly companies that combine a shared platform with custom client implementations.

  • Based in or near Chicago.

What Success Looks Like
  • A reliable AI platform that supports multiple enterprise clients and their workflows.

  • Production LLM systems with measurable quality, strong evaluations, and effective hallucination prevention.

  • Reusable platform capabilities developed from patterns identified across client engagements.

  • Efficient model routing that balances output quality, cost, and latency.

  • A scalable knowledge graph and retrieval architecture designed for complex commercial real estate data.

  • Strong governance, security, and auditability across enterprise workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding AI Engineer Role at CRE AI Startup | LLM
Founding AI Engineer Role at CRE AI Startup | LLM

Zipdev • Chicago (IL)

Hybrid
USD 160,000 - 230,000
AI Engineer
AI Engineer

Radley James • United States

On-site
USD 150,000 - 190,000
Staff AI Engineer
Staff AI Engineer

Harnham • San Francisco (CA)

On-site
USD 180,000 - 240,000
Principal Engineer & Architect - AI Agent Plaform
Principal Engineer & Architect - AI Agent Plaform

DevSavant Inc. • United States

Remote
USD 180,000 - 240,000
Staff AI Engineer
Staff AI Engineer

People in AI • San Francisco (CA)

On-site
USD 250,000 - 300,000
Equity
Senior AI Product Manager
Senior AI Product Manager

Jobgether • Oregon

Hybrid
USD 180,000 - 240,000
Fully remote working environment
Equity opportunity
Performance-based bonus
+2
AI Architech
AI Architech

Meeru AI Inc • Pleasanton (CA)

Remote
USD 180,000 - 280,000
AI Engineer
AI Engineer

Covalent Resource Group • Southfield (MI)

On-site
USD 140,000 - 200,000
Founding AI Engineer — Build & Own Core AI Systems
Founding AI Engineer — Build & Own Core AI Systems

GreenSand • United States

Remote
USD 120,000 - 180,000
Chief Engineer
Chief Engineer

Coxvi Technologies • United States

Remote
USD 180,000 - 280,000