Senior AI Engineer

withpulley

San Francisco (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Pulley is hiring a senior ML/AI engineer in the San Francisco Bay Area to own end-to-end LLM-powered features. You will turn unstructured permitting data into reliable outputs and build the evaluation and observability foundations for fast, safe shipping.

You will guide product decisions, mentor peers, and work in a fast-paced environment that values quality and velocity. This role requires in-person collaboration four days a week.

Qualifications

  • 4+ years of software engineering experience with production ML/LLM work.
  • Own LLM-powered product surface end-to-end: requirements through production, including data quality and eval design.
  • Deep hands-on experience with large language models in production: prompting, retrieval-augmented generation, structured extraction, and agentic workflows.
  • Experience designing evals and making LLM-powered features reliable in production.
  • Based in the San Francisco Bay Area and willing to work in person 4 days a week.

Responsibilities

  • Own AI-powered features end-to-end from talking to users to defining correct outputs for permitting workflows.
  • Turn unstructured permitting documents and city regulations into structured outputs: extraction, classification, retrieval, and agentic workflows.
  • Build evaluation and observability foundations to ship LLM-powered features with confidence.
  • Build with AI agents as a daily practice: directing, reviewing, and shipping agent-driven work at high velocity.
  • Make technical and product decisions with direct customer impact.
  • Raise the bar for engineers around you through design review, mentorship, and standards.

Skills

Software engineering
LLM systems
Prompting design
Agentic workflows

Tools

TypeScript
React
Google Cloud

Job description

About Pulley

Pulley helps the country's top architects, builders, and retailers speed up every project in their portfolio. With AI-powered permitting intelligence and expert guidance, we eliminate costly delays and bring predictability across the full lifecycle of commercial projects.

Today, permitting is the slowest, most uncertain part of building, spread across 19,000+ jurisdictions with different rules, timelines, and surprises. Pulley gives project teams the clarity and predictability they need to move from planning to opening without delays.

We support rollout programs for brands like J.Crew, Solidcore, and Hibbett Sports, as well as major data center buildouts, EV charging networks, and other commercial projects. Our platform dramatically reduces approval timelines, improves forecasting accuracy, and removes thousands of hours of manual work from design and construction teams.

Founded in 2021, Pulley combines deep permitting expertise with purpose-built AI from people who have created products used by millions. We're backed by CRV, Susa Ventures, Fifth Wall, and leaders from Plaid, Segment, ServiceTitan, and Procore.

WHAT YOU'LL DO
  • Own AI-powered features end-to-end-from talking to users and defining what "correct" means for a permitting workflow, through prompt and pipeline design, evals, deployment, and iteration in production
  • Turn unstructured permitting documents, city regulations, and jurisdiction workflows into structured, reliable outputs-extraction, classification, retrieval, and agentic workflows over documents that were never designed to be machine-readable
  • Build the evaluation and observability foundation that lets us ship LLM-powered features with confidence: define ground truth, measure quality and regressions, and know when a model change is actually an improvement
  • Build with AI agents as a daily practice-directing, reviewing, and shipping agent-driven work at high velocity while owning the quality bar
  • Make technical and product decisions that have direct impact on our customers and their projects
  • Raise the bar for the engineers around you in how they build with LLMs, through design review, mentorship, and the standards you set in your own work
  • Make technical and product decisions that have direct impact on our customers and their projects
WHO YOU ARE
  • You thrive in ambiguity-you'd rather define the right problem than execute a spec, and you're energized rather than paralyzed when the path isn't laid out
  • You're product-minded: you care whether the thing you built actually solved the customer's problem, and you'll talk to users to find out
  • You're rigorous about what "working" means-you don't trust a demo, you trust an eval, and you build the measurement before you build the feature
  • You have strong opinions about quality and velocity and don't treat them as a tradeoff-you look for the tools, abstractions, and processes that buy both
  • You default to ownership: when something is broken or missing, your instinct is to fix it, not to file it as someone else's problem
NEED TO HAVE
  • 4+ years of software engineering experience, with a substantial portion building production LLM or ML systems
  • Track record of owning an LLM-powered product surface end-to-end: requirements through production, including the unglamorous parts-data quality, eval design, cost and latency, failure handling
  • Deep hands-on experience with large language models in production-prompting, retrieval-augmented generation, structured extraction, tool use and agentic workflows, and knowing when each is the wrong tool
  • Experience designing evals and otherwise making LLM-powered features reliable in production
  • Real experience building with AI coding agents-not just autocomplete; you've shipped work where agents did substantial implementation under your direction
  • Ability to architect durable systems while making pragmatic tradeoffs
  • Based in the San Francisco Bay Area and willing to work in person 4 days a week
NICE TO HAVES
  • Experience with document understanding at scale-OCR, layout-aware parsing, or vision-language models over scanned PDFs, drawings, or forms
  • Experience fine-tuning models or building data pipelines to produce training and eval sets from real-world usage
  • Experience in construction tech, govtech, proptech, or another domain where the hard part is messy real-world documents and processes
  • Experience with modern full-stack development-we use TypeScript, React, and Google Cloud-and an appetite for working in the application code that puts AI features in front of users
  • Startup experience at the stage where you helped build the team, not just the product
  • Experience mentoring engineers or leading technical direction across teams
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer
Software Engineer

Pulley • San Francisco (CA)

On-site
USD 180,000 - 240,000
Applied AI Engineer
Applied AI Engineer

Pulley • San Francisco (CA)

On-site
USD 180,000 - 320,000
AI Developer
AI Developer

Awesome Motive • United States

Remote
USD 130,000 - 180,000
Health insurance
401(k) matching
Staff Software Engineer, Applied AI
Staff Software Engineer, Applied AI

Emergence Capital Partners • San Francisco (CA)

On-site
USD 160,000 - 230,000
AI Engineer
AI Engineer

Valsoft Corporation • United States

Remote
USD 150,000 - 210,000
AI Engineer - VA
AI Engineer - VA

LawPro.ai • Virginia

On-site
USD 150,000 - 190,000
Head of Applied AI
Head of Applied AI

Bask Health • United States

Remote
USD 190,000 - 260,000
AI Engineer, Multimodal LLMs
AI Engineer, Multimodal LLMs

Eloquent AI • San Francisco (CA)

On-site
USD 150,000 - 210,000
AI/ML Engineer
AI/ML Engineer

RiskForce LLC • United States

On-site
USD 120,000 - 180,000
Senior AI-First Software Engineer (End-to-End SaaS)
Senior AI-First Software Engineer (End-to-End SaaS)

Turing Labs • San Francisco (CA)

On-site
USD 120,000 - 160,000