Founding AI Engineer vision-language models that guide physical work reliably, live. →

Alcor Labs

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Alcor Labs in San Francisco is building wearable AI that sees what technicians see and talks them through the job, live. The model layer you own spans data, evals, inference, and on-site behavior, with real field data guiding every release.

You’ll work with systems engineers, full-stack engineers, and deployment strategists to bring the model to real industrial sites, next to technicians it guides. You’ll ensure safety, latency and reliability on-site at scale.

Qualifications

  • 3–7 years of relevant experience in applied computer vision or vision-language models, taken through to real users
  • Experience as a founder or one of the first engineers at a startup shipping AI, vision or robotics products
  • End-to-end ownership of a vision model's behavior in production, beyond API calls
  • Expert Python and deep learning frameworks, and production experience serving models under latency and hardware limits

Responsibilities

  • Build the multi-step visual reasoning loop that follows real jobs and inspections and calls the tools it needs
  • Own failure analysis: trace each wrong answer from the field to its cause, and fix it in the data, the model or the system around it
  • Fine-tune, quantize and serve open-weight vision-language models within latency and connectivity limits
  • Build real-time voice and video interaction: conversational guidance and proactive alerts
  • Decide where to steer the model, prove or drop an approach on real data, and make the model and infrastructure choices the rest of the team builds on

Skills

Python
Deep learning
Vision-language models
Edge inference
Latency optimization
Model evaluation
Production tool use

Tools

PyTorch
TensorFlow
CUDA

Job description

Data centers and power grids never stop, and the technicians who keep them running can't wait for better tools. Alcor builds wearable AI that sees what they see and talks them through the job, live.

The people who do this work rely on knowledge that was mostly never written down, and the most experienced of them can't be on every site. Our model is how that expertise reaches the technician in front of the equipment. In a data hall or a substation, a benchmark score decides nothing. What matters is reading the right thing on the right part, noticing when the work goes off track, knowing when the model is unsure, and answering fast on a weak network.

You own the model layer that makes that true, end to end: the data, the evals, the inference path, and how the model behaves on a real site. It is not a component someone else scoped. When the model is wrong in the field, you find out why and you fix it.

How do you build an eval from a few hundred field clips that predicts how the model will do on the next site? How does the model tell the right component from the identical one beside it, in bad light and in motion? When should it speak up mid-task, and when should it stay quiet? How do you make "I'm not sure" more common than a confident wrong answer? What do you fine-tune, what do you leave to a tool call, and what has to answer even when the network doesn't?

You'll work with the systems engineers who get frames and audio to your model, the full-stack engineers who put it in the product, and the forward deployed engineers and deployment strategists who bring back every failure from the field. You'll see your model at work on real industrial sites, next to the technicians it guides.

Every confident wrong answer costs a technician's trust. We work with that urgency, in person in San Francisco.

  • Build the multi-step visual reasoning loop that follows real jobs and inspections and calls the tools it needs.
  • Build evals from small amounts of real field data, decide what the model is judged on, and run the loop that turns field failures into better models with every release.
  • Own failure analysis: trace each wrong answer from the field to its cause, and fix it in the data, the model or the system around it.
  • Fine-tune, quantize and serve open-weight vision-language models within latency and connectivity limits, at the edge and on-premise.
  • Build real-time voice and video interaction: conversational guidance and proactive alerts.
  • Decide where to steer the model, prove or drop an approach on real data, and make the model and infrastructure choices the rest of the team builds on.
  • Every model change ships against an eval built from real field data.
  • Confident wrong answers become rare, and the model says when it is unsure.
  • Answers stay fast when the network does not cooperate.
  • Each new site needs less new data than the last.
  • 3–7 years of relevant experience in applied computer vision or vision-language models, taken through to real users: training, fine-tuning or adapting the models, or building the path that serves them.
  • Experience as a founder or one of the first engineers at a startup shipping AI, vision or robotics products.
  • End-to-end ownership of a vision model's behavior in production, beyond API calls and beyond a component someone else scoped: the evals, the failure analysis and the metrics that decided each release.
  • A habit of judging a model by the errors that matter in use (confident wrong answers, misses, latency), not only by benchmark accuracy.
  • Expert Python and deep learning frameworks, and production experience serving models under latency and hardware limits.
  • In person in San Francisco.
  • On-device or edge inference
  • multi-step agents with tool use in production
  • egocentric or wearable video
  • robotics or driving perception combined with modern VLM work
  • inference and GPU optimization
  • a main-venue paper on top of shipped work
  • data and labeling strategy for rare failures
  • guardrails and fallbacks for model outputs and tool calls

This is the base salary range we expect to pay for this role in San Francisco. Where your offer falls within it depends on your experience and skills.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Systems Engineer →
Founding Systems Engineer →

Alcor Labs • San Francisco (CA)

On-site
USD 180,000 - 240,000
Founding Forward Deployed Engineer →
Founding Forward Deployed Engineer →

Alcor Labs • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founding Full-Stack Engineer →
Founding Full-Stack Engineer →

Alcor Labs • San Francisco (CA)

On-site
USD 150,000 - 210,000
Founding AI Engineer (Vision-language models)
Founding AI Engineer (Vision-language models)

Jack • San Francisco (CA)

On-site
USD 180,000 - 230,000
Founding Robotics Engineer, Perception & VLA
Founding Robotics Engineer, Perception & VLA

Bonfirevc • New York (NY)

On-site
USD 150,000 - 210,000
Founding equity
Founding ML Engineer
Founding ML Engineer

a16z-speedrun • San Francisco (CA)

On-site
USD 150,000 - 230,000
Member of Technical Staff, Post-Training & Applied Research
Member of Technical Staff, Post-Training & Applied Research

San Francisco Tensor Company • San Francisco (CA)

On-site
USD 275,000 - 315,000
Relocation assistance
Founding ML Engineer
Founding ML Engineer

a16z • San Francisco (CA)

On-site
USD 180,000 - 250,000
Applications Engineer, San Francisco
Applications Engineer, San Francisco

Overview • San Francisco (CA)

Hybrid
USD 80,000 - 110,000
Health insurance
401(k)
Generous PTO
Founding Systems Engineer
Founding Systems Engineer

AI Talent Now • San Francisco (CA)

On-site
USD 150,000 - 190,000