AI Engineer - Production LLM Systems, On-Site SF

Wintermeyer Ventures; San Francisco (CA); On-site; USD 150,000 - 250,000; Full time

Job summary

Wintermeyer Ventures is seeking an AI Engineer to own the production AI layer for its early-stage, commerce-focused SaaS product in San Francisco. You will build end-to-end AI systems, design evaluation pipelines, and optimize latency and costs for merchant-scale deployments.

The role requires 2–4 years building production LLM systems, hands-on Python, and experience shipping AI/ML systems to production. Prior freelance or startup experience is a plus; a strong engineering track record is

Qualifications

• Two to four years of experience building production LLM systems with strong Python skills.
• Experience shipping an AI or ML system to real production users.
• Experience building LLM evaluation systems that identified regressions.
• A computer science degree or equivalent strong fundamentals.
• Experience in contract or freelance work, and at a startup, preferably one that has reached a growth stage.
• A track record of strong engineering through work experience, open-source contributions, papers, or side projects.
• Familiarity with ML or fine-tuning, and ideally commerce, Shopify, or marketplace products.
• Experience with Python, LLMs, React, TypeScript, and Node.js.

Responsibilities

• Build end-to-end AI systems, including prompts, retrieval, tool use, agent orchestration, and fine-tuning when it is useful.
• Create evaluation systems that test model changes and catch regressions before release.
• Improve latency and operating costs so AI features perform reliably at merchant scale.
• Turn ambiguous product needs into solutions by identifying whether the issue is with the model, data, or user experience.
• Ship to production regularly and monitor how features perform with real users.

Skills

Production LLM systems

LLM evaluation systems

Startup experience

Engineering track record

Commerce familiarity

Education

CS degree or equivalent

Tools

Python

React

TypeScript

Node.js

Fine-tuning

Job description

Wintermeyer Ventures is seeking an AI Engineer to own the production AI layer for its early-stage, commerce-focused SaaS product in San Francisco. You will build end-to-end AI systems, design evaluation pipelines, and optimize latency and costs for merchant-scale deployments.

The role requires 2–4 years building production LLM systems, hands-on Python, and experience shipping AI/ML systems to production. Prior freelance or startup experience is a plus; a strong engineering track record is