AI/ML Engineer

kaizenlabs

United States

Hybrid

USD 140,000 - 210,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health & Insurance
Fully covered benefits
Life insurance $100k
One Medical membership
Fertility support
401(k) matching
Parental leave

Job summary

Kaizen sucht eine erfahrene KI-/ML-Ingenieurin oder -Ingenieurin in New York City, hybrid-Work Modell. Fokus liegt auf dem Feinabstimmen, Anpassen und Destillieren von Open-Weight-Modellen, um spezialisierte Intelligenz für öffentliche Aufgabensbereiche zu schaffen.

Die Rolle erfordert Hands-on-Erfahrung im Training von Sprachmodellen, starkes Python/PyTorch-Know-how und die Fähigkeit, Modelle in produktionsreife Anwendungen zu überführen.

Qualifications

  • Hands-on experience training or adapting language models.
  • Strong software engineering fundamentals and reliable training pipelines.
  • Proficiency in Python and PyTorch with transformer knowledge.
  • Demonstrated model engineering ability via fine-tuned models or open-source contributions.

Responsibilities

  • Fine-tune, adapt and distill open-weight models for requirements interpretation, code generation, repository understanding and validation.
  • Own the experiment loop: curate datasets, build training pipelines, test architectures and techniques.
  • Build evaluations on real software tasks that set baselines and expose failure modes.
  • Collaborate with platform engineers to close model gaps and ship capabilities to production.
  • Experiment with supervised fine-tuning, synthetic data, and RL to improve task-specific behavior.
  • Deliver applications built around customer needs while minimizing frontier-model token spend.
  • Lay groundwork to train Kaizen's own models from scratch.

Skills

Model training
Fine-tuning
Code generation
Repository understanding
Python programming
PyTorch
Debugging pipelines

Tools

Python
PyTorch
Transformer architectures

Job description

Government technology has failed citizens, veterans, public servants, and service members for decades.

Kaizen powers America's application layer. We replace the legacy systems federal agencies run on with modern software, built with craft. The ticketing platform a resident uses to visit a presidential library. The marketplace DoW uses to procure counter-drone systems to protect lives and critical infrastructure. The system a Veteran uses to access benefits. We build systems of record, of national consequence. Our AI-native modules and harness allow us to do so in weeks, not years.

This year, our revenue has grown 35x. Next year, our software will serve over 100 million Americans across dozens of federal agencies.

Founded in 2022 and based in New York City and DC, Kaizen has raised $35 million from NEA, a16z, Accel, 776, and Carpenter Capital.

Location

New York, NY (Hybrid). In office Monday to Thursday. Candidates must live in or be able to commute to New York City.

The Role

Most companies building with AI connect someone else's models to their software. Kaizen's AI-native platform turns requirements into working applications, and today much of that intelligence comes from general-purpose models that carry capabilities we don't need, lack knowledge we do, and leave us and our customers paying frontier-model token costs for intelligence we don't control. This role changes that. You'll fine-tune, adapt and distill open-weight models into specialized intelligence Kaizen owns, and prove where it beats the general-purpose alternative. The goal isn't the biggest model or the most papers: it's public-sector software that works better, costs less to run, and is harder to replicate.

What You'll Do
  • Fine-tune, adapt and distill open-weight models for requirements interpretation, code generation, repository understanding, structured output and software validation.
  • Own the experiment loop: curate datasets, build training pipelines, and test architectures and techniques until a promising idea becomes a working model.
  • Build evaluations on real software engineering tasks that set baselines, expose failure modes, and separate real gains from benchmark noise.
  • Work with platform engineers to find where current models fall short, then build the capabilities that close those gaps and ship them into production.
  • Experiment with supervised fine-tuning, synthetic data, preference optimization and reinforcement learning to improve model behavior on specialized tasks.
  • Deliver applications built around each customer's needs without frontier-model token spend, so public budgets go to residents, not inference.
  • Lay the groundwork (datasets, evals, research practices) for Kaizen to eventually train its own models from scratch.
What You'll Bring
  • Hands-on experience training, fine-tuning or adapting language models. You've worked with model weights, not just model APIs or prompts.
  • Strong software engineering fundamentals. You build reliable training pipelines, debug complex systems, and write code other engineers build on.
  • Strong Python and PyTorch, with a working understanding of transformer architectures, tokenization and language model training.
  • Something you've built that shows real model engineering ability: a fine-tuned model, an original training approach, or a meaningful open-source ML contribution. Industry, research or independent work all count; demonstrated ability matters more than years or credentials.
Strong Candidates May Also...
  • Have fine-tuned models for code generation, program synthesis or repository understanding.
  • Design experiments and evaluation sets that tell a meaningful improvement from noise or overfitting.
  • Bring experience with synthetic data, distillation, quantization, or preference optimization and RL with verifiable rewards.
  • Have contributed to open-source model development, published applied ML research, or reproduced significant research results.
Don't Apply If...
  • Your model experience is prompt engineering and API calls.
  • You'd rather publish a result than ship a model people use every day.
  • You hand off notebooks and expect someone else to make them run in production.
  • You assume the biggest model is the right answer and don't want to think about cost.
  • Residents and public servants rely on the software we build because they don't have another option. The models underneath it have to earn that.
What Kaizen Offers
  • Health & Insurance
  • 100% coverage across the board: medical through Oxford/United (Gold and Platinum PPO plans), dental through Guardian PPO, and vision through Beam - all fully covered for employees, with 100% coverage for dependents.
  • $100,000 in fully paid life insurance. FSA and Dependent Care FSA.
  • One Medical membership, on us - same-day primary care, 24/7 virtual visits, and offices all over the city.
  • Fertility and family-building support through Carrot.
  • 401(k) through Guideline, with a 2% company match.
  • Family & Time Off
  • 16 weeks of fully paid parental leave for bir
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Engineer
AI/ML Engineer

Kaizen Labs • New York (NY)

Hybrid
USD 180,000 - 240,000
Health insurance
Life insurance
One Medical membership
+7
AI/ML Engineer
AI/ML Engineer

Kaizen • New York (NY)

Hybrid
USD 160,000 - 240,000
Health insurance
One Medical membership
401(k) with company match
+3
K Open role · via a16z Speedrun 1d ago AI/ML Engineer Kaizen Labs New York, NY $240k–280k MACHINE-LEARNING Express interest →
K Open role · via a16z Speedrun 1d ago AI/ML Engineer Kaizen Labs New York, NY $240k–280k MACHINE-LEARNING Express interest →

JoinStartup • New York (NY)

Hybrid
USD 240,000 - 280,000
Health insurance
1 Medical membership
401(k) with company match
+1
Applied AI Engineer
Applied AI Engineer

Kaizen Labs • New York (NY)

Hybrid
USD 120,000 - 170,000
Health insurance
Life insurance
One Medical membership
+5
Executive Assistant
Executive Assistant

kaizenlabs • United States

Hybrid
USD 90,000 - 120,000
Health & Insurance
Full benefits coverage
Life insurance $100,000
+3
Senior Software Engineer
Senior Software Engineer

kaizenlabs • United States

Hybrid
USD 140,000 - 220,000
Health insurance
Life insurance
One Medical membership
+6
Executive Assistant
Executive Assistant

Kaizen Labs • New York (NY)

Hybrid
USD 85,000 - 110,000
Health & Insurance
Family & Time Off
Office & Remote Setup
+2
Senior Software Engineer
Senior Software Engineer

Kaizen Labs • New York (NY)

Hybrid
USD 150,000 - 190,000
Health & Life Insurance
One Medical membership
401(k) with company match
+2
Founders Associate
Founders Associate

Kaizen Labs • New York (NY)

Hybrid
USD 80,000 - 130,000
Health & Insurance
Parental leave
Unlimited PTO
+6
Recruiter
Recruiter

Kaizen Labs • New York (NY)

Hybrid
USD 90,000 - 150,000
Health & Insurance
Parental leave
Unlimited PTO
+1