Applied AI Systems Engineer – ML Infra & Evaluation

Tzafon; San Francisco (CA); On-site; USD 150,000 - 400,000; Full time

Benefits offered by this job

Full medical, dental, and vision coverage

401(k) in the US

Early‑stage equity

Job summary

Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible for building evaluation infrastructure, designing data pipelines, and implementing fine-tuning processes. Ideal candidates have expertise in Python and machine learning frameworks, a solid track record of shipping ML systems, and strong opinions on evaluation methodologies. The position offers competitive compensation starting at $150k with equity options and full medical coverage.

Qualifications

• Deep experience with LLM fine‑tuning and evaluation infrastructure.
• Experience with RLHF/Constitutional AI/DPO.
• Contributions to open source ML infrastructure.

Responsibilities

• Build evaluation infrastructure for agent systems.
• Create benchmarks that measure real capability.
• Design data pipelines for behavioral data collection.

Skills

Expert-level at Python

ML frameworks (PyTorch)

Experience with wandb, MLflow

Track record of shipping ML systems

Strong opinions on eval criteria

Job description

Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible for building evaluation infrastructure, designing data pipelines, and implementing fine-tuning processes. Ideal candidates have expertise in Python and machine learning frameworks, a solid track record of shipping ML systems, and strong opinions on evaluation methodologies. The position offers competitive compensation starting at $150k with equity options and full medical coverage.