Production AI Engineer: Model Evaluation & Deployment

Lunon; United States; Remote; USD 120,000 - 190,000; Full time

Job summary

Lunon is an AI-native consulting firm in New York City that embeds engineers inside businesses to ship AI software. The team is young, fast-moving, and owns what it ships end to end.

We’re looking for someone who has fine-tuned or post-trained models, built impactful evals, and deployed models to production with attention to cost and latency. You’ll work across frontier APIs and open-weight models to deliver practical AI solutions, in a fast-paced NYC environment.

Qualifications

• Fine-tuned or post-trained a model and know what worked.
• Built evals that changed a decision and shipped LLM features.
• Served a model in production and cared about cost and latency.

Responsibilities

• Pick the right model, from frontier APIs to open-weight models.
• Build evals and benchmarks that show whether a change helps.
• Take models to serving and tune cost, latency, and quality.

Skills

Fine-tuned model

Build evals/benchmarks

Production model serving

Shipped LLM features

Job description

Lunon is an AI-native consulting firm in New York City that embeds engineers inside businesses to ship AI software. The team is young, fast-moving, and owns what it ships end to end.

We’re looking for someone who has fine-tuned or post-trained models, built impactful evals, and deployed models to production with attention to cost and latency. You’ll work across frontier APIs and open-weight models to deliver practical AI solutions, in a fast-paced NYC environment.