Founding ML Engineer, Post-Training New

The Game Scientist

Lisboa

Hybride

EUR 90 000 - 150 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Equity
Autonomy and ownership
Modern tooling

Résumé du poste

Aghanim, Inc. is seeking a Founding ML Engineer (Senior or Principal) to lead the Newton AI product transition from proprietary APIs to self-hosted models. You will own data collection, evaluation, post-training, serving, and rollout, with a focus on maintaining quality while reducing cost and keeping partner data in-house.

You’ll work with product teams to set priorities, define technical strategy, and drive model training decisions using production data and evaluations.

Qualifications

  • Hands-on experience shipping post-training LLMs to production.
  • Ability to build evaluation and benchmarking systems from production data.

Responsabilités

  • Build production data pipelines with versioned instructions, tool calls, outputs and costs.
  • Develop benchmarks, regression tests, and evaluators using Newton runs.
  • Compare frontier vs open-weight models and route tasks to best models.
  • Train/adapt models with distillation, SFT, LoRA/QLoRA, DPO; apply RL when needed.
  • Deploy models behind Newton’s interface and oversee rollout by quality and economics.

Connaissances

Post-training LLMs production
SFT/LoRA/QLoRA
Distillation
Evaluation systems

Outils

Langfuse
vLLM
Axolotl
Unsloth

Description du poste

Aghanim is an integrated commerce, liveops automation, community engagement, and payments platform for video games.

Mobile games have traditionally depended on app stores for distribution, payments, and player relationships. We believe there is a better way. Aghanim helps game studios build direct relationships with players, sell directly, and build their future on their own terms. Today, more than 100 games worldwide are already building this future with Aghanim.

Our team brings together people across Los Angeles, New York, Seoul, Beijing, London, Lisbon, Belgrade and other locations around the globe, with deep expertise in gaming, fintech and technology. We move quickly, keep communication direct, and focus on getting things done. We believe the best people thrive when they have autonomy, ownership, and a stake in the company's success.

We’re looking for a Founding ML Engineer at Senior or Principal level to lead the transition of Newton, Aghanim’s AI product for partners, from proprietary model APIs to models we control.

Newton already runs in production on frontier models. You’ll own the model layer end to end: data collection, evaluation, post-training, serving, and rollout. The goal is to preserve the quality partners rely on while reducing cost, improving speed, and keeping partner data within our infrastructure.

You’ll work closely with the product to understand its behavior and partner expectations, then independently define the technical approach and priorities. Decisions about training, routing, and model replacement should be backed by production data and evaluations.

Key Responsibilities
  • Build production data pipelines that capture versioned instructions, tool calls, outputs, costs, and outcomes, with anonymization, partner-level deletion, and expert corrections.

  • Develop benchmarks, regression tests, and code-based and LLM-judge evaluators using real Newton runs to measure factual accuracy, tool use, answer quality, cost, and latency.

  • Compare frontier and open-weight models, route tasks to suitable models, and identify where prompting, distillation, or post-training delivers the best results.

  • Train and adapt models using distillation, SFT, LoRA/QLoRA, and DPO on accepted trajectories and expert feedback; use RL where simpler approaches fall short.

  • Deploy models behind Newton’s existing interface, validate them through shadow runs, and manage rollout based on quality benchmarks and serving economics.

Tech stack: Python, TypeScript, SQL, self-hosted Langfuse, TRL / Unsloth / Axolotl or managed training platforms, vLLM, serverless GPUs, GCP / Modal; open-weight models including Qwen, Gemma, DeepSeek, and GLM.

Required Qualifications
  • Hands-on experience post-training LLMs and shipping them to production using SFT, LoRA/QLoRA, DPO, and distillation.

  • Experience building evaluation systems from production data, including offline benchmarks, regression and behavior tests, and code-based and LLM-judge evaluators.

  • Understanding of agentic systems, including tool calling, multi-step trajectories, structured outputs, and the impact of changing the underlying model.

  • Practical experience serving models with vLLM or similar tools, quantization, and GPU deployment, including latency, cold-start, and cost tradeoffs.

  • Strong production Python and SQL skills, with enough TypeScript proficiency to modify product code and instrumentation independently.

  • Ability to understand product behavior and user expectations, translate them into measurable quality requirements, and decide when training is justified.

  • Experience independently owning a technical area, setting priorities, and working across an unfamiliar codebase and its design documents.

  • Regular use of AI coding agents, with a clear approach to verifying their output.

Preferred Qualifications
  • Experience migrating a production product from proprietary model APIs to self-hosted or open-weight models.

  • Experience with RL for LLMs, particularly GRPO with automatic verifiers.

  • Familiarity with Langfuse, Braintrust, or similar tracing and evaluation tools.

  • Experience with GCP, including Vertex AI, Cloud Run GPU, and BigQuery.

  • Interest in game monetization and analytics.

Why Join Us
  • World-class team – work alongside experienced professionals from around the globe who have built products used by millions of players

  • High growth, high impact – be part of a fast‑growing company where ideas turn into products and reach customers in days, not months

  • Autonomy and ownership – we trust people to make decisions, take initiative, and drive results

  • Modern tools and technology – use AI, automation, and modern tools as part of your everyday work

  • Equity – participate in the company’s growth and long‑term success

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Founding ML Engineer, Post-Training
Founding ML Engineer, Post-Training

Aghanim, Inc. • Lisboa

Sur place
EUR 90 000 - 140 000
Founding ML Engineer — Self-Hosted AI for Games
Founding ML Engineer — Self-Hosted AI for Games

Aghanim, Inc. • Lisboa

Hybride
EUR 90 000 - 150 000
Equity
Autonomy and ownership
Modern tooling
Founding ML Engineer - Self-Hosted AI for Games
Founding ML Engineer - Self-Hosted AI for Games

Aghanim, Inc. • Lisboa

Sur place
EUR 90 000 - 140 000
Senior Data Scientist (Gaming)
Senior Data Scientist (Gaming)

Bring It On • Portugal

À distance
EUR 65 000 - 90 000
Stock options
Fully remote work
Home office budget
+1
Senior Python AI Engineer
Senior Python AI Engineer

Proxify AB • Portugal

À distance
EUR 50 000 - 80 000
Flexible withdrawal options
Up to 24 flex days off
Consistent 8-hour working days
+1
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Loka, Inc • Portugal

À distance
EUR 50 000 - 70 000
Every other Friday off
Remote-first culture
Explore and Relocation programs
+3
Senior Frontend Engineer
Senior Frontend Engineer

Aghanim, Inc. • Lisboa

Sur place
EUR 45 000 - 65 000
Equity participation
Use of modern tools and technology
World-class team
Staff Engineer
Staff Engineer

Ogment AI • Lisboa

À distance
EUR 60 000 - 80 000
Flexible schedule
Work with cutting-edge AI technologies
Direct influence on product decisions
+1
Senior Frontend Engineer: High-Performance Web Platforms
Senior Frontend Engineer: High-Performance Web Platforms

Aghanim, Inc. • Lisboa

Sur place
EUR 45 000 - 65 000
Equity participation
Use of modern tools and technology
World-class team
Senior Ml Engineer - Remote, Genai Production
Senior Ml Engineer - Remote, Genai Production

TensorOps Consulting Services Ltd • Viseu

À distance
EUR 70 000 - 100 000
100% Remote
AWS Certification
GCP Certification
+5
Lieux principaux