Applied ML Engineer

Lever, Inc.; Portugal; Presencial; EUR 70 000 - 110 000; Tempo integral

Resumo da oferta

Lever, Inc. seeks an Applied ML Engineer based in Portugal to bridge ML research and production systems. You will reproduce research, design experiments, and build production‑grade tooling across model evaluation, inference, and backend services.

The role emphasizes ownership, rigorous experiments, and cross‑functional collaboration. Join a fast‑moving environment where you’ll move ideas from research to reliable products, work with modern ML models, and contribute across research,

Qualificações

• Strong Python engineering and ML evaluation experience.
• Experience with PyTorch and Hugging Face Transformers.
• Ability to implement methods from first principles.
• Professional software engineering beyond notebooks.
• Familiarity with open-weight models and LLM inference.
• Ability to work across backend and frontend with React/TypeScript.
• Ownership and initiative in fast-moving startups.
• Experience with model provenance, watermarking, or safety eval is a plus.
• Knowledge of evaluation infra like DSPy, vLLM, Temporal.

Responsabilidades

• Reproduce and evaluate ML research methods with open-weight models.
• Design evaluation datasets, probes, baselines, and calibration tests.
• Work with model weights, logits, hidden states, and inference infra.
• Build evaluation infrastructure including runners, persistence, orchestration.
• Translate research workflows into product experiences with config, execution, and reports.
• Run controlled experiments across base, fine-tuned, merged, and quantized models.
• Produce technical reports separating evidence from interpretation.
• Deliver production-quality systems with APIs, databases, observability, and docs.
• Collaborate across research, experimentation, engineering, and product.

Conhecimentos

Python

PyTorch

Transformers

APIs

Async jobs

Databases

React/TypeScript

Testing

Deployment

Experimentation

Ownership

Startup mindset

Ferramentas

DSPy

LiteLLM

Temporal

Ray

vLLM

PostgreSQL/pgvector

Next.js

React

TypeScript

Descrição da oferta de emprego

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Applied ML Engineer based in Portugal.

As an Applied ML Engineer, you’ll work at the intersection of machine learning research, experimentation, and production engineering.
You’ll turn ideas from research papers into rigorous experiments, measurable evidence, and reliable products.
The role spans model evaluation, model internals, inference infrastructure, backend systems, and user-facing product experiences.
You’ll work hands‑on with modern ML models, designing evaluations that reveal what methods can—and cannot—demonstrate.
You’ll also build production‑grade tooling that makes complex experiments repeatable, observable, and accessible to users.
The environment values technical judgment, ownership, scientific rigor, and the ability to move comfortably across the technology stack.
It’s an opportunity to help transform emerging ML techniques into practical systems that people can trust.

Accountabilities

• Reproduce and evaluate machine learning research methods using open-weight and API-accessible models.
• Design evaluation datasets, probes, scoring approaches, baselines, calibration tests, and experiment harnesses.
• Work directly with model weights, logits, hidden states, activations, model APIs, and inference infrastructure when required.
• Build and extend evaluation infrastructure covering experiment runners, judges, persistence, orchestration, reporting, and reproducibility.
• Turn research workflows into intuitive product experiences, including experiment configuration, execution, traces, comparisons, reports, and review workflows.
• Investigate how verification methods behave when models are modified through fine‑tuning, merging, quantization, distillation, safety removal, or deliberate evasion.
• Design controlled experiments that distinguish meaningful signals from artifacts, confounders, and misleading correlations.
• Produce clear technical reports that separate measured evidence from interpretation and hypotheses.
• Deliver production-quality systems with APIs, asynchronous jobs, databases, observability, testing, deployment, and documentation.
• Contribute across research, experimentation, engineering, and product as priorities evolve.
• During the first six months, reproduce and document at least one published model‑provenance or verification method, including its capabilities, assumptions, and limitations.
• Build a repeatable model‑verification runner with versioned inputs, artifacts, metrics, and reports, and make at least one verification workflow accessible through the product interface.
• Run controlled experiments across base, fine‑tuned, merged, quantized, and known distilled models, improving understanding of when verification methods succeed, fail, and why.

Requirements:

• Strong Python engineering skills, with hands‑on experience using PyTorch and Hugging Face Transformers.
• Solid understanding of machine learning evaluation, including dataset design, baselines, metrics, calibration, false positives and negatives, statistical uncertainty, and reproducibility.
• Ability to read ML research papers critically and implement methods from first principles rather than relying entirely on existing packages.
• Professional software engineering experience beyond notebooks, including APIs, asynchronous jobs, databases, logging, testing, deployment, and documentation.
• Familiarity with open‑weight models and a practical understanding of how modern LLM inference systems operate.
• Ability to work across backend and frontend boundaries, with sufficient React/TypeScript knowledge to help make complex experiments and results understandable to users.
• Strong experimental and analytical judgment, particularly around distinguishing what evidence demonstrates from what it merely suggests.
• High ownership and initiative, with the ability to identify problems, propose solutions, and drive projects forward independently.
• Comfort working in a fast‑moving startup environment where priorities can change quickly and engineers may operate across multiple functions.
• Experience with model provenance, fingerprinting, watermarking, distillation detection, red‑teaming, safety evaluation, interpretability, or related areas is a plus.
• Experience with activation and representation analysis, probing, model hooks, logits, hidden states, or other model‑internals techniques is advantageous.
• Familiarity with evaluation and inference infrastructure such as DSPy, LiteLLM, Temporal, Ray, vLLM, PostgreSQL/pgvector, or comparable technologies is beneficial.
• Experience with Next.js, React, TypeScript, data visualization, or experiment dashboards is a plus.
• Experience running and serving open‑weight models on GPUs, including reasoning about latency, throughput, memory, precision, and cost trade‑offs, is valuable.
• Experience designing adversarial evaluations or testing systems against deliberate attempts to evade detection is an advantage.
• A strong commitment to producing production‑quality code, tests, tooling, and documentation that other engineers can confidently operate and extend.

Benefits:

• Opportunity to work on applied machine learning at the intersection of research, experimentation, engineering, and product.
• End-to-end ownership across model evaluation, model internals, infrastructure, backend systems, and user‑facing experiences.
• Exposure to modern open‑weight models, LLM inference systems, and emerging ML verification techniques.
• A role with significant technical autonomy and the opportunity to shape both experiments and production systems.
• Fast‑moving startup environment with evolving priorities and cross‑functional collaboration.
• Opportunity to translate cutting‑edge research into practical, measurable, and user‑accessible products.
• The opportunity to build systems and evaluation methodologies designed to produce evidence that users can understand and trust.
• Location: Romania.
• Additional compensation, flexibility, healthcare, and other benefits may be provided according to the partner company’s employment package and local arrangements.