Senior AI Lab Engineer: LLM Prototyping & Evaluation

Jobtailor; Madrid; Presencial; EUR 120.000 - 150.000; Jornada completa

Descripción de la vacante

dLocal is seeking a senior technologist to validate high-value AI and automation technologies, running instrumented LLM experiments, prototypes, and benchmarks to de-risk adoption across the company.

You will design evaluation environments, build tooling, write concise decision memos, mentor engineers, and collaborate with Security, Legal, Compliance and product teams to align on standards and governance.

Formación

• 8+ years of software engineering experience, including senior/Staff-level scope.
• Deep hands-on experience building and evaluating AI/ML systems based on LLMs and tooling.
• Strong fundamentals and ability to rapidly build high-quality experimental systems.
• Experience building agentic or multi-step AI systems with tool use and integrations.
• Strong knowledge of cloud infrastructure, preferably AWS, with secure, cost-conscious workloads.
• Experience with observability, telemetry, testing, and benchmarking of complex systems.
• Ability to design experiments and evaluation plans with hypotheses and metrics.
• Ability to explain technical results to non-specialists.

Responsabilidades

• Validate high-value AI and automation technologies and de-risk adoption across the company.
• Own technology scouting, prototyping, and evaluation for the business.
• Run instrumented spikes and benchmarks on LLMs, agents, and copilots.
• Compare vendor and open-source options across quality, cost, latency, security.
• Deliver decision memos with recommendations to adopt, watch, or avoid.
• Design and maintain evaluation environments with datasets, prompts, and telemetry.
• Build automation and tooling to measure quality, latency, cost, and regressions.
• Mentor engineers on evaluation methods and experimentation design.
• Share knowledge through internal talks and write-ups.

Conocimientos

8+ years software engineering

Senior/Staff-level scope

LLMs evaluation

Influencing without authority

Curiosity

Mentoring

Communication

Herramientas

LLMs

Agentic Systems

Vector Databases

Orchestration Frameworks

Telemetry Tools

Automation and Tooling

AWS AI Suite

Descripción del empleo

dLocal is seeking a senior technologist to validate high-value AI and automation technologies, running instrumented LLM experiments, prototypes, and benchmarks to de-risk adoption across the company.

You will design evaluation environments, build tooling, write concise decision memos, mentor engineers, and collaborate with Security, Legal, Compliance and product teams to align on standards and governance.