Staff AI Engineer (AI Labs)

dLocal; Madrid; Presencial; EUR 120.000 - 180.000; Jornada completa

Descripción de la vacante

dLocal is seeking a Staff AI Engineer for the AI Lab in Madrid. You will own technology scouting, prototyping, and evaluation for high-value AI/automation technologies, running instrumented spikes and benchmarking to inform cross-functional decisions across engineering, business, legal and IT.

This senior IC role emphasizes technical influence without direct reports, shaping production-ready AI patterns and guardrails.

Formación

• Experience building agentic or multi-step AI systems involving tool use, orchestration, state, retrieval, or external integrations.
• Experience with LLMs and modern AI tooling.
• Track record of designing experiments or benchmarks that influenced meaningful technical decisions.
• Strong software engineering fundamentals and the ability to rapidly build high-quality experimental systems.
• Experience constructing evaluation datasets with proper holdout discipline and reproducibility.

Responsabilidades

• Own technology scouting, prototyping, and evaluation for dLocal.
• Run instrumented spikes and benchmarking on emerging AI technologies; produce recommendations for stakeholders.
• Coordinate hand-offs to teams that productionize validated technologies.
• Define patterns, guardrails, and technical requirements for adoption.
• Design and maintain evaluation environments and tooling to measure quality, latency, and cost.

Conocimientos

Agentic systems

LLMs

Observability

Benchmarking

AWS

Experiment design

Prototyping

Production readiness

System architecture

Cost awareness

Herramientas

Vector databases

Orchestration

Copilots

Deployment tooling

AWS Suite

Descripción del empleo

• You will join the AI Lab, a team whose mission is to validate high-value emerging AI and automation technologies and de-risk their adoption across dLocal
• This is a rare opportunity to work at the frontier of applied AI in fintech: running rigorous experiments on the latest models and tools, and turning results into decisions that shape how a global payments company adopts AI
• This is a senior individual-contributor role
• It does not require direct people management, but it carries significant technical influence within the Lab and across the teams that consume its work
• As a Staff AI Engineer in the AI Lab, you own technology scouting, prototyping, and evaluation for dLocal
• You will run instrumented spikes and benchmarking on emerging AI technologies, produce clear recommendations for stakeholders across engineering, business, legal and IT based on your prototypes, and coordinate hand-offs to the teams that take validated technologies into production
• For promising technologies, you will help define the patterns, guardrails, and technical requirements needed for adoption and coordinate the hand-off to the engineering teams responsible for productionizing them
• Technology Scouting & Evaluation
• Run short, instrumented spikes and benchmarking on new models, tools and frameworks: LLMs, agentic systems, vector databases, orchestration frameworks, copilots, assistants and more
• Compare vendor and open-source options, documenting trade-offs across quality, cost, latency, security and integration complexity
• Deliver concise decision memos with clear recommendations: adopt, watch, or avoid
• Evaluation Harnesses & Sandboxes
• Design and maintain evaluation environments (e.g. datasets, prompts, scenarios, telemetry) to test models under realistic constraints
• Build automation and tooling to measure quality, robustness, latency and cost, including regression tracking over time
• Ensure every evaluated technology has benchmark coverage and a documented risk and limitations view
• Prototyping & Technical Validation
• Build enough of a system to understand how a technology behaves under realistic conditions, not just in vendor demos or isolated examples
• Explore architecture, integration patterns, operational constraints, security boundaries, and failure modes through working prototypes
• Determine what must be true for a proof of concept to become a viable production capability
• Prefer focused prototypes that answer specific technical questions over prematurely building production systems
• Recommendations, Readiness & Hand-offs
• Translate technical findings into clear decision memos for both technical and non-technical stakeholders
• For validated technologies, produce readiness guidance covering recommended patterns, guardrails, known limitations, operational considerations, and integration requirements
• Coordinate hand-offs to the engineering teams responsible for productionization
• Support those teams during the transition when deep context from the evaluation is required, without becoming the permanent owner of the resulting system
• Track what happens after Lab recommendations and use those outcomes to improve future evaluation methods
• Governance, Risk & Standards
• Work with Security, Legal, Compliance and other AI teams to document risk assessments, mitigations and governance recommendations for each evaluated technology
• Maintain checklists, decision templates and lightweight standards reusable across evaluations and by partner teams
• Incorporate learnings from third-party AI tooling already in use, such as external copilots and the AWS AI suite, into adoption guidelines
• Collaboration, Mentoring & Community
• Partner with other AI teams and domain teams to ensure clear boundaries and smooth collaboration
• Participate in hiring as a technical evaluator and culture champion
• Mentor engineers in the Lab and adjacent teams on evaluation methods, benchmarking and experimental design
• Share knowledge through internal write-ups, tech talks and occasional external meetups and conferences

Experience building agentic or multi-step AI systems involving tool use, orchestration, state, retrieval, or external integrations8+ years of software engineering experience, including significant experience operating at senior or Staff-level scopeExperience with observability, telemetry, testing, and benchmarking of complex systemsAbility to reason about system architecture, reliability, scalability, asynchronous workflows, and distributed components where relevantDeep hands-on experience building and evaluating systems based on LLMs and modern AI toolingStrong knowledge of cloud infrastructure, preferably AWS, and the ability to run experimental workloads securely and cost-consciouslyTrack record of designing experiments or benchmarks that influenced meaningful technical decisionsStrong software engineering fundamentals and the ability to rapidly build high-quality experimental systemsExperience constructing evaluation datasets: task selection, labelling, holdout discipline, and keeping a set useful as models improveWorking knowledge of LLM-as-judge methods and their failure modes, alongside human evaluation, inter-annotator agreement, and a view on when each is appropriateFamiliarity with regression tracking, telemetry and versioning, so that a result stays reproducible months laterAble to reason about statistical significance on small samples, and to state confidence honestly rather than over-reading a resultTrack record designing and running benchmarks that compare AI models and tools under real constraintsExperience writing short, opinionated decision memos that help others move fastComfortable making trade-off calls across quality, latency, cost and vendor lock-in, and documenting them clearlyAble to turn ambiguous “we should try this new thing” ideas into well-scoped evaluation plans with clear hypotheses and metricsCan explain technical results to non-specialists in concrete, concise termsAble to influence without authority, aligning teams around shared standards and guardrailsExperience working with platform, product and operations teams to align evaluations with real use casesCurious and biased toward experimentation, combined with disciplined measurement and risk awarenessComfortable in a small, high-leverage team without embedded PMs. You structure your own work and keep stakeholders informedBuilder attitude: you prefer reusable tools, templates and playbooks over one-off work