AI Evaluation & Platform Strategy Lead

Danske Bank; Warszawa; Hybrid; PLN 211,000 - 316,000; Full time

Benefits offered by this job

Growth opportunities

Health & Well-being

Hybrid working conditions

Additional days of leave

Pension & insurance

Job summary

Danske Bank in Warsaw, Poland, seeks an AI Evaluation Methodology & Platform Requirements Lead to define robust evaluation methods for AI models and the platforms that support them. You will translate risk and control needs into concrete methods, data, and platform capabilities, and work with the 2nd Line and engineering teams to ensure auditable evidence and traceability.

Focus areas include methodology ownership, platform requirements, data pipelines and observability, with the role based in a

Qualifications

• Experience designing or governing AI/ML evaluation methodologies, including test objectives, datasets, metrics and evidence standards.
• Experience translating evaluation, monitoring, risk and control needs into platform requirements for pipelines, reporting and observability.
• Knowledge of AI evaluation, model risk management, MLOps/LLMOps and AI platforms is advantageous.

Responsibilities

• Own the evaluation methodology for AI models and AI-enabled solutions, including objectives, tests, acceptance criteria and evidence standards.
• Define functional/technical requirements for evaluation/monitoring platforms (data ingestion, tests, metrics, observability, evidence, access controls, auditability).
• Translate risk/requirements into reusable evaluation methods, datasets, metrics, monitoring indicators and evidence requirements.
• Assess how AI architectures, data flows and dependencies affect evaluation scope and platform capabilities.
• Set platform-agnostic requirements across environments (AWS Bedrock, AgentCore, Databricks, Azure OpenAI, etc.).
• Ensure end-to-end traceability across models, prompts, data and configurations.

Skills

AI evaluation methodologies

Model risk management

Data architectures

Platform tooling

Python or similar

Communication skills

Tools

AWS Bedrock

AgentCore

Databricks

Azure OpenAI

Mosaic AI

Job description

Danske Bank in Warsaw, Poland, seeks an AI Evaluation Methodology & Platform Requirements Lead to define robust evaluation methods for AI models and the platforms that support them. You will translate risk and control needs into concrete methods, data, and platform capabilities, and work with the 2nd Line and engineering teams to ensure auditable evidence and traceability.

Focus areas include methodology ownership, platform requirements, data pipelines and observability, with the role based in a