AI Engineer, Deep Data Science for Production Finance

emagine; København; On-site; DKK 800,000 - 1,200,000; Full time

Job summary

emagine is seeking a freelance AI Engineer with Deep Data Science understanding to contribute to the AI Skills Registry for clients in the financial sector. The role focuses on building reliable components for AI solutions across platforms, including AWS AgentCore-based agents and our enterprise AI solution.

The position is on-site in Denmark, full-time, and involves developing components, evaluating models, and ensuring robust evaluation practices in a regulated industry environment.

Qualifications

• Hands-on experience evaluating ML or LLM-based systems in production.
• Knowledge of evaluation methodology, including error analysis and rubric design.
• Strong Python and data analysis skills.
• Experience with cloud-native ML infrastructure, such as AWS Bedrock.
• Ability to work independently within a growing team.
• Experience in regulated industries such as financial services or healthcare.

Responsibilities

• Build components for the AgentCore and run evaluation frameworks for skills and tools builds.
• Ensure the reliability and accuracy of AI models.
• Operationalize the Evaluate and Iterate phase of the ADS to ensure robust evaluation practices across various agent builds.
• Define and track quality and cost-per-outcome metrics for production agents.
• Run structured error analysis on agent outputs to identify failure patterns and implement fixes.
• Develop innovative AI solutions within a dynamic team environment.

Skills

Python

Data analysis

Evaluation methodology

Error analysis

Independent work

Production ML/LLM experience

Tools

AWS Bedrock

AgentCore

Job description

emagine is seeking a freelance AI Engineer with Deep Data Science understanding to contribute to the AI Skills Registry for clients in the financial sector. The role focuses on building reliable components for AI solutions across platforms, including AWS AgentCore-based agents and our enterprise AI solution.

The position is on-site in Denmark, full-time, and involves developing components, evaluating models, and ensuring robust evaluation practices in a regulated industry environment.