AI Development Engineer

HSBC Global Services Limited; Kraków; On-site; PLN 195,000 - 293,000; Full time

Benefits offered by this job

Healthcare

Pension

Life Insurance

Home office setup reimbursement (up to

Home office setup reimbursement (up to

Job summary

HSBC Global Services Limited is seeking an engineer to join a six-person team building flagship AI/ML projects for Credit and Lending. You will craft evaluation strategies, develop datasets, and ensure safety and reliability before production releases.

You will work with business stakeholders, engineers, and product managers to align evaluation coverage with user needs and strategic goals, in a fast-moving, international environment.

Qualifications

• Deep expertise in Python and ML/AI tooling.
• Experience with FastAPI, LangChain, and data containers.
• Solid understanding of microservices, observability, API design, and concurrency.
• Experience deploying on Azure or GCP with containers and Kubernetes.
• Hands-on with TDD/BDD and automated testing.
• Knowledge of RAG, prompt engineering, and agentic architectures.
• Clear written/spoken English for business partners.

Responsibilities

• Define and implement evaluation strategies for LLM/AI apps with clear criteria.
• Build/maintain evaluation datasets and test harnesses.
• Measure quality, relevance, latency, cost using automated and human methods.
• Evaluate data retrieval, grounding, attribution across financial data.
• Test AI systems for safety, bias, hallucinations; guide improvements.
• Automate evaluation and regression tests in CI/CD.

Skills

Python

ML/AI

FastAPI

LangChain

Data containers

Kubernetes

CI/CD

Azure DevOps

GCP

English

Tools

Python ecosystem

FastAPI

LangChain

Docker

Kubernetes

Jenkins

Azure DevOps

GCP Cloud Build

Job description

Some careers shine brighter than others.
If you're looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

Your career opportunity

We are a dedicated team of six engineers working on flagship AI and ML projects that are transforming the Credit and Lending landscape. You'll join a fast-moving, innovative and stable environment, partnering closely with business stakeholders to deliver high-impact solutions. This role focuses on building robust evaluation approaches for LLM and AI applications so quality, reliability and safety are proven before changes reach production.

What you'll do

• Define and implement evaluation strategies for LLM and AI applications used in Credit and Lending with clear quality reliability and safety criteria
• Build and maintain representative evaluation datasets and repeatable test harnesses for prompts models Retrieval-Augmented Generation and agentic workflows
• Measure response correctness relevance groundedness completeness latency and cost using appropriate automated and human evaluation methods
• Evaluate retrieval quality source attribution and answer grounding across complex financial data and vector databases
• Test AI systems for robustness hallucinations bias fairness prompt injection and other safety risks and use findings to guide improvements
• Automate evaluation and regression tests in CI/CD so changes to prompts models or data are assessed before release
• Analyse evaluation results investigate quality regressions and communicate trade-offs and recommendations to engineering and business stakeholders
• Collaborate with engineers product managers and business experts to align evaluation coverage with user needs and strategic goals

What you need to have to succeed in this role

• Demonstrate deep expertise in Python and its ML and AI ecosystem
• Apply experience with FastAPI LangChain and data containerisation
• Use a solid understanding of microservices observability API design and concurrency models
• Build and deploy on Azure or GCP using containers Kubernetes and CI/CD tools such as Jenkins Azure DevOps or GCP Cloud Build
• Apply practical experience with Test-Driven Development Behaviour-Driven Development and automated testing
• Use a strong grasp of LLM architectures including experience fine-tuning models on domain-specific data
• Apply hands-on experience with Retrieval-Augmented Generation advanced prompt engineering and agentic architectures
• Communicate clearly in English including explaining technical solutions evaluation results and trade-offs to business partner

What we offer

The pay range for this role is 17484 PLN - 26225 PLN (monthly, gross).

Variable pay is discretionary, but influenced by Group performance, business/function performance and individual performance.

We offer a comprehensive and competitive package of benefits covering healthcare, family friendly leaves, pension and life assurance, as well as many other benefits to support your wellbeing.

• Additional bonuses for recognition awards
• Multisport card
• Private medical care
• Life insurance
• One-time reimbursement of home office set-up (up to 800 PLN).
• Cafeteria platform
• Employee assistance program
• Additional contributions to PPK scheme
• Corporate parties & events
• CSR initiatives
• Nursery discounts
• Financial support with trainings and education
• Social fund
• Flexible working hours
• Free parking

Recruitment process

• Online behavioural test (for external candidates only)
• Telephone screen (for external candidates only)
• Interview with the hiring manager

Being open to different points of view is important for our business and the communities we serve. At HSBC, we're dedicated to creating diverse and inclusive workplaces. We are committed to removing barriers and ensuring careers at HSBC are inclusive and accessible for everyone to be at their best.

If you have a need that requires accommodations or changes during the recruitment process, please let us know.