Senior AI Developer

Sii Poland; Toruń; On-site; PLN 180,000 - 220,000; Full time

Job summary

A leading tech company in Poland seeks a Senior AI Engineer to develop cutting-edge RAG systems in Azure. The role involves defining metrics, analyzing results, and refining AI processes. Candidates should have over 6 years of experience in AI/ML systems and strong proficiency in Azure. Join a dynamic team and engage in impactful projects aimed at improving patient outcomes. Benefits include profit sharing, medical care, and a supportive work environment.

Benefits

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Qualifications

• Minimum 6 years of experience in LLM-based AI/ML systems.
• Very good knowledge of RAG systems architecture and building practices.
• Ability to work with metrics, evaluation and quality analysis.

Responsibilities

• Defining quality metrics and building monitoring pipelines.
• Creating and maintaining benchmark sets based on real questions.
• Analyzing results and identifying sources of errors.

Skills

Experience in LLM-based AI/ML systems

Knowledge of RAG systems architecture

Ability to work with metrics

Fluency in Azure AI or Azure ML

Knowledge of vector databases

Proficiency in prompt creation

Experience with function calling

Knowledge of English (B2 level)

Job description

Join a project where advanced AI is making a real difference in the lives of patients. We are looking for a Senior AI Engineer to take on a key role in the development of cutting‑edge RAG systems running in the Azure environment. Working with cutting‑edge technologies, having a real impact on the direction of product development, and working in partnership in an international, Scandinavian team await you. If you want to develop LLM systems at the highest level and participate in projects with high social value, this is the place for you.

Job no. 251120-ALR94

Your tasks

• Defining quality metrics (accuracy, hit‑rate, faithfulness, latency) and building monitoring pipelines
• Creating and maintaining benchmark sets based on real questions and golden answers
• Analyzing results and identifying sources of errors: retrieval, hallucinations, prompt problems
• Optimizing chunking, embedding, vector storage and search configurations
• Improving generation by refining prompts, formatting and hallucination mitigation methods
• Improving function calling processes and validating the correctness of calls
• Testing advanced RAG techniques, such as query rewriting and re‑ranking

Requirements

• Minimum 6 years of experience in LLM‑based AI/ML systems
• Very good knowledge of RAG systems architecture and building practices
• Ability to work with metrics, evaluation and quality analysis
• Fluent in Azure AI or Azure ML environment
• Knowledge of vector databases and embedding approaches
• Proficiency in prompt creation and hallucination mitigation techniques
• Experience with function calling and integration with external tools
• Knowledge of English at a minimum B2 level

Benefits For You

• Great Place to Work
• Solid financial situation
• Contracts with the biggest brands
• Centre of internal trainings
• Many experts you can learn from
• Open and accessible management team
• Profit sharing
• Passion Sponsorship program
• Regular integration events and trips
• Comfortable and well‑equipped offices
• MySii app
• Medical care