Senior AI/ML Backend Engineer – LLM and RAG Technologies

Talanto; Kraków; Hybrid; PLN 309,000 - 375,000; Full time

Job summary

Talanto in Kraków is seeking a Senior AI/ML Backend Engineer to shape AI-driven Credit & Lending solutions. You will design, test, and deploy LLM/RAG-based systems, leveraging Python/Java and cloud platforms to deliver scalable data insights.

Collaborate with product managers and engineers to build production-grade AI pipelines, ensure fairness and transparency, and implement robust CI/CD processes across Azure and GCP environments.

Qualifications

• 3+ years in AI/ML backend development, with NLP and LLMs.
• Experience with prompt engineering, RAG, and agentic AI concepts in finance.
• Strong Python (3+ years) and Java skills with modern frameworks.
• Experience deploying models on Azure or GCP with CI/CD pipelines.

Responsibilities

• Design, test, and optimize prompts for LLMs to ensure high-quality outputs for Credit & Lending applications.
• Develop and implement advanced solutions using RAG, vector databases, and cloud technologies to extract insights from complex financial data.
• Participate in all phases of solution development, from discovery and prototyping to deployment and maintenance.
• Apply AI best practices to promote fairness, transparency, and ethical responsibility in all models and applications.
• Collaborate with cross-functional teams to align technical efforts with strategic objectives.
• Write, review, and maintain high-quality, scalable, and testable code in Python, Java, and related frameworks.
• Utilize Azure and GCP for development, deployment, and scaling of AI solutions.
• Co-author architecture design documents and oversee production-grade solutions.

Skills

AI/ML backend

NLP

Python

Java

FastAPI

LangChain

Spring

PostgreSQL

Vector Databases

Redis

Kubernetes

Docker

CI/CD

TDD/BDD

prompt engineering

RAG

agentic AI

Azure

GCP

Tools

Azure

GCP

Kubernetes

Docker

PostgreSQL

LangChain

FastAPI

Redis

Vector Databases

CI/CD tools

Job description

Senior AI/ML Backend Engineer – LLM and RAG Technologies

27,720 – 33,600 PLN

Unleash the power of cutting-edge AI — shape the future of Credit & Lending solutions!

Kraków-based opportunity with hybrid work model.

As a Senior AI/ML Backend Engineer, you will be working for our client, a leader in financial technology, specializing in innovative credit and lending use cases. You will contribute to designing and deploying sophisticated AI models leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and cloud platforms, helping redefine the landscape of financial data analysis and decision-making. Join a dynamic environment where your expertise drives impactful innovation and career growth.

Your main responsibilities:

• Design, test, and optimize prompts for LLMs to ensure high-quality outputs for Credit & Lending applications.


• Develop and implement advanced solutions using RAG, vector databases, and cloud technologies to extract insights from complex financial data.


• Participate in all phases of solution development, from discovery and prototyping to deployment and maintenance.


• Apply AI best practices to promote fairness, transparency, and ethical responsibility in all models and applications.


• Collaborate with cross-functional teams, including engineers, product managers, and business experts, to align technical efforts with strategic objectives.


• Write, review, and maintain high-quality, scalable, and testable code in Python, Java, and related frameworks.


• Utilize cloud platforms like Azure and GCP for development, deployment, and scaling of AI solutions.


• Co-author architecture design documents and oversee production-grade solutions.

You're ideal for this role if you have:

• At least 3 years of experience in AI/ML backend development, especially with NLP and large language models.


• Strong proficiency in Python (3+ years) and Java, with experience in frameworks such as FastAPI, LangChain, Spring, and in databases like PostgreSQL, Vector Databases, Redis.


• Practical knowledge of microservices architecture, APIs, observability, concurrency, and containerization (Kubernetes, Docker).


• Experience deploying models on cloud platforms like Azure or GCP, including CI/CD pipelines and infrastructure automation.


• Familiarity with TDD, BDD, and best practices in software development.


• Expertise in prompt engineering, RAG, and agentic AI architectures within financial domain contexts.


• Solid understanding of machine learning, deep learning, and NLP.


• Excellent communication and presentation skills in English.

It is a strong plus if you have:

• Hands-on experience working within the Credit & Lending industry.


• Familiarity with financial data privacy and regulatory considerations.

Language Required for the role:

• Fluent English Level (spoken and written).

Eligibility to work in:

• Only candidates with an existing legal right to work in the European Union will be considered for this role.