Senior AI Engineer – Agentic LLMs in Production

Margo Group; Warszawa; Hybrid; PLN 300,000 - 520,000; Full time

Job summary

Margo Group in Poland seeks a senior AI/ML software engineer to design and develop LLM-based agentic solutions for the Investment Banking division. You will work with business teams to implement data extraction pipelines, evaluate AI agents, and deploy models on GPU infrastructure with testing and DevOps best practices.

The role requires strong Python, OO programming, FastAPI, and experience with asynchronous microservices, LangGraph, DSPy, and vLLM.

Qualifications

• Strong Python with extensive experience in Object-Oriented programming and enterprise design patterns.
• Proven track record building asynchronous microservices and endpoints using FastAPI.
• Hands-on pytest for unit, functional, and integration testing for ML/LLM pipelines.
• Bash scripts for automation, data handling, and container interaction.

Responsibilities

• Design and develop LLM-based agentic solutions to automate complex business processes.
• Work closely with business teams to identify needs and drive adoption of AI solutions.
• Develop data extraction pipelines and implement evaluation and observability frameworks for AI agents.
• Deploy and industrialize models (LLMs, GPUs), ensuring quality through testing and DevOps best practices.
• You are taking full ownership in driving AI features.
• You remember to respect the boundaries and non-deterministic nature of LLMs, communicate constraints clearly, and build robust safety rails.
• You are a team player, communicate trade-offs with architects and business users, and mentor peers.
• You are testing ideas and PoCs quickly, validate feasibility with data and avoid technical debt.

Skills

Python programming

Object-oriented programming

Enterprise software design patterns

Tools

FastAPI

pytest

Bash scripting

LangGraph

DSPy

vLLM

CUDA

Kubernetes

Jenkins

Arize Phoenix

Google ADK

Job description

Margo Group in Poland seeks a senior AI/ML software engineer to design and develop LLM-based agentic solutions for the Investment Banking division. You will work with business teams to implement data extraction pipelines, evaluate AI agents, and deploy models on GPU infrastructure with testing and DevOps best practices.

The role requires strong Python, OO programming, FastAPI, and experience with asynchronous microservices, LangGraph, DSPy, and vLLM.