Principal AI Engineer

Intellias; Poland; On-site; PLN 180,000 - 260,000; Full time

Job summary

Intellias in Poland is seeking an engineering professional to build production-grade agentic and LLM systems. You will design workflows across PDFs, transcripts, files, and databases, surfacing confidence, gaps and provenance to end users.

You will implement ingestion pipelines, quality checks, evaluation guardrails, dashboards, and monitoring, working with platform engineering, data sourcing, and PMs to translate business expectations into measurable, automated standards.

Qualifications

• Proven experience building production agentic and LLM systems across multiple sources (PDFs, transcripts, files, databases).
• Hands-on experience engineering document ingestion and extraction pipelines with robust quality controls.

Responsibilities

• Build agentic workflows that reason over research content and present gaps and confidence to end users.
• Engineer automated quality checks on unstructured source content before ingestion.
• Build vendor delivery validation to detect defects and feed improvements back to sourcing teams.
• Develop evaluation guardrails for groundedness, provenance and citation of outputs.
• Ship monitoring dashboards showing data-quality findings and coverage gaps for engineers and PMs.
• Collaborate with platform engineering, data sourcing and portfolio managers to define measurable quality standards.

Skills

Python

LLM workflows

Production systems

Data ingestion

CI/CD

Tools

Snowflake

Linux/UNIX

Git

Jira

Job description

We build the data foundations and evaluation frameworks that make AI useful, reliable and safe inside regulated financial firms. The value of an AI agent depends not only on the models behind it, but also on the quality of the structured and unstructured data it consumes and the accuracy, relevance and traceability of the outputs it produces. Your job is to measure that quality, identify where it breaks down and turn the findings into practical improvements.

This is an *engineering* role, not an analytical one. You will build the agentic workflows that reason over the firm's research content, and the ingestion, evaluation and guardrail tooling that makes their output trustworthy enough for investment professionals to act on. None of this tooling exists today - you would be building it from scratch.

What you will do

• *Build agentic workflows* that reason over research reports, transcripts, filings and news, and present portfolio managers with a clear view of what was found, what is missing, and how confident the system is in each answer.
• *Engineer automated quality checks on unstructured source content* before ingestion - empty or blank content, truncation, extraction fidelity, coverage gaps across expected document sets.
• *Build vendor delivery validation*: detect and quantify parsing and format defects in incoming feeds, feed them back to vendors and the data sourcing team, and fix extraction where it sits with us.
• *Build evaluation harnesses, benchmarks and guardrails* for agent output - groundedness, factual accuracy, relevance, and citation/provenance, so any claim can be traced back to a specific file and snippet.
• *Ship monitoring and dashboards* surfacing data-quality findings, confidence levels and coverage gaps to both engineering and PM audiences.
• Work directly with the platform engineering team, data sourcing, and portfolio managers to turn business expectations into measurable, automated quality standards.

What you need for this

• Proven experience building production agentic and LLM systems - multi-agent or orchestrated workflows that reason across heterogeneous sources (PDFs, audio transcripts, file shares, databases) and surface confidence, gaps and provenance back to end users.
• Hands-on experience engineering document ingestion and extraction pipelines: parsing, chunking and the automated quality controls around them - detecting empty or truncated content, vendor feeds delivering the wrong section of a document, duplication, encoding and OCR defects.
• Experience building evaluation and guardrail infrastructure for AI systems: groundedness scoring, citation and provenance (file name plus the exact snippet retrieved), eval harnesses, regression suites and LLM observability.
• Strong production Python engineering - services and pipelines that run unattended, with testing, CI and code standards. This is not a notebook-and-analysis role.
• Able to work from a deliberately vague brief, shape the problem directly with business stakeholders, and explain technical results to non-technical audiences.

Nice to have

• Experience tuning retrieval quality - chunking strategy, embedding choice, retrieval evaluation.
• Structured and time-series data-quality experience (coverage gaps, nulls in critical columns).
• ETL pipelines and fluency in SQL.
• Previous experience working with investment professionals in a fast-paced environment.
• Working knowledge of Snowflake, Linux/UNIX, Git, Jira.

What it's like to work at Intellias

At Intellias, where technology takes center stage, people always come before processes. By creating a comfortable atmosphere in our team, we empower individuals to unlock their true potential and achieve extraordinary results. That's why we offer a range of benefits that support your well-being and charge your professional growth.

We are committed to fostering equity, diversity, and inclusion as an equal opportunity employer. All applicants will be considered for employment without discrimination based on race, color, religion, age, gender, nationality, disability, sexual orientation, gender identity or expression, veteran status, or any other characteristic protected by applicable law.

We welcome and celebrate the uniqueness of every individual. Join Intellias for a career where your perspectives and contributions are vital to our shared success.