Senior AI Machine Learning Engineer

BlackLine; Kraków; On-site; PLN 140,000 - 210,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

BlackLine is seeking an AI Engineer to advance its AI-powered Invoice‑to‑Cash platform. You will design, build, and deploy production‑grade applications that leverage foundation models to deliver insights and automate finance workflows.

You will apply prompt engineering and RAG techniques, tune models, and create robust evaluation pipelines while collaborating with cross‑functional teams. You will work on datasets, model adaptation, and AI agents to optimize latency and cost, supporting

Qualifications

• Experience developing and deploying apps with foundation models (GPT‑4o/3, Claude Opus/Sonnet, Llama).
• Hands‑on prompt engineering, few/zero‑shot learning, defensive prompt design.
• Practical knowledge of RAG and knowledge‑intensive apps.
• Experience with fine‑tuning LLMs vs. RAG.
• Building/evaluating AI agents for complex tasks.

Responsibilities

• Design, build, and deploy production‑grade apps using foundation models to deliver insights and efficiency to Finance teams.
• Develop evaluation methodologies for open‑ended AI systems and ensure accuracy and reliability.
• Master model adaptation techniques (prompt engineering, RAG, fine‑tuning) for financial use cases.
• Create and manage datasets for training and fine‑tuning.
• Build and deploy AI agents to automate complex workflows.

Skills

Foundation models

Prompt engineering

RAG

Fine-tuning

Python

C#

Hugging Face Transformers

LangChain

LangGraph

PyTorch

AI engineering principles

AgenticOS patterns

Tools

Hugging Face Transformers

LangChain

LangGraph

PyTorch

Job description

Make Your Mark:

You\'ll Get To: Get to Know Us: It\'s fun to work in a company where people truly believe in what they\'re doing! At BlackLine, we\'re committed to bringing passion and customer focus to the business of enterprise applications. Since being founded in 2001, BlackLine has become a leading provider of cloud software that automates and controls the entire financial close process. Our vision is to modernize the finance and accounting function to enable greater operational effectiveness and agility, and we are committed to delivering innovative solutions and services to empower accounting and finance leaders around the world to achieve Modern Finance. Being a best-in-class SaaS Company, we understand that bringing in new ideas and innovative technology is mission critical. At BlackLine we are always working with new, cutting edge technology that encourages our teams to learn something new and expand their creativity and technical skillset that will accelerate their careers.

This role is specifically for our AI-powered Invoice-to-Cash solution, a market leading platform that uses intelligent automation to help companies collect cash faster, unlock working capital, and supercharge efficiency in their accounts receivable processes.

Make Your Mark: As an AI Engineer at BlackLine, you will be a key player in our mission to bring autonomous finance to every company in the world.

• Design, build, and deploy production‑grade applications that leverage foundation models to deliver unprecedented insights and efficiency to Finance & Accounting teams.


• Develop and implement robust evaluation methodologies for open-ended AI systems, including the use of "AI as a judge" to ensure our solutions meet the highest standards of accuracy and reliability.


• Master and apply a variety of model adaptation techniques, including prompt engineering, Retrieval-Augmented Generation (RAG), and fine‑tuning, to tailor foundation models to specific financial use cases.


• Create and manage datasets for training and fine‑tuning models, ensuring data quality and relevance.


• Build and deploy AI agents that can automate complex financial workflows and interact with various tools and systems.


• Optimize the performance of our AI applications, focusing on reducing latency and cost to deliver a seamless user experience.


• Collaborate with cross‑functional teams to identify and implement the best AI‑powered solutions to address the challenges faced by the office of the CFO.

What You\'ll Bring:

• Proven experience in developing and deploying applications using foundation models (e.g., GPT‑4o/o3, Claude Opus 4.x / Sonnet 4.x, Llama 3.x).


• A strong understanding of the principles of AI Engineering, as distinct from traditional Machine Learning Engineering.


• Hands‑on experience with prompt engineering, including techniques for few‑shot and zero‑shot learning, and defensive prompt design.


• Practical knowledge of Retrieval-Augmented Generation (RAG) architecture and its application in building knowledge‑intensive applications.


• Experience with fine‑tuning LLMs and an understanding of when to use fine‑tuning versus RAG.


• Experience with building and evaluating AI agents that can perform complex, multi‑step tasks.


• Familiarity with the challenges of evaluating foundation models and experience with designing and implementing evaluation pipelines.


• Proficiency in Python or C# and experience with relevant libraries and frameworks (e.g., Hugging Face Transformers, LangChain, LangGraph, PyTorch).

We\'re Even More Excited If You Have:

• Experience designing or operating AgenticOS patterns (e.g., memory management, tool registries, agent lifecycle orchestration, and inter‑agent communication) to build reliable, production‑grade autonomous agent systems.


• Knowledge of techniques for optimizing inference, including quantization and other methods to improve latency and cost.


• Expertise in multi‑modal generative models (e.g., text, image, audio) and a proven ability to apply them to create innovative enterprise solutions.


• A deep understanding of dataset engineering, including data curation, augmentation, and synthesis.


• Proven experience in designing and building end‑to‑end Generative AI systems, from data ingestion and model orchestration to scalable deployment and continuous monitoring.


• A strong grasp of LLMOps principles and hands‑on experience with tools and platforms for managing the entire lifecycle of Large Language Models in production.


• Experience with Model Composition (MCP) techniques, demonstrating an ability to solve complex problems by intelligently combining multiple specialized models or AI agents.


• Deep knowledge of Responsible AI principles and practical experience in implementing robust guardrails, safety filters, and ethical considerations into generative models to ensure fairness, transparency, and accountability.


• Familiarity with the financial domain and the challenges of applying AI in a regulated industry.

Thrive at BlackLine Because You Are Joining:

A technology‑based company with vision and ambition. A culture that is kind, open, and diverse. A workplace that empowers growth and continuous learning. Professional development seminars and inclusive affinity groups. Equal opportunity employer - inclusivity at the core. Hybrid work model: at least 3 days per week in office for local candidates.

Thrive at BlackLine Because You Are Joining:

A technology‑based company with a sense of adventure and a vision for the future. Every door at BlackLine is open. Just bring your brains, your problem‑solving skills, and be part of a winning team at the world\'s most trusted name in Finance Automation! A culture that is kind, open, and accepting. It\'s a place where people can embrace what makes them unique, and the mix of cultural backgrounds and varying interests cultivates diverse thought and perspectives. A culture where BlackLiner\'s continued growth and learning is empowered. BlackLine offers a wide variety of professional development seminars and inclusive affinity groups to celebrate and support our diversity. BlackLine is an equal opportunity employer.

BlackLine is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity or expression, race, ethnicity, age, religious creed, national origin, physical or mental disability, ancestry, color, marital status, sexual orientation, military or veteran status, status as a victim of domestic violence, sexual assault or stalking, medical condition, genetic information, or any other protected class or category recognized by applicable equal employment opportunity or other similar laws. BlackLine recognizes that the ways we work and the workplace itself has shifted. We innovate in a workplace that optimizes a combination of virtual and in‑person interactions to maximize collaboration and nurture our culture.

Accommodations:

BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form.

Wondering what it\'s like to work at BlackLine? Don\'t take our word for it. We\'ve been voted Best Place to Work by Inc. Magazine four years in a row. Built in LA ranks us in their top 100 Best Places to Work in LA. Reviewers on Glassdoor say we have “smart and kind people,” “phenomenal culture,” and “good work/life balance.” Sound good? Check out our open positions and see if there\'s a fit for you.