Product Manager Agentic AI & LLMs (f/m/x)

ING Deutschland; Mainz; Hybrid; EUR 55.000 - 65.000; Vollzeit

Zusammenfassung

A leading financial institution in Germany is seeking a skilled product manager with expertise in AI. The role involves defining and managing product requirements, delivering agentic AI systems, and ensuring best practices in LLM orchestration. Candidates should have substantial product management experience, strong communication skills, and an understanding of AI concepts. Benefits include flexible work arrangements, a company pension plan, and opportunities for personal development. Apply with your resume to join a dynamic team.

Leistungen

Company pension plan

Free Germany ticket

Bicycle leasing

Continuing education budget

Health budget

Qualifikationen

• Many years of professional experience in product management or technical leadership roles.
• Comprehensive understanding of the AI product lifecycle.
• Strong communication skills to present complex topics clearly.

Aufgaben

• Define requirements and manage dependencies for AI projects.
• Support the delivery of agentic AI and LLM systems.
• Ensure best practices in LLM orchestration and evaluations.

Kenntnisse

Professional experience in product management

Understanding of the AI product lifecycle

Strong communication skills

International project experience

Knowledge of LLM concepts

Understanding of data governance

Fluency in English

Tools

AI

API

Cloud

LLM

Jobbeschreibung

Salary: 55.000 - 65.000 per year

Requirements

• Many years of professional experience in product management or technical leadership roles, ideally in AI, analytics or software engineering environments
• Comprehensive understanding of the AI product lifecycle including training, integration, deployment and evaluation, as well as operational monitoring and maintenance of AI systems
• Strong communication skills with the ability to present complex technical topics clearly to business audiences
• International project experience and excellent stakeholder management skills
• Familiarity with and a conceptual understanding of LLM concepts such as prompt engineering, API integration, data pipelines and cloud platforms
• Knowledge of data, AI risk and governance topics; experience with banking processes is a plus
• A proactive, entrepreneurial mindset combined with a high degree of self‑direction and a passion for innovation
• Ability to think beyond one's own horizon and develop sustainable solutions
• Fluency in spoken and written English; German is an advantage

Responsibilities

• Are AI, LLM and agents real‑life expertise for you rather than mere buzzwords? Do you use your business expertise and IT know‑how to build products with real added value? Perfect! With us, you can expect a collaborative company culture built on mutual respect, diverse career paths and plenty of room for personal development. Sounds good? Then apply your CV is sufficient and help take our agentic AI solutions to the next level.
• Your Tasks
• Whether you maintain and prioritise the backlog, develop well‑thought‑out user stories and acceptance criteria, or steer ways of working and routines thanks to you, our AI Delivery Squad is always on the right track and delivers agentic AI capabilities that are measurably better.
• To ensure we build what is truly needed, you immerse yourself in functional and business challenges, understand what needs to be done, and work closely with business units, data scientists and engineers to translate requirements into robust technical solutions. In doing so, you define requirements, manage dependencies, and confidently handle risk and governance requirements.
• From architecture and integration to implementation, you act as the advisory authority on the path to the optimal solution at a technical level. - You support your team in delivering agentic AI and LLM systems and ensure best practices in LLM orchestration, tool integration, and testing and evaluation frameworks.
• At all times, you maintain an overview, identify hurdles and obstacles particularly with regard to scaling and integration at an early stage, and proactively remove them.
• And of course, you always keep a critical eye on the business perspective, develop business cases and benefit calculations, and diligently track the value realisation of agentic AI initiatives.

Technologies

• AI
• API
• Cloud
• Support
• LLM
• Mobile

More

Working at ING means working with great people: friendly, collaborative and (we think) fun! We empower the people around us and our customers to stay a step ahead. A job at ING comes with autonomy and the expectation to drive progress, deliver superior value for customers and create a more sustainable future for people and planet.

We offer many benefits

• Company pension plan, capital‑building offers, free Deutschlandticket & bicycle leasing, company restaurant
• Remote working depending on the position and department and in line with the company, regulatory and legal requirements; individualized work schedule models, sabbatical, subsidisation of nursing & childcare costs
• Personal budget for continuing education and development as well as health; plus, a personal budget to set up your mobile working space

Ready for a new job? At ING we are colourful and diverse: different personalities with different perspectives - an international culture where we value and appreciate each other. We believe in substance over style, people instead of labels.

This describes you to a T? Simply apply online - your resume is all we need to get to know you, a cover letter is optional!

last updated 4 week of 2026