PhD Measuring and Scaling Agentic Software Engineering (f/m/x)

BMW Group; München; Sur place; EUR 19 000 - 29 000; Plein temps

Résumé du poste

BMW Group invites PhD candidates to join the ProMotion PhD programme within the New Technologies team. You will design benchmarks to evaluate coding agents on automotive codebases and study how agents lose relevant code between exploration and generation.

You will develop methods to preserve and use critical code effectively while ensuring trustworthy outputs. You will benchmark configurations across embedded C/C++, Java, Python and Go, and translate findings into research and deployment

Qualifications

• Studies in computer science, data science, mathematics or a comparable field.
• Solid knowledge of machine learning, in particular large language models and agentic systems.
• Strong programming skills in Python; experience with C/C++, Java or Go is an advantage.
• Hands-on experience with agent evaluation and benchmarking, for example SWE-bench, Terminal-Bench, tau-bench or comparable frameworks.
• Ideally first publications or submissions at relevant scientific venues during your studies.
• Very good English language skills; German is an advantage.

Responsabilités

• Design benchmarks that evaluate coding agents on real automotive codebases across the full development lifecycle.
• Investigate where agents lose relevant code between exploration and generation and measure it.
• Explore methods to help agents preserve and use relevant code more effectively.
• Develop verification and testing approaches that keep agent-generated code trustworthy without slowing development.
• Benchmark agent configurations, LLMs, harnesses and scaffolding across heterogeneous stacks such as embedded C/C++, Java, Python and Go.
• Translate findings into research and deployment frameworks applicable at real-world scale.

Connaissances

Python programming

Machine learning

Agent evaluation

Benchmarking

English language skills

Formation

Studies in computer science, data science, mathematics or comparable field

Outils

SWE-bench

Terminal-Bench

tau-bench

C/C++

Java

Go

Description du poste

PhD Measuring and Scaling Agentic Software Engineering (f/m/x)

THE FUTURE IS WHAT WE CREATE WHEN WE TAKE OUR VISIONS TO THE LIMITS.

PHD AT THE BMW GROUP.

Bridging the gap between your doctoral studies and the kind of career challenge you’re looking for isn’t always easy. That’s why our ProMotion PhD programme gives you the opportunity to apply your passion and scientific expertise to very real challenges that could shape the future of mobility. If selected, you’ll have the chance to really develop your own future career path with us through your practice-related thesis, promote your chosen specialty from within – and position yourself to secure the career you’ve always wanted.

Our New Technologies team explores and evaluates emerging technologies and brings the most promising ones into productive use across the BMW Group. Agentic software engineering is one of these technologies, and as a PhD candidate, you help find ways to systematically measure agentic software development and scale it to real-world use.

What awaits you?

• You design benchmarks that evaluate coding agents on real automotive codebases across the full development lifecycle.
• Within this project, you investigate where agents lose relevant code between exploration and generation - a failure mode that grows with codebase size and remains unmeasured.
• Building on these insights, you explore methods that help agents preserve and use relevant code more effectively.
• In this role, you help develop verification and testing approaches that keep agent-generated code trustworthy without slowing down development.
• Together with the team, you benchmark agent configurations, LLMs, harnesses and scaffolding across heterogeneous stacks such as embedded C/C++, Java, Python and Go.
• Finally, you translate your findings into research and deployment frameworks that can be applied at real-world scale.

What should you bring along?

• Studies in computer science, data science, mathematics or a comparable field.
• Solid knowledge of machine learning, in particular large language models and agentic systems.
• Strong programming skills in Python; experience with C/C++, Java or Go is an advantage.
• Hands-on experience with agent evaluation and benchmarking, for example SWE-bench, Terminal-Bench, tau-bench or comparable frameworks.
• Ideally first publications or submissions at relevant scientific venues during your studies.
• Very good English language skills; German is an advantage.

Are you excited about advancing the science and practice of agentic software engineering at automotive scale?

If you make it to the next round, you will receive an invitation to a video interview by e-mail. Please also check your spam folder regularly.

What do we offer?

• Digital offers & mobile working.
• Annual special payments such as vacation pay and Christmas bonus.
• Apartment offers for students (subject to availability & only Munich).

You can find helpful tips on your application and the application process here .

At the BMW Group, we place great importance on equal treatment and equal opportunities. Our recruiting decisions are based on the personality, experience, and skills of the applicants. Learn more here .

BMW AG