AI Agent Lab: Evaluating MCP & LLM Workflows

Siemens AG; Villeurbanne; Hybrid; EUR 12,000 - 15,000; Full time

Benefits offered by this job

Meal vouchers

Siemens Learning Hub access

Mentorship

Job summary

Siemens Software invites applications for a six-month Strategic Student Program internship in Villeurbanne, near Lyon, starting January 2027. You will design and build an evaluation platform to analyze MCP-based workflows and automate result validation using LLMs, collaborating with the Nexus team.

The role requires a Master’s-level engineering student (Bac +5 / MSc) in France, strong Python/Go skills, and interest in CI/CD and MLflow.

Qualifications

• Currently enrolled in a Master’s-level engineering program (Bac +5 / MSc or equivalent) in France, specialising in Computer Science, Artificial Intelligence, Software Engineering, or a related field.
• Strong software development skills in Python and Go.
• Knowledge of or interest in testing frameworks, performance analysis, and CI/CD practices (CI/CD, MLflow, or similar tools).
• Curious, self-motivated, and adaptable in fast-paced environments.
• French and English communication skills for collaboration in international teams.
• Able to work independently with mentorship support.

Responsibilities

• Design and implement robust test suites (using MLflow or equivalent) to measure performance, quality, and relevance of AI agents and MCP-driven interactions with Simcenter Amesim.
• Develop an evaluation platform to automate testing, monitoring, and benchmarking of AI workflows.
• Investigate and integrate LLM-based evaluation techniques to automatically validate generated results and assess workflow quality.
• Operate in a rapidly evolving environment with evolving project scope.

Skills

Python

Go

AI/LLMs

CI/CD

Testing

English

French

Education

Master's degree in CS/AI/SE

Tools

MLflow

Job description

Siemens Software invites applications for a six-month Strategic Student Program internship in Villeurbanne, near Lyon, starting January 2027. You will design and build an evaluation platform to analyze MCP-based workflows and automate result validation using LLMs, collaborating with the Nexus team.

The role requires a Master’s-level engineering student (Bac +5 / MSc) in France, strong Python/Go skills, and interest in CI/CD and MLflow.