Master Thesis: Optimization of KV-Cache in Distributed LLMs

Siemens Mobility; Garching bei München; Vor Ort; EUR 40.000 - 60.000; Vollzeit

Zusammenfassung

A leading technology company in Garching bei München is seeking a Master Thesis student to work on edge AI technologies. You will analyze and optimize KV-Cache in distributed LLMs, significantly impacting performance. Candidates should be pursuing a Master's degree in fields like Computer Science or Electrical Engineering, with skills in Python, C++, and AI frameworks. This role offers exciting projects and individual supervision to enhance your research experience.

Leistungen

Exciting research and development projects

Individual supervision and support

Access to latest technologies and laboratories

Diverse opportunities to contribute ideas

Excellent career opportunities

Qualifikationen

• Currently pursuing a Master's degree focused on AI or distributed systems.
• Proficient in Python and C++, with experience in Linux systems.
• Familiar with AI frameworks and optimization techniques.

Aufgaben

• Analyze existing Large Language Model (LLM) frameworks to identify optimizations.
• Evaluate and compare optimization strategies for edge deployment.
• Develop improvements for KV-Cache management focusing on efficiency.
• Implement and test optimization approaches within edge networks.
• Contribute to frameworks for distributed LLM deployment.

Kenntnisse

Programming with Python

Programming with C++

Linux systems and network management

AI frameworks

Performance optimization techniques

Analytical mindset

Problem-solving abilities

Documentation skills

Communication skills in English

Communication skills in German

Ausbildung

Master's degree in Computer Science, Electrical Engineering, or related field

Jobbeschreibung

Mode of Employment:Fixed Term / Full- or Part-Time

Are you ready to shape the future of edge AI technologies? Join us as a Master Thesis student in GCH FL and dive into optimizing KV-Cache in Distributed LLMs, where your analysis and innovations will drive performance in new, exciting ways!

What we offer you

• Exciting research and development projects that put your theoretical knowledge into practice
• Individual supervision and support from experienced experts in your field
• Access to the latest technologies, laboratories, and resources
• Diverse opportunities to contribute your ideas and actively shape the projects
• Excellent career opportunities through contact with potential employers

You'll make an impact by

• You perform a comprehensive analysis of existing Large Language Model (LLM) frameworks and approaches to identify areas for optimization
• Following this, you evaluate and compare different optimization strategies for edge deployment to enhance system performance
• Subsequently, you develop improvements for KV-Cache management in distributed LLMs, focusing on efficiency and scalability
• You then implement and test these optimization approaches within edge networks to ensure they meet performance criteria
• Finally, you contribute to the creation or extension of frameworks for distributed LLM deployment, documenting the process and results to advance edge AI technologies

This is how you'll win us over

• Education: You are currently pursuing a Master's degree in Computer Science, Electrical Engineering, or a related field with a focus on AI, distributed systems, or edge computing
• Experience and Skills:
  • Proficient in programming with Python and C++
  • Experienced in working with Linux systems and network management
  • Familiar with AI frameworks, Large Language Models, and performance optimization techniques
• Ways of Working: You demonstrate an analytical mindset with strong problem-solving abilities, are independent in your work, and have excellent documentation and communication skills
• Languages: Fluent in English with good communication skills in German both written and spoken

You are much more than your qualifications, and we believe in the potential of every single candidate. We look forward to getting to know you!

Your individual personality and perspective are important to us. We create a working environment that reflects the diversity of the society and support you in your personal and professional development. Let’s get to know your authentic personality and create a better future together with us. As an equal-opportunity employer we are happy to consider applications from individuals with disabilities.

About Us

The world never stands still. And new challenges arise every day. With a passion for questioning things, for supplying ideas, and intelligently driving things forward we are helping society move towards a smarter tomorrow. Be it with technologies that reduce carbon emissions in cities or hyperintelligent robots. This is how we are able, to tackle the most important projects and push them forward together. Help us shape the future.

www.siemens.de/careers – if you would like to find out more about jobs & careers at Siemens.

FAQ – if you need further information on the application process.

#sagthesisConducting