Jr Software Engineer - ML Runtime - Rust

JobCubby; München; Hybrid; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

Tensordyne in Munich is seeking a Software Engineer for the Low-Level Runtime team. You will build components of an ML model execution framework – low-level assembler architecture hyper-optimized for our hardware – and port models to run within it.

You will maintain and optimize the framework, improve hardware-specific models, and push performance improvements across virtual and physical environments. This fast-paced startup offers collaboration across North America and Europe and a strong

Qualifikationen

• Experience with Rust programming language.
• Understanding of high-level ML concepts (LLMs).
• Experience with embedded systems development.
• Experience with driving agents and building LLM workflows.

Aufgaben

• Maintain and develop low-level ML model execution framework in Rust.
• Maintain and enhance components and whole models written for our hardware.
• Optimize performance of ML models, maximizing performance and utilization.
• Debug and productize models in both virtual and physical hardware environments.

Kenntnisse

Rust

LLMs concepts

Embedded systems

LLM workflows

Jobbeschreibung

About Tensordyne (formerly Recogni)

AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative AI inference solutions that will make AI even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

About the role

As a Software Engineer working within the Low-Level Runtime team, you will build components of an ML model execution framework – low-level assembler architecture hyper-optimized for our hardware – as well as port components of various models to be executed within it.

In this role, you will

• Maintain and develop low-level ML model execution framework in Rust
• Maintain and enhance components and whole models written for our hardware
• Optimize performance of ML models, maximizing performance and utilization
• Debug and productize models in both virtual and physical hardware environments

Preferred qualifications

• Experience with Rust programming language
• General awareness of high-level ML model concepts: LLMs, attention architectures
• Experience with low-level code development – e.g. embedded systems
• Experience with driving agents and building LLM engineering workflows

Nice to have

• Experience with Google Cloud Platform or similar
• Experience with Python
• Deep knowledge of modern LLM attention architectures (GDN, DSA, KDA etc)

Tensordyne is an equal opportunity employer.

We believe that a diverse team is better at tackling complex problems and coming up with innovative solutions.

All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.