Software Engineer – Cloud Services – Rust

Tensordyne; United States; Remote; USD 110,000 - 170,000; Full time

Benefits offered by this job

Comprehensive benefits

Competitive compensation

Flexible spending options

Recognition programs

Job summary

Tensordyne is building high-performance, power-efficient inference hardware and software. We seek a backend engineer to advance our Rust-based cloud services inside a collaborative, cross-functional team.

You will design distributed services, maintain Rust code, build APIs for generative AI, and coordinate with multiple teams to translate requirements into robust features. The role supports a remote, international team and contributes to scalable AI inference solutions.

Qualifications

• Experience with Rust and distributed systems.
• Proficiency in designing scalable APIs.
• Knowledge of asynchronous programming patterns.

Responsibilities

• Design and develop distributed cloud services in Rust.
• Maintain Rust software and integrate external frameworks.
• Build APIs for generative AI workloads.
• Collaborate across teams to derive design specs and decisions.
• Orchestrate agent teams to implement features.

Skills

Rust programming

Distributed systems

API design

Asynchronous patterns

HTTP knowledge

Kubernetes awareness

Tools

Kubernetes

Docker

HTTP frameworks

Job description

About Tensordyne

AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications.Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

About the role

Tensordyne builds high-performance, power-efficient inference hardware, backed by our novel AI math approach.

You will work within a team working on the inference backend software. Your focus will be on a part of a software stack of a future Tensordyne product.

In this role, you will

• Design and develop distributed cloud services in Rust
• Maintain Rust software developed in-house, as well as work with external frameworks
• Build APIs for generative AI
• Collaborate across different teams to derive design specifications and decisions
• Orchestrate agent teams to implement features

Preferred qualifications

• Experience with modern Rust
• Experience with agentic tools and workflows
• Knowledge of common Rust design patterns, including patterns for asynchronous code
• General awareness of network technologies and high-level protocols like HTTP
• General awareness of Kubernetes and other related technologies is a plus

Tensordyne’s culture was built on the following values

• Put people first. We only succeed when our people succeed.
• Ethics and integrity always; Being open, honest, and respectful of everyone.
• Think Big. Be ambitious and have audacious goals of global scale.
• Aim for excellence. Quality and excellence count in everything we do.
• Own it and get it done. Results matter!
• Make each person better together, than they would be as an individual.
• Embrace each others’ differences, and embrace that there will be differences.

Tensordyne is an equal opportunity employer. We believe that a diverse team is better at tackling complex problems and coming up with innovative solutions. All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.