Staff Software Engineer - Rack Scaleout

Untether AI; Kitchener; On-site; CAD 80,000 - 120,000; Full time

Job summary

Join a forward-thinking company at the forefront of AI technology, where you'll work on innovative projects that merge hardware and software. As a scaleout developer, you'll be part of a dynamic team that shapes the future of AI by developing solutions for large-scale models and collaborating with cross-departmental teams. Your expertise in C++ and problem-solving will be crucial in addressing complex challenges. This is an exciting opportunity to make a significant impact in a rapidly evolving field and contribute to groundbreaking advancements in AI technology.

Benefits

20 vacation days

Strong health and extended health benefits

Unlimited sick days

Stock options

Opportunity to build impactful technology

Qualifications

• 5+ years of experience in software development, especially in C++.
• Strong understanding of hardware architecture and circuits.

Responsibilities

• Collaborate with teams to define scaleout product offerings.
• Develop orchestration software to enable scaleout solutions.

Skills

C++ Development

Creative Problem Solving

Networking Concepts

Cross-Functional Team Collaboration

Education

Bachelor in Computer Science or Engineering

Master or PhD in Computer Science or Engineering

Tools

Neural Net Frameworks

PCIe Interconnect

SmartNIC Networking

Job description

The early productization team works at the frontiers of AI technologies including areas such as large language model generative AI, autonomous vehicles, and next-generation silicon. We operate at the intersection between hardware and software. Our work helps shape both the hardware and software solutions that underlie Untether AI technology, and we are looking to grow the team through the addition of a scaleout developer.

One ongoing trend in AI is the move towards ever larger models. Models have grown from millions, through billions, and into trillions of parameters. This, in turn, has driven AI platform deployments to move from cards, to servers, to racks, to pods and, eventually, full data centers.

As a successful candidate, you would find working as a member of cross-departmental virtual teams tasked with shaping and implementing scaleout solutions that enable this transition. On any given day your work could include:

1. Collaborating with our board/platform team to define short-term scaleout product offerings,
2. Collaborating with the CTO office to explore next-gen silicon interconnect innovations,
3. Interacting with customers to understand their scaleout needs and propose solutions,
4. Standing up physical hardware to prove out scaleout solutions,
5. Developing orchestration software solutions to enable such scaleout,

And much more!

Whatever the task, you can rest assured that it is of critical importance, requires innovative thinking and will help shape the future of Untether AI. If you are a self-driven generalist capable of working at the intersection of software and hardware then this job might be right for you!

Requirements

• Computer science, engineering or related degree
• 5+ years of experience
• Creative problem solver, passionate about solving hard problems
• Strong C++ development skills required
• Working hardware knowledge (architecture, circuits, RTL)
• Familiarity with networking concepts
• Experience working in cross-functional teams

Preferred Skills & Experience

• Master or PhD in Computer science, engineering or related field
• Experience with rack scale and above distributed systems
• Experience delivering high-performance software to production
• Hardware design experience (architecture, circuits, RTL) a plus
• Familiarity with neural net frameworks
• Familiarity with PCIe interconnect
• Experience with smartNIC networking
• Strong communication skills

What are some of the perks that you will receive being part of Untether AI?

• Aligned to Untether’s philosophy, our employees enjoy the same perks, regardless of role or level. In part, these include:
• 20 vacation days
• Strong health and extended health benefits
• Unlimited sick days
• Stock options
• Building chips and software that will change the world

Thinking about applying?

• We’re a pretty welcoming bunch of people. If we’ve piqued your interest, you’re passionate about the same things we are but you aren’t sure if you check all the boxes, please apply anyway. We’re a great place to work, an even better place to learn and we focus on both capability and potential!
• Besides being a pretty friendly group, we’re also pretty diverse - ethnically, experientially and in our physical and mental abilities. If you are someone who needs accommodation during the interview process and/or in the workplace, please send a note along with your resume to [e-mail] and we’ll be in touch.

A little bit more about Untether AI

Untether AI has developed a groundbreaking new architecture that brings neural net inference to new levels of performance and efficiency. We’ve already sold our product to smart clients who want to get in at ground zero. We’ve done this while continuing to improve our technology creating ultra-efficient, high performance AI chips that eliminates the data movement bottleneck that costs energy and performance in traditional architectures. We’re a team made up of scientists, engineers and entrepreneurs and have the support of tier one investors. We recently received $125 million in our series B funding round which enables us to expand our customer engagements, enhance our software offering, and build the next generation of industry leading AI inference products. Join us to be part of something big - a chance to create the future of AI.