Senior Staff Software Engineer

hackajob; United States; Remote; USD 310,000 - 357,000; Full time

Job summary

hackajob seeks a Senior Staff Software Engineer to design cutting-edge algorithms for AI infrastructure. Ideal candidates will have deep expertise in Generative AI and Speculative Decoding, backed by substantial experience and a Master's degree. The position offers a competitive salary and requires authorization to work in the U.S. or Canada.

Qualifications

• 6+ years of experience in relevant fields.
• Master’s degree required or equivalent industry experience.
• Experience in developing high-performance systems.

Responsibilities

• Design, implement, and optimize algorithms for AI infrastructure.
• Enhance capabilities in post-training and model evaluation.

Skills

C++

Generative AI inference

Speculative decoding

Data science

Education

Master’s degree in Computer Science

Tools

PyTorch

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from hackajob

Talent Acquisition Consultant | People | Recruitment | Human Resources | Mass Consumption | Tech

hackajob has partnered with a leading company in software development, headquartered in Silicon Valley, on a mission to make high-performance AI compute more accessible and affordable.

Role: Senior Staff Software Engineer

Location: Remote across the U.S. or Canada (San Francisco or Toronto preferred)

Salary: Up to 310k!

Work authorization: This role requires you to be authorized to work in Canada or the United States without sponsorship.

Mission: With a strong background in Generative AI Inference and expertise in Speculative Decoding, you will design, implement, and optimize cutting-edge algorithms to enhance our production AI infrastructure and capabilities in post-training, model evaluation, and operational performance.

Qualifications: (+6 years of experience)

• Master’s degree in Computer Science, Electrical Engineering, or a related field (or equivalent industry experience).
• Extensive, hands-on experience in generative AI inference with a specific focus on speculative decoding.
• Proficiency in C++ is essential, with demonstrated experience in developing high-performance systems.
• Understanding of the architecture of Generative AI models, PyTorch, familiarity with the data science necessary to evaluate layers of models, their performance, and quality.

hackajob is a recruitment platform that will match you with relevant roles based on your preferences, and in order to be matched with the roles, you need to create an account with us.

This role requires you to be based in the US or Canada.

Seniority level

• Seniority level

  Associate

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at hackajob by 2x

Get notified about new Software Engineer jobs in United States.

Software Engineer - Fullstack, Multiple Locations

United States $81,900.00-$174,600.00 1 week ago

Software Engineer (L5) - Open Connect Platform

United States $100,000.00-$720,000.00 6 days ago

Costa Mesa, CA $125,000.00-$155,000.00 23 hours ago

Full-Stack Software Engineer (New graduates: United States)

United States $70,000.00-$100,000.00 2 weeks ago

New York, NY $140,000.00-$185,000.00 1 week ago

Software Engineer (L5) - Ads Identity & Privacy

United States $100,000.00-$720,000.00 2 weeks ago

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

United States $100,000.00-$720,000.00 1 week ago

New York, United States $142,600.00-$196,200.00 1 week ago

United States $140,000.00-$170,000.00 1 month ago

Software Engineer Intern/Co-op (Fall 2025)

United States $110,000.00-$140,000.00 15 hours ago

United States $130,000.00-$180,000.00 1 week ago

New York, NY $145,000.00-$260,000.00 7 months ago

United States $90,000.00-$170,000.00 9 months ago

Software Engineer - AI/ML, Multiple Locations

United States $81,900.00-$174,600.00 1 week ago

Software Engineer - AI/ML, Multiple Locations

Redmond, WA $81,900.00-$174,600.00 2 weeks ago

United States $164,200.00-$229,900.00 1 week ago

Software Engineer L4/L5, Training Platform, Machine Learning Platform

United States $100,000.00-$720,000.00 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.