Software Engineer - Kernels

MatX; Mountain View (CA); Hybrid; USD 160,000 - 600,000; Full time

Benefits offered by this job

PTO 4 weeks

Holidays 12 days

Remote work 3 weeks

Health insurance

401K match

Job summary

MatX is building a compute platform for AGI and develops full-stack solutions from silicon to software. This role focuses on designing and optimizing kernels interfacing with specialized hardware, working closely with ML research and hardware engineering teams, and shaping hardware architecture from a programmer's view.

The position is hybrid, based in Mountain View, CA, requiring in-office work Tue–Thu. The candidate should have a BS in CS and 10+ years of software development, with experience

Qualifications

• Bachelor's degree in Computer Science or equivalent
• 10+ years of software development experience
• Experience optimizing software for specialized hardware (parallelism, SIMD, C/assembly, or GPU/CUDA)
• Language: assembly, C++, C, Zig, or Rust
• Hybrid role in Mountain View, CA office 3 days a week (Tue–Thu)

Responsibilities

• Design and optimize kernels that interface directly with hardware
• Collaborate with ML Research and Hardware Engineering teams
• Provide expertise on hardware architecture from a programmer's perspective for software integration

Skills

Software development

Kernel optimization

Hardware optimization

C/C++/Rust

Assembly optimization

Parallelism

SIMD programming

CUDA

Education

Bachelor's degree CS

Tools

CUDA

Job description

What MatX Is Building

MatX is on a mission to be the compute platform for AGI. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust programming language.

What You’ll Do Here

• Design and optimize kernels that interface directly with our hardware
• Work in partnership with our ML Research and Hardware Engineering teams
• Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack

Who You Are

• Bachelor of Computer Science or equivalent degree
• 10+ years of software development experience
• Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
• Language: at least one of assembly, C++, C, Zig, or Rust
• This is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through Thursday

Bonus Points If You Have

• Experience implementing kernels for ML models such as Transformers
• Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
• Familiarity with how compilers work

Compensation

The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job-related skills, and relevant education and training. Career length is only a guideline for compensation.

• Early Career - $160,000 - $275,000 + equity
• Mid Career - $175,000 - $400,000 + equity
• Senior Career - $250,000 - $600,000 + equity

What We Offer

• Time off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote work
• Health: Company-subsidized Medical (Kaiser or Anthem) for employees & dependents, Guardian Dental and Vision insurances for employee & dependents, and life insurance (employee only), plus HSA and FSA offerings via Lively.
• Financial Security: Choose from Roth or pre-tax 401K (or both) with a 5% company contribution (even if you don't contribute), 100% company-paid life insurance (up to $300K), long-term disability and travel insurance.
• Professional Development: $1500 per year Professional Development Budget
• Team Meals: MatX provides onsite team lunch & dinner Monday - Friday, with your choice of ordering via WeBox, Specialty's or via our reimbursement system
• Commute on Us: We pay 100% for your daily commute. Commute via our company rideshare account, reimburse public transportation, or get a Fasttrak card (or all three)
• MatX E[x]tras: $50/mo to use on the perk you value most
• Cell & Internet Reimbursement: $35/mo for cellular and $40/mo for wifi
• Remote Home Setup: Use our Amazon business account for up to $1000 in office setup purchases.
• Mental Wellbeing: 100% paid mental health benefit via SpringHealth and Guardian EAP.
• Support to Parents: Up to 12 weeks paid parental leave regardless of path to parenthood, 10 weeks pregnancy disability leave, flexible return-to-work hours, and a $6K Family Fund to cover fertility, surrogacy, adoption, menopausal health, preservation, family counseling and more.

As part of our dedication to the diversity of our team and our focus on creating an inviting and inclusive work experience, MatX is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, gender, gender identity, gender expression, sexual orientation, age, physical or mental disability, medical condition, marital/domestic partner status, military and veteran status, genetic information or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances.

This position requires access to information that is subject to U.S. export controls. This offer of employment is contingent upon the applicant's capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.