Staff Software Engineer, Managed AI

Crusoe; Sunnyvale (CA); On-site; USD 180,000 - 250,000; Full time

Job summary

Join Crusoe as a Staff Software Engineer on the Managed AI team, where you'll play a pivotal role in developing cutting-edge AI infrastructure solutions. This role involves designing robust AI services, optimizing performance for thousands of clients, and collaborating across teams to drive innovation in AI technologies. Be a part of a mission-driven company that merges responsible technology with climate sustainability.

Benefits

Industry competitive pay

Restricted Stock Units

Health insurance package options

Employer contributions to HSA accounts

Paid Parental Leave

401(k) with a 100% match up to 4% of salary

Generous paid time off and holiday schedule

Tuition reimbursement

Subscription to the Calm app

Company paid Commuter FSA benefit

Qualifications

• Advanced degree in Computer Science, Engineering, or related field.
• Experience in distributed systems design and implementation.
• Familiarity with container runtimes and microservices architectures.

Responsibilities

• Lead design and implementation of core AI services.
• Build infrastructure for millions of API requests.
• Collaborate with cross-functional teams to shape AI platform.

Skills

Distributed systems design

AI/ML expertise

Software engineering

Container runtimes

REST APIs

Education

Advanced degree in Computer Science or related field

Tools

Kubernetes

Job description

Join to apply for the Staff Software Engineer, Managed AI role at Crusoe

1 month ago Be among the first 25 applicants

Join to apply for the Staff Software Engineer, Managed AI role at Crusoe

Crusoe is building the World’s Favorite AI-first Cloud infrastructure company. We’re pioneering vertically integrated, purpose-built AI infrastructure solutions trusted by Fortune 500 companies to power their most advanced AI applications. Crusoe is redefining AI cloud infrastructure, with a mission to align the future of computing with the future of the climate. Our AI platform is recognized as the "gold standard" for reliability and performance. Our data centers are optimized for AI workloads and are powered by clean, renewable energy.

Be part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure.

About This Role:

As a Staff Software Engineer on the Managed AI team at Crusoe, you'll have a pivotal role in shaping the architecture and scalability of our next-generation AI inference platform. You will lead the design and implementation of core systems for our AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role gives you the opportunity to build and scale infrastructure capable of handling millions of API requests per second across thousands of customers.

From day one, you'll own critical subsystems for managed AI inference, helping to serve large language models (LLMs) to a global audience. As part of a dynamic, fast-growing team, you’ll collaborate cross-functionally, influence the long-term vision of the platform, and contribute to cutting-edge AI technologies. This is a unique opportunity to build a high-performance AI product that will be central to Crusoe's business growth.

What You’ll Be Working On:

• Design and Development:
• Lead the design and implementation of core AI services, including:
• Resilient fault-tolerant queues for efficient task distribution.
• Model catalogs for managing and versioning AI models.
• Scheduling mechanisms optimized for cost and performance.
• High-performance APIs for serving AI models to customers.
• Scalability and Performance:
• Build and scale infrastructure to handle millions of API requests per second.
• Optimize AI inference performance on GPU-based systems.
• Implement robust monitoring and alerting to ensure system health and availability.
• Collaboration and Innovation:
• Collaborate closely with product management, business strategy, and other engineering teams.
• Influence the long-term vision and architectural decisions of the AI platform.
• Contribute to open-source AI frameworks and participate in the AI community.
• Prototype and iterate on new features and technologies.
  

What You’ll Bring to the Team:

• Strong Engineering Fundamentals:
• Advanced degree in Computer Science, Engineering, or a related field.
• Demonstrable experience in distributed systems design and implementation.
• Proven track record of delivering early-stage projects under tight deadlines.
• Expertise in using cloud-based services, such as, elastic compute, object storage, virtual private networks, managed database, etc.
• AI/ML Expertise:
• Experience in Generative AI (Large Language Models, Multimodal).
• Familiarity with AI infrastructure, including training, inference, and ETL pipelines.
• Software Engineering Skills:
• Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
• Experience using REST APIs and common communication protocols, such as gRPC.
• Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
• Preferred Qualifications:
• Proficiency in Golang or Python for large-scale, production-level services.
• Contributions to open-source AI projects such as VLLM or similar frameworks.
• Performance optimizations on GPU systems and inference frameworks.
• Personal Attributes:
• Proactive and collaborative approach with the ability to work autonomously.
• Strong communication and interpersonal skills.
• Passion for building cutting-edge AI products and solving challenging technical problems.
  

Benefits:

• Industry competitive pay
• Restricted Stock Units in a fast growing, well-funded technology company
• Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
• Employer contributions to HSA accounts
• Paid Parental Leave
• Paid life insurance, short-term and long-term disability
• Teladoc
• 401(k) with a 100% match up to 4% of salary
• Generous paid time off and holiday schedule
• Cell phone reimbursement
• Tuition reimbursement
• Subscription to the Calm app
• MetLife Legal
• Company paid Commuter FSA benefit of $200 per month
  
  

Compensation:

Compensation will be paid up to $250,000 a year + Bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicants knowledge, education, and abilities, as well as internal equity and alignment with market data.

Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at Crusoe by 2x

Sign in to set job alerts for “Staff Software Engineer” roles.

Software Engineer, AI Intern (Fall 2025)

Software Engineer, AI Intern (Summer 2025)

Mountain View, CA $125,400.00-$188,100.00 5 days ago

Software Engineer, AI Platform - New Grad

San Jose, CA $130,000.00-$180,000.00 6 days ago

Software Engineer I (Full Time) United States

San Jose, CA $98,600.00-$125,900.00 21 hours ago

New Grads 2025 - Software Engineer, Algorithm

San Jose, CA $120,000.00-$165,000.00 9 months ago

New Grads 2025 - General Software Engineer

San Jose, CA $120,000.00-$165,000.00 4 months ago

Software Engineer (L4), Content & Business Products

Full Stack Software Engineer - Post-training

Palo Alto, CA $180,000.00-$440,000.00 16 hours ago

Software Engineer(s) - New Grad (Fall 2025 Graduation)

Sunnyvale, CA $117,000.00-$234,000.00 6 days ago

San Jose, CA $142,400.00-$190,100.00 1 week ago

Software Engineer 4 - TV & Web Player Platform

Palo Alto, CA $140,000.00-$185,000.00 2 weeks ago

San Jose, CA $133,900.00-$242,000.00 2 weeks ago

Menlo Park, CA $56.25-$173,000.00 15 hours ago

San Jose, CA $113,400.00-$206,300.00 4 days ago

San Jose, CA $113,400.00-$206,300.00 1 week ago

San Jose, CA $113,400.00-$206,300.00 1 week ago

San Jose, CA $113,400.00-$206,300.00 1 week ago

Frontend Software Engineer - University Graduate 2025

San Mateo, CA $120,000.00-$280,000.00 5 days ago

San Jose, CA $100,500.00-$173,250.00 2 days ago

Software Engineer - Intern (Summer 2025)

San Jose, CA $3,000.00-$4,000.00 8 months ago

Santa Clara, CA $150,000.00-$175,000.00 7 months ago

Full Stack Software Engineer (L4), Product Localization Engineering

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.