Senior Software Engineer, AI Model Lifecycle

Epoch Biodesign; San Francisco (CA); On-site; USD 166,000 - 201,000; Full time

Benefits offered by this job

Health insurance options

401(k) with 100% match

Generous paid time off

Tuition reimbursement

Cell phone reimbursement

Job summary

A leading technology firm in San Francisco seeks a Senior Software Engineer for the Model LifeCycle team. This role focuses on building a managed platform for application development, specifically leveraging Machine Learning models, including LLMs. Candidates should have 4-5 years of experience in the field and a Bachelor’s in Computer Science or Engineering. The position offers competitive compensation up to $201,000 and includes benefits like health insurance and stock options.

Qualifications

• 4-5+ years of industry experience leading initiatives.
• Familiarity with essential cloud-based services.
• Some experience with training and fine-tuning LLMs.

Responsibilities

• Implement and maintain end-to-end training pipelines for LLMs.
• Work closely with Senior Engineers to implement system abstractions.
• Engage with the open-source LLM ecosystem.

Skills

Experience delivering production-ready features

Proficiency in Golang or Python

Strong communication skills

Familiarity with Generative AI and LLMs

Proactive and collaborative approach

Education

Bachelor's degree in Computer Science or Engineering

Tools

PyTorch

Job description

Location

San Francisco, CA - US

Employment Type

Full time

Location Type

On-site

Department

Cloud Engineering

Crusoe's mission is to accelerate the abundance of energy and intelligence. We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, speed, or sustainability.

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure.

About this role

The Senior Software Engineer for the Model LifeCycle team will contribute to building a managed platform for the entire application development lifecycle, with a specific focus on leveraging Machine Learning models, including Large Language Models (LLMs).

What You Will Be Working On

• Implement and maintain systems for fine-tuning large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling.
• Implement and maintain end-to-end training pipelines for Large Language Models.
• Implement components for distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling).
• Develop and maintain core agent execution infrastructure.
• Implement features for dataset, model, and experiment management, focusing on versioning, lineage, evaluation, and reproducible fine-tuning.

Collaboration and Impact

• Work closely with Senior Engineers and Principal Engineers, as well as product and platform teams, to implement system abstractions and APIs.
• Contribute to technical discussions on training runtimes, scheduling, storage, and model lifecycle management.
• 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
• Engage with the open-source LLM ecosystem.
• This role involves significant implementation ownership for core system components.

What You’ll Bring to the Team

• Engineering Fundamentals
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Experience delivering production-ready features.
  • Familiarity with essential cloud-based services (e.g., compute, storage, networking).
• AI/ML Expertise
  • Familiarity with Generative AI (Large Language Models, Multimodal).
  • Experience with AI infrastructure components (training, inference).

Preferred Qualifications

• Proficiency in Golang or Python for production services.
• Familiarity with PyTorch.
• Some experience with training and fine-tuning LLMs.

Personal Attributes

• Proactive and collaborative approach.
• Strong communication and interpersonal skills.
• Passion for building AI products and solving technical problems.

Benefits

• Industry competitive pay
• Restricted Stock Units in a fast growing, well‑funded technology company
• Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
• Employer contributions to HSA accounts
• Paid Parental Leave
• Paid life insurance, short‑term and long‑term disability
• Teladoc
• 401(k) with a 100% match up to 4% of salary
• Generous paid time off and holiday schedule
• Cell phone reimbursement
• Tuition reimbursement
• Subscription to the Calm app
• MetLife Legal
• Company paid commuter benefit; $300/month

Compensation Range

Compensation will be paid in the range of up to $166,000 - $201,000 + Bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicants knowledge, education, and abilities, as well as internal equity and alignment with market data.

Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.