Senior Software Engineer, Server Fleet Infrastructure

CoreWeave; Sunnyvale (CA); Hybrid; USD 139,000 - 242,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with employer match

Flexible PTO

Catered lunch

Tuition reimbursement

Job summary

A leading cloud infrastructure provider in Sunnyvale, CA, seeks a Senior Software Engineer focused on server fleet infrastructure. This role involves designing scalable solutions, building backend services, and automating infrastructure management in a dynamic environment. Ideal candidates will have extensive experience in Go, Python, and Kubernetes, along with strong problem-solving skills. The position offers competitive pay and robust benefits including medical insurance, stock options, and flexible PTO.

Qualifications

• 5+ years of experience in software or infrastructure engineering.
• Proficiency in Go and/or Python software development.
• Familiarity with CI/CD tools like Argo, Flux, and GitHub Actions.
• Strong understanding of Linux internals.

Responsibilities

• Design and implement solutions to problems of scale for multi-site deployment.
• Build and maintain backend services and APIs (gRPC/REST) in Go or Python.
• Develop provisioning services and automation workflows.
• Write Kubernetes custom controllers and operators.
• Design and implement observability solutions for large-scale monitoring.

Skills

Software Engineering

Infrastructure Automation

CI/CD

Observability

Go

Python

Linux Internals

Tools

Ansible

Kubernetes

gRPC

Job description

Senior Software Engineer, Server Fleet Infrastructure

Join to apply for the Senior Software Engineer, Server Fleet Infrastructure role at CoreWeave

Senior Software Engineer, Server Fleet Infrastructure

Join to apply for the Senior Software Engineer, Server Fleet Infrastructure role at CoreWeave

Get AI-powered advice on this job and more exclusive features.

CoreWeave is the AI Hyperscaler, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies of 2024.

As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you’re someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, CoreWeave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry.

CoreWeave powers the creation and delivery of the intelligence that drives innovation.

At CoreWeave, we don’t box people into rigid job titles—we look for exceptional engineers and match them to the work that excites them most. Instead of measuring you against a narrow checklist of qualifications, we hire based on broad technical domains and use our interview process to determine where you’ll have the biggest impact.

Tell us what interests you most, and throughout the hiring process, we’ll get a sense of your strengths, expertise, and aspirations. If you join CoreWeave, you’ll land on the team where you can do your best work—driving innovation, solving complex problems, and shaping the future of cloud computing.

About This Domain

At CoreWeave, infrastructure isn’t just a foundation, it’s a product. We build scalable, high-performance computing systems that power the largest AI workloads in the world. We’re looking for Engineers that thrive at the intersection of software and systems, deploying and managing large scale bare metal compute.

Within this domain, you’ll design and build software that manages complex infrastructure across globally distributed datacenters. Working in Go, Python/Ansible, deep in Linux environments, observability/monitoring stacks, and leveraging technologies like gRPC and Kubernetes CRs/Controllers/Operators. Whether you’re automating bare metal, building fleet lifecycle management services, solving multi-layer integration challenges, or observing our globally distributed fleet, your work will be critical to the company's delivery of reliable and efficient infrastructure.

You’ll join a high-performing, communicative, and supportive team, solving complex problems at hyperscale, deploying purpose built AI across the world.

What You’ll Do

• Design and implement solutions to problems of scale for multi-site deployment and management of CoreWeave’s global server hardware fleet.
• Build and maintain backend services and APIs (gRPC/REST) in Go or Python to interact with Kubernetes and other infrastructure systems.
• Develop provisioning services, automation workflows, and fleet management tools that span from bare metal to container orchestration.
• Write and maintain Kubernetes custom controllers and operators to automate infrastructure behavior.
• Design and implement observability solutions for large-scale server monitoring to improve system stability and insight.
• Adapt and extend open source tooling to enhance visibility into system metrics, performance, and health.
• Create test plans, deployment automation, dashboards, alerts, and insights into our fleet operations.
• Resolve integration challenges across the entire infrastructure stack, from data center hardware to orchestration platforms.
• Participate in an on-call rotation.
  
  

Investing in our people is one of our top priorities, and we value candidates who can bring their diversified experiences to our teams. Here are some qualities we’ve found compatible with our team. We'd love to talk about whether this aligns with your experience and interests and what you’re excited to work on next.

Who You Are

Minimum Qualifications

• 5+ years of experience in software or infrastructure engineering.
• Proficiency in Go and/or Python software development.
• Familiarity with CI/CD tools like Argo, Flux, and GitHub Actions.
• Strong understanding of Linux internals.
  
  

Preferred Qualifications

• Experience designing, implementing, and monitoring Kubernetes operators for custom resource definitions.
• Experience with infrastructure automation and configuration management tools like Ansible, Puppet, Chef, Salt.
• Experience with distributed cloud computing principles, including testing strategies, observability, error budgets, and fault-tolerant design.
• Experience implementing metrics pipelines, custom alerts, and monitoring strategies.
• Ability to break down complex problems into achievable tasks and collaborate with teammates to execute them.
• Willingness and ability to thrive in a fast-paced startup environment.
  
  

Examples of teams you might join at CoreWeave

Fleet Provisioning Automation: Automation is key to delivering reliable GPU compute to clients. On this team you’ll write Go microservices and extend Kubernetes custom resources and operators to deliver and monitor cutting-edge computing platforms. Ensuring new compute hardware is ready to deploy, and monitor existing hardware across our growing datacenter footprint.

Fleet Management Tools: Regular testing is critical to keeping our server hardware fleet running at peak performance. On this team you will write and maintain the infrastructure for testing and maintaining CoreWeave’s fleet. We engineer solutions to problems at scale using a variety of technologies ranging from Ansible to custom Kubernetes controllers written in Go.

Fleet Monitoring & Analysis: Our customers's AI workloads push our physical infrastructure to the limit. This team is solving our fleet monitoring, visibility and self-healing problems at scale. We develop, collect and correlate metrics to engineer observability solutions, utilizing technologies like Go, Prometheus, Grafana, and Kubernetes.

The base pay and target total cash for this position range from $139,000 to $242,000 and $160,000 to $278,000, accordingly. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. This position includes a discretionary bonus, equity, and a comprehensive benefits package.

What We Offer

The range we’ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs, including:

• Medical, dental, and vision insurance - 100% paid for by CoreWeave
• Company-paid Life Insurance
• Voluntary supplemental life insurance
• Short and long-term disability insurance
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement
• Ability to Participate in Employee Stock Purchase Program (ESPP)
• Mental Wellness Benefits through Spring Health
• Family-Forming support provided by Carrot
• Paid Parental Leave
• Flexible, full-service childcare support with Kinside
• 401(k) with a generous employer match
• Flexible PTO
• Catered lunch each day in our office and data center locations
• A casual work environment
• A work culture focused on innovative disruption
  
  

Our Workplace

While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration

California Consumer Privacy Act - California applicants only

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: [e-mail].

Export Control Compliance

This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C.

• 1157, or (iv) asylee under 8 U.S.C.
• 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at CoreWeave by 2x

Get notified about new Senior Software Engineer jobs in Sunnyvale, CA.

Sunnyvale, CA $143,000.00-$286,000.00 6 days ago

San Mateo, CA $90,000.00-$150,000.00 1 year ago

Senior Developer Events Manager, Google Cloud

Sunnyvale, CA $165,000.00-$245,000.00 6 days ago

Tech Lead Software Engineer, TikTok Customer Service Platform

San Jose, CA $224,000.00-$410,000.00 4 days ago

Tech Lead Software Engineer, TikTok AI Video Editing

San Jose, CA $224,000.00-$410,000.00 4 days ago

San Francisco Bay Area $215,000.00-$295,000.00 2 weeks ago

Mountain View, CA $134,000.00-$241,900.00 5 days ago

Sr. Software Engineer, Supply Chain Applications

Senior Software Development Engineer, Virtual Network

San Jose, CA $194,000.00-$410,000.00 3 weeks ago

Senior Software Quality Assurance Engineer

San Jose, CA $131,000.00-$241,400.00 1 week ago

Senior Supply Chain Application Developer - Kinaxis

Software Engineering Technical Leader (Control Plane) --Cisco Hypershield

San Jose, CA $163,900.00-$305,100.00 5 days ago

Senior System Software Engineer, Power and Thermal Management

Mountain View, CA $204,000.00-$259,000.00 2 weeks ago

Santa Clara, CA $163,008.00-$254,700.00 1 day ago

Senior Controls Engineer, Core Development

Mountain View, CA $183,825.00-$275,975.00 1 day ago

Sr. Software Engineer, Plant Modeling and Tools

Redwood City, CA $96,800.00-$251,600.00 2 weeks ago

Fremont, CA $180,000.00-$238,000.00 12 hours ago

San Jose, CA $163,360.00-$245,040.00 1 day ago

Senior Developer Relations Manager, CSP Hyperscale

Senior Software Engineer, Product Foundations

San Francisco Bay Area $155,000.00-$215,000.00 2 weeks ago

Sunnyvale, CA $248,000.00-$349,000.00 6 days ago

Software Engineering Technical Leader (Hybrid Remote- San Jose, CA)

San Jose, CA $198,600.00-$282,900.00 1 week ago

Senior Developer Relations Manager, CSP Hyperscale

San Jose, CA $224,000.00-$425,500.00 1 week ago

San Mateo, CA $448,990.00-$515,210.00 2 weeks ago

Manager, Software Quality Engineering in Test

San Mateo, CA $195,500.00-$293,300.00 2 months ago

Senior Software Engineer, Database Infra

Redwood City, CA $187,000.00-$233,500.00 3 weeks ago

Redwood City, CA $140,000.00-$198,000.00 2 weeks ago

Sr. Software Engineer, HIL Automation, Autonomy

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.