Staff Software Architect, Compute & GPU Infrastructure

CoreWeave; New York (NY); On-site; Full time

Job description

Requirements

• B.S., M.S., or PhD in Computer Science or related field, or equivalent experience
,
• 8+ years of software engineering experience with a strong focus on infrastructure, cloud engineering, and distributed databases—particularly within large-scale datacenter and cloud environments
,
• Expertise in Go and proven experience building REST/gRPC APIs for mission-critical platforms
,
• Strong background in architecting and scaling cloud-native Kubernetes infrastructure and distributed services
,
• Proven success in mentoring engineers, leading technical projects, and influencing engineering strategy across teams
,
• Experience contributing to and collaborating with open source communities
,
• Skilled in applying a data-driven approach to reliability, optimization, and continuous improvement
,
• Excellent communicator able to work effectively with both technical and non-technical stakeholders
,
• Hands-on experience with observability stacks (Prometheus, Grafana, PromQL), CI/CD pipelines, and operating large fleets of GPU servers
,
• Track record of leading incident response, postmortems, and driving robust service reliability
,
• (Desirable) Working knowledge of Kafka, ClickHouse and CRDB
,
• (Desirable) DMTF, RedFish APIs, and GPU servers

What the job involves

• As a Staff Software Engineer within our Compute Architecture Org, you’ll shape the backbone of our GPU-driven data centers—powering some of the most advanced workloads in AI and large-scale computing
,
• This isn’t just about keeping the lights on; it’s about architecting the next generation of reliable, secure, and massively scalable infrastructure
,
• The METALDEV team builds and operates a suite of Go-based services that power large-scale datacenter deployments
,
• These platforms automate complex workflows while providing deep observability and monitoring for tens of thousands of GPU servers and diverse infrastructure components—including CDUs, PDUs, and NVLink switches
,
• Our tooling is designed for next-generation rack systems like NVIDIA GB200 and GB300, as well as a broad range of GPU server platforms
,
• Provide technical leadership in designing, architecting, and operating large-scale infrastructure services for GPU servers, with a focus on security, reliability, and scalability
,
• Build and enhance infrastructure services and automation, including inventory management systems and lifecycle management solutions using open source technologies
,
• Drive strategic direction for infrastructure automation, lifecycle management, and service orchestration, making MetalDev core services more scalable and resilient
,
• Define best practices for API development (REST/gRPC), distributed databases, and Kubernetes orchestration—while mentoring engineers to follow your lead
,
• Partner with hardware, software, and operations teams to align infrastructure with business impact
,
• Contribute to open source communities (e.g., Go, Redfish) through collaboration and technical thought leadership
,
• Lead and improve CI/CD pipelines for hardware compliance, firmware management, and data systems
,
• Champion reliability and operational excellence by driving observability (Prometheus/Grafana), production incident response, and continuous service improvement