Staff Software Engineer, Inference

coreweaveu

Warszawa

On-site

PLN 369,000 - 542,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
Life Assurance at 4x Salary
Critical Illness Cover
Employee Assistance Programme
Tuition Reimbursement
Work culture focused on innovative dis
Benefits may vary by location.

Job summary

CoreWeave in Warsaw is seeking a high-impact Technical Lead to define cross-service architecture for the inference platform and drive low-latency, high-throughput workloads.

You will own performance optimizations, capacity planning, autoscaling, and post-incident reviews, while mentoring engineers and aligning product, orchestration, and hardware teams.

The role requires 8–12+ years in large distributed systems, strong Kubernetes, and Go/Python/C++ skills; a CS/Engineering degree is expected.

Qualifications

  • 8–12+ years of experience building large-scale distributed systems or cloud platforms
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field
  • Strong coding skills in Go, Python, or C++
  • Deep expertise in Kubernetes at production scale, including orchestration, scheduling, and service design
  • Experience leading cross-team technical initiatives at scale

Responsibilities

  • Define and drive multi-service, cross-team architecture for CoreWeave's inference platform.
  • Lead complex design initiatives spanning request routing, adaptive scheduling, GPU resource management, and cost-per-token optimization.
  • Set technical direction for low-latency, high-throughput inference systems operating under strict P99 SLAs.
  • Lead development of inference optimizations (micro-batching, dynamic scheduling, caching, memory optimization).
  • Own system-wide SLIs/SLOs and ensure reliability improvements across releases.
  • Mentor senior and mid-level engineers; lead cross-team design reviews and raise engineering standards.

Skills

Go
Python
C++
Distributed systems
Kubernetes

Education

Bachelors in CS/Engineering

Tools

Kubernetes
vLLM
Triton
TensorRT-LLM
Ray Serve
TorchServe

Job description

CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com . We’re proud to be a Living Wage accredited Employer.

What You'll Do

Technical Leadership & Architecture

Define and drive multi-service, cross-team architecture for CoreWeave's inference platform.

Lead complex design initiatives spanning request routing, adaptive scheduling, GPU resource management, and cost-per-token optimization.

Set technical direction for low-latency, high-throughput inference systems operating under strict P99 SLAs.

Performance & Optimization

Lead development of advanced inference optimizations, including:

  • micro-batching and dynamic scheduling
  • speculative decoding
  • KV-cache reuse and memory optimization

Drive measurable improvements in P95/P99 latency, throughput, and GPU utilization across the platform.

Establish performance benchmarking frameworks and guide teams in data-driven optimization strategies.

Reliability & Systems Excellence

Own system-wide SLIs/SLOs and ensure reliability improvements across releases.

Lead efforts in capacity planning, autoscaling strategies, traffic management, and failure mitigation.

Drive post-incident analysis and ensure systemic improvements across teams.

Cross-Team Influence

Partner with Product, Orchestration, Networking, Storage, and Hardware teams to deliver a cohesive inference platform.

Influence technical decisions across org boundaries and ensure alignment on architecture, performance, and scalability goals.

Serve as a go-to technical expert for inference systems and distributed AI workloads.

Mentorship & Engineering Excellence

Mentor senior and mid-level engineers; elevate design, coding, and operational standards across teams.

Lead cross-team design reviews and ensure high-quality system thinking at scale.

Raise the bar for engineering rigor, testing, and observability practices.

What We're Looking For
  • ~8-12+ years of experience building large-scale distributed systems or cloud platforms
  • Proven track record of leading cross-team technical initiatives at scale
  • Strong coding skills in Go, Python, or C++
  • Deep expertise in Kubernetes at production scale, including orchestration, scheduling, and service design
  • Strong understanding of networked systems, performance optimization, and system design
  • Bachelor's degree in Computer Science, Engineering, or a related technical field
Inference & Performance Expertise
  • Hands-on experience with inference systems, including:
    • batching and micro-batching strategies
    • caching and memory optimization
    • mixed precision (BF16/FP8)
    • streaming token delivery
  • Demonstrated ability to improve tail latency (P95/P99) and system reliability through metrics-driven engineering
Nice to Have
  • Contributions to inference frameworks such as vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe
  • Experience with GPU systems and performance optimization (CUDA, NCCL, RDMA, NUMA, GPU interconnects)
  • Experience leading multi-team or org-level initiatives
  • Exposure to large-scale AI/ML infrastructure or hyperscale cloud environments
Salary and Rewards

The base salary range for this role is 369,000 to 542,300 PLN. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

To fulfill our obligation to protect client data, successful applicants offered employment with CoreWeave will be required to complete a basic criminal record check, conducted in compliance with GDPR. Employment offers are conditional upon receiving satisfactory check results.

What We Offer
  • Family-level Medical Insurance
  • Family-level Dental Insurance
  • Generous Pension Contribution
  • Life Assurance at 4x Salary
  • Critical Illness Cover
  • Employee Assistance Programme
  • Tuition Reimbursement
  • Work culture focused on innovative disruption

Benefits may vary by location.

Equal Opportunity

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Software Engineer, Inference
Sr. Software Engineer, Inference

coreweaveu • Warszawa

On-site
PLN 321,000 - 471,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+5
Staff Software Engineer, Inference
Staff Software Engineer, Inference

Coreweave • Warszawa

On-site
PLN 260,000 - 480,000
Medical Insurance
Dental Insurance
Pension
+4
Sr. Software Engineer, Inference
Sr. Software Engineer, Inference

Coreweave • Województwo mazowieckie

On-site
PLN 240,000 - 360,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+3
Staff Software Engineer, Cluster Orch (Non SUNK)
Staff Software Engineer, Cluster Orch (Non SUNK)

coreweaveu • Warszawa

On-site
PLN 369,000 - 542,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+6
Staff Software Engineer, Cluster Orch (SUNK)
Staff Software Engineer, Cluster Orch (SUNK)

coreweaveu • Warszawa

On-site
PLN 369,000 - 542,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+5
Senior Production Engineer
Senior Production Engineer

coreweaveu • Warszawa

On-site
PLN 320,000 - 600,000
Equity awards
Discretionary bonus
Benefits program
Senior Engineer, AI Object Storage
Senior Engineer, AI Object Storage

coreweaveu • Warszawa

On-site
PLN 262,000 - 350,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+5
Senior Software Engineer, Observability
Senior Software Engineer, Observability

coreweaveu • Warszawa

On-site
PLN 321,000 - 428,000
Living Wage employer
Competitive salary
Comprehensive benefits
Senior Site Reliability Engineer, Infrastructure Engineering
Senior Site Reliability Engineer, Infrastructure Engineering

Coreweave • Warszawa

On-site
PLN 262,000 - 350,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+6
Staff Software Engineer, Observability
Staff Software Engineer, Observability

Coreweave • Województwo mazowieckie

On-site
PLN 320,000 - 520,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+5
Top locations