Senior AI Inference Platform Engineer

CoreWeave; Warszawa; On-site; PLN 321,000 - 428,000; Full time

Benefits offered by this job

Family-level Medical Insurance

Family-level Dental Insurance

Generous Pension Contribution

Life Assurance at 4x Salary

Tuition Reimbursement

Work culture focused on innovation

Job summary

CoreWeave is hiring a Senior Software Engineer, Inference, to own architectural designs and drive improvements across a Kubernetes-native inference platform. You will partner with product, orchestration, and hardware teams to deliver scalable, low-latency services with strong SLIs/SLOs.

You will mentor engineers, oversee critical components like routing and caching, and implement optimizations such as micro-batch schedulers and KV-cache reuse.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field (or equivalent practical experience).
• 3+ years of professional industry experience building distributed systems or high‑performance cloud services.
• Strong software development skills in Python or Go, with deep familiarity with networked systems and performance optimization.
• Hands‑on experience with Kubernetes at production scale, including CI/CD and observability stacks (Prometheus, Grafana, OpenTelemetry).
• Experience defining and owning SLIs/SLOs, capacity planning, autoscaling policies, and post‑incident remediation.

Responsibilities

• Lead technical designs and raise engineering standards across multiple services.
• Collaborate with product, orchestration, and hardware teams to evolve a Kubernetes‑native inference platform.
• Own critical infrastructure areas such as routing, scheduling, and capacity planning, with measurable improvements.
• Mentor engineers and drive best practices for performance, reliability, and monitoring.

Skills

Python

Go

Kubernetes

CI/CD

Prometheus

Grafana

OpenTelemetry

Education

Bachelor/Master in CS

Tools

CUDA kernels

NCCL/SHARP

RDMA/NUMA

GPU interconnect

Job description

CoreWeave is hiring a Senior Software Engineer, Inference, to own architectural designs and drive improvements across a Kubernetes-native inference platform. You will partner with product, orchestration, and hardware teams to deliver scalable, low-latency services with strong SLIs/SLOs.

You will mentor engineers, oversee critical components like routing and caching, and implement optimizations such as micro-batch schedulers and KV-cache reuse.