Senior AI Inference Systems Engineer - Edge & HPC

Fdetimes; Austin, New York, San Francisco (TX, NY, CA); Híbrido; USD 180.000 - 260.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical/Rx Insurance

Dental Insurance

Vision Insurance

401(k) Retirement Savings Plan

Employee Stock Participation Plan

Flexible PTO

Descripción de la vacante

Cloudflare is building an AI inference platform embedded in the fabric of the internet. You will design and implement core infrastructure powering real-time AI inference across Cloudflare’s global network, working with AI/ML engineers, hardware partners and product teams.

The role emphasizes solving foundational infrastructure problems and scalable edge deployment. Ideal candidates have strong experience in distributed systems, Rust, and performance optimization, with exposure to container

Formación

• Experience in systems engineering focusing on distributed, high-performance systems.
• Proficiency in Rust, especially in asynchronous environments.
• Hands-on experience with networking protocols (TCP, HTTP, WebSocket).
• Strong background in scaling, load balancing, and caching in distributed setups.

Responsabilidades

• Platform Architecture: develop and maintain core components of the serverless inference platform for high availability and scalability.
• Optimization & Performance: improve model scheduling and routing to reduce latency.
• System Reliability: drive measurable reliability improvements and mitigate systemic risks.
• Observability: expand metrics, logs, traces and refine alerts.
• Technical Leadership: lead cross-functional technical projects from concept to deployment.
• Mentorship: mentor junior engineers and foster a collaborative culture.

Conocimientos

Rust (async)

Distributed systems

Networking protocols

Herramientas

Kubernetes

Nomad

Descripción del empleo

Cloudflare is building an AI inference platform embedded in the fabric of the internet. You will design and implement core infrastructure powering real-time AI inference across Cloudflare’s global network, working with AI/ML engineers, hardware partners and product teams.

The role emphasizes solving foundational infrastructure problems and scalable edge deployment. Ideal candidates have strong experience in distributed systems, Rust, and performance optimization, with exposure to container