ML Infra Engineer — Scalable GPU & Model Serving (Remote)

Quora; United States; Remote; USD 54,000 - 78,000; Full time

Job summary

Quora seeks a student or graduate to help build and maintain the core infrastructure powering Quora's ML platform. You will work on distributed systems that serve ML models in production, from LRMs to LLMs, and optimize GPU model serving for latency, throughput, and cost.

Ideal candidates are 2025 or 2026 graduates pursuing or holding a B.S., M.S., or Ph.D. in CS, Engineering, or related fields, with a genuine interest in distributed systems and ML.

Qualifications

• Genuine interest in large-scale distributed systems, infrastructure, and machine learning.
• Previous software engineering experience via an internship, work experience, open-source contribution, or coding competition.
• Coursework or hands-on experience with ML frameworks such as PyTorch or TensorFlow.
• Exposure to Kubernetes, Docker, or cloud technologies like AWS.

Skills

Distributed systems

Infrastructure

Machine learning

Internship experience

Open-source contributions

Coding competitions

Education

B.S./M.S./Ph.D. in CS/Engineering

Tools

PyTorch

TensorFlow

Kubernetes

Docker

AWS

Job description

Quora seeks a student or graduate to help build and maintain the core infrastructure powering Quora's ML platform. You will work on distributed systems that serve ML models in production, from LRMs to LLMs, and optimize GPU model serving for latency, throughput, and cost.

Ideal candidates are 2025 or 2026 graduates pursuing or holding a B.S., M.S., or Ph.D. in CS, Engineering, or related fields, with a genuine interest in distributed systems and ML.