Staff AI Infra Engineer: Lead Distributed Systems

Coupang; Mountain View (CA); On-site; USD 152,000 - 282,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life

401K Plan with Company Match

PTO 18-21 days/year

Paid Holidays

Paid Parental leave

FSA / HSA

EV charging station

Job summary

Coupang in Mountain View, CA is seeking a Staff Software Engineer to lead the design and evolution of large-scale distributed systems powering the AI lifecycle. You will own critical platform initiatives, shaping architecture and mentoring engineers across teams.

You will build scalable resource managers, developer tools, and observability solutions, collaborating with product owners, TPMs, and compliance to deliver secure, high-performance ML workflows.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 8 years of professional software development experience, or 6 years with an advanced degree.
• Experience designing, building, and operating large-scale distributed systems in cloud environments.
• Proficiency in Java, Go, or Python.
• Experience with AWS, Azure, or GCP and cloud-native development practices.

Responsibilities

• Design and implement the development of a next-generation Resource Manager and AI developer tools, enabling efficient, secure, and policy-compliant data access across hybrid environments.
• Lead the design of scalable, event-driven microservices for optimized resource management.
• Build and enhance developer tools that improve workflow orchestration, model management, observability, and operational efficiency.
• Mentor junior engineers and contribute to architectural decisions that shape the future of AI infrastructure.
• Collaborate with Product owner, TPMs, and Compliance teams to define end-to-end ML model development lifecycle experiences.
• Drive operational excellence by improving system reliability, performance, monitoring, and incident management practices.
• Take end-to-end ownership of critical platform initiatives from design through operation and continuous improvement.

Skills

Distributed systems

Java

Go

Python

Cloud platforms

System design

Leadership

Education

Bachelor’s degree in Computer Science or related field

Tools

Kubernetes

Docker

gRPC

Spring

Hibernate

REST APIs

Prometheus

Grafana

ELK

Kafka

Cassandra

ClickHouse

MongoDB

Job description

Coupang in Mountain View, CA is seeking a Staff Software Engineer to lead the design and evolution of large-scale distributed systems powering the AI lifecycle. You will own critical platform initiatives, shaping architecture and mentoring engineers across teams.

You will build scalable resource managers, developer tools, and observability solutions, collaborating with product owners, TPMs, and compliance to deliver secure, high-performance ML workflows.