Cloud-Scale AI Inference Architect

FriendliAI; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive compensation and benefits package

Daily lunch and dinner

Unlimited snacks and beverages

Health check-up

Flexible working hours

Job summary

FriendliAI is looking for a Solution Architect in San Francisco to enable enterprises to implement AI workloads effectively. The role involves designing large-scale deployment architectures, solving AI inference challenges, and collaborating closely with customers' DevOps teams. Ideal candidates will have 3+ years in cloud infrastructure or DevOps, strong skills in Kubernetes, Docker, Terraform, and a solid understanding of distributed systems. Benefits include competitive compensation, flexible hours, and daily meals.

Qualifications

• 3+ years of experience in cloud infrastructure, DevOps, or reliability engineering.
• Strong foundation in distributed systems, networking, and performance tuning.
• Experience with GPU-based computing and generative AI model serving workloads.

Responsibilities

• Design and implement large-scale deployment architectures for LLM and multimodal inference.
• Deploy and manage containerized workloads across Kubernetes clusters.
• Collaborate with customers' DevOps teams to integrate FriendliAI’s infrastructure into their CI/CD workflows.
• Lead workshops and technical sessions for customers.

Skills

cloud infrastructure

DevOps

reliability engineering

Kubernetes

Docker

Terraform

Helm

distributed systems

problem-solving

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Kubernetes

Docker

Terraform

Helm

Job description

FriendliAI is looking for a Solution Architect in San Francisco to enable enterprises to implement AI workloads effectively. The role involves designing large-scale deployment architectures, solving AI inference challenges, and collaborating closely with customers' DevOps teams. Ideal candidates will have 3+ years in cloud infrastructure or DevOps, strong skills in Kubernetes, Docker, Terraform, and a solid understanding of distributed systems. Benefits include competitive compensation, flexible hours, and daily meals.