Field AI Inference Platform Engineer

FriendliAI Inc.

San Francisco (CA)

On-site

USD 140,000 - 190,000

Full time

2 days ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation and benefits

Daily lunch and dinner provided

Unlimited snacks and beverages

Health check-up and top-tier hardware

Flexible working hours

Job summary

FriendliAI Inc. is seeking a Forward Deployed Engineer to help enterprises deploy, scale, and operate generative AI workloads on our infrastructure.

You will work directly with customers to implement production-grade applications using our Serverless Endpoints, Dedicated Endpoints, or Container services. You will collaborate with customer engineering teams on AI inference challenges, including scaling, orchestration, and monitoring, in a hands-on, customer-embedded role.

Qualifications

3+ years in cloud infrastructure, DevOps, or reliability engineering.
Bachelor's or Master's in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
Proficiency with Kubernetes, Docker, Terraform, and Helm.
Strong foundation in distributed systems, networking, and performance tuning.

Responsibilities

Design and implement large-scale deployment architectures for LLM and multimodal inference.
Deploy and manage containerized workloads across Kubernetes clusters.
Diagnose production issues and implement temporary fixes as needed.
Collaborate with customers' DevOps teams to integrate FriendliAI's infrastructure into CI/CD workflows.
Develop scripts, Helm charts, and Terraform modules to simplify deployments.
Contribute field insights to platform reliability and scaling strategies.
Lead workshops and technical sessions to help customers master infrastructure best practices.