Customer-Facing AI Deployment Engineer

Novita AI; San Mateo (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Novita AI is seeking a Forward Deployed Engineer to work directly with customers building demanding AI applications. You will traverse software engineering, infrastructure, product, and customer success to solve real workloads that reach production.

You will diagnose latency, scale sandbox environments, and craft integrations that become reusable capabilities for future customers, collaborating with teams across the US and Asia.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field.
• Strong software engineering fundamentals.
• Proficiency in Python and experience with at least one additional programming language.
• Strong understanding of APIs, Linux, networking, and cloud-native applications.
• Experience debugging complex technical systems.
• Strong written and verbal communication skills.
• Comfortable working directly with customers.
• High ownership and ability to operate in ambiguous environments.
• Ability to move quickly between engineering, product, and customer problems.

Responsibilities

• Own the technical relationship with customers from evaluation through production.
• Understand customer architectures, workloads, and engineering requirements.
• Deploy and integrate across APIs, containers, Linux, networking, model serving, and distributed systems.
• Debug issues across APIs, containers, Linux, networking, model serving, and distributed systems.
• Analyze inference performance including latency, throughput, concurrency, caching, and reliability.
• Build customer-specific integrations, prototypes, tools, and automation.
• Support PoCs and help customers transition into production.
• Work closely with Technical Account Executives on capacity planning, quotas, pricing considerations, and workload expansion.
• Identify opportunities where customers can expand their usage of Novita.
• Translate recurring customer problems into product requirements.
• Build reusable tooling and reference implementations that improve the experience for future customers.
• Work closely with engineering teams across the US and Asia.

Skills

Software engineering fundamentals

Python

Additional language

APIs

Linux

Networking

Cloud-native apps

Debugging complex systems

Communication skills

Customer-facing

Ownership

Ambiguity handling

Cross-functional work

Rapid problem solving

Education

Bachelor’s or Master’s degree in Computer Science/Engineering

Tools

Docker

Kubernetes

Ray

Distributed serving frameworks

vLLM

SGLang

Job description

Novita AI is seeking a Forward Deployed Engineer to work directly with customers building demanding AI applications. You will traverse software engineering, infrastructure, product, and customer success to solve real workloads that reach production.

You will diagnose latency, scale sandbox environments, and craft integrations that become reusable capabilities for future customers, collaborating with teams across the US and Asia.