Customer-Facing AI Deployment Engineer

Linuxconfig; San Mateo, Northern (CA, KY); Hybrid; USD 120,000 - 190,000; Full time

Job summary

Novita AI is seeking a Forward Deployed Engineer to work directly with customers on demanding AI workloads. You will own technical relationships from evaluation to production, understand architectures, deploy model APIs, and debug complex systems.

You will collaborate with engineers across the US and Asia to deliver reusable tooling and scalable integrations. The role emphasizes solving customer problems, driving production workloads, and aligning product needs with customer success.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field.
• Strong software engineering fundamentals.
• Proficiency in Python and experience with at least one additional programming language.
• Strong understanding of APIs, Linux, networking, and cloud-native applications.
• Experience debugging complex technical systems.
• Strong written and verbal communication skills.
• Comfortable working directly with customers.
• High ownership and ability to operate in ambiguous environments.
• Ability to move quickly between engineering, product, and customer problems.

Responsibilities

• Own the technical relationship with customers from evaluation through production.
• Understand customer architectures, workloads, and engineering requirements.
• Deploy and integrate: Model APIs and inference endpoints; Dedicated model serving; Agent Sandbox environments.
• Debug issues across APIs, containers, Linux, networking, model serving, and distributed systems.
• Analyze inference performance including latency, throughput, concurrency, caching, and reliability.
• Build customer‑specific integrations, prototypes, tools, and automation.
• Support PoCs and help customers transition into production.
• Work closely with Technical Account Executives on capacity planning, quotas, pricing considerations, and workload expansion.
• Identify opportunities where customers can expand their usage of Novita.
• Translate recurring customer problems into product requirements.
• Build reusable tooling and reference implementations that improve the experience for future customers.
• Work closely with engineering teams across the US and Asia.

Skills

Strong software engineering

Python proficient

APIs & Linux knowledge

Debugging complex systems

Customer communication

Ownership in ambiguity

Cross-functional collaboration

Rapid engineering-to-product mindset

Education

Bachelor’s or Master’s in CS/CE or related

Tools

Docker

Kubernetes

Ray

Job description

Novita AI is seeking a Forward Deployed Engineer to work directly with customers on demanding AI workloads. You will own technical relationships from evaluation to production, understand architectures, deploy model APIs, and debug complex systems.

You will collaborate with engineers across the US and Asia to deliver reusable tooling and scalable integrations. The role emphasizes solving customer problems, driving production workloads, and aligning product needs with customer success.