AI Inference Engineer — Real-Time ML on Scalable GPU

Perplexity; New York (NY); On-site; USD 190,000 - 250,000; Full time

Benefits offered by this job

Comprehensive health, dental, and vision insurance

401(k) plan

Equity may be part of total compensation

Job summary

Join a leading AI platform as an AI Inference Engineer, working on real-time inference deployment of ML models. The role provides opportunities to enhance your skills in Python, Rust, and optimization techniques, while being part of a rapidly growing company with robust venture backing.

Qualifications

• Experience with ML systems and frameworks like PyTorch and TensorFlow.
• Familiarity with LLM architectures and inference optimization techniques.
• Understanding of GPU architectures and CUDA programming.

Responsibilities

• Develop APIs for AI inference used by customers.
• Benchmark and address bottlenecks in the inference stack.
• Improve system reliability and respond to outages.

Skills

ML systems

deep learning frameworks

GPU architectures

Job description

Get notified about new Vice President Retail Banking jobs in United States.

7,000+ Vice President Retail Banking Jobs in United States

Vice President of Retail Sales, Strategy & Service

Vice President, Branch Administration PNW

Vice President, Banking Compliance (HMDA Officer, CRA Officer)

Chase Card SMB Acquisitions - Credit Strategy - Vice President

VP - Digital Sales & Service (Three or more days onsite required)

Vice President, Banking Compliance (HMDA Officer, CRA Officer)

VP - Cards & Operational Support Services

Regional Vice President / Branches - South Sound

Vice President - Business Services (Commercial Banking)

Vice President, Software Engineering and Data Intelligence

Credit Strategy - Chase Auto - Vice President