AI Inference Engineer

Perplexity AI; London; On-site; USD 190,000 - 240,000; Full time

Job summary

Join a forward-thinking company as an AI Inference Engineer, where you'll develop APIs for AI inference and optimize large-scale machine learning models. This role offers the chance to work with cutting-edge technologies like Python, C++, and TensorRT-LLM while contributing to a rapidly growing AI-powered search assistant with millions of users. You'll be part of a dynamic team focused on enhancing system reliability and performance, making impactful contributions to real-time inference solutions. If you're passionate about AI and eager to drive innovation, this opportunity is perfect for you.

Benefits

Comprehensive health insurance

Dental insurance

Vision insurance

401(k) plan

Equity compensation

Qualifications

• Experience with ML systems and deep learning frameworks.
• Familiarity with LLM architectures and optimization techniques.

Responsibilities

• Develop APIs for AI inference used by customers.
• Benchmark and address bottlenecks in our inference stack.

Skills

Python

C++

TensorRT-LLM

Kubernetes

PyTorch

TensorFlow

ONNX

CUDA

Job description

We are looking for an AI Inference Engineer to join our growing team.

Our current stack includes Python, C++, TensorRT-LLM, and Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

1. Develop APIs for AI inference used by internal and external customers.
2. Benchmark and address bottlenecks in our inference stack.
3. Improve system reliability and observability; respond to outages.
4. Explore research and implement optimizations for LLM inference.

Qualifications

1. Experience with ML systems and deep learning frameworks (e.g., PyTorch, TensorFlow, ONNX).
2. Familiarity with LLM architectures and inference optimization techniques (e.g., batching, quantization).
3. Experience deploying reliable, distributed, real-time model serving at scale.
4. (Optional) Understanding of GPU architectures or experience with CUDA kernel programming.

The cash compensation range for this role is $190,000 - $240,000.

About Perplexity

Since launching the world's first fully functional conversational answer engine over a year ago, we've experienced tremendous growth. Our AI-powered search assistant has 10 million monthly active users as of early 2024, with over 1 million app installations across iOS and Android. In 2023, we served over 500 million queries globally.

We have raised significant funding, including a $73.6 million Series B in January 2024 led by IVP with participation from NVIDIA, Jeff Bezos' fund, NEA, Databricks, and others. We also completed a $62.7 million Series B1 in April 2024, valuing Perplexity at over $1 billion.

Our investor base includes IVP, NEA, NVIDIA, Jeff Bezos, Databricks, Bessemer Venture Partners, and prominent individuals like Elad Gil, Nat Friedman, Naval Ravikant, and Tobi Lutke.

Additional Information

Final offer amounts depend on experience and expertise and may vary from listed ranges.

Compensation includes base salary and equity.

Benefits include comprehensive health, dental, and vision insurance, and a 401(k) plan.