Senior ML Engineer, AI Labs - Remote, LLM Inference

Netskope; Santa Clara (CA); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Family Medical Leave

Flexible Work Schedule

Remote Work Program

Dental Benefits

Disability Insurance

Flexible Spending Account (FSA)

Health Insurance Benefits

Life Insurance

Vision Benefits

Commuter Benefits

Company Outings

Stocked Kitchen

401(K)

Employee Stock Purchase Plan

Paid Holidays

Paid Sick Days

Job summary

Netskope in Santa Clara, California is seeking a high-caliber Machine Learning Engineer to enhance AI solutions for the Netskope Intelligent Security Service Edge platform.

You will work closely with senior architects to influence our SASE architecture and drive execution of AI/ML strategies, focusing on high performance and scalability. The role demands deep expertise in distributed systems and machine learning, with a strong background in software engineering.

The position offers a flexible work schedule and a remote work program among various benefits such as health and life insurance, paid holidays, and 401(K).

Qualifications

• 6+ years of experience in architecting and building high-performance distributed systems.
• 10+ years of overall software engineering and product development experience.
• 2+ years of experience in developing, optimizing, and deploying AI/ML solutions.

Responsibilities

• Design, optimize, and deploy enterprise-scale LLM serving infrastructures.
• Collaborate on driving execution of AI/ML technical strategies.
• Implement and scale strict 'Report Cards' for production models.

Skills

Machine Learning

Artificial Intelligence

Distributed Systems

High-Throughput Inference

Communication

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

vLLM

SGLang

TensorRT-LLM

Job description

Netskope in Santa Clara, California is seeking a high-caliber Machine Learning Engineer to enhance AI solutions for the Netskope Intelligent Security Service Edge platform.

You will work closely with senior architects to influence our SASE architecture and drive execution of AI/ML strategies, focusing on high performance and scalability. The role demands deep expertise in distributed systems and machine learning, with a strong background in software engineering.

The position offers a flexible work schedule and a remote work program among various benefits such as health and life insurance, paid holidays, and 401(K).