Machine Learning Engineer (AI Labs)

Netskope; Santa Clara (CA); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Family Medical Leave

Flexible Work Schedule

Remote Work Program

Dental Benefits

Disability Insurance

Flexible Spending Account (FSA)

Health Insurance Benefits

Life Insurance

Vision Benefits

Commuter Benefits

Company Outings

Stocked Kitchen

401(K)

Employee Stock Purchase Plan

Paid Holidays

Paid Sick Days

Job summary

Netskope in Santa Clara, California is seeking a high-caliber Machine Learning Engineer to enhance AI solutions for the Netskope Intelligent Security Service Edge platform.

You will work closely with senior architects to influence our SASE architecture and drive execution of AI/ML strategies, focusing on high performance and scalability. The role demands deep expertise in distributed systems and machine learning, with a strong background in software engineering.

The position offers a flexible work schedule and a remote work program among various benefits such as health and life insurance, paid holidays, and 401(K).

Qualifications

• 6+ years of experience in architecting and building high-performance distributed systems.
• 10+ years of overall software engineering and product development experience.
• 2+ years of experience in developing, optimizing, and deploying AI/ML solutions.

Responsibilities

• Design, optimize, and deploy enterprise-scale LLM serving infrastructures.
• Collaborate on driving execution of AI/ML technical strategies.
• Implement and scale strict 'Report Cards' for production models.

Skills

Machine Learning

Artificial Intelligence

Distributed Systems

High-Throughput Inference

Communication

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

vLLM

SGLang

TensorRT-LLM

Job description

• Within Netskope Engineering, Netskope AI Labs is the powerhouse advancing state-of-the-art artificial intelligence (AI) and machine learning (ML) to protect the modern enterprise
• We build the intelligence behind the Netskope Intelligent Security Service Edge (SSE) platform
• We are seeking a high-caliber Machine Learning Engineer to help us build, optimize, and deploy enterprise-scale AI solutions
• Working closely with senior architects, you will directly influence our Secure Access Service Edge (SASE) architecture, turning cutting-edge AI research into production-grade reality
• Collaborate on the AI Roadmap: Play a key role alongside senior architects and team members in driving the execution of critical AI/ML technical strategies, building highly scalable, reliable, and production-grade systems
• Architect High-Performance Inference Systems: Design, optimize, and deploy enterprise-scale LLM serving infrastructures. You will push the boundaries of throughput and latency
• Own the End-to-End AI Lifecycle: Partner closely with ML scientists and product stakeholders to translate complex business requirements into elegant, deployed code
• Enforce AI Excellence: Implement and scale strict "Report Cards" for production models, tracking real-world accuracy, latency, and security relevance
• High-Impact Ownership: You aren't just maintaining pipelines; you are playing a critical role in the AI transformation of a market-leading cloud security company
• Cutting-Edge Stack: Work on the bleeding edge of LLM inference optimization, utilizing tools like vLLM, SGLang, and advanced KV Cache optimization
• Elite Collaboration: Work alongside top-tier engineers, researchers, and ML scientists to solve the industry’s toughest challenges in latency, throughput, and cloud security

Benefits

• Family Medical Leave
• Flexible Work Schedule
• Remote Work Program
• Dental Benefits
• Disability Insurance
• Flexible Spending Account (FSA)
• Health Insurance Benefits
• Life Insurance
• Vision Benefits
• Commuter Benefits
• Company Outings
• Stocked Kitchen
• 401(K)
• Employee Stock Purchase Plan
• Paid Holidays
• Paid Sick Days

The Modern AI Stack: Direct exposure to (or a strong conceptual understanding of) optimizing LLMs in production. Familiarity with high-throughput inference frameworks (e.g., vLLM, SGLang, TensorRT-LLM) and memory management techniques like KV Cache optimization is a massive plus The Distributed Systems Focus: 6+ years of deep experience architecting, building, and scaling high-performance distributed systems, combined with a strong desire to apply those infrastructure skills to cutting-edge AI/LLM engineering Industry Experience: 10+ years of overall experience in software engineering and product development, with a specialized focus in one of two tracks: The AI/ML Focus: 2+ years of production experience developing, optimizing, and deploying AI/ML solutions (or an equivalent blend of an advanced technical degree + hands-on experience) Clear Communication: The ability to distill complex technical architecture or infrastructure bottlenecks into clear, actionable concepts for cross-functional teams The Startup Mindset: You are an energetic self-starter who thrives in fast-paced, dynamic environments and isn't afraid to wear multiple hats to get a product across the finish line BSCS or equivalent required, MSCS or equivalent strongly preferred We believe great talent doesn't always fit into a rigid box. Candidates are assessed individually and leveled (from mid to senior) according to their specific skills, background, and technical depth