Senior LLM Infra Engineer for AI Platforms

CrowdStrike; United States; On-site; USD 140,000 - 215,000; Full time

Benefits offered by this job

Market-competitive compensation

Equity awards

Wellness programs

Paid time off

Job summary

CrowdStrike is seeking a Senior AI Infrastructure Engineer to join our AI Infrastructure Team. You will design, build, and deploy cutting‑edge AI infrastructure powering our next generation of AI‑driven security products, with hands‑on work across large scale training pipelines, deployment, and optimization.

You will mentor the team and collaborate with Data Scientists, Product Managers, and other engineers to turn research prototypes into robust, production‑grade services.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or related STEM field; Master’s degree preferred.
• 6+ years of experience in Infrastructure/Data Engineering, with at least 2 years focused on LLM‑based platforms.
• Hands‑on experience in LLM infrastructure engineering including cluster provisioning and maintaining inference pipelines.

Responsibilities

• Provision and configure large GPU clusters for LLM training, finetuning, and inference workloads.
• Develop and optimize LLM model‑serving infrastructure and inference frameworks.
• Lead model lifecycle management across training and inference deployments.
• Design evaluation frameworks to assess model performance, accuracy, and reliability for production‑ready AI services.
• Address GPU utilization and memory bottlenecks with quantization, batching, and caching.
• Architect data platforms and pipelines for LLMs, RAG, and AI Agentic Systems at scale.
• Deliver production‑ready code with emphasis on performance, maintainability, and testing.

Skills

Python

MLOps

LLM infra

CUDA fundamentals

Docker

Kubernetes

Slurm

Airflow

Terraform

Ansible

AWS

GCP

OCI

PyTorch

Ray

Megatron

JAX

vLLM

Triton Inference Server

MLflow

SageMaker

Vertex AI

Education

Bachelor’s degree in Computer Science, Data Engineering, or related STEM

Master’s degree preferred

Tools

MLflow

SageMaker

Vertex AI

vLLM

Triton Inference Server

PyTorch

Ray

Megatron

JAX

Docker

Kubernetes

Slurm

Airflow

Terraform

Ansible

Job description

CrowdStrike is seeking a Senior AI Infrastructure Engineer to join our AI Infrastructure Team. You will design, build, and deploy cutting‑edge AI infrastructure powering our next generation of AI‑driven security products, with hands‑on work across large scale training pipelines, deployment, and optimization.

You will mentor the team and collaborate with Data Scientists, Product Managers, and other engineers to turn research prototypes into robust, production‑grade services.