Software Development Engineer in Test - AI

Delos Data Inc

United States

Hybrid

USD 140,000 - 220,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
401(k)
Hybrid work arrangement

Job summary

Delos Data Inc. seeks a tests/integration engineer to build and maintain automated testing for distributed AI workloads. You will design end-to-end integration tests, stress tests, and performance validation spanning hardware-software boundaries.

You will collaborate with system engineers to diagnose failures in distributed clusters and use telemetry and profiling to identify bottlenecks. A strong background in Python and containerized environments is required.

Qualifications

  • 5+ years of relevant experience in testing or SRE/DevOps
  • Strong Python skills for test automation and orchestration
  • Experience building or extending automation frameworks for complex backend systems
  • Ability to troubleshoot test failures in large distributed systems and identify root causes
  • Experience with containers and CI/CD tools (Docker/Kubernetes, GitHub Actions, GitLab CI, or Jenkins)

Responsibilities

  • Design, build, and maintain an automated test framework for distributed AI workloads.
  • Create end-to-end integration and stress tests beyond unit-level coverage.
  • Test conditions at the boundary between hardware and software.
  • Partner with system engineers to investigate failures in distributed clusters.
  • Use telemetry and profiling tools to help identify system bottlenecks.

Skills

Python
Test automation
Distributed systems
Diagnostics & debugging
CI/CD concepts

Education

Bachelor's or Master's in CS/CE or related field

Tools

Docker
Kubernetes
GitHub Actions
GitLab CI
Jenkins

Job description

Role overview

Build the testing foundation for infrastructure that supports distributed AI training and inference. The role focuses on automation, integration, and stress testing across distributed systems, GPU kernels, and AI frameworks, helping teams find and diagnose reliability and performance issues at scale.

Responsibilities
  • Design, build, and maintain an automated test framework for distributed AI workloads.
  • Create end-to-end integration and stress tests beyond unit-level coverage.
  • Test conditions at the boundary between hardware and software.
  • Partner with system engineers to investigate failures in distributed clusters.
  • Use telemetry and profiling tools to help identify system bottlenecks.
Requirements
  • At least five years of relevant experience.
  • Strong Python skills for test automation and orchestration.
  • Experience building or extending automation frameworks for complex backend systems.
  • Ability to troubleshoot test failures in large distributed systems and identify root causes.
  • Experience with containers such as Docker or Kubernetes and CI/CD tools such as GitHub Actions, GitLab CI, or Jenkins.
  • Bachelor's or master's degree in computer engineering, computer science, or a related field.
Nice to have
  • Experience using Kubernetes, Terraform, or Ansible to manage test environments.
  • Experience testing high-performance networking protocols or distributed file systems.
  • Experience testing software that interacts directly with drivers or firmware.
Benefits and work setup
  • Hybrid role based in Palo Alto, California.
  • Advertised target base salary of $140,000–$220,000 per year, plus equity, benefits, and a 401(k). The range depends on role level, experience, and location.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Development Engineer in Test - AI
Software Development Engineer in Test - AI

Delos Data Inc • Palo Alto (CA)

Hybrid
USD 140,000 - 220,000
Equity
Benefits
401(k)
Software Development Engineer in Test - AI
Software Development Engineer in Test - AI

Delos Data • Palo Alto (CA)

Hybrid
USD 140,000 - 220,000
Equity
Benefits package
401k
System Software Engineer - AI
System Software Engineer - AI

Delos Data Inc • United States

Hybrid
USD 140,000 - 220,000
Equity
401(k) plan
Health benefits
Software Engineer, Workload Enablement
Software Engineer, Workload Enablement

OpenAI, Inc. • Seattle (WA)

On-site
USD 293,000 - 455,000
Senior Software Engineer, Machine Learning Infrastructure & Automation
Senior Software Engineer, Machine Learning Infrastructure & Automation

fal-ai • United States

Remote
USD 150,000 - 210,000
Health insurance
Dental insurance
Vision insurance
AI - Software Development Engineer in Test (AI - SDET)
AI - Software Development Engineer in Test (AI - SDET)

web • United States

Remote
USD 120,000 - 180,000
System Software Engineer - AI
System Software Engineer - AI

Delos Data Inc • Palo Alto (CA)

Hybrid
USD 140,000 - 200,000
Equity
401k
Benefits
Software Engineer, Test Infrastructure (AI DevEx)
Software Engineer, Test Infrastructure (AI DevEx)

Sift • California

On-site
USD 150,000 - 190,000
Equity
Benefits
Senior Software Development Engineer in Test (SDET) - AI Cluster
Senior Software Development Engineer in Test (SDET) - AI Cluster

Cerebras • Sunnyvale (CA)

On-site
USD 170,000 - 230,000
SDET - GPU Platforms
SDET - GPU Platforms

Kardow • Sunnyvale (CA)

On-site
USD 180,000 - 240,000