Lead AI Platform Engineer - Kubernetes, On-Prem & Cloud

Cohu, Inc.

Seattle (WA)

On-site

USD 175,000 - 225,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical/dental/vision insurance
401(k) matching
Employee Stock Purchase Plan
Tuition assistance
Disability & life insurance
Profit Sharing

Job summary

Cohu, Inc. is seeking an AI-Engineering Principal Software Engineer to lead and build the AI engineering platform for semiconductor test. You will own technical direction, design agent tooling and RAG systems, and ship production software with a hands-on engineering role.

You will drive cloud and on-prem infrastructure, configure AI workflows, and guide a small team through architectural planning and implementation. Strong distributed-systems, Kubernetes, and GPU stack experience is required.

Qualifications

  • Bachelor's degree in Computer Science or equivalent; EE/physics acceptable with strong software track record.
  • 5+ years relevant experience, prior technical-lead or architect experience preferred.
  • Senior-level ability to design, build, and ship production software independently.

Responsibilities

  • Personally design, build, and ship agent tooling, RAG systems, or infrastructure work alongside directing others.
  • This role remains a working engineer, not a pure architecture/coaching function.
  • Set technical direction for software integration, cloud infrastructure, and on-prem hardware selection/deployment for air-gapped LLM inference.
  • Architect and drive team-wide adoption of reusable patterns for custom AI agent development and RAG components.
  • Responsible for Kubernetes-based infrastructure, capacity planning, scaling, and incident response.
  • Provide guidance, coaching, and day-to-day prioritization for the team; participate in architectural planning.
  • Serve as technical escalation point for architecture calls crossing teams.
  • Potential to act as AI Engineering lead.
  • Stay ahead of model-serving and inference-hardware landscape.
  • Hands-on experience selecting and optimizing GPU/server hardware and inference stacks.
  • Semiconductor industry familiarity, particularly test/ATE domain.

Skills

Kubernetes
Cloud
LLM tooling
C++
Python
Leadership
Distributed systems
Frontend UI

Education

Bachelor's in CS or equivalent
EE/Physics acceptable

Tools

vLLM
TensorRT-LLM

Job description

Cohu, Inc. is seeking an AI-Engineering Principal Software Engineer to lead and build the AI engineering platform for semiconductor test. You will own technical direction, design agent tooling and RAG systems, and ship production software with a hands-on engineering role.

You will drive cloud and on-prem infrastructure, configure AI workflows, and guide a small team through architectural planning and implementation. Strong distributed-systems, Kubernetes, and GPU stack experience is required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Infrastructure Engineer – Kubernetes & Multi-Cloud
GPU Infrastructure Engineer – Kubernetes & Multi-Cloud

Cohere • Seattle (WA)

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend: $75/£75 or local
Health and dental benefits
RRSP matching / Pension
+6
Enterprise AI Deployment Engineer (On-Prem/Cloud, Kubernetes)
Enterprise AI Deployment Engineer (On-Prem/Cloud, Kubernetes)

Cohere • United States

Remote
USD 140,000 - 210,000
A weekly lunch stipend of $75/£75 or?
Full health and dental benefits
RRSP matching, 401K, Pension Scheme
+5
Lead Platform AI Engineer - Hybrid Cloud & AI Systems
Lead Platform AI Engineer - Hybrid Cloud & AI Systems

Target Corp • Brooklyn Park (MN)

Hybrid
USD 132,000 - 238,000
Health benefits
401(k) plan
Paid time off
+1
Kubernetes Platform Engineer - End-to-End AI Cloud
Kubernetes Platform Engineer - End-to-End AI Cloud

Confidential • United States

Remote
USD 170,000 - 250,000
Senior Platform Engineer - On-Prem Kubernetes & AI Infra
Senior Platform Engineer - On-Prem Kubernetes & AI Infra

Akina, Inc. • Maryland

On-site
USD 241,000 - 295,000
24 days PTO
11 federal holidays
401k 10% employer contribution
+2
Senior AI Platform Engineer
Senior AI Platform Engineer

Covalent Resource Group • Southfield (MI)

On-site
USD 150,000 - 210,000
Senior AI Infrastructure Engineer – Multi-Cloud & Kubernetes
Senior AI Infrastructure Engineer – Multi-Cloud & Kubernetes

DroneDeploy • Austin (TX)

Hybrid
USD 141,000 - 194,000
Equity compensation
Bonus incentive compensation
Lead AI Infrastructure Architect for HPC & GPUs
Lead AI Infrastructure Architect for HPC & GPUs

Cisco Systems, Inc. • Clegg (NC)

On-site
USD 140,000 - 178,000
Medical, dental and vision insurance
401(k) with Cisco matching
Paid parental leave
+2
Senior AI Platform Engineer - AWS, Kubernetes & Governance
Senior AI Platform Engineer - AWS, Kubernetes & Governance

Cirrus • Austin (TX)

On-site
USD 140,000 - 190,000
Senior Platform Engineer – AI Compute & GPU Infra
Senior Platform Engineer – AI Compute & GPU Infra

Cisco Systems, Inc. • San Jose (CA)

On-site
USD 168,000 - 245,000