Staff AI Platform Engineer — Scale Production ML Infra

DAT Freight & Analytics; Seattle (WA); Hybrid; USD 198,000 - 246,000; Full time

Benefits offered by this job

Medical, Dental, Vision

Paid time off

401k match

Health Savings Account

Employee stock purchase plan

Transit benefits

Job summary

DAT Freight & Analytics seeks a Staff AI Platform Engineer to own the platform for all AI/ML workloads. You will shape architecture from gateway to storage, enabling scalable training, inference, evaluation, and observability across the enterprise.

The role emphasizes leadership, production ML experience, and delivering robust AI infrastructure on AWS with Pulumi/Terraform, while mentoring teams and driving best practices in a hybrid WA environment.

Qualifications

• 10+ years of experience in software engineering owning production infrastructure
• 4+ years building and operating ML/AI platforms from notebook to production
• Strong development skills in TypeScript/Node.js, Java, or Go
• Extensive AWS production experience including EKS, Lambda, S3, and managed services
• Hands-on experience with containerized inference, GPU scheduling, and autoscaling
• Experience with LLM systems in production: retrieval-augmented generation, vector DBs, tool-calling
• Proven track record in building evaluation/monitoring for models (offline/online metrics)
• Strong background in distributed systems using Kafka/Redpanda, and observability
• Demonstrated technical leadership across cross-team designs and runbooks
• Mentoring engineers and data scientists in system design and ops excellence

Responsibilities

• Design, build, and operate shared AI platform services (model gateway, inference endpoints, feature storage)
• Lead architecture for large-scale AI systems and align stakeholders
• Architect scalable AWS infrastructure (Bedrock, SageMaker, EKS, S3) and implement Pulumi/Terraform IaC
• Develop offline and online evaluation systems and drift detection for models
• Own inference cost, latency, batching, caching, and capacity planning
• Implement governance: logging, data handling, access controls, model lineage
• Promote modern software development practices: CI/CD, automated tests, runbooks
• Mentor engineers and data scientists on production ML and distributed systems
• Lead incident response, root cause analysis, and post-incident improvements

Skills

Software architecture

AWS

Pulumi

Terraform

Kubernetes

LLM systems

Observability

Mentoring

Leadership

TypeScript/Node.js/Java/Go

Tools

AWS (Bedrock, SageMaker)

EKS/Kubernetes

S3

Pulumi

Terraform

Kafka/MSK

Job description

DAT Freight & Analytics seeks a Staff AI Platform Engineer to own the platform for all AI/ML workloads. You will shape architecture from gateway to storage, enabling scalable training, inference, evaluation, and observability across the enterprise.

The role emphasizes leadership, production ML experience, and delivering robust AI infrastructure on AWS with Pulumi/Terraform, while mentoring teams and driving best practices in a hybrid WA environment.