Senior ML Systems Engineer: Productionize & Optimize AI

PERMUTE; Chicago (IL); On-site; USD 150,000 - 210,000; Full time

Job summary

Permute is seeking a Senior Research Engineer to productionize, optimize, and extend model systems that power AI reasoning over structured data. The role centers on building reliable production systems from research ideas, with profiling, testing, and failure handling as core priorities.

The ideal candidate can implement research, diagnose performance, write clean production code, and make sound architectural decisions in a fast-moving startup environment.

Qualifications

• Strong background in machine learning research and ML systems.
• Experience building and training models with PyTorch.
• Strong foundations in algorithms, statistics, optimization, and experimental design.
• Strong software engineering and system architecture skills.
• 5+ years building ML or performance-sensitive software systems.

Responsibilities

• Productionize and optimize learned evidence architecture for structured data.
• Improve training and inference performance (throughput, latency, memory, reliability, cost).
• Port and optimize model training and inference workloads from CPU to GPU.
• Build production systems for training, evaluation, deployment, and inference.
• Develop tooling for experimentation, reproducibility, monitoring, observability.
• Write clean Python and PyTorch code integrated with Permute's platform.
• Design and evaluate new heads, layers, objectives, and fine-tuning methods.
• Explore transformer-based architectures and reinforcement learning.
• Collaborate with engineering and product teams to deliver model capabilities for production features.

Skills

ML research

ML systems

Software engineering

System architecture

Performance optimization

Education

Bachelor's or higher in Mathematics/Physics/CS

Tools

PyTorch

Job description

Permute is seeking a Senior Research Engineer to productionize, optimize, and extend model systems that power AI reasoning over structured data. The role centers on building reliable production systems from research ideas, with profiling, testing, and failure handling as core priorities.

The ideal candidate can implement research, diagnose performance, write clean production code, and make sound architectural decisions in a fast-moving startup environment.