Remote Lead AI Platform Engineer - MLOps

Ladders; United States; Remote; USD 200,000 - 270,000; Full time

Benefits offered by this job

Employer-paid benefits

Unlimited PTO

401K

Flexible remote working arrangements

Life insurance

Disability coverage

Career growth culture

Job summary

Ladders is seeking a Lead Software Platform Engineer, MLOps to shape the architecture of a multi-tenant AI/ML platform for external users and production workloads at scale. You will lead decisions on model lifecycle, inference services, security, and observability, partnering with security, infra, and app teams to bring AI into production confidently.

The role is remote with a strong hands-on leadership component, guiding platform reliability, performance, and cost-efficiency in a production

Qualifications

• 10+ years of professional experience in software and infrastructure engineering.
• Leadership/architecture experience with scale, performance, and cost optimization.
• Experience designing multi-tenant platform security handling sensitive data (PII/PHI).
• Production-level AI/ML infrastructure for multi-tenant external users.
• Hands-on with LLM-based systems in production and real traffic/failures.
• Expertise in evaluating AI-generated code and best practices.
• Model registry and serving stack experience (Databricks MLflow preferred).

Responsibilities

• Own the technical architecture of the AI/ML platform and its APIs.
• Manage the model and prompt lifecycle across MLflow and AWS Bedrock.
• Design the inference substrate for real-time and batch AI workloads.
• Integrate AI models and LLMs into production systems with robust architectures.
• Implement security measures in collaboration with security teams.
• Build evaluation and quality infrastructure for reliable AI deployments.
• Establish observability with monitoring and alerting.

Skills

TypeScript

Python

Technical leadership

Tools

Databricks MLflow

Job description

Ladders is seeking a Lead Software Platform Engineer, MLOps to shape the architecture of a multi-tenant AI/ML platform for external users and production workloads at scale. You will lead decisions on model lifecycle, inference services, security, and observability, partnering with security, infra, and app teams to bring AI into production confidently.

The role is remote with a strong hands-on leadership component, guiding platform reliability, performance, and cost-efficiency in a production