Lead Software Platform Engineer, MLOps

Ladders; United States; Remote; USD 200,000 - 270,000; Full time

Benefits offered by this job

Employer-paid benefits

Unlimited PTO

401K

Flexible remote working arrangements

Life insurance

Disability coverage

Career growth culture

Job summary

Ladders is seeking a Lead Software Platform Engineer, MLOps to shape the architecture of a multi-tenant AI/ML platform for external users and production workloads at scale. You will lead decisions on model lifecycle, inference services, security, and observability, partnering with security, infra, and app teams to bring AI into production confidently.

The role is remote with a strong hands-on leadership component, guiding platform reliability, performance, and cost-efficiency in a production

Qualifications

• 10+ years of professional experience in software and infrastructure engineering.
• Leadership/architecture experience with scale, performance, and cost optimization.
• Experience designing multi-tenant platform security handling sensitive data (PII/PHI).
• Production-level AI/ML infrastructure for multi-tenant external users.
• Hands-on with LLM-based systems in production and real traffic/failures.
• Expertise in evaluating AI-generated code and best practices.
• Model registry and serving stack experience (Databricks MLflow preferred).

Responsibilities

• Own the technical architecture of the AI/ML platform and its APIs.
• Manage the model and prompt lifecycle across MLflow and AWS Bedrock.
• Design the inference substrate for real-time and batch AI workloads.
• Integrate AI models and LLMs into production systems with robust architectures.
• Implement security measures in collaboration with security teams.
• Build evaluation and quality infrastructure for reliable AI deployments.
• Establish observability with monitoring and alerting.

Skills

TypeScript

Python

Technical leadership

Tools

Databricks MLflow

Job description

For our client, we are seeking a Lead Software Platform Engineer, MLOps to join the team of a leader in the Enterprise Technology space. This role will shape the architecture of a multi-tenant AI/ML platform that supports external users and production workloads at scale. You will lead technical decisions across model lifecycle management, inference services, security, and observability to ensure the platform is reliable, performant, and cost-effective. The position calls for a hands‑on engineering leader who can partner closely with security, infrastructure, and application teams to bring AI capabilities into production with confidence.

Location: Remote

Compensation: $200,000 – $270,000 annually

Responsibilities

• Own the technical architecture of the AI/ML platform and its APIs
• Manage the model and prompt lifecycle across MLflow and AWS Bedrock
• Design the inference substrate for real-time and batch AI workloads
• Integrate AI models and LLMs into production systems with effective architectures
• Implement security measures into the AI platform in collaboration with security teams
• Build evaluation and quality infrastructure for robust AI deployment
• Establish observability for the AI platform, including monitoring and alerting

Qualifications

• 10+ years of professional experience in software and infrastructure engineering, with a focus on distributed, cloud-native systems
• Proven technical leadership or architecture experience, with responsibility for system design, scalability, performance, and cost optimization decisions
• Experience designing multi-tenant platform security, including authorization and handling sensitive data such as PII and PHI
• Extensive experience with AI/ML infrastructure in production, especially as a multi-tenant product for external users
• Hands‑on experience with LLM-based systems in production, including real traffic and failure modes
• Expert coding skills in TypeScript and Python, along with strong judgment for evaluating AI-generated code
• Production-level experience with a model registry and serving stack, ideally Databricks MLflow

Benefits

• 100% employer-paid benefits for eligible employees and their families
• Unlimited paid time off (PTO)
• 401K
• Flexible remote working arrangements
• Company-paid life insurance, limited/short-term disability
• Culture of continuous improvement with career growth opportunities

Our client is an equal opportunity employer.