Senior ML Ops & Data Platform Engineer

Boardroom Appointments; Cape Town; On-site; ZAR 1,000,000 - 1,700,000; Full time

Job summary

Boardroom Appointments is seeking a Senior ML Ops Engineer to lead the continuous improvement of our machine learning operations landscape in a cloud-first environment. You will design and maintain end-to-end ML pipelines for ingestion and inference, ensuring reproducibility, security, and efficiency at scale.

You will collaborate with data scientists, data engineers, API engineers, and DevOps to monitor deployment metrics and drive improvements in deployment frequency, lead time, and MTTR,

Qualifications

• Master's degree in relevant field.
• 5 years of relevant work experience.
• Strong Scala and Python background.
• Experience with Apache Spark and/or Ray.
• Knowledge of AWS, GCP, Azure, or other cloud platform.
• Knowledge of ML Ops principles and frameworks.

Responsibilities

• Develop and implement a strategy for continuous improvement of our ML Ops including versioning, testing, automation, reproducibility, deployment, monitoring, and data privacy.
• Develop and report on ML Ops metrics such as deployment frequency, lead time for changes, mean time to restore, and change failure rate.
• Collaborate with data scientists, data engineers, API engineers, and the dev ops team.
• Build scalable data ingestion and machine learning inference pipelines.
• Scale up production systems to handle increased demand from new products, features, and users.
• Provide visibility into the health of our data platform and optimize cloud costs.
• Automate and handle the life-cycle of the systems and platforms that process our data.

Skills

Scala

Python

APIs

ML Deployment

Data privacy

CI/CD

Cloud security

Analytics

Education

Master's degree in Software Engineering, Data Engineering, Computer Science or related field

Tools

Apache Spark

Ray

MLflow

DVC

Grafana

DataHub

Databricks

PyTorch

TensorFlow

SageMaker

Jenkins

GitHub Actions

Docker

Kubernetes

AWS

GCP

Azure

Job description

Boardroom Appointments is seeking a Senior ML Ops Engineer to lead the continuous improvement of our machine learning operations landscape in a cloud-first environment. You will design and maintain end-to-end ML pipelines for ingestion and inference, ensuring reproducibility, security, and efficiency at scale.

You will collaborate with data scientists, data engineers, API engineers, and DevOps to monitor deployment metrics and drive improvements in deployment frequency, lead time, and MTTR,