Senior ML Engineer: Production Pipelines on Databricks

dotdigital; Milnerton; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading global tech company in Milnerton is seeking a skilled Machine Learning Engineer to enhance their data and analytics team. This role involves designing and optimizing data pipelines on Databricks, leveraging your expertise in Python and machine learning frameworks. Join a culture of innovation and collaboration, where you can impact diverse customer solutions. Competitive benefits include parental leave, medical coverage, and Wellbeing Days.

Benefits

Parental leave

Medical benefits

Paid sick leave

Wellbeing reward

Qualifications

• 5+ years in data or machine learning engineering with experience in building data pipelines.
• Strong proficiency in Python and hands-on experience with PySpark.
• Experience with Databricks, Unity Catalog, Delta Lake, and Apache Iceberg.

Responsibilities

• Architect and implement data pipelines using PySpark on Databricks.
• Develop and operationalise ML workflows and pipelines.
• Collaborate with cross-functional teams to translate business challenges into ML solutions.

Skills

Data pipeline architecture

Python programming

PySpark

Machine Learning frameworks

Collaboration skills

Tools

Databricks

Unity Catalog

Delta Lake

Apache Iceberg

Job description

A leading global tech company in Milnerton is seeking a skilled Machine Learning Engineer to enhance their data and analytics team. This role involves designing and optimizing data pipelines on Databricks, leveraging your expertise in Python and machine learning frameworks. Join a culture of innovation and collaboration, where you can impact diverse customer solutions. Competitive benefits include parental leave, medical coverage, and Wellbeing Days.