Senior AI Engineer – Databricks / GenAI (Healthcare)

Blue Pearl HQ; Johannesburg; Hybrid; ZAR 900,000 - 1,400,000; Full time

Job summary

Decision Inc. seeks a Senior AI Engineer to develop a GenAI reporting solution for a leading private hospital group.

You will translate clinical reporting needs into governed data structures in Databricks and design LLM-powered workflows that generate structured hospital reports. You will implement retrieval-augmented generation, guardrails, and evaluation frameworks, and deploy the solution in production with monitoring and cost controls.

Qualifications

• Experience in AI/ML engineering with at least one production LLМ solution.
• Strong Databricks experience including Unity Catalog, Delta Lake, Databricks Workflows, MLflow, Mosaic AI Model Serving, Vector Search.
• Production-standard Python, PySpark and SQL skills.
• Prompt engineering and orchestration using LangChain, LangGraph, DSPy or equivalents.
• Experience generating structured outputs from LLMs and designing RAG solutions.
• Knowledge of LLM evaluation methods and regression testing.
• Experience implementing guardrails and protecting sensitive personal data.

Responsibilities

• Translate clinical reporting requirements into governed data points and build tables in Databricks.
• Design prompts, templates and orchestration workflows for structured narrative reports.
• Build retrieval capabilities over clinical guidelines and policy documents.
• Implement guardrails to ground statements in source data and protect patient information.
• Develop LLM evaluation frameworks with clinical stakeholders, including datasets and automated scoring.
• Deploy the solution into production with monitoring, audit trails and cost controls.
• Demonstrate progress to clinical stakeholders during sprints and incorporate feedback.

Skills

AI/ML engineering

LLM in production

Python

PySpark

SQL

RAG

LangChain

LangGraph

DSPy

Prompt engineering

LLM evaluation

Healthcare data

Clinical reporting

POPIA

Azure OpenAI

Unity Catalog

Delta Lake

Databricks Workflows

MLflow

Vector Search

Tools

Unity Catalog

Delta Lake

Databricks Workflows

MLflow

Mosaic AI

Vector Search

Job description

Decision Inc. is seeking a Senior AI Engineer to develop a Generative AI (GenAI) reporting solution for a leading private hospital group. The solution will use Large Language Models (LLMs) to transform patient and clinical data stored in Databricks into accurate, clinician‑ready reports.

The successful candidate will be responsible for translating clinical reporting requirements into governed data structures, designing LLM-powered reporting workflows, implementing retrieval‑augmented generation (RAG), establishing evaluation and safety controls, and deploying the solution into production.

Key Responsibilities

• Translate clinical reporting requirements into the required data points and build governed tables in Databricks.
• Design prompts, templates and orchestration workflows to generate structured narrative reports.
• Build retrieval capabilities over clinical guidelines and policy documents where required.
• Implement guardrails to ensure generated statements are grounded in source data and sensitive patient information remains protected.
• Develop LLM evaluation frameworks with clinical stakeholders, including test datasets, automated scoring and regression testing.
• Deploy the solution into production with monitoring, audit trails and cost controls.
• Demonstrate progress to clinical stakeholders during each sprint and incorporate feedback into ongoing improvements.

Requirements

Essential Technical Requirements

• Experience in AI/ML engineering, including at least one LLM solution delivered into production.
• Strong Databricks experience, including:
  • Unity Catalog
  • Delta Lake
  • Databricks Workflows
  • MLflow
  • Mosaic AI Model Serving
  • Vector Search
• Production‑standard Python, PySpark and SQL skills.
• Prompt engineering and orchestration experience using LangChain, LangGraph, DSPy or equivalent frameworks.
• Experience generating structured outputs from LLMs.
• Hands‑on experience designing, tuning and evaluating retrieval‑augmented generation (RAG) solutions.
• Knowledge of LLM evaluation methods, including golden datasets, groundedness scoring, LLM‑as‑judge and regression testing.
• Experience implementing guardrails, hallucination controls and sensitive personal data protection.

Preferred / Advantageous Requirements

• Healthcare data experience, including admissions, clinical coding (ICD‑10), case management or funder interactions.
• Working knowledge of POPIA and South African health data governance.
• Azure experience, including Azure OpenAI, Key Vault and private networking.
• Databricks Generative AI Engineer or Machine Learning Professional certification.

Core Skills and Search Keywords

Senior AI Engineer, Generative AI, GenAI, LLM, Databricks, Unity Catalog, Delta Lake, MLflow, Mosaic AI, Model Serving, Vector Search, Python, PySpark, SQL, RAG, Retrieval‑Augmented Generation, LangChain, LangGraph, DSPy, Prompt Engineering, LLM Evaluation, Healthcare Data, Clinical Reporting, POPIA, Azure OpenAI.

Candidate Screening Questions

• Have you delivered at least one LLM solution into production? Please describe the solution and your role.
• What hands‑on experience do you have with Databricks, particularly Unity Catalog, MLflow, Mosaic AI Model Serving and Vector Search?
• Describe your experience designing and evaluating RAG solutions.
• Which orchestration frameworks have you used: LangChain, LangGraph, DSPy or equivalent?
• Have you worked with healthcare or clinical data and sensitive personal information?
• What is your hourly rate?
• What is your availability and notice period?
• Are you comfortable working in a hybrid arrangement from Waterfall City?

Recruitment priority: Urgent – target start date 1 November 2026.