Senior Ai Engineer – Databricks / Genai (Healthcare)

Blue Pearl Pty Ltd; Johannesburg; On-site; ZAR 758,000 - 1,309,000; Full time

Job summary

Decision Inc. seeks a Senior AI Engineer to develop a GenAI reporting solution for a leading private hospital group. The solution will use LLMs to transform patient and clinical data in Databricks into clinician-friendly reports, enabling actionable insights for care teams.

The role translates clinical reporting needs into governed data structures, designs LLM-powered workflows, implements RAG and guardrails, and deploys the solution with monitoring, auditing and cost controls.

Qualifications

• Experience in AI/ML engineering, including at least one LLM solution delivered into production.
• Strong Databricks experience: Unity Catalog, Delta Lake, Databricks Workflows, MLflow, Mosaic AI Model Serving, Vector Search.
• Production-standard Python, PySpark and SQL skills.
• Prompt engineering and orchestration using LangChain, LangGraph, DSPy or equivalents.
• Experience generating structured outputs from LLMs and designing RAG solutions.
• Knowledge of LLM evaluation methods and guardrails for sensitive data.

Responsibilities

• Translate clinical reporting requirements into required data points and build governed tables in Databricks.
• Design prompts, templates and orchestration workflows to generate structured narrative reports.
• Build retrieval capabilities over clinical guidelines and policy documents.
• Implement guardrails to ground outputs in source data and protect patient information.
• Develop LLM evaluation frameworks with clinical stakeholders, including datasets and scoring.
• Deploy the solution into production with monitoring, audit trails and cost controls.
• Demonstrate progress to clinical stakeholders during each sprint and incorporate feedback.

Skills

Python

PySpark

SQL

LLM deployment

RAG

Prompt engineering

LangChain

LangGraph

DSPy

Vector Search

Databricks

Tools

Unity Catalog

Delta Lake

Databricks Workflows

MLflow

Mosaic AI Model Serving

Vector Search

Job description

Role Overview

Decision Inc. is seeking a Senior AI Engineer to develop a Generative AI (GenAI) reporting solution for a leading private hospital group. The solution will use Large Language Models (LLMs) to transform patient and clinical data stored in Databricks into accurate, clinician-ready reports.

The successful candidate will be responsible for translating clinical reporting requirements into governed data structures, designing LLM-powered reporting workflows, implementing retrieval-augmented generation (RAG), establishing evaluation and safety controls, and deploying the solution into production.

Key Responsibilities

• Translate clinical reporting requirements into the required data points and build governed tables in Databricks.

• Design prompts, templates and orchestration workflows to generate structured narrative reports.

• Build retrieval capabilities over clinical guidelines and policy documents where required.

• Implement guardrails to ensure generated statements are grounded in source data and sensitive patient information remains protected.

• Develop LLM evaluation frameworks with clinical stakeholders, including test datasets, automated scoring and regression testing.

• Deploy the solution into production with monitoring, audit trails and cost controls.

• Demonstrate progress to clinical stakeholders during each sprint and incorporate feedback into ongoing improvements.

Requirements

Essential Technical Requirements

• Experience in AI/ML engineering, including at least one LLM solution delivered into production.

• Strong Databricks experience, including:

  • Unity Catalog

  • Delta Lake

  • Databricks Workflows

  • MLflow

  • Mosaic AI Model Serving

  • Vector Search

• Production-standard Python, PySpark and SQL skills.

• Prompt engineering and orchestration experience using LangChain, LangGraph, DSPy or equivalent frameworks.

• Experience generating structured outputs from LLMs.

• Hands‑on experience designing, tuning and evaluating retrieval‑augmented generation (RAG) solutions.

• Knowledge of LLM evaluation methods, including golden datasets, groundedness scoring, LLM-as-judge and regression testing.

• Experience implementing guardrails, hallucination controls and sensitive personal data protection.

Preferred / Advantageous Requirements

• Healthcare data experience, including admissions, clinical coding (ICD-10), case management or funder interactions.

• Working knowledge of POPIA and South African health data governance.

• Azure experience, including Azure OpenAI, Key Vault and private networking.

• Databricks Generative AI Engineer or Machine Learning Professional certification.

Core Skills and Search Keywords

Senior AI Engineer, Generative AI, GenAI, LLM, Databricks, Unity Catalog, Delta Lake, MLflow, Mosaic AI, Model Serving, Vector Search, Python, PySpark, SQL, RAG, Retrieval-Augmented Generation, LangChain, LangGraph, DSPy, Prompt Engineering, LLM Evaluation, Healthcare Data, Clinical Reporting, POPIA, Azure OpenAI.

Candidate Screening Questions

1. Have you delivered at least one LLM solution into production? Please describe the solution and your role.

2. What hands‑on experience do you have with Databricks, particularly Unity Catalog, MLflow, Mosaic AI Model Serving and Vector Search?

3. Describe your experience designing and evaluating RAG solutions.

4. Which orchestration frameworks have you used: LangChain, LangGraph, DSPy or equivalent?

5. Have you worked with healthcare or clinical data and sensitive personal information?

6. What is your hourly rate?

7. What is your availability and notice period?

8. Are you comfortable working in a hybrid arrangement from Waterfall City?

Submission Requirements

Please ensure candidate submissions include:

• Updated CV highlighting relevant AI/ML and production LLM projects.

• Current hourly rate.

• Availability and notice period.

• Databricks experience and relevant certifications.

• Healthcare experience, if applicable.

Recruitment priority: Urgent – target start date 1 November 2026.