Senior GenAI Engineer - Databricks & Clinician Reports

Blue Pearl PTY LTD; Johannesburg; On-site; ZAR 758,000 - 1,309,000; Full time

Job summary

Decision Inc. seeks a Senior AI Engineer to develop a GenAI reporting solution for a leading private hospital group. The solution will use LLMs to transform patient and clinical data in Databricks into clinician-friendly reports, enabling actionable insights for care teams.

The role translates clinical reporting needs into governed data structures, designs LLM-powered workflows, implements RAG and guardrails, and deploys the solution with monitoring, auditing and cost controls.

Qualifications

• Experience in AI/ML engineering, including at least one LLM solution delivered into production.
• Strong Databricks experience: Unity Catalog, Delta Lake, Databricks Workflows, MLflow, Mosaic AI Model Serving, Vector Search.
• Production-standard Python, PySpark and SQL skills.
• Prompt engineering and orchestration using LangChain, LangGraph, DSPy or equivalents.
• Experience generating structured outputs from LLMs and designing RAG solutions.
• Knowledge of LLM evaluation methods and guardrails for sensitive data.

Responsibilities

• Translate clinical reporting requirements into required data points and build governed tables in Databricks.
• Design prompts, templates and orchestration workflows to generate structured narrative reports.
• Build retrieval capabilities over clinical guidelines and policy documents.
• Implement guardrails to ground outputs in source data and protect patient information.
• Develop LLM evaluation frameworks with clinical stakeholders, including datasets and scoring.
• Deploy the solution into production with monitoring, audit trails and cost controls.
• Demonstrate progress to clinical stakeholders during each sprint and incorporate feedback.

Skills

Python

PySpark

SQL

LLM deployment

RAG

Prompt engineering

LangChain

LangGraph

DSPy

Vector Search

Databricks

Tools

Unity Catalog

Delta Lake

Databricks Workflows

MLflow

Mosaic AI Model Serving

Vector Search

Job description

Decision Inc. seeks a Senior AI Engineer to develop a GenAI reporting solution for a leading private hospital group. The solution will use LLMs to transform patient and clinical data in Databricks into clinician-friendly reports, enabling actionable insights for care teams.

The role translates clinical reporting needs into governed data structures, designs LLM-powered workflows, implements RAG and guardrails, and deploys the solution with monitoring, auditing and cost controls.