Senior Data Scientist

Paracon; Sandton; On-site; ZAR 1,200,000 - 1,800,000; Full time

Job summary

Paracon is designing, prototyping, and building next-generation analytic engines and AI services. You will operationalize models, develop AI applications, and create platforms delivering business value at scale.

Focus areas include deploying ML models, GenAI agents, RAG solutions, and containerized services on Databricks and AKS, with strong emphasis on CI/CD, testing, governance, and cross-team collaboration.

Qualifications

• Experience building, deploying and supporting ML solutions in production.
• Strong understanding of MLOps, DevOps and software engineering practices for ML platforms.
• Proficiency in Python and SQL with API development experience.

Responsibilities

• Design, prototype, and build next-generation analytic engines and services.
• Deploy, monitor and scale ML models and data pipelines in production on Databricks.
• Develop and maintain reusable ML pipelines using MLOps principles (CI/CD, testing, monitoring).
• Collaborate with cross-functional teams to expose AI capabilities via APIs and microservices.

Skills

Databricks Workflows

MLflow

Python

SQL

REST APIs

Docker

Kubernetes

CI/CD

MLOps

Generative AI

LLM deployment

Cloud engineering

Monitoring & troubleshooting

Education

Master's degree or PhD in CS/Statistics/EE

Tools

AKS

Databricks

Job description

To design, prototype, and build next-generation analytic engines and services by applying strong expertise in Artificial Intelligence (AI)

Build, deploy, scale and support machine learning, AI and GenAI solutions in production. The role focuses on operationalizing models, developing AI applications and agents, and creating the platforms and services required to deliver business value at scale.

Key Responsibilities

• Productions, deploy and monitor machine learning models and data science pipelines on Databricks.
• Build, deploy and support AI Agents, GenAI applications and RAG solutions on Databricks.
• Develop and maintain reusable ML pipelines using MLOps principles, including CI/CD, automated testing, monitoring and governance.
• Deploy, optimize and manage open-source AI and machine learning models on Azure Kubernetes Service (AKS).
• Design, develop and support custom APIs and microservices on AKS to expose AI and machine learning capabilities to business applications.
• Implement containerized solutions using Docker and Kubernetes to ensure scalable, secure and resilient deployments.
• Monitor model performance, drift, reliability and operational health in production environments.
• Partner with Data Scientists to productions prototypes and enable business-ready solutions.
• Collaborate with platform, security, cloud and infrastructure teams to ensure compliance with enterprise standards.
• Troubleshoot and resolve production issues related to models, pipelines, APIs and AI applications.
• Optimise AI and ML solutions for performance, scalability, cost and reliability.
• Contribute to engineering standards, reusable frameworks and best practices across the AI and ML ecosystem.
• Mentor junior engineers and promote knowledge sharing across the team.
• Stay current with advancements in AI, GenAI, MLOps, Databricks, Kubernetes and cloud technologies.
• Production-ready ML models and pipelines running on Databricks.
• AI Agents and business applications deployed on Databricks.
• Open-source LLMs and AI services deployed on AKS.
• Secure and scalable APIs exposing AI capabilities to consuming systems.
• Automated deployment, monitoring and governance processes.
• Reliable, scalable and compliant AI platforms supporting business outcomes.

Key Skills

• Databricks Workflows, Model Serving, MLflow and Mosaic AI
• Python, SQL and REST APIs
• Docker and Kubernetes
• CI/CD and MLOps practices
• Machine Learning and Generative AI
• LLM deployment and optimization
• Cloud engineering and infrastructure automation
• Monitoring, observability and troubleshooting
• Computer Science, Engineering, Econometrics, Mathematical Statistics, Actuary Science. Masters or Doctorate will be an added advantage.

Preferred Certifications

• Microsoft Azure certifications (AZ-104, AZ-305, AI-102 or equivalent)
• Databricks certifications (Data Engineer, Machine Learning Engineer, Generative AI Engineer)
• Kubernetes and containerization certifications (CKA, CKAD or equivalent)
• DevOps, MLOps or Platform Engineering certifications
• AWS or Google Cloud certifications will be advantageous
• Machine Learning, Artificial Intelligence or Data Science certifications from recognized providers such as Microsoft, Databricks, SAS, Coursera or DeepLearning.AI will be an added advantage

Technical / Professional Knowledge

• Strong understanding of MLOps, DevOps and software engineering practices for machine learning platforms.
• Experience building, deploying and supporting machine learning solutions in production environments.
• Proficiency in Python and experience with SQL and API development.
• Experience with Databricks, MLflow, Model Serving and cloud-native AI/ML platforms.
• Hands-on experience with Kubernetes, Docker and containerized application deployment.
• Experience deploying and supporting machine learning and Generative AI solutions on Azure Kubernetes Service (AKS).
• Knowledge of CI/CD pipelines, infrastructure automation and platform monitoring.
• Experience with distributed computing technologies such as Spark and large-scale data processing frameworks.
• Understanding of machine learning, large language models (LLMs), retrieval-augmented generation (RAG) and AI agents.
• Ability to productions data science solutions and collaborate effectively with Data Scientists.
• Experience delivering end-to-end AI and machine learning use cases from development to production.
• Ability to translate technical concepts into business outcomes and communicate effectively with stakeholders.
• Strong written and verbal communication skills with the ability to work across cross-functional teams.
• Self-driven, adaptable and capable of thriving in a fast-paced, technology-driven environment.