Social network you want to login/join with:
Principal Data Scientist, Newcastle-upon-Tyne, Tyne and Wear
Client: ISx4
Location: Newcastle-upon-Tyne, Tyne and Wear, United Kingdom
Job Category: Other
EU work permit required: Yes
Job Views:
2
Posted:
26.08.2025
Expiry Date:
10.10.2025
Job Description:
You will be part of a team designing and building a Gen AI virtual agent to support customers and employees across multiple channels. Responsibilities include building and running LLM-powered agentic experiences, owning design, orchestration, MLOps, and continuous improvement.
- Design & build client-specific GenAI/LLM virtual agents
- Enable orchestration, management, and execution of AI-powered interactions through purpose-built AI agents
- Design, build, and maintain robust LLM-powered processing workflows
- Develop cutting-edge testing suites related to bespoke LLM performance metrics
- Implement CI/CD pipelines for ML/LLM: automated build, train, validate, deploy for chatbots and agent services
- Use Infrastructure as Code (Terraform/CloudFormation) to provision scalable cloud infrastructure for training and real-time inference
- Monitor models and services: drift detection, hallucination checks, SLOs, alerting
- Serve at scale: containerized, auto-scaling environments (e.g., Kubernetes) with low-latency inference
- Manage data & model versioning; maintain a central model registry with lineage and rollback capabilities
- Deliver live performance dashboards (e.g., intent accuracy, latency, error rates) and document retraining strategies
- Lead and foster innovation around frameworks/models; collaborate with product, engineering, and client stakeholders
Qualifications / Experience
- Relevant degree (BSc, MSc, PhD preferred)
- Proven expertise in mathematics, classical ML algorithms, and deep knowledge of LLMs (prompting, fine-tuning, RAG, evaluation)
- Hands-on experience with AWS and Azure ML services (e.g., Bedrock, SageMaker, Azure OpenAI, Azure ML)
- Strong engineering skills: Python, APIs, containers, Git; experience with CI/CD (GitHub Actions, Azure DevOps), IaC (Terraform, CloudFormation)
- Experience with scalable serving infrastructure: containerized, auto-scaling (Kubernetes), low latency
- Workflow automation across the ML lifecycle: data ingestion, preprocessing, model retraining, deployment
- Experience with live performance dashboards and model registries
- Automated retraining workflows and documentation
- Experience with Kubernetes, inference optimization, caching, vector stores, model registries
- Excellent communication skills, stakeholder management, and ability to produce clear technical documentation
Personal Attributes
- Integrity, stakeholder management, project management, Agile methodologies, automation, data visualization, and analysis