Senior AI Reliability Engineer: LLM Serving & Resilience

Anthropic; Greater London; Hybrid; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Competitive compensation

Flexible working hours

Generous vacation and parental leave

Job summary

A leading AI research organization in Greater London is seeking a Senior Software Engineer to enhance the reliability of AI systems. This role involves developing Service Level Objectives and designing monitoring systems to optimize performance. Ideal candidates should have extensive experience in distributed systems and AI infrastructure. The organization promotes a collaborative environment with a commitment to diversity and ethical AI development, offering competitive compensation and work flexibility.

Qualifications

• Extensive experience with distributed systems observability and monitoring at scale.
• Understanding of challenges of operating AI infrastructure, including model serving.
• Experience implementing and maintaining SLO/SLA frameworks.

Responsibilities

• Develop Service Level Objectives for large language model systems.
• Design and implement monitoring systems for availability and latency.
• Lead incident response for critical AI services.

Skills

Distributed systems observability

AI infrastructure operation

SLO/SLA frameworks

Communication skills

Education

Bachelor's degree in a related field

Tools

Monitoring systems

AI-specific observability tools

Job description

A leading AI research organization in Greater London is seeking a Senior Software Engineer to enhance the reliability of AI systems. This role involves developing Service Level Objectives and designing monitoring systems to optimize performance. Ideal candidates should have extensive experience in distributed systems and AI infrastructure. The organization promotes a collaborative environment with a commitment to diversity and ethical AI development, offering competitive compensation and work flexibility.