Staff Engineer, Inference at Scale

Anthropic; Dublin; Hybrid; EUR 120,000 - 180,000; Full time

Benefits offered by this job

Competitive compensation

Flexible working hours

Generous vacation and parental leave

Office space for collaboration

Job summary

A technology company focused on AI in Dublin is seeking a Staff Software Engineer for the Inference team. You will optimize infrastructure to serve AI models to millions of users. Candidates should have experience in performance optimization and distributed systems. This role offers opportunities to contribute to impactful AI research and requires at least a Bachelor's degree. Hybrid work is expected part-time in the office.

Qualifications

• Significant software engineering experience, particularly with distributed systems.
• Results-oriented, with a bias towards flexibility and impact.
• Willing to pick up slack, even if it goes outside your job description.
• Desire to learn more about machine learning systems and infrastructure.
• Able to thrive in environments where technical excellence drives business results.

Responsibilities

• Identify and address key infrastructure blockers.
• Serve Claude to millions of users.
• Enable breakthrough AI research.
• Design intelligent routing algorithms.
• Autoscale compute fleet to match supply with demand.

Skills

Performance optimization

Distributed systems

Large-scale service orchestration

Intelligent request routing

Load balancing

Request routing

Traffic management systems

Kubernetes

Cloud infrastructure (AWS, GCP)

Python

Rust

Education

Bachelor's degree in a related field

Job description

A technology company focused on AI in Dublin is seeking a Staff Software Engineer for the Inference team. You will optimize infrastructure to serve AI models to millions of users. Candidates should have experience in performance optimization and distributed systems. This role offers opportunities to contribute to impactful AI research and requires at least a Bachelor's degree. Hybrid work is expected part-time in the office.