Staff Software Engineer, Inference at Scale

Anthropic; Dublin; Hybrid; EUR 80,000 - 110,000; Full time

Benefits offered by this job

Competitive compensation

Flexible working hours

Generous vacation and parental leave

Job summary

A tech company specializing in AI in Dublin is seeking a Staff Software Engineer for the Inference team. This role involves building and optimizing critical systems that serve millions of users while enabling advanced AI research. The ideal candidate will have a strong background in software engineering, particularly in distributed systems. The company offers competitive compensation, flexible working hours, and a collaborative work environment focused on impactful AI research.

Qualifications

• Significant software engineering experience, particularly with distributed systems.
• Results-oriented and flexible with a focus on impact.
• Willingness to learn about machine learning systems and infrastructure.

Responsibilities

• Work end to end to identify and address infrastructure blockers.
• Optimize request distribution across thousands of accelerators.
• Dynamically manage compute resources based on workflow demands.

Skills

Distributed systems

Performance optimization

Service orchestration

Request routing

Machine learning systems

Education

Bachelor's degree in a related field

Tools

Kubernetes

AWS

GCP

Python

Rust

Job description

A tech company specializing in AI in Dublin is seeking a Staff Software Engineer for the Inference team. This role involves building and optimizing critical systems that serve millions of users while enabling advanced AI research. The ideal candidate will have a strong background in software engineering, particularly in distributed systems. The company offers competitive compensation, flexible working hours, and a collaborative work environment focused on impactful AI research.