Developer Experience Engineer for AI Inference Tools

Fractile Ltd.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Competitive salary

Equity ownership

Medical, Dental & Vision

25 days holiday + bank holidays

Job summary

Fractile Ltd. is advancing AI inference hardware with a software UX that empowers developers to interact with the Fractile inference accelerator. You will help shape tooling, workflows, and integrations used by LLM engineers.

You will identify opportunities to improve performance, deliver practical tools, and ensure minimal disruption to engineers’ existing toolsets. This role sits in the Developer Experience within the Software organisation.

Qualifications

• Experience with inference frameworks such as JAX and PyTorch.
• Experience coding in Python, Rust, C/C++ or similar.
• Experience monitoring and optimizing CUDA, ROCm, OpenCL code.
• Experience deploying large language models (50+ billion parameters).
• Experience collaborating with multiple teams and stakeholders.

Responsibilities

• Shape how customers interact with the Fractile inference accelerator.
• Identify tooling opportunities and design them for LLM engineers.
• Deliver tools that fit into existing workflows with minimal disruption.

Skills

Inference frameworks

Programming languages

GPU optimization

LLM deployments

Cross-team collaboration

Tools

CUDA

ROCm

OpenCL

Job description

Fractile Ltd. is advancing AI inference hardware with a software UX that empowers developers to interact with the Fractile inference accelerator. You will help shape tooling, workflows, and integrations used by LLM engineers.

You will identify opportunities to improve performance, deliver practical tools, and ensure minimal disruption to engineers’ existing toolsets. This role sits in the Developer Experience within the Software organisation.