Backend / AI Infrastructure Engineer

Flaredog; United States; Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Fully remote

Ownership from the start

Async-first culture

Job summary

Flaredog is seeking a backend engineer to build and operate the infrastructure that makes AI systems run reliably and safely in production. You will work on model serving, orchestration, observability, and cost management in a small, async-first team.

This fully remote role is arranged within your United States timezone. You will own the system end to end, contribute to design reviews, and collaborate closely with the founders to ship durable, scalable services.

Qualifications

• Strong backend engineering skills in Python, Go, or both.
• Experience operating production services.
• Practical understanding of reliability, retry behavior, tracing, and cost control in AI or LLM systems.
• Ability to own a system end to end in a small team.
• Clear written communication in code reviews and design documents.

Responsibilities

• Design and build infrastructure for AI serving, orchestration, retries, and durable execution.
• Make system runs traceable and debuggable using observability tools, metrics, and replay capabilities.
• Strengthen security and access controls for enterprise use.
• Monitor and manage the costs of LLM workloads.
• Work with a small team to take systems through implementation and production delivery.

Skills

Python

Go

Backend engineering

Job description

Role overview

Build and operate the backend infrastructure that helps AI systems run reliably and safely in production. The work spans model serving, orchestration, durable execution, observability, security, and cost management, with responsibility for delivering systems into real production environments.

Responsibilities

• Design and build infrastructure for AI serving, orchestration, retries, and durable execution.
• Make system runs traceable and debuggable using observability tools, metrics, and replay capabilities.
• Strengthen security and access controls for enterprise use.
• Monitor and manage the costs of LLM workloads.
• Work with a small team to take systems through implementation and production delivery.

Requirements

• Strong backend engineering skills in Python, Go, or both.
• Experience operating production services.
• Practical understanding of reliability, retry behavior, tracing, and cost control in AI or LLM systems.
• Ability to own a system end to end in a small team.
• Clear written communication in code reviews and design documents.

Nice to have

• Experience with event sourcing or durable execution tools such as Temporal.
• Background in large-scale MLOps, LLM gateways, or agent frameworks.
• Relevant open-source contributions.

Benefits and work setup

• Fully remote, with work arranged within your timezone.
• Ownership of your area from the start, with direct access to founders.
• Small, experienced team and an async-first culture with few meetings.