Backend Engineer

Procom; United States; Remote; USD 110,000 - 170,000; Full time

Job summary

Procom is seeking a Backend Engineer for a permanent, remote role based in Austin, Texas. You will own the inference and orchestration layer powering AI interactions and build production systems that expose fast, observable APIs across clients.

Responsibilities include designing inference pipelines, managing monitoring and incident response, and optimizing latency across caching, batching, and streaming. Strong backend fundamentals and experience with high-throughput services are essential.

Qualifications

• Experience building production-grade backend services.
• Ability to operate high-throughput, low-latency systems.
• Familiarity with AI inference patterns (LLMs, embeddings).
• Bias toward shipping and learning from production metrics.

Responsibilities

• Own inference and orchestration layers powering AI features.
• Design pipelines, boundaries, and production readiness.
• Monitor, log, alert, and respond to incidents.
• Optimize latency across inference, caching, batching, and streaming.

Skills

Backend fundamentals

High-throughput services

AI inference patterns

Distributed systems debugging

Shipping in production

Tools

Kubernetes

Docker

Python

NodeJs

PyTorch

Open-source LLMs

SQL

NoSQL

Job description

Backend Engineer:On behalf of our technology client, Procom is searching for a Backend Engineer for a permanent role. This position is a remote position based in Austin, Texas.Job Description:As a Backend Engineer, AI, you will be responsible for owning the inference and orchestration layer that powers every AI interaction in the product. You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.Responsibilities:• Build and operate backend systems that serve AI-powered features in production.• Design inference pipelines, orchestration layers, and service boundaries around models.• Own production concerns: monitoring, logging, alerting, and incident response.• Optimize latency and throughput across inference, caching, batching, and streaming.Mandatory Skills:• Strong backend engineering fundamentals in production environments.• Experience running high-throughput, low-latency services.• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).• Comfortable debugging distributed systems under load.• Bias toward shipping and learning from production behavior.Nice-to-Have Skills:• Experience with Python and NodeJs.• Familiarity with Pytorch and open-source LLMs.• Knowledge of SQL & noSQL databases.• Experience with Kubernetes and Docker.• Strong communication and teamwork skills.Assignment Length:This is a permanent position.Backend Engineer - Start Date:ASAP.Backend Engineer - Assignment Location:Remote position based in Austin, Texas, United States.