AI Infrastructure / Product Engineer, Mid-Level

Remote Jobs; United States; Remote; USD 180,000 - 260,000; Full time

Job summary

Remote Jobs is seeking a software/infra/product engineer to join a distributed team at the intersection of AI research and product development. You will turn AI experiments into reliable products for legal work, building evaluation systems, services, and features needed to bring applied AI into production.

Responsibilities include building benchmarks, dashboards, turning prototypes into production workflows, developing backend services and APIs, and deploying cloud infrastructure.

Qualifications

• Strong Python skills and hands-on cloud deployment experience.
• Experience building evaluation pipelines, benchmarks, or assessment systems for ML/AI systems.
• Experience with APIs, databases, backend services, deployment pipelines, and dashboards or monitoring systems.

Responsibilities

• Build repeatable benchmarks and evaluation pipelines to measure accuracy, hallucinations, retrieval quality, latency, and cost.
• Create dashboards that help the team understand changes in system performance.
• Turn research prototypes into usable retrieval, drafting, document, and agent workflows.
• Build backend services, APIs, and internal tools for testing and releasing improvements.
• Deploy and operate cloud infrastructure, including monitoring, databases, delivery pipelines, and reliable operations.
• Work closely with AI research while staying connected to product and user needs.

Skills

Python

Cloud deployment

Evaluation pipelines

LLMs interest

Tools

FastAPI

Docker

React

Next.js

Postgres

Vector databases

APIs

Backend services

Job description

About the Role

Join a distributed team working at the intersection of AI research and product development. You will turn AI experiments into reliable products for legal work, building the evaluation systems, services, and features needed to bring applied AI into production.

What You'll Do

• Build repeatable benchmarks and evaluation pipelines to measure accuracy, hallucinations, retrieval quality, latency, and cost.
• Create dashboards that help the team understand changes in system performance.
• Turn research prototypes into usable retrieval, drafting, document, and agent workflows.
• Build backend services, APIs, and internal tools for testing and releasing improvements.
• Deploy and operate cloud infrastructure, including monitoring, databases, delivery pipelines, and reliable operations.
• Work closely with AI research while staying connected to product and user needs.

What We're Looking For

• At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.
• Strong Python skills and hands-on cloud deployment experience.
• Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.
• Experience with APIs, databases, backend services, deployment pipelines, and dashboards or monitoring systems.
• Ability to turn experimental code and ambiguous ideas into maintainable products.
• Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation.
• Full-stack experience is a plus. Familiarity with FastAPI, Docker, React, Next.js, Postgres, or vector databases is helpful.

Compensation & Benefits

Annual base salary is $180,000 to $260,000 USD, depending on relevant skills, experience, and role scope.

Visa sponsorship is not available.

Location

Remote within the United States.