Senior AI Platform Engineer — APIs & Observability

Polluxa, Inc.; United States; On-site; USD 120,000 - 200,000; Full time

Job summary

Polluxa, Inc. is seeking an experienced software engineer to design and implement API gateways, routing layers, and scalable service infrastructure for production AI workflows. You will build internal tooling and dashboards to accelerate AI feature delivery and ensure seamless integration with existing LightBox workflows.

You will collaborate with ML engineers on model serving and contribute to architecture discussions, owning features end-to-end from design to deployment and monitoring.

Qualifications

• 6+ years of software engineering experience with a strong full-stack foundation.
• Production experience building APIs, microservices, and platform infrastructure in Python and/or TypeScript/Node.js.
• Solid understanding of cloud infrastructure (AWS or GCP), containerization (Docker, Kubernetes), and CI/CD pipelines.
• Experience building developer-facing tools, SDKs, or internal platforms that other engineers consume.
• Familiarity with LLM integration patterns: API-based model consumption, prompt engineering, retrieval-augmented generation, and tool/function calling.

Responsibilities

• Design and implement API gateways, model routing layers, and service infrastructure that connect fine-tuned CRE models with production applications.
• Develop internal developer tooling - prompt management interfaces, evaluation dashboards, trace viewers - that accelerate the team's ability to ship and iterate on AI features.
• Implement integration patterns for embedding AI capabilities into LightBox's existing workflow applications, ensuring seamless user experiences.
• Build observability and monitoring infrastructure for AI workloads: latency tracking, quality metrics, cost attribution, and usage analytics.
• Contribute to the platform's knowledge retrieval and caching layers, optimizing for both accuracy and performance at scale.
• Collaborate with ML engineers on model serving infrastructure, helping bridge the gap between training outputs and production deployment.
• Participate in architecture decisions and technical design reviews, bringing a pragmatic full-stack perspective to the team's work.

Skills

API gateways

Microservices

Full-stack

Python

TypeScript/Node.js

Cloud infrastructure

Docker

Kubernetes

CI/CD

LLM integration patterns

Model serving frameworks

Observability

Data modeling

API design

Distributed systems

Tools

LiteLLM

OpenRoute

AWS BedRock

Docker

Kubernetes

Job description

Polluxa, Inc. is seeking an experienced software engineer to design and implement API gateways, routing layers, and scalable service infrastructure for production AI workflows. You will build internal tooling and dashboards to accelerate AI feature delivery and ensure seamless integration with existing LightBox workflows.

You will collaborate with ML engineers on model serving and contribute to architecture discussions, owning features end-to-end from design to deployment and monitoring.