Backend AI Platform Engineer – Scalable ML Infra

Engg; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Nexxa is seeking a Backend AI Engineer to design, build, and own core AI infrastructure powering production GenAI, ML, and CV solutions. You will create model-serving pipelines, inference services, data pipelines, and APIs to connect models with enterprise data sources.

You’ll architect scalable, real-time and batch systems, implement RAG pipelines, and drive reliability, observability, and CI/CD for ML services while collaborating with ML engineers, Forward Deployed teams, and product teams.

Qualifications

• Bachelor's degree in CS or related field.
• 5+ years of backend/ML infrastructure experience.
• Strong API design and distributed systems knowledge.
• Experience with ML/model integration in production.
• Proficiency with cloud platforms (AWS/GCP/Azure) and containerization.

Responsibilities

• Design, build, and maintain backend services and APIs powering GenAI, LLM, and CV model integrations.
• Build and own core AI/ML infrastructure: model-serving pipelines, inference services, data pipelines, and embedding/vector stores.
• Architect scalable, production-grade systems for real-time and batch AI workloads in manufacturing, infrastructure, and logistics.
• Implement and optimize RAG systems, prompt/context pipelines, and orchestration layers for enterprise data connections.
• Develop robust APIs and microservices connecting AI systems to customer data and legacy systems.
• Ensure reliability, performance, and observability with logging, monitoring, and CI/CD for ML services.
• Collaborate with Forward Deployed Engineers, ML engineers, and product teams to translate requirements into reusable backend capabilities.
• Evaluate and integrate ML/CV/LLM models into production backends; manage versioning and deployment pipelines.

Skills

Backend eng

API design

Distributed systems

TypeScript/Node.js

Python ML

Education

Bachelor's degree in CS or related

Tools

Docker

Kubernetes

Cloud platforms

Kafka

gRPC

WebSockets

Job description

Nexxa is seeking a Backend AI Engineer to design, build, and own core AI infrastructure powering production GenAI, ML, and CV solutions. You will create model-serving pipelines, inference services, data pipelines, and APIs to connect models with enterprise data sources.

You’ll architect scalable, real-time and batch systems, implement RAG pipelines, and drive reliability, observability, and CI/CD for ML services while collaborating with ML engineers, Forward Deployed teams, and product teams.