Backend AI Engineer — Scalable ML Infra

Nexxa.AI

Sunnyvale (CA)

Hybrid

USD 150,000 - 210,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Nexxa.AI is seeking a Backend AI Engineer to design, build, and own core AI infrastructure that powers Nexxa’s products in production. You will develop model-serving pipelines, inference services, and data pipelines, connecting Generative AI, CV, and ML models to enterprise environments.

This role blends backend software engineering, ML infrastructure, and systems architecture, requiring you to craft scalable, reliable systems and collaborate with cross-functional teams.

Qualifications

  • 4–8+ years in backend software engineering or ML infrastructure.
  • Strong API and microservice design; production experience.
  • Experience integrating ML/AI models into backend services.

Responsibilities

  • Design, build, and maintain backend services and APIs powering GenAI, LLM, and Computer Vision integrations.
  • Build and own AI/ML infra: model-serving pipelines, inference services, data pipelines, embedding/vector stores.
  • Architect scalable, production-grade systems for real-time and batch workloads.
  • Implement RAG systems, prompt pipelines, and orchestration layers.
  • Create robust APIs and integration layers with enterprise data and legacy systems.
  • Ensure reliability, observability, and CI/CD for ML services.
  • Collaborate with Forward Deployed Engineers, ML engineers, and product teams.
  • Manage model versioning, rollout, and deployment pipelines.
  • Document architecture and API specs; produce runbooks.

Skills

Backend engineering
TypeScript/Node.js
Python
Distributed systems
Cloud platforms (AWS/GCP/Azure)
Docker & Kubernetes
ML model integration
RAG systems
APIs / microservices

Education

Bachelor’s degree in Computer Science or related field

Tools

Kafka
TensorFlow
PyTorch
OpenCV
gRPC
WebSockets

Job description

Nexxa.AI is seeking a Backend AI Engineer to design, build, and own core AI infrastructure that powers Nexxa’s products in production. You will develop model-serving pipelines, inference services, and data pipelines, connecting Generative AI, CV, and ML models to enterprise environments.

This role blends backend software engineering, ML infrastructure, and systems architecture, requiring you to craft scalable, reliable systems and collaborate with cross-functional teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Backend AI Engineer
Backend AI Engineer

Nexxa.AI • Sunnyvale (CA)

Hybrid
USD 150,000 - 210,000
AI Engineer: End-to-End ML & MLOps Architect
AI Engineer: End-to-End ML & MLOps Architect

nexacode • United States

On-site
USD 120,000 - 180,000
Production AI Engineer: Build & Deploy Scalable AI
Production AI Engineer: Build & Deploy Scalable AI

Nablon AI • United States

Remote
USD 140,000 - 190,000
Staff DevOps Engineer
Staff DevOps Engineer

Nexxa.ai • Sunnyvale (CA)

On-site
USD 200,000 - 260,000
Equity
Competitive compensation
Staff DevOps Engineer: Industrial AI Infra at Scale
Staff DevOps Engineer: Industrial AI Infra at Scale

Nexxa.ai • Sunnyvale (CA)

On-site
USD 200,000 - 260,000
Equity
Competitive compensation
Real-Time Ad Tech ML Engineer — Scalable AI & Optimization
Real-Time Ad Tech ML Engineer — Scalable AI & Optimization

Nexxen • Baltimore (MD)

Hybrid
USD 180,000 - 220,000
Medical
Dental
Vision
+6
Lead AI Systems Engineer (Java/Kotlin) — Remote
Lead AI Systems Engineer (Java/Kotlin) — Remote

N-iX • Union (NJ), Northern (KY)

Hybrid
USD 180,000 - 240,000
Flexible working format
Competitive salary
Mentorship program
+1
AI Platform Engineer II - Cloud & GenAI
AI Platform Engineer II - Cloud & GenAI

NexTech Solutions • Memphis (TN)

Hybrid
USD 110,000 - 170,000
Backend/Infra Engineer for Scalable Video AI Platform
Backend/Infra Engineer for Scalable Video AI Platform

Nomadic AI • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Senior AI-Native Backend Engineer
Senior AI-Native Backend Engineer

Lean Solutions Group • Washington

On-site
USD 140,000 - 190,000