Backend Engineer – AI Pipelines & AWS DevOps

My Custom AI; Santa Clara (CA); On-site; USD 140,000 - 200,000; Full time

Job summary

My Custom AI in Santa Clara, CA is seeking a Backend Engineer to shape backend systems powering AI applications. You will build pipelines, integrate custom models hosted on Hugging Face via REST APIs, and optimize performance and cost for large-scale workloads.

Collaborate with ML and frontend teams, deploy infrastructure on AWS, design scalable, fault-tolerant workflows, monitor with CloudWatch, and ensure operations run smoothly across real-time and batch processes.

Qualifications

• Proficiency in Python.
• Experience with REST API integration.
• Solid understanding of AWS services: EC2, S3, RDS, CloudFormation, spot fleets, and auto-scaling groups.
• Hands-on experience with Docker.
• Expertise in cost optimization and performance tuning for GPU workloads.
• Strong SQL skills (NoSQL knowledge is a plus).

Responsibilities

• Build and maintain pipelines to integrate custom AI models hosted on Hugging Face via REST APIs.
• Optimize API calls for cost efficiency and peak performance.
• Design, implement, and maintain scalable, fault-tolerant pipelines for real-time and batch processing workflows.
• Manage data preprocessing and postprocessing workflows for AI models.
• Deploy and manage infrastructure using AWS services: EC2, S3, RDS, spot fleets, auto-scaling groups, load balancers, and CloudFormation.
• Optimize GPU instance workloads at scale (hundreds of machines in parallel).
• Configure custom AMIs and implement auto-scaling strategies tailored to operational needs.
• Build backend systems capable of handling large parallel workloads with minimal downtime.
• Monitor and optimize system performance using AWS CloudWatch.
• Work closely with machine learning engineers, full-stack engineers, and other team members for seamless integration.

Skills

Python

REST API

AWS

Docker

SQL

NoSQL

GPU optimization

Job description

My Custom AI in Santa Clara, CA is seeking a Backend Engineer to shape backend systems powering AI applications. You will build pipelines, integrate custom models hosted on Hugging Face via REST APIs, and optimize performance and cost for large-scale workloads.

Collaborate with ML and frontend teams, deploy infrastructure on AWS, design scalable, fault-tolerant workflows, monitor with CloudWatch, and ensure operations run smoothly across real-time and batch processes.