Backend Engineer (AI Integration & AWS DevOps)

My Custom AI; Santa Clara (CA); On-site; USD 140,000 - 200,000; Full time

Job summary

My Custom AI in Santa Clara, CA is seeking a Backend Engineer to shape backend systems powering AI applications. You will build pipelines, integrate custom models hosted on Hugging Face via REST APIs, and optimize performance and cost for large-scale workloads.

Collaborate with ML and frontend teams, deploy infrastructure on AWS, design scalable, fault-tolerant workflows, monitor with CloudWatch, and ensure operations run smoothly across real-time and batch processes.

Qualifications

• Proficiency in Python.
• Experience with REST API integration.
• Solid understanding of AWS services: EC2, S3, RDS, CloudFormation, spot fleets, and auto-scaling groups.
• Hands-on experience with Docker.
• Expertise in cost optimization and performance tuning for GPU workloads.
• Strong SQL skills (NoSQL knowledge is a plus).

Responsibilities

• Build and maintain pipelines to integrate custom AI models hosted on Hugging Face via REST APIs.
• Optimize API calls for cost efficiency and peak performance.
• Design, implement, and maintain scalable, fault-tolerant pipelines for real-time and batch processing workflows.
• Manage data preprocessing and postprocessing workflows for AI models.
• Deploy and manage infrastructure using AWS services: EC2, S3, RDS, spot fleets, auto-scaling groups, load balancers, and CloudFormation.
• Optimize GPU instance workloads at scale (hundreds of machines in parallel).
• Configure custom AMIs and implement auto-scaling strategies tailored to operational needs.
• Build backend systems capable of handling large parallel workloads with minimal downtime.
• Monitor and optimize system performance using AWS CloudWatch.
• Work closely with machine learning engineers, full-stack engineers, and other team members for seamless integration.

Skills

Python

REST API

AWS

Docker

SQL

NoSQL

GPU optimization

Job description

We are looking for a talented Backend Engineer to join our team, working on backend systems that power cutting-edge AI applications. This role focuses on API integration, AWS DevOps, and building scalable systems to handle large-scale workloads.

If you're passionate about backend engineering, AI integration, and tackling challenges at scale, we'd love to hear from you!

Responsibilities

• Build and maintain pipelines to integrate custom AI models hosted on Hugging Face via REST APIs.


• Optimize API calls for cost efficiency and peak performance.


• Design, implement, and maintain scalable, fault-tolerant pipelines for real-time and batch processing workflows.


• Manage data preprocessing and postprocessing workflows for AI models.

AWS DevOps

• Deploy and manage infrastructure using AWS services: EC2, S3, RDS, spot fleets, auto-scaling groups, load balancers, and CloudFormation.


• Optimize GPU instance workloads at scale (hundreds of machines in parallel).


• Configure custom AMIs and implement auto-scaling strategies tailored to operational needs.

System Scalability & Monitoring

• Build backend systems capable of managing large parallel workloads with minimal downtime.


• Monitor and optimize system performance using AWS CloudWatch.


• Work closely with machine learning engineers, full-stack engineers, and other team members to ensure seamless integration and operational excellence.

Requirements

Technical Skills

• Proficiency in Python.


• Experience with REST API integration.


• Solid understanding of AWS services: EC2, S3, RDS, CloudFormation, spot fleets, and auto-scaling groups.


• Hands‑on experience with Docker.


• Expertise in cost optimization and performance tuning for GPU workloads.


• Strong SQL skills (NoSQL knowledge is a plus).

Experience

• Proven track record of building scalable backend systems and AI/ML application pipelines.


• Experience managing real‑time and batch processing workflows.


• Familiarity with monitoring tools like AWS CloudWatch.


• Ideally AWS Certified

Soft Skills

• Strong problem-solving abilities and ability to work independently.


• Excellent communication skills for cross-functional collaboration.

Why Join Us?

• Work on groundbreaking AI projects that solve real-world problems across diverse industries.


• Be part of a high-impact team, leveraging cutting-edge technologies to build scalable systems at scale.


• Collaborate with a talented and passionate team of engineers.