AI Infrastructure Specialist

Ali Aydi

United States

Remote

USD 95,000 - 155,000

Full time

Just now
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

100% remote work
Health insurance
Paid time off

Job summary

Ali Aydi is seeking an AI Infrastructure Specialist to design, build, deploy, and maintain scalable AI-focused infrastructure in a fully remote US-wide team. The role centers on cloud platforms, GPU computing, containerization, Kubernetes, MLOps, and reliable AI model deployment.

You will optimize performance, ensure scalability, and support AI-powered applications while collaborating with AI engineers and DevOps. Remote work across the United States is supported.

Qualifications

  • 2–6 years of experience in AI Infrastructure, Cloud Infrastructure, DevOps, or related field.
  • Strong knowledge of AWS, Azure, or Google Cloud platforms.
  • Hands-on experience with Docker and Kubernetes.
  • Understanding of GPU computing and AI workload optimization.
  • Experience with Linux administration and system troubleshooting.

Responsibilities

  • Design, deploy, and maintain scalable infrastructure for AI and ML applications.
  • Manage cloud-based AI infrastructure across AWS, Azure, or Google Cloud.
  • Configure and optimize GPU-based computing environments for AI workloads.

Skills

AI Infrastructure
Cloud IaaS
DevOps
Linux administration
Python scripting
CI/CD

Education

Bachelor's or Master's degree in CS/IT/Engineering

Tools

Docker
Kubernetes
Terraform
Ansible
Prometheus
Grafana
Datadog
NVIDIA CUDA

Job description

Job Title: AI Infrastructure Specialist
Location: United States (Remote)
Work Mode: 100% Remote
Experience: 2–6 Years
Salary Range: $95,000 – $155,000 per year (USD)
Employment Type: Full-Time
Job Category: Artificial Intelligence / Cloud Infrastructure / DevOps

Job Summary

We are seeking a skilled and experienced AI Infrastructure Specialist to join our growing technology team in the United States. The ideal candidate will be responsible for designing, building, deploying, and maintaining scalable infrastructure to support AI and machine learning workloads.

The candidate should have strong knowledge of cloud infrastructure, GPU computing, containerization, Kubernetes, MLOps, and AI model deployment. This role involves optimizing infrastructure performance, ensuring scalability, and supporting reliable AI-powered applications.

This position offers a fully remote work opportunity for qualified candidates across the United States.

Key Responsibilities
  • Design, deploy, and maintain scalable infrastructure for AI and machine learning applications.
  • Manage cloud-based AI infrastructure across AWS, Microsoft Azure, or Google Cloud.
  • Configure and optimize GPU-based computing environments for AI workloads.
  • Implement and maintain Kubernetes clusters and Docker containers.
  • Support AI model training, deployment, and inference environments.
  • Build and maintain MLOps pipelines for continuous integration and deployment.
  • Monitor infrastructure performance, availability, scalability, and resource utilization.
  • Optimize GPU, CPU, memory, and storage resources for AI workloads.
  • Implement infrastructure automation using Terraform, Ansible, or similar tools.
  • Collaborate with AI engineers, ML engineers, and DevOps teams.
  • Implement infrastructure security, access controls, and monitoring solutions.
  • Troubleshoot infrastructure issues and ensure system reliability.
  • Maintain technical documentation and infrastructure best practices.
Required Skills & Qualifications
  • 2–6 years of experience in AI Infrastructure, Cloud Infrastructure, DevOps, or a related field.
  • Strong knowledge of AWS, Azure, or Google Cloud platforms.
  • Hands-on experience with Docker and Kubernetes.
  • Understanding of GPU computing and AI workload optimization.
  • Experience with Linux administration and system troubleshooting.
  • Knowledge of Python, Bash, or Shell scripting.
  • Familiarity with machine learning model deployment and inference workflows.
  • Experience with CI/CD pipelines and infrastructure automation.
  • Knowledge of Terraform, Ansible, or similar infrastructure tools.
  • Understanding of networking, storage, and cloud security fundamentals.
  • Experience with monitoring tools such as Prometheus, Grafana, or Datadog.
  • Strong analytical, troubleshooting, and problem-solving skills.
Preferred Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Experience with NVIDIA GPUs, CUDA, and GPU resource management.
  • Familiarity with MLflow, Kubeflow, Ray, or similar MLOps frameworks.
  • Knowledge of LLM deployment and inference optimization.
  • Experience with distributed computing and high-performance computing (HPC).
  • Familiarity with serverless AI infrastructure and microservices architecture.
  • Understanding of model serving frameworks such as NVIDIA Triton, vLLM, or TorchServe.
  • Experience managing large-scale AI infrastructure environments.
Salary & Benefits
  • Competitive compensation based on experience and technical expertise.
  • 100% remote work opportunity.
  • Flexible working arrangements.
  • Health, dental, and vision insurance.
  • Paid time off and holidays.
  • Retirement savings benefits, where applicable.
  • Professional development and technical certification support.
Work Location

United States – Fully Remote

  • Candidates from eligible locations across the United States are encouraged to apply.
  • Must be legally authorized to work in the United States.
  • Ability to collaborate with distributed engineering teams across different US time zones.

Equal Opportunity Employer: We welcome qualified candidates from diverse professional backgrounds and encourage applications from eligible candidates across the United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Specialist
AI Infrastructure Specialist

EdgeQ Technologies Private Limited • United States

Remote
USD 95,000 - 155,000
AI Infrastructure Specialist
AI Infrastructure Specialist

Software • United States

Remote
USD 95,000 - 155,000
Health, dental, and vision insurance
100% remote work
Flexible working arrangements
+4
AI Infrastructure Specialist | MLOps & GPU Cloud Role
AI Infrastructure Specialist | MLOps & GPU Cloud Role

EdgeQ Technologies Private Limited • United States

Remote
USD 95,000 - 155,000
100% remote
Health insurance
Professional development support
+2
Remote AI Infrastructure Engineer (GPU/MLOps)
Remote AI Infrastructure Engineer (GPU/MLOps)

Software • United States

Remote
USD 95,000 - 155,000
Health, dental, and vision insurance
100% remote work
Flexible working arrangements
+4
Senior AI Engineer - Cloud Infrastructure
Senior AI Engineer - Cloud Infrastructure

Placements24 • United States

Remote
USD 150,000 - 210,000
Health insurance
Retirement plan
Flexible PTO
+2
AI Data Quality Analyst
AI Data Quality Analyst

EdgeQ Technologies Private Limited • United States

Remote
USD 70,000 - 115,000
100% remote work
Health, dental, and vision insurance
Paid time off and holidays
+3
AI/ML Engineer
AI/ML Engineer

BITS, Inc. • United States

Remote
USD 125,000 - 130,000
Remote work
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
AI Engineer
AI Engineer

Pioneer Consulting Services LLC • Princeton (NJ)

Hybrid
USD 120,000 - 180,000
Cloud Solutions Architect
Cloud Solutions Architect

Syntas • United States

Remote
USD 160,000 - 220,000
401(k) with company match
12 weeks paid parental leave
$1,000 home office stipend
+2