AI Infrastructure Specialist

Software

United States

Remote

USD 95,000 - 155,000

Full time

1 hour ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health, dental, and vision insurance
100% remote work
Flexible working arrangements
Paid time off and holidays
Retirement savings benefits
Professional development and technical
Certification support

Job summary

Software is seeking an AI Infrastructure Specialist to design, deploy, and maintain scalable AI and ML infrastructure in a fully remote US-based team. You’ll manage cloud platforms (AWS/Azure/GCP), optimize GPU environments, and implement MLOps pipelines to support model training, deployment, and inference.

The role requires 2–6 years of experience in AI infrastructure, strong Linux and scripting skills, and hands-on Docker/Kubernetes expertise. Remote work across the United States is offered.

Qualifications

  • 2–6 years of experience in AI infrastructure, Cloud Infrastructure, DevOps, or related field.
  • Strong knowledge of AWS, Azure, or Google Cloud platforms.
  • Hands-on experience with Docker and Kubernetes.
  • Understanding of GPU computing and AI workload optimization.
  • Experience with Linux administration and system troubleshooting.

Responsibilities

  • Design, deploy, and maintain scalable infrastructure for AI and machine learning applications.
  • Manage cloud-based AI infrastructure across AWS, Azure, or Google Cloud.
  • Configure and optimize GPU-based computing environments for AI workloads.
  • Implement and maintain Kubernetes clusters and Docker containers.
  • Support AI model training, deployment, and inference environments.
  • Build and maintain MLOps pipelines for continuous integration and deployment.
  • Monitor infrastructure performance, availability, scalability, and resource utilization.

Skills

Cloud platforms (AWS/Azure/GCP)
Linux administration
Python/Bash scripting
CI/CD pipelines
ML model deployment workflows
Infrastructure as code
GPU computing knowledge
Security fundamentals

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Docker
Kubernetes
Terraform
Ansible
Prometheus
Grafana
Datadog

Job description

Headquarters: United States

Location: United States (Remote)

Work Mode: 100% Remote

Experience: 2–6 Years

Salary Range: $95,000 – $155,000 per year (USD)

Employment Type: Full-Time

Job Category: Artificial Intelligence / Cloud Infrastructure / DevOps

Job Title: AI Infrastructure Specialist

Job SummaryWe are seeking a skilled and experienced AI Infrastructure Specialist to join our growing technology team in the United States. The ideal candidate will be responsible for designing, building, deploying, and maintaining scalable infrastructure to support AI and machine learning workloads. The candidate should have strong knowledge of cloud infrastructure, GPU computing, containerization, Kubernetes, MLOps, and AI model deployment. This role involves optimizing infrastructure performance, ensuring scalability, and supporting reliable AI-powered applications. This position offers a fully remote work opportunity for qualified candidates across the United States.

Key Responsibilities
  • Design, deploy, and maintain scalable infrastructure for AI and machine learning applications.
  • Manage cloud-based AI infrastructure across AWS, Microsoft Azure, or Google Cloud.
  • Configure and optimize GPU-based computing environments for AI workloads.
  • Implement and maintain Kubernetes clusters and Docker containers.
  • Support AI model training, deployment, and inference environments.
  • Build and maintain MLOps pipelines for continuous integration and deployment.
  • Monitor infrastructure performance, availability, scalability, and resource utilization.
  • Optimize GPU, CPU, memory, and storage resources for AI workloads.
  • Implement infrastructure automation using Terraform, Ansible, or similar tools.
  • Collaborate with AI engineers, ML engineers, and DevOps teams.
  • Implement infrastructure security, access controls, and monitoring solutions.
  • Troubleshoot infrastructure issues and ensure system reliability.
  • Maintain technical documentation and infrastructure best practices.
Required Skills & Qualifications
  • 2–6 years of experience in AI Infrastructure, Cloud Infrastructure, DevOps, or a related field.
  • Strong knowledge of AWS, Azure, or Google Cloud platforms.
  • Hands-on experience with Docker and Kubernetes.
  • Understanding of GPU computing and AI workload optimization.
  • Experience with Linux administration and system troubleshooting.
  • Knowledge of Python, Bash, or Shell scripting.
  • Familiarity with machine learning model deployment and inference workflows.
  • Experience with CI/CD pipelines and infrastructure automation.
  • Knowledge of Terraform, Ansible, or similar infrastructure tools.
  • Understanding of networking, storage, and cloud security fundamentals.
  • Experience with monitoring tools such as Prometheus, Grafana, or Datadog.
  • Strong analytical, troubleshooting, and problem-solving skills.
Preferred Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Experience with NVIDIA GPUs, CUDA, and GPU resource management.
  • Familiarity with MLflow, Kubeflow, Ray, or similar MLOps frameworks.
  • Knowledge of LLM deployment and inference optimization.
  • Experience with distributed computing and high-performance computing (HPC).
  • Familiarity with serverless AI infrastructure and microservices architecture.
  • Understanding of model serving frameworks such as NVIDIA Triton, vLLM, or TorchServe.
  • Experience managing large-scale AI infrastructure environments.
Salary & Benefits
  • Annual Salary: $95,000 – $155,000 USD.
  • Competitive compensation based on experience and technical expertise.
  • 100% remote work opportunity.
  • Flexible working arrangements.
  • Health, dental, and vision insurance.
  • Paid time off and holidays.
  • Retirement savings benefits, where applicable.
  • Professional development and technical certification support.
  • Career advancement opportunities.
Work Location

United States – Fully Remote

Candidates from eligible locations across the United States are encouraged to apply.

Legal Authorization

Must be legally authorized to work in the United States.

Ability to collaborate with distributed engineering teams across different US time zones.

Equal Opportunity Employer

We welcome qualified candidates from diverse professional backgrounds and encourage applications from eligible candidates across the United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Specialist
AI Infrastructure Specialist

EdgeQ Technologies Private Limited • United States

Remote
USD 95,000 - 155,000
AI Infrastructure Specialist | MLOps & GPU Cloud Role
AI Infrastructure Specialist | MLOps & GPU Cloud Role

EdgeQ Technologies Private Limited • United States

Remote
USD 95,000 - 155,000
100% remote
Health insurance
Professional development support
+2
Senior AI Engineer - Cloud Infrastructure
Senior AI Engineer - Cloud Infrastructure

Placements24 • United States

Remote
USD 150,000 - 210,000
Health insurance
Retirement plan
Flexible PTO
+2
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Digivance Solutions • United States

Remote
USD 140,000 - 190,000
Remote AI Infrastructure Engineer (GPU/MLOps)
Remote AI Infrastructure Engineer (GPU/MLOps)

Software • United States

Remote
USD 95,000 - 155,000
Health, dental, and vision insurance
100% remote work
Flexible working arrangements
+4
AI Engineer
AI Engineer

Pavago • United States

Remote
USD 120,000 - 180,000
Machine Learning Data Engineer
Machine Learning Data Engineer

EdgeQ Technologies Private Limited • United States

Remote
USD 110,000 - 175,000
AI Data Quality Analyst
AI Data Quality Analyst

Zim Directory • United States

Remote
USD 70,000 - 115,000
Remote work
Health, dental, vision insurance
Paid time off
+2
AI Data Quality Analyst
AI Data Quality Analyst

EdgeQ Technologies Private Limited • United States

Remote
USD 70,000 - 115,000
100% remote work
Health, dental, and vision insurance
Paid time off and holidays
+3
AI/ML Engineer
AI/ML Engineer

Nexdew Tech • United States

Hybrid
USD 120,000 - 170,000
Competitive compensation
Performance incentives
Cutting-edge AI projects
+1