Senior AI Infrastructure Architect

EEHO

United States

On-site

USD 115,000 - 235,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

EEHO is seeking a Senior Core Infrastructure Engineer to design, implement, and maintain scalable, reliable infrastructure supporting AI/ML initiatives. You’ll work with data scientists, software engineers, and IT professionals to deploy secure, cost-effective solutions at scale.

The role involves hands-on troubleshooting for POC and production deployments, building fault‑tolerant components, and driving automation, monitoring, and incident response across multi‑tenant environments.

Responsibilities

  • System Design & Architecture - System Scalability: Implements and contributes to the development for components of distributed systems that support horizontal and vertical scaling including leveraging distributed state management tools.
  • System Design & Architecture - System Scalability: Optimizes code and/or systems for large-scale data processing in large-scale systems.
  • System Design & Architecture - System Scalability: Implements scalability requirements for assigned components and reviews implementation of team members.
  • System Design & Architecture - System Scalability: Leverages components of data plane platforms to handle large-scale data retrieval, storage, and processing.
  • System Design & Architecture - System Scalability: Implements performance and load testing.
  • System Design & Architecture - System Reliability Design: Collaborates with team to build fault‑tolerant components capable of withstanding in‑service updates by implementing redundancy, replication, and automatic failover mechanisms.
  • System Design & Architecture - System Reliability Design: Applies recovery oriented computing principles to design components that effectively handle service disruptions.
  • System Design & Architecture - System Reliability Design: Implements retry mechanisms, circuit breakers, and timeouts to help handle network unreliability.
  • System Design & Architecture - System Reliability Performance: Implements tests and alarm configurations to proactively detect and address issues/failures.
  • System Design & Architecture - System Reliability Performance: Supports efforts to recover from failures by drafting and executing runbooks and operational procedures.
  • System Design & Architecture - System Reliability Performance: Builds and customizes dashboards, telemetry systems, and alerting mechanisms to monitor component health.
  • System Design & Architecture - Correctness / Availability: Designs and implements functional requirements and testing for assigned features within an existing system.
  • System Design & Architecture - Correctness / Availability: Implements tests scenarios (e.g., fault‑injection, brown‑out) to evaluate system correctness.
  • System Design & Architecture - Correctness / Availability: Implements standard data replication and synchronization techniques to maintain data integrity and availability.
  • Operational Troubleshooting & Incident Management: Diagnoses, debugs, and resolves issues in system components to support ongoing operation.
  • Operational Troubleshooting & Incident Management: Implements basic strategies to prevent interruptions, ensuring no maintenance windows are required for customers and users when resolving issues.
  • Operational Troubleshooting & Incident Management: Designs and implements automation scripts and tooling used to troubleshoot operational issues.
  • Operational Troubleshooting & Incident Management: Participates in operational support rotations, assisting in incident responses and root cause investigations.
  • Compliance & Security: Applies advanced security measures to protect data and applications in multi‑tenant environments, including encryption and access controls.
  • Compliance & Security: Implements remediation plans to continuously improve security.
  • Compliance & Security: Collaborates with the team to ensure cloud infrastructure complies with relevant industry standards and regulations and that documentation is up‑to‑date.
  • Automation & Change Management: Maintains automation scripts and tools (e.g., Infrastructure as Code (IaC)) for managing cloud infrastructure.
  • Automation & Change Management: Adheres to change management plans for patching, updating, and rolling back applications.
  • Core Responsibilities Planning & Execution: Track timelines with minimal supervision, ensuring work is completed in a timely manner and is in alignment with project requirements.
  • Core Responsibilities Planning & Execution: Prioritize and adjust work as resources or timelines change, with some guidance.
  • Collaboration & Partnership: Collaborates across teams to align on expectations and achieve shared objectives.
  • Collaboration & Partnership: Builds and maintains a comprehensive understanding of business, stakeholder, and/or customer needs to build and support effective partnerships.
  • Collaboration & Partnership: Actively listens to diverse perspectives and asks questions to ensure understanding of others.
  • Problem Solving: Independently identifies and addresses standard and non‑standard issues in accordance with standard practices, escalating more complex issues as appropriate.
  • Problem Solving: Analyzes data and/or information from multiple sources to troubleshoot standard and non‑standard errors.
  • Problem Solving: Contributes to knowledge sharing and best practices.
  • Continuous Learning: Embraces continuous learning by actively seeking to build knowledge and new skills and/or tools, and staying current with industry trends and best practices.
  • Continuous Learning: Seeks out and leverages feedback and training to improve skills.
  • Continuous Learning: Contributes to a culture of continuous learning and knowledge sharing with team members.
  • Continuous Improvement: Develops ideas and recommends updates to increase the efficiency and effectiveness of processes, protocols, and workflows within a team.
  • Continuous Improvement: Seeks input from team members on alternative approaches and methods for improving work.

Job description

EEHO is seeking a Senior Core Infrastructure Engineer to design, implement, and maintain scalable, reliable infrastructure supporting AI/ML initiatives. You’ll work with data scientists, software engineers, and IT professionals to deploy secure, cost-effective solutions at scale.

The role involves hands-on troubleshooting for POC and production deployments, building fault‑tolerant components, and driving automation, monitoring, and incident response across multi‑tenant environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Platform Engineer - Cloud Infra & AI Tools
Senior AI Platform Engineer - Cloud Infra & AI Tools

Sweeping Corporation of America • Alpharetta (GA)

Hybrid
USD 150,000 - 230,000
Senior AI Infra Engineer - Cloud-Native Platform Mastery
Senior AI Infra Engineer - Cloud-Native Platform Mastery

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
Senior AI/ML Platform Engineer for Scalable Infra
Senior AI/ML Platform Engineer for Scalable Infra

Employee Relations Associates, Inc. • Denver (CO)

Hybrid
USD 170,000 - 210,000
Medical coverage
Dental coverage
Vision coverage
+4
Senior DevOps Engineer - AI Platform, Multi-Cloud & Edge
Senior DevOps Engineer - AI Platform, Multi-Cloud & Edge

webAI • United States

Remote
USD 150,000 - 210,000
Equity options
Parental leave
401(k) plan
+3
Senior AI Systems Engineer — Multi-Environment Data Platform
Senior AI Systems Engineer — Multi-Environment Data Platform

EY • Orlando (FL)

Hybrid
USD 107,000 - 177,000
Medical and dental coverage
Pension and 401(k)
Paid time off
+2
Senior AI Data Infrastructure Engineer
Senior AI Data Infrastructure Engineer

EY • Sacramento (CA)

Hybrid
USD 107,000 - 177,000
Hybrid work model
Medical and dental coverage
Pension and 401(k) plans
+1
Senior AI Data Infrastructure Engineer
Senior AI Data Infrastructure Engineer

EY • Philadelphia

Hybrid
USD 107,000 - 177,000
Hybrid work model
Total Rewards package
Paid time off
Senior AI Infrastructure Engineer — Edge-Cloud ML + Equity
Senior AI Infrastructure Engineer — Edge-Cloud ML + Equity

Anduril Industries • Washington

On-site
USD 191,000 - 253,000
Senior AI Platform Infrastructure Lead
Senior AI Platform Infrastructure Lead

EY • Woodbridge Township (NJ)

Remote
USD 237,000 - 329,000