AI Infrastructure Engineer — Secure GPU Platform (Hybrid)

Magen Financial LLC; Miami (FL); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Magen Financial LLC in Miami, FL, is hiring a full-time AI Infrastructure Engineer to own the platform layer for AI services, ensuring reliability, security, and production readiness. The role covers designing infrastructure for large and small models, secure APIs, GPU workloads, and CI/CD pipelines.

You will collaborate with AI engineers, implement observability, access controls, and environment segmentation, and help standardize model packaging, versioning, rollout, and rollback while

Qualifications

• 5+ years of infrastructure, platform engineering, DevOps, SRE, or ML platform experience.
• Strong experience with Microsoft Azure.
• Strong experience with Kubernetes, preferably AKS, and with Docker and containerized services.
• Strong C# / .NET ecosystem experience, especially for internal service integration.
• Good Python skills for automation, AI infrastructure, and scripting.
• Experience building production APIs and internal developer platforms.
• Experience with CI/CD, infrastructure as code, and observability.
• Strong Linux skills.
• Experience operating systems with high security and reliability requirements.
• Ability to debug complex issues across applications, infrastructure, networking, and storage.

Responsibilities

• Designing and operating infrastructure for serving large and smaller specialist models
• Building secure internal APIs for AI-powered applications
• Deploying and managing GPU-based workloads across development and production
• Integrating model serving with retrieval systems, databases, internal services, and authentication
• Building CI/CD pipelines for model and application deployments
• Implementing observability for latency, throughput, errors, GPU utilization, and service health
• Supporting batch, interactive, and evaluation inference workloads
• Supporting fine-tuning, evaluation, and deployment while implementing secure access controls, audit logging, and environment separation
• Optimizing reliability, cost, and performance
• Defining standards for model packaging, versioning, rollout, and rollback

Skills

Azure

C# / .NET

Python

CI/CD

Linux

Debugging

Observability

Networking

Security

Containerization

Tools

Kubernetes

Docker

AKS

Git

CI/CD tooling

GPUs

Job description

Magen Financial LLC in Miami, FL, is hiring a full-time AI Infrastructure Engineer to own the platform layer for AI services, ensuring reliability, security, and production readiness. The role covers designing infrastructure for large and small models, secure APIs, GPU workloads, and CI/CD pipelines.

You will collaborate with AI engineers, implement observability, access controls, and environment segmentation, and help standardize model packaging, versioning, rollout, and rollback while