Hybrid AI Infra Engineer for Secure Production ML on Azure

Magen Financial LLC; Miami (FL); Hybrid; USD 130,000 - 170,000; Full time

Job summary

Magen Financial LLC is hiring an AI Infrastructure Engineer to own the platform layer for AI services in a hybrid Miami-based setting. You will design, implement, and operate infrastructure for serving large and small models, secure API access, and GPU workloads across development and production environments.

You will collaborate with AI engineers to enable model fine-tuning, evaluation, and deployment, while enforcing security, audit logging, and environment separation to ensure reliability,

Qualifications

• 5+ years in infrastructure, platform engineering, DevOps, SRE, or ML platform roles.
• Strong Azure experience and cloud-native design.
• Experience with Kubernetes (AKS) and Docker in production.
• Proficiency in C# and .NET for internal service integration.
• Python automation for AI infrastructure and tooling.
• Experience building production APIs and internal developer platforms.
• Knowledge of CI/CD, IaC, and observability.
• Ability to work with secure, high-reliability systems.

Responsibilities

• Designing and operating infrastructure for serving large and smaller specialist models.
• Building secure internal APIs for AI-powered applications.
• Deploying and managing GPU-based workloads across development and production.
• Integrating model serving with retrieval systems, databases, internal services, and authentication.
• Building CI/CD pipelines for model and application deployments.
• Implementing observability for latency, throughput, errors, GPU utilization, and service health.
• Supporting batch, interactive, and evaluation inference workloads.
• Supporting fine‑tuning, evaluation, and deployment while implementing secure access controls, audit logging, and environment separation.
• Optimizing reliability, cost, and performance.
• Defining standards for model packaging, versioning, rollout, and rollback.

Skills

Microsoft Azure

Kubernetes

AKS

Docker

C# .NET

Python

CI/CD

Observability

Security

Internal APIs

Tools

MLflow

Azure Machine Learning

Vector databases

Retrieval systems

Job description

Magen Financial LLC is hiring an AI Infrastructure Engineer to own the platform layer for AI services in a hybrid Miami-based setting. You will design, implement, and operate infrastructure for serving large and small models, secure API access, and GPU workloads across development and production environments.

You will collaborate with AI engineers to enable model fine-tuning, evaluation, and deployment, while enforcing security, audit logging, and environment separation to ensure reliability,