AI Infrastructure Engineer

Magen Financial LLC; Miami (FL); Hybrid; USD 130,000 - 170,000; Full time

Job summary

Magen Financial LLC is hiring an AI Infrastructure Engineer to own the platform layer for AI services in a hybrid Miami-based setting. You will design, implement, and operate infrastructure for serving large and small models, secure API access, and GPU workloads across development and production environments.

You will collaborate with AI engineers to enable model fine-tuning, evaluation, and deployment, while enforcing security, audit logging, and environment separation to ensure reliability,

Qualifications

• 5+ years in infrastructure, platform engineering, DevOps, SRE, or ML platform roles.
• Strong Azure experience and cloud-native design.
• Experience with Kubernetes (AKS) and Docker in production.
• Proficiency in C# and .NET for internal service integration.
• Python automation for AI infrastructure and tooling.
• Experience building production APIs and internal developer platforms.
• Knowledge of CI/CD, IaC, and observability.
• Ability to work with secure, high-reliability systems.

Responsibilities

• Designing and operating infrastructure for serving large and smaller specialist models.
• Building secure internal APIs for AI-powered applications.
• Deploying and managing GPU-based workloads across development and production.
• Integrating model serving with retrieval systems, databases, internal services, and authentication.
• Building CI/CD pipelines for model and application deployments.
• Implementing observability for latency, throughput, errors, GPU utilization, and service health.
• Supporting batch, interactive, and evaluation inference workloads.
• Supporting fine‑tuning, evaluation, and deployment while implementing secure access controls, audit logging, and environment separation.
• Optimizing reliability, cost, and performance.
• Defining standards for model packaging, versioning, rollout, and rollback.

Skills

Microsoft Azure

Kubernetes

AKS

Docker

C# .NET

Python

CI/CD

Observability

Security

Internal APIs

Tools

MLflow

Azure Machine Learning

Vector databases

Retrieval systems

Job description

Magen Financial LLC is a fintech brokerage company focused on delivering modern, technology-driven financial services and trading solutions. The firm combines brokerage expertise with advanced data, AI, and engineering capabilities to support informed decision-making and efficient operations. We are building secure AI and data systems for financial markets workflows, operating primarily on the Microsoft Azure stack and integrating closely with .NET-based internal systems. Because we work with sensitive financial data, we care deeply about security, auditability, correctness, and reliability. The company values innovation, reliability, and data integrity as core components of its service offering.

About the Role

This is a full-time, hybrid AI Infrastructure Engineer role based in Miami, FL, with flexibility for partial work from home. You will own the platform layer for our AI services, making advanced models reliable, secure, and usable in production. Responsibilities include designing and operating infrastructure for serving large and smaller specialist models; building secure internal APIs for AI-powered applications; deploying and managing GPU-based workloads across development and production; and integrating model serving with retrieval systems, databases, internal services, and authentication. You will build CI/CD pipelines for model and application deployments, implement observability for latency, throughput, errors, GPU utilization, and service health, and support batch, interactive, and evaluation inference workloads. Working closely with AI engineers, you will support fine-tuning, evaluation, and deployment while implementing secure access controls, audit logging, and environment separation. This is a hands‑on platform role focused on turning AI models into dependable internal services, optimizing reliability, cost, and performance, and defining standards for model packaging, versioning, rollout, and rollback.

Responsibilities

• Designing and operating infrastructure for serving large and smaller specialist models
• Building secure internal APIs for AI-powered applications
• Deploying and managing GPU-based workloads across development and production
• Integrating model serving with retrieval systems, databases, internal services, and authentication
• Building CI/CD pipelines for model and application deployments
• Implementing observability for latency, throughput, errors, GPU utilization, and service health
• Supporting batch, interactive, and evaluation inference workloads
• Supporting fine‑tuning, evaluation, and deployment while implementing secure access controls, audit logging, and environment separation
• Optimizing reliability, cost, and performance
• Defining standards for model packaging, versioning, rollout, and rollback

Qualifications

• 5+ years of infrastructure, platform engineering, DevOps, SRE, or ML platform experience
• Strong experience with Microsoft Azure
• Strong experience with Kubernetes, preferably AKS, and with Docker and containerized services
• Strong C# / .NET ecosystem experience, especially for internal service integration
• Good Python skills for automation, AI infrastructure, and scripting
• Experience building production APIs and internal developer platforms
• Experience with CI/CD, infrastructure as code, and observability
• Experience operating systems with high security and reliability requirements
• Ability to debug complex issues across applications, infrastructure, networking, and storage

Preferred Skills

• Experience with GPU clusters or distributed compute, and serving large language models or other deep learning models
• Experience with high-throughput batch processing
• Experience with model registries, MLflow, or Azure Machine Learning
• Experience with financial services infrastructure or secure internal platforms in regulated environments
• Experience with retrieval-augmented generation systems, vector databases, or search infrastructure
• Experience with performance tuning for latency-sensitive services

Additional Job Application Terms

This job is part of LinkedIn’s Full-Service Hiring beta program. Eligibility is limited to candidates located in and performing services in the United States, excluding those based in Alaska, Hawaii, Nevada, South Carolina, or West Virginia.

We’re committed to making our hiring process as smooth and timely as possible, and we understand that waiting to hear back can add to the anticipation. If you’re a potential fit, our team will reach out within two weeks to progress you to the next stage. If you don’t hear from us in that time, we encourage you to explore other opportunities with our team in the future, and we wish you the very best in your job search.

Do you agree to the additional job application terms, linked in the job description and available at https://www.linkedin.com/help/linkedin/answer/a7729058?