Senior AI Platform Infra Engineer — Hybrid Cloud & GPU

Carex Consulting Group; Madison (WI); Hybrid; USD 180.000 - 240.000; Vollzeit

Zusammenfassung

Carex Consulting Group seeks a Senior AI Platform Infrastructure Engineer to lead architecture, development, and operation of a scalable, secure AI/ML platform for cancer diagnostics. This hands-on technology leadership role covers cloud, Kubernetes, GPU infrastructure, model serving, and workflow orchestration across multi-cloud environments.

The ideal candidate has 3+ years leading Agile/SAFe projects, deep Python/Go/Rust development experience, and strong security/governance knowledge to

Qualifikationen

• Bachelor’s degree in Computer Science, AI, Data Science, or a related field.
• Demonstrated expertise designing and deploying AI solutions that deliver measurable business impact.
• Strong understanding of ethical considerations in AI systems.
• At least three years of project leadership experience, including Agile project management and SAFe.
• Advanced proficiency with machine learning frameworks, Python, and cloud platforms.
• Production software development experience with Python, Go, and/or Rust.
• Experience leading platform transformations and/or building large-scale AI infrastructure.
• Experience with multi-cloud environments or migrating significant workloads between cloud providers.
• Knowledge of Kubernetes-native serverless technologies and event-driven autoscaling, such as Knative or KEDA, as well as service meshes, API gateways, and zero-trust networking patterns.
• Experience managing GPU infrastructure costs or comparable FinOps responsibilities for shared compute environments.
• Ability to operate effectively within enterprise governance and compliance requirements, including environments where network, identity, and change management are managed by separate teams.
• Familiarity with compliance frameworks and regulated environments, such as HIPAA, FDA, and GxP.
• Experience guiding cross-functional engineering teams and mentoring senior-level engineers.
• Strong technical leadership, collaboration, communication, and ownership skills.

Aufgaben

• Architect, build, and maintain cloud infrastructure and Kubernetes foundation.
• Lead platform expansion across clusters and regions with identity federation and multi-cloud strategies.
• Own infrastructure-as-code, GitOps practices, and drift detection.
• Build and operate CI/CD pipelines and deployment tooling with AI Platform Software lead.
• Design and operate production model-serving and GPU infrastructure for LLMs and predictive models.
• Partner with AI Platform Software and Safety leads to support reproducible data and pipelines.
• Architect and operate workflow orchestration and event-streaming systems.
• Establish observability, SLOs, monitoring, and disaster-recovery strategies.
• Serve as escalation point for infrastructure incidents and drive improvements.
• Own infrastructure security and governance, including IAM, secrets, network policies, and automated controls.
• Contribute to production software development through design, coding, testing, and reviews.
• Mentor engineers and participate in long-term tech planning.
• Promote accountability, innovation, integrity, quality, teamwork, inclusion, and reliable execution.

Kenntnisse

AI platform infra leadership

Cloud architecture

Python

Go

Rust

SAFe / Agile leadership

Kubernetes

GPU infrastructure management

Observability / SRE

Cost/FinOps

Security governance

Ausbildung

Bachelor’s degree in Computer Science, AI, Data Science, or related field

Tools

Kubernetes

Knative

KEDA

API gateways

Service meshes

Jobbeschreibung

Carex Consulting Group seeks a Senior AI Platform Infrastructure Engineer to lead architecture, development, and operation of a scalable, secure AI/ML platform for cancer diagnostics. This hands-on technology leadership role covers cloud, Kubernetes, GPU infrastructure, model serving, and workflow orchestration across multi-cloud environments.

The ideal candidate has 3+ years leading Agile/SAFe projects, deep Python/Go/Rust development experience, and strong security/governance knowledge to