ML Platform Engineer - Production AI Infra & Pipelines

Abbott (abbottcareers2 board)

Madison (WI)

On-site

USD 140,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Abbott in Madison, WI seeks an AI Platform Engineer to own the full model lifecycle in production, from data pipelines to serving and monitoring. You’ll build data, feature, and training pipelines, implement automated evaluation and promotion gates, and automate CI/CD and GitOps for end-to-end model lifecycle.

You’ll operate production model-serving infra for LLMs, manage GPU infrastructure, and extend registries with traceable history. Collaboration and quality are core.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, AI/ML, or related field; or equivalent practical experience.
  • 3+ years building and operating production software, including significant work on ML or AI infrastructure.
  • Strong Python, including software engineering fundamentals - automated testing, code review, and designing code others will read and extend.
  • Experience with the ML model lifecycle: pipelines that carry a model from training through evaluation, deployment, monitoring, and retraining.
  • Kubernetes experience - deploying, scaling, and debugging containerized workloads on a major cloud provider (AWS preferred).
  • Experience with CI/CD, GitOps-based delivery, and infrastructure automation.

Responsibilities

  • Build and maintain data, feature, and training pipelines for ML and LLM workloads - ingestion, transformation, fine-tuning, distributed training, and reproducible experiment execution with lineage tracked from dataset and code to resulting model.
  • Implement automated evaluation and promotion gates - performance benchmarks, regression checks, and validation criteria that determine whether a model advances toward production.
  • Automate the model lifecycle end to end through CI/CD and GitOps: packaging, promotion across environments, progressive rollout, and rollback.
  • Build and operate production model-serving infrastructure for LLMs and predictive models, including inference optimization, autoscaling, and low-latency serving across multiple model formats and runtimes.
  • Architect and manage GPU infrastructure - scheduling, autoscaling, resource isolation, and utilization efficiency for training and inference workloads.
  • Instrument the platform and the models on it - structured logging, telemetry, drift detection, and cost tracking - and build the triggers and pipelines that close the loop into retraining and revalidation.
  • Extend model, dataset, and artifact registries, metadata systems, and versioning so every deployed model has a traceable, auditable history.
  • Build the developer-facing surface of the platform: APIs, SDK components, templates, documentation, and runbooks that make it self-service, backed by well-tested code and active participation in design and code review.
  • Uphold company mission and values through accountability, innovation, integrity, quality, and teamwork.
  • Maintain regular and reliable attendance.
  • Act with an inclusion mindset and model these behaviors for the organization.

Skills

Python
Production software
CI/CD
GitOps
Kubernetes
Cloud AWS
AI/ML infra

Education

Bachelor's degree in CS/Engineering/AI/ML
Equivalent practical experience

Tools

Kubeflow
Argo Workflows
MLflow
Weights & Biases
ONNX Runtime
TensorRT

Job description

Abbott in Madison, WI seeks an AI Platform Engineer to own the full model lifecycle in production, from data pipelines to serving and monitoring. You’ll build data, feature, and training pipelines, implement automated evaluation and promotion gates, and automate CI/CD and GitOps for end-to-end model lifecycle.

You’ll operate production model-serving infra for LLMs, manage GPU infrastructure, and extend registries with traceable history. Collaboration and quality are core.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Platform Engineer for Scalable AI in Healthcare
ML Platform Engineer for Scalable AI in Healthcare

Abbott • Madison (WI)

On-site
USD 61,000 - 123,000
Staff AI/ML Platform Engineer for HealthTech & Edge AI
Staff AI/ML Platform Engineer for HealthTech & Edge AI

Abbott • United States

On-site
USD 150,000 - 230,000
AI Platform Engineer
AI Platform Engineer

Abbott (abbottcareers2 board) • Madison (WI)

On-site
USD 140,000 - 210,000
Staff AI/ML Platform Engineer — Scale ML to Edge & Cloud
Staff AI/ML Platform Engineer — Scale ML to Edge & Cloud

Abbott • Alameda (CA)

On-site
USD 114,000 - 228,000
Free medical coverage
Competitive retirement plan
Tuition reimbursement
+1
Senior AI Platform Engineer — Gen AI & LLM Solutions
Senior AI Platform Engineer — Gen AI & LLM Solutions

Abbott • Madison (WI)

On-site
USD 99,300 - 198,700
AI Platform Lead: GenAI, LLMs & Scalable ML
AI Platform Lead: GenAI, LLMs & Scalable ML

Abbott • Madison (WI)

On-site
USD 99,000 - 199,000
Principal AI Platform Engineer – GenAI Scale
Principal AI Platform Engineer – GenAI Scale

Abbott Laboratories • Lewes (DE)

On-site
USD 149,000 - 299,000
Staff Data Engineer: Lead Data Platform & ML (Madison)
Staff Data Engineer: Lead Data Platform & ML (Madison)

Abbott • Madison (WI)

On-site
USD 99,000 - 199,000
Senior AI Platform Engineer: Production ML & Data Pipelines
Senior AI Platform Engineer: Production ML & Data Pipelines

TeamViewer • Austin (TX)

On-site
USD 140,000 - 210,000
Competitive compensation & bonuses
Flexible PTO & holidays
401(k) with employer matching
+7
Remote AI Platform Engineer Production-Grade LLM Pipelines
Remote AI Platform Engineer Production-Grade LLM Pipelines

Megsoft Consulting, Inc. • United States

Hybrid
USD 120,000 - 180,000