Staff AI Platform Engineer - MLOps/LLMOps (Azure)

SMBC

Charlotte (NC)

Hybrid

USD 140,000 - 180,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid work model

Job summary

SMBC in Charlotte, NC, is seeking a Staff AI-Ops Engineer to operationalize and govern the GenAI platform. You will partner with Azure, Databricks, and other providers to build scalable MLOps backbones in production.

The role emphasizes reliability, security, cost governance, automated testing, and responsible-AI guardrails, with mentoring across engineering teams and a hybrid work schedule.

Qualifications

  • Bachelor’s degree in Computer Science, ML, Data Science, or related field.
  • 5+ years deploying GenAI/advanced ML models in production.
  • 3+ years Python and GenAI frameworks/tools such as Databricks Vector Search and LangGraph.
  • Deep expertise with MLOps/LLMOps tooling (MLflow — Prompt Registry, Tracing, Experiments).
  • Experience building CI/CD and observability for AI systems.
  • Knowledge of governance, security, and FinOps in regulated environments.

Responsibilities

  • Operationalize the MLOps/LLMOps backbone for the AI platform.
  • Design CI/CD pipelines and IaC for models, prompts, and agents.
  • Implement data, model, and prompt lineage and version control.
  • Build observability for data quality, drift, and cost governance.
  • Establish automated validation (A/B, canary, champion-challenger).
  • Mentor teams on MLOps best practices and platform capabilities.

Skills

Python
GenAI frameworks
MLOps tooling
Databricks
Azure cloud
CI/CD automation
RESTful services
Observability

Education

Bachelor’s degree in Computer Science or related field

Tools

MLflow
Databricks Asset Bundles
LangGraph
Haystack
Llama Index
Databricks Vector Search
Azure AI Search
PyTorch/TensorFlow

Job description

SMBC in Charlotte, NC, is seeking a Staff AI-Ops Engineer to operationalize and govern the GenAI platform. You will partner with Azure, Databricks, and other providers to build scalable MLOps backbones in production.

The role emphasizes reliability, security, cost governance, automated testing, and responsible-AI guardrails, with mentoring across engineering teams and a hybrid work schedule.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Hybrid AI Platform Engineer – GenAI MLOps & Observability
Hybrid AI Platform Engineer – GenAI MLOps & Observability

SMBC Group • Charlotte (NC)

Hybrid
USD 170,000 - 210,000
GenAI Platform Engineer: MLOps & Observability
GenAI Platform Engineer: MLOps & Observability

SMBC Group • Charlotte (NC)

Hybrid
USD 140,000 - 210,000
Hybrid work model
Health insurance
Employee stock plan
GenAI Platform Engineer: Scale, Secure AI Infra & MLOps
GenAI Platform Engineer: Scale, Secure AI Infra & MLOps

SMBC Group • Charlotte (NC)

Hybrid
USD 140,000 - 210,000
GenAI Platform Engineer: Scalable AI/LLMOps
GenAI Platform Engineer: Scalable AI/LLMOps

SMBC • Charlotte (NC)

Hybrid
USD 130,000 - 180,000
Hybrid work model
Remote MLOps & AI Infrastructure Engineer
Remote MLOps & AI Infrastructure Engineer

Mission US • United States

Remote
USD 140,000 - 210,000
Remote MLOps & AI Platform Engineer
Remote MLOps & AI Platform Engineer

Mission Underwriting Managers • United States

Remote
USD 150,000 - 190,000
401K, 401K Match
Life and Disability Benefits
11 Paid Holidays
+4
Senior GenAI Platform Engineer
Senior GenAI Platform Engineer

SMBC Group • Charlotte (NC)

Hybrid
USD 130,000 - 190,000
Senior MLOps & AI Platform Engineer - Remote
Senior MLOps & AI Platform Engineer - Remote

Mission Underwriting Managers, LLC • United States

Remote
USD 140,000 - 190,000
Remote-first
Medical insurance
Dental coverage
+6
Azure AI Architect - Production ML & MLOps Leader
Azure AI Architect - Production ML & MLOps Leader

SMX Services & Consulting, Inc. • United States

Remote
USD 180,000 - 240,000
GenAI Architect: Azure AI Platform Lead, RAG & MLOps
GenAI Architect: Azure AI Platform Lead, RAG & MLOps

Ampcus Inc • Charlotte (NC)

On-site
USD 170,000 - 210,000