Hybrid AI Platform Engineer – GenAI MLOps & Observability

SMBC Group

Charlotte (NC)

Hybrid

USD 170,000 - 210,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

SMBC Group in Charlotte, NC seeks a Staff AI-Ops Engineer to operationalize and govern its GenAI platform. You will partner with Azure, Databricks, and other infra to build scalable MLOps/LLMOps, ensuring reliable, observable, and secure AI systems for production use in a high-stakes financial environment.

You will own end-to-end CI/CD, governance, monitoring, and security controls, while mentoring teams and evaluating new tooling to raise reliability and reduce cost.

Qualifications

  • Bachelor’s degree in Computer Science, Machine Learning, Data Science, or related field.
  • 5+ years of hands-on experience deploying, operating, and maintaining GenAI or advanced ML models in production environments, with a strong focus on MLOps/LLMOps.
  • 3+ years of experience in Python and GenAI frameworks/tools e.g. Databricks Vector Search, Azure AI Search, Azure AI document intelligence, LangGraph, haystack, Llama Index etc.

Responsibilities

  • Operationalize the AI Platform: design and operate the MLOps/LLMOps backbone for the AI platform on Databricks and Azure Cloud Services.
  • Build CI/CD pipelines and IaC for models, prompts, and agents using Databricks Asset Bundles across DEV/QA/REL/PROD with canary and blue/green strategies.
  • Governance, versioning and auditability across data, prompts, retrievals, models, and responses using MLflow and Prompt Registry.
  • Monitoring, drift and cost governance: observability for data quality, model drift, inference cost, and KPIs with FinOps.
  • Testing, evaluation and validation: automated regression, A/B, canary, and champion-challenger validation with golden datasets.
  • Responsible AI and security controls: implement guardrails, privacy controls, and secure management of data, prompts, and embeddings.
  • Operational readiness and run management: runbooks, incident response, SLAs, and documented processes.
  • Evaluate emerging technology: identify and pilot new AI-Ops tooling to improve reliability and observability.
  • Technical mentorship: coach teams on MLOps/LLMOps best practices.

Skills

GenAI production
MLOps/LLMOps
Python programming
CI/CD automation
Observability tooling
Cloud platforms
Security controls

Education

Bachelor’s in CS/ML

Tools

Databricks
Azure
MLflow
LangGraph
Haystack
Llama Index

Job description

SMBC Group in Charlotte, NC seeks a Staff AI-Ops Engineer to operationalize and govern its GenAI platform. You will partner with Azure, Databricks, and other infra to build scalable MLOps/LLMOps, ensuring reliable, observable, and secure AI systems for production use in a high-stakes financial environment.

You will own end-to-end CI/CD, governance, monitoring, and security controls, while mentoring teams and evaluating new tooling to raise reliability and reduce cost.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GenAI Platform Engineer: MLOps & Observability
GenAI Platform Engineer: MLOps & Observability

SMBC Group • Charlotte (NC)

Hybrid
USD 140,000 - 210,000
Hybrid work model
Health insurance
Employee stock plan
Staff AI Platform Engineer - MLOps/LLMOps (Azure)
Staff AI Platform Engineer - MLOps/LLMOps (Azure)

SMBC • Charlotte (NC)

Hybrid
USD 140,000 - 180,000
Hybrid work model
GenAI Platform Engineer: Scale, Secure AI Infra & MLOps
GenAI Platform Engineer: Scale, Secure AI Infra & MLOps

SMBC Group • Charlotte (NC)

Hybrid
USD 140,000 - 210,000
GenAI Platform Engineer: Scalable AI/LLMOps
GenAI Platform Engineer: Scalable AI/LLMOps

SMBC • Charlotte (NC)

Hybrid
USD 130,000 - 180,000
Hybrid work model
GenAI Platform Architect (Hybrid) – Azure & MLOps
GenAI Platform Architect (Hybrid) – Azure & MLOps

TekCommands • Georgia (AL)

Hybrid
USD 190,000 - 270,000
Senior GenAI Platform Engineer
Senior GenAI Platform Engineer

SMBC Group • Charlotte (NC)

Hybrid
USD 130,000 - 190,000
Cloud MLOps Engineer II — GenAI Platform
Cloud MLOps Engineer II — GenAI Platform

GM Financial • Irving (TX)

Hybrid
USD 120,000 - 180,000
401K matching
Bonding leave for new parents (12 wks,
Tuition assistance
+3
GenAI Architect — Azure AI Platform & Governance Lead
GenAI Architect — Azure AI Platform & Governance Lead

TechDigital Group • Charlotte (NC)

On-site
USD 180,000 - 240,000
AI Platform Engineer
AI Platform Engineer

SMBC Group • Charlotte (NC)

Hybrid
USD 140,000 - 210,000
Hybrid work model
Health insurance
Employee stock plan
GenAI Architect: Azure AI Platform Lead, RAG & MLOps
GenAI Architect: Azure AI Platform Lead, RAG & MLOps

Ampcus Inc • Charlotte (NC)

On-site
USD 170,000 - 210,000