GenAI Platform Engineer: MLOps & Observability

SMBC Group; Charlotte (NC); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Hybrid work model

Health insurance

Employee stock plan

Job summary

SMBC Group is seeking a Staff AI-Ops Engineer to operationalize and govern the GenAI platform, collaborating with Azure, Databricks, and other infrastructure to ensure reliable, observable, and secure AI systems in production.

You will drive CI/CD, governance, cost governance, and automated validation while mentoring teams in MLOps/LLMOps best practices within a regulated, financial-services environment.

Qualifications

• Bachelor's degree in Computer Science, Machine Learning, Data Science, or related field.
• 5+ years deploying GenAI or advanced ML models in production, with strong MLOps/LLMOps focus.
• 3+ years of Python experience and GenAI frameworks/tools.
• Deep expertise with MLOps/LLMOps tooling, data platforms and cloud platforms.
• Experience building RESTful services, containers, and automated CI/CD systems.
• Proven observability, monitoring, and cost governance for AI systems.

Responsibilities

• Operationalize the AI Platform and standardize model, prompts, pipelines, and agents across environments.
• Develop automated CI/CD pipelines and infrastructure-as-code for models and assets.
• Maintain governance, versioning, and auditability with end-to-end lineage and MLflow.
• Build observability for data quality, drift, hallucination/grounding health, and performance metrics.
• Establish automated validation, A/B testing, canary deployments, and risk-controlled releases.
• Implement responsible-AI guardrails and security/privacy controls across inference layers.
• Support day-2 operations with runbooks and SLAs; mentor broader teams on MLOps/LLMOps.

Skills

GenAI deployment

Python

MLOps/LLMOps

RESTful services

CI/CD automation

Observability

Platform automation

Education

Bachelor's degree in CS/ML/DS

Tools

Databricks

Azure Cloud Services

MLflow

LangGraph

haystack

Llama Index

Job description

SMBC Group is seeking a Staff AI-Ops Engineer to operationalize and govern the GenAI platform, collaborating with Azure, Databricks, and other infrastructure to ensure reliable, observable, and secure AI systems in production.

You will drive CI/CD, governance, cost governance, and automated validation while mentoring teams in MLOps/LLMOps best practices within a regulated, financial-services environment.