Senior AI Engineer: LLMs, MLOps & GenAI Platform

Zs Associates; Chicago (IL); Hybrid; USD 120,000 - 190,000; Full time

Benefits offered by this job

Hybrid working model

Total rewards package

Job summary

ZS Associates in Chicago is seeking a Senior ML Engineer to build and operate ML engineering platforms, APIs, and microservices with FastAPI. You will deploy ML/DL models, integrate Azure OpenAI, and implement MLOps including model KPI tracking and drift detection.

You'll work with Python, async programming, and vector databases, shaping real-time and batch inference pipelines while aligning with SLAs. The role offers hybrid work and opportunities to grow within a global firm.

Qualifications

• Master's or bachelor's degree in Computer Science or a related field from a top university.
• 4+ years hands-on experience in Machine Learning, including production LLM systems.
• Strong fundamentals in machine learning, deep learning, and fine-tuning models (LLMs).
• Experience in backend API design using FastAPI or similar asynchronous frameworks.
• Experience with vector databases such as Pinecone, Weaviate, or Chroma.
• Experience with MLOps to measure and track model performance (MLFlow, Langfuse).
• NLP and document processing experience (OCR, PDF extraction).
• Azure OpenAI / Langfuse / LangChain / LlamaIndex familiarity preferred.

Responsibilities

• Build, refine, and use ML Engineering platforms and components; develop scalable backend systems, APIs, and microservices using FastAPI.
• Implement MLOps including model KPI measurement, tracking, model drift detection, and model feedback loops.
• Deploy and operationalize ML and Deep Learning models, focusing on LLMs and Generative AI.
• Integrate Azure OpenAI and other LLM providers with retry logic and error handling.
• Maintain knowledge of state-of-the-art technologies such as LLMs, GenAI, transformer architectures.
• Scale ML algorithms to work on massive data sets under strict SLAs.
• Build and orchestrate model pipelines with feature engineering and continuous training.
• Write backend code in Python and SQL using OOP and asyncio.

Skills

Python

FastAPI

ML Engineering

MLOps

Langfuse

LangChain

LlamaIndex

HuggingFace transformers

PyTorch

Pydantic

Asyncio

SQL

Vector databases

Education

Master's or bachelor's degree in Computer Science or a related field

Tools

Azure OpenAI

Pinecone

Weaviate

Chroma

Docker

Kubernetes

Job description

ZS Associates in Chicago is seeking a Senior ML Engineer to build and operate ML engineering platforms, APIs, and microservices with FastAPI. You will deploy ML/DL models, integrate Azure OpenAI, and implement MLOps including model KPI tracking and drift detection.

You'll work with Python, async programming, and vector databases, shaping real-time and batch inference pipelines while aligning with SLAs. The role offers hybrid work and opportunities to grow within a global firm.