Senior AI Platform Engineer - LLM & MLOps

Zs Associates; Princeton (NJ); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

ZS Associates is seeking a skilled ML Engineer to build scalable ML backend systems, APIs, and orchestration pipelines. You will implement MLOps, model performance tracking, and multimodal AI integrations, with a focus on LLMs and Generative AI.

Collaborative cross‑functional teams will drive client‑facing solutions. Ideal candidates have strong Python/SQL, FastAPI experience, and a solid background in transformers, vector databases, and MLOps tooling like MLFlow and Langfuse.

Qualifications

• Master's or bachelor's degree in Computer Science or related field from a top university.

Responsibilities

• Build, refine, and use ML Engineering platforms and components; develop and implement scalable backend systems, APIs, and microservices using FastAPI.
• Implement MLOps including model KPI measurement, tracking, model drift detection, and model feedback loops.
• Deploy and operationalize ML and Deep Learning models, with a strong focus on LLMs and Generative AI.
• Integrate Azure OpenAI (GPT-4, GPT-4 Vision) and other LLM providers with proper retry logic and error handling.
• Maintain up-to-date knowledge of state‑of‑the‑art technologies such as LLMs, GenAI, and transformer architectures.
• Scale machine learning algorithms to work on massive data sets under strict SLAs.
• Build and orchestrate model pipelines including feature engineering, inferencing, and continuous model training.
• Write backend application code in Python and SQL using strong object‑oriented principles and asynchronous programming (asyncio, async/await).
• Implement dependency injection patterns and layered architecture (Service, Foundation, Orchestration, DAL).
• Build LLM observability (e.g., Langfuse) to track prompts, tokens, costs, and latency.
• Develop prompt management systems with versioning and fallback mechanisms.
• Implement Celery (or similar) workflows for asynchronous task processing and complex pipelines.

Skills

ML Engineering

Python

Async programming

FastAPI

ML Ops

Azure OpenAI

GPT-4 / LLMs

Data platforms

Vector search

Pinecone / Weaviate / Chroma

HuggingFace

Transformers

LangChain

LlamaIndex

Keras / TensorFlow / PyTorch

SQL

Education

Master's or Bachelor's degree in Computer Science or related field

Tools

FastAPI

Python

SQL

Azure OpenAI

Langfuse

MLFlow

Pinecone / Weaviate / Chroma

HuggingFace

Transformers

Job description

ZS Associates is seeking a skilled ML Engineer to build scalable ML backend systems, APIs, and orchestration pipelines. You will implement MLOps, model performance tracking, and multimodal AI integrations, with a focus on LLMs and Generative AI.

Collaborative cross‑functional teams will drive client‑facing solutions. Ideal candidates have strong Python/SQL, FastAPI experience, and a solid background in transformers, vector databases, and MLOps tooling like MLFlow and Langfuse.