Senior AI Engineer: LLM & MLOps Architect

ZS

Princeton (NJ)

Hybrid

USD 150,000 - 210,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

ZS is seeking a Senior ML Engineer to build and operate ML platforms, pipelines, and backend services focused on LLMs and GenAI. You will implement MLOps, model deployment, and observability while integrating Azure OpenAI and other providers.

You will work with FastAPI, Python, and vector databases in a hybrid US-based role, collaborating across teams to deliver scalable AI-enabled solutions. Strong English proficiency and client-focused mindset are essential.

Qualifications

Master's or bachelor's degree in Computer Science or related field.
4+ years hands-on experience in Machine Learning, including production LLM systems.
Strong fundamentals in ML, DL, and fine-tuning models (LLMs).
Understanding of transformer architectures.
Prompt engineering expertise.
Experience with vector databases and embedding storage.
Backend API design using FastAPI with async patterns.

Responsibilities

Build, refine, and use ML Engineering platforms and components; scalable backend systems, APIs, and microservices with FastAPI.
Implement MLOps including KPI measurement, drift detection, and feedback loops.
Deploy and operationalize ML and DL models with focus on LLMs and GenAI.
Integrate Azure OpenAI and other LLMs with retry logic and error handling.
Maintain knowledge of state-of-the-art AI technologies and transformer architectures.
Scale ML algorithms for massive datasets under strict SLAs.
Build and orchestrate model pipelines with feature engineering, inferencing, and retraining.
Write Python/SQL backend code with async programming and SOLID principles.
Implement CI/CD, containerization, and cloud tooling for ML workloads.