Senior AI & Deep Learning Engineer

EPAM Systems; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

EPAM Systems Inc in the United States seeks a Senior AI & Deep Learning Engineer to bridge traditional ML/DL with agentic AI workflows for MURAL & MURAL LIVE teams. You will build production-grade agentic systems powering real-time content scanning, tagging, and live streaming classification.

You will architect event-driven microservices over WebSockets, integrate vector search/OpenSearch, and enforce evaluation using Weights & Biases in a fast-paced Kanban environment with rapid prototyping.

Qualifications

• 3+ years software engineering with ML and agentic AI workflows.
• Experience building stateful, event-driven microservices and agentic frameworks (MCP, WebSockets, tool-call orchestration).
• Hands-on experience with search and vector databases (OpenSearch / Elasticsearch).
• Strong experience with model evaluation, tracking, and experimentation tools (Weights & Biases).
• Proficiency in Python & FastAPI backend development.
• Expertise in agentic AI frameworks such as LangChain, LlamaIndex, or custom agents.
• English proficiency at B2 level or higher.
• Nice to have skills in fine-tuning, distillation, and quantization of open-source models.
• Background in media & entertainment domain expertise (broadcast video supply chain, Peacock/live streaming).
• Familiarity with Go / gRPC microservices.
• Knowledge of Terraform & AWS Cloud infrastructure.

Responsibilities

• Develop and deploy advanced agentic AI frameworks (context management, MCP over WebSockets, event-driven architectures) for autonomous enterprise workflows
• Build and fine-tune traditional ML and deep learning models for classification, OCR, and audio spectrogram analysis
• Architect and optimize high-performance search and retrieval systems using OpenSearch / Elasticsearch and vector databases
• Implement rigorous evaluation pipelines using Weights & Biases to validate new model versions before production switching
• Collaborate in a fast-paced, experimental Kanban environment with constant daily discussions, technical reviews, and rapid prototyping
• Deliver robust, autonomous agentic workflows running over WebSockets that successfully handle content scanning and live streaming tagging without hallucinations
• Integrate high-accuracy classification, OCR, and audio processing models seamlessly into production MURAL and MURAL LIVE pipelines
• Maintain comprehensive evaluation and observability dashboards (Weights & Biases) governing all model updates and agentic tool calls

Skills

Python

FastAPI

WebSockets

MCP

LangChain

LlamaIndex

Go

gRPC

Terraform

AWS

Search/Vector databases

Tools

OpenSearch

Elasticsearch

Weights & Biases

WebSockets

Terraform

AWS

Job description

We are looking for a Senior AI & Deep Learning Engineer who bridges the gap between traditional machine learning / deep learning and advanced agentic AI workflows. In the MURAL & MURAL LIVE teams, you will build production-grade agentic systems that power real-time content scanning, tagging, audio/visual classification, and contextual ad insertion for live streaming feeds (such as Peacock). You will architect event-driven microservices communicating over WebSockets, integrate vector search/OpenSearch, and enforce rigorous evaluation using Weights & Biases.

Responsibilities

• Develop and deploy advanced agentic AI frameworks (context management, MCP over WebSockets, event-driven architectures) for autonomous enterprise workflows
• Build and fine-tune traditional ML and deep learning models for classification, OCR (Optical Character Recognition), and audio spectrogram analysis
• Architect and optimize high-performance search and retrieval systems using OpenSearch / Elasticsearch and vector databases
• Implement rigorous evaluation pipelines using Weights & Biases (or equivalent ML/LLMOps tools) to validate new model versions against evals before production switching
• Collaborate in a fast-paced, experimental Kanban environment with constant daily discussions, technical reviews, and rapid prototyping
• Deliver robust, autonomous agentic workflows running over WebSockets that successfully handle content scanning and live streaming tagging without hallucinations
• Integrate high-accuracy classification, OCR, and audio processing models seamlessly into production MURAL and MURAL LIVE pipelines
• Maintain comprehensive evaluation and observability dashboards (Weights & Biases) governing all model updates and agentic tool calls

Requirements

• 3+ years of software engineering experience with a hybrid background in traditional machine learning/deep learning (classification, OCR, computer vision/audio) and modern agentic AI workflows
• Proven experience building stateful, event-driven microservices and agentic frameworks (MCP, WebSockets, tool-call orchestration)
• Hands-on experience with search and vector database infrastructure (OpenSearch / Elasticsearch)
• Strong experience with model evaluation, tracking, and experimentation tools (Weights & Biases)
• Proficiency in Python & FastAPI backend development
• Expertise in agentic AI frameworks such as LangChain, LlamaIndex, or custom agents
• English proficiency at B2 level or higher
• Nice to have Skills in fine-tuning, distillation, and quantization of open-source models
• Background in media & entertainment domain expertise (broadcast video supply chain, Peacock / live streaming architecture)
• Familiarity with Go / gRPC microservices
• Knowledge of Terraform & AWS Cloud infrastructure