Production AI/ML Engineer - Pipelines & Scale

Veritone, Inc.; Irvine (CA); On-site; USD 175,000 - 200,000; Full time

Benefits offered by this job

Incentive compensation

Health benefits

Retirement benefits

Life insurance

Paid time off

Parental leave and benefits

Other employee perks and benefits

Job summary

Veritone, Inc. is seeking an AI/ML Engineer to build and refactor production-grade ML pipelines and model integration layers.

You will collaborate with product, design, data, and infra teams to embed AI capabilities into applications and maintain scalable features. The role requires 3+ years in AI/ML, strong Python skills, and hands-on experience with LLMs, RAG, and inference services across modern stacks including PyTorch, TensorFlow, Hugging Face, and vector DBs.

Qualifications

• At least 3 years of professional experience building and deploying software systems with AI/ML models in production environments.
• Deep proficiency with Python and standard ML libraries (PyTorch, NumPy, Pandas, Scikit-learn, Hugging Face).
• Hands-on experience with LLMs, RAG architectures, prompt engineering, or traditional ML model pipelines and inference serving.
• Ability to design and implement robust APIs and backend microservices in Python (Go or Node.js a plus).
• Professional experience with RDBMSs, NoSQL DBs, and Vector Databases.
• Demonstrated deployment, monitoring, and scaling of ML workloads and production code.

Responsibilities

• Process: identify and analyze areas in code, model inference workflows, and data pipelines for optimization, efficiency, and latency improvements.
• Team: partner with product, design, data, and infrastructure teams to integrate AI/ML capabilities into workflows.
• On-call: participate in on-call support rotation for production ML services, if necessary.
• Meetings: share knowledge on AI trends, ask questions, and challenge assumptions.
• Delivery: help the team meet commitments and accept constructive feedback.
• Growth: continuously improve technical skills and stay current with AI developments.
• Quality: write maintainable code with unit/integration tests and evaluation benchmarks.
• Learning: adapt to new frameworks, algorithms, and stacks quickly.
• Stack familiarity: Python, PyTorch / TensorFlow, Hugging Face, LangChain / LlamaIndex, vector DBs; Docker, Kubernetes, MLflow / Weights & Biases; AWS SageMaker, GCP Vertex AI; backend & API: Python, Go, Node.js, GraphQL, Elasticsearch, Postgres.

Skills

Python

PyTorch

TensorFlow

Hugging Face

LangChain

LlamaIndex

Vector Databases

Pinecone

Qdrant

pgvector

Go

Node.js

GraphQL

Elasticsearch

PostgreSQL

Docker

Kubernetes

MLflow

Weights & Biases

AWS SageMaker

GCP Vertex AI

Tools

Docker

Kubernetes

MLflow

Weights & Biases

Pinecone

Qdrant

pgvector

SageMaker

Vertex AI

Job description

Veritone, Inc. is seeking an AI/ML Engineer to build and refactor production-grade ML pipelines and model integration layers.

You will collaborate with product, design, data, and infra teams to embed AI capabilities into applications and maintain scalable features. The role requires 3+ years in AI/ML, strong Python skills, and hands-on experience with LLMs, RAG, and inference services across modern stacks including PyTorch, TensorFlow, Hugging Face, and vector DBs.