AI Engineering Lead: Real-Time Agent Evaluation & Strategy

Verizon; San Francisco (CA); Hybrid; USD 126,000 - 242,000; Full time

Benefits offered by this job

Health and wellness benefits

401(k) match

Paid parental leave

Tuition assistance

Job summary

Verizon is seeking an engineering leader to define the architecture for autonomous AI agent evaluation and governance across mission-critical applications. You will lead a team of Principal AI Engineers and Architects to build scalable pipelines for faster, cheaper, and safer AI.

You will work with VP/SVP-level executives to align technical realities with deployment decisions, while hands-on engineering remains core to the role.

Qualifications

• Bachelor’s degree or six+ years of work experience.
• Ten+ years of relevant experience in AI/ML engineering.
• Four+ years in AI/ML engineering focusing on LLMOps and model evaluation.
• Three+ years managing high-performing engineering/AI data science teams.
• Hands-on experience architecting AI evaluation frameworks and optimization pipelines.
• Proven ability to optimize LLM inference costs and throughput.

Responsibilities

• Architect core engineering systems for continuous AI evaluation and real-time observability.
• Drive AI optimization strategies including RL techniques and weight tuning.
• Lead fine-tuning of LLMs to increase throughput and reduce costs.
• Design and deploy lightweight classification models to triage traffic.
• Mentor Principal AI Engineers and Scientists and plan technical roadmaps.
• Integrate evaluation architectures with cloud governance and AI hubs.

Skills

AI/ML engineering

LLMOps

Model evaluation

Distributed systems

Leadership

Education

Bachelor’s degree

Masters/PhD (advantage)

Tools

LangGraph

AutoGen

MCP

Job description

Verizon is seeking an engineering leader to define the architecture for autonomous AI agent evaluation and governance across mission-critical applications. You will lead a team of Principal AI Engineers and Architects to build scalable pipelines for faster, cheaper, and safer AI.

You will work with VP/SVP-level executives to align technical realities with deployment decisions, while hands-on engineering remains core to the role.