Lead AI Engineer

uPerform

Oregon

Hybrid

USD 180,000 - 260,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

uPerform seeks a Lead AI Engineer to split time between hands-on development and strategic leadership. You will guide the AI engineering team, shape architecture for adaptive learning, and direct LLM-powered features on Bedrock, focusing on conversational search, AI analytics, and adaptive learning.

The role requires shipping AI features to production, mentoring engineers, and ensuring high standards of quality and performance across cloud deployments and data pipelines.

Qualifications

  • 8+ years of professional software engineering experience.
  • 2+ years building generative AI features in production.
  • Hands-on production experience with Amazon Bedrock or Azure AI Foundry.
  • Experience building agentic systems, including tool use and multi-step workflows.
  • Experience with retrieval-augmented generation (RAG), embeddings, and vector/hybrid search (OpenSearch/Elasticsearch).
  • Demonstrated experience leading a team of 3–5+ engineers as a tech lead or lead engineer.
  • Strong Python skills and experience with AWS-native services (Lambda, S3, DynamoDB, Step Functions).
  • Daily use of AI coding tools such as Cursor or Claude Code.
  • Excellent communication skills; able to explain AI concepts to technical and non-technical audiences.
  • Experience working within Agile software methodologies.

Responsibilities

  • Lead and mentor the AI engineering team in an agile environment, balancing hands-on development with team leadership.
  • Design, build, and operate LLM-powered features on Amazon Bedrock, including RAG pipelines and agentic workflows.
  • Drive conversational search to general availability, including quality evaluation, latency, and cost.
  • Build dashboards on Amazon Redshift to measure AI feature usage and performance.
  • Shape the architecture for adaptive learning, rebuilding uPerform courses to adapt to each learner using AI.
  • Own technical decisions on model selection, retrieval design, evaluation, and cost-quality trade-offs.
  • Establish evaluation practices, including golden datasets, offline evals, and LLM-as-judge.
  • Provision resources with infrastructure as code (CloudFormation) and partner with operations on production deployments.
  • Drive adoption of AI coding tools such as Cursor and Claude Code across the team.
  • Contribute to agile team performance through planning, standups, sprint reviews, and retrospectives.

Skills

Software engineering
Generative AI features in production
Amazon Bedrock
Azure AI Foundry
Agentic systems
RAG
Embeddings
OpenSearch
Elasticsearch
Team leadership
Python
AWS Lambda
AWS S3
DynamoDB
Step Functions
Cursor
Claude Code
Communication
Agile

Tools

AWS Lambda
AWS S3
DynamoDB
Step Functions

Job description

Lead AI Engineer

uPerform – the fastest and easiest solution to help enterprises and health care organizations rapidly create, manage, and distribute targeted learning content – is looking for an experienced and driven Lead AI Engineer to join our Software Development & Innovation Group (SDIG).

The ideal candidate is a hands-on technical leader who has shipped generative AI features to production and led the engineers who build them. This individual will split their time evenly between building and leading, setting technical direction for our AI products – conversational search, AI analytics, and adaptive learning – while maintaining uPerform’s standards of quality and excellence.

Duties and Responsibilities
  • Lead and mentor the AI engineering team in an agile environment, balancing hands-on development with team leadership
  • Design, build, and operate LLM-powered features on Amazon Bedrock, including RAG pipelines and agentic workflows
  • Drive conversational search to general availability, including quality evaluation, latency, and cost
  • Build dashboards on Amazon Redshift to measure AI feature usage and performance
  • Shape the architecture for adaptive learning, rebuilding uPerform courses to adapt to each learner using AI
  • Own technical decisions on model selection, retrieval design, evaluation, and cost-quality trade-offs
  • Establish evaluation practices, including golden datasets, offline evals, and LLM-as-judge
  • Provision resources with infrastructure as code (CloudFormation) and partner with operations on production deployments
  • Drive adoption of AI coding tools such as Cursor and Claude Code across the team
  • Contribute to agile team performance through planning, standups, sprint reviews, and retrospectives
Required Skills
  • 8+ years of professional software engineering experience, including 2+ years building generative AI features in production
  • Hands-on production experience with Amazon Bedrock or Azure AI Foundry
  • Experience building agentic systems, including tool use and multi-step workflows
  • Experience with retrieval-augmented generation (RAG), embeddings, and vector or hybrid search (OpenSearch or Elasticsearch)
  • Demonstrated experience leading a team of 3–5+ engineers as a tech lead or lead engineer
  • Strong Python skills and experience with AWS-native services (Lambda, S3, DynamoDB, Step Functions)
  • Daily use of AI coding tools such as Cursor or Claude Code
  • Excellent communication skills, including explaining AI concepts to technical and non-technical audiences
  • Experience working within Agile software methodologies
Preferred Skills
  • Healthcare or regulated-data experience (HIPAA, PHI, SOC 2)
  • Experience building LLM evaluation frameworks and modeling cost per query
  • Infrastructure as code with CloudFormation, CDK, or Terraform
  • Data warehousing and dashboarding on Redshift or Snowflake
  • Edtech, learning platform, or adaptive learning background
Location

Remote, United States (uPerform HQ in Elkridge, MD)

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI Engineer
Lead AI Engineer

ANCILE Solutions, Inc. • United States

Remote
USD 180,000 - 260,000
Lead AI Engineer
Lead AI Engineer

ADP, Inc. • Elkridge (MD)

Remote
USD 150,000 - 190,000
Lead AI Engineer
Lead AI Engineer

uPerform • Elkridge (MD)

Remote
USD 180,000 - 240,000
Lead AI Engineer
Lead AI Engineer

Bazeta • Elkridge (MD)

Hybrid
USD 140,000 - 200,000
Remote Lead AI Engineer: Generative AI & Adaptive Learning
Remote Lead AI Engineer: Generative AI & Adaptive Learning

uPerform • Oregon

Hybrid
USD 180,000 - 260,000
Remote Lead AI Engineer, LLM & Adaptive Learning
Remote Lead AI Engineer, LLM & Adaptive Learning

uPerform • Elkridge (MD)

Remote
USD 180,000 - 240,000
Lead AI Engineer - Generative AI, LLMs, Remote
Lead AI Engineer - Generative AI, LLMs, Remote

ADP, Inc. • Elkridge (MD)

Remote
USD 150,000 - 190,000
Staff AI Engineer
Staff AI Engineer

Harnham • New York (NY)

Remote
USD 160,000 - 185,000
Remote Lead AI Engineer: Generative AI & LLM Architect
Remote Lead AI Engineer: Generative AI & LLM Architect

ANCILE Solutions, Inc. • United States

Remote
USD 180,000 - 260,000
Lead AI Engineer
Lead AI Engineer

Salt • New York (NY)

On-site
USD 180,000 - 230,000