AI Engineer

Hiringhood; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

Hiringhood seeks a seasoned product-focused engineer to build and evolve AI agents for a healthcare technology SaaS platform. You will design, deploy, and maintain multi-client agentic workflows, securely handle health data, and drive end-to-end features from concept to production.

You will run rigorous evaluation pipelines to optimize cost, effectiveness, tone, and quality while ensuring privacy and compliance.

Qualifications

• Experience working directly for a product company, not an agency or services firm.
• Hands-on design, prompting, and management of autonomous AI agents in production.
• Experience setting up rigorous AI evaluation pipelines (golden datasets, LLM-as-a-judge).
• Experience safely navigating and leveraging health data in software products.
• Deep understanding of multi-tenant SaaS architecture and feature iteration.
• Ability to collaborate effectively with distributed international teams across time zones.
• Strong product instinct: focus on usability, speed, and usefulness.
• High ownership and independence, shipping in a small team.

Responsibilities

• Build and evolve AI agents within our SaaS architecture, scalable across clients.
• Run comprehensive evaluation pipelines to monitor AI performance and optimize cost, efficacy, tone, and quality.
• Integrate and manage health data securely to contextualize agent responses.
• Iterate on multi-client SaaS deployments, refining prompts, context windows, and routing logic.
• Own features end-to-end with Product, Design and Backend from design to production.
• Build with AI using modern development tools while upholding engineering standards.

Skills

Product company experience

AI agents

AI evaluation frameworks

Health data proficiency

SaaS architecture

Global collaboration

Ownership & independence

Missionary mindset

Product instinct

Tools

OpenAI

Anthropic

LangChain

Job description

One of our key clients is a healthcare technology company focused on making healthcare more personalized, proactive, and accessible through AI. Its platform brings together medical records, lab reports, wearable data, and other health information to deliver personalized health insights to consumers. It also helps clinics intelligently engage with patients through communication, scheduling, reports, and health insights. The platform aims to connect patients, healthcare providers, and health data in one seamless ecosystem.

Must have

Prior experience with Product based company

• Product company experience: You have a proven track record working directly for a product company rather than an agency or services firm, bringing a strong product mindset and deep feature ownership.
  Expertise in building agents: Strong hands-on experience designing, prompting, and managing autonomous or semi-autonomous AI agents in production environments.
  Mastery of AI evaluation frameworks: You are highly experienced in setting up and running rigorous LLM evals (e.g., using golden datasets, LLM-as-a-judge) to balance cost, efficacy, tone, and quality.
  Health data proficiency: Prior experience safely navigating, processing, and leveraging sensitive health data in software products.
  SaaS architecture familiarity: Deep understanding of how to iterate and manage features in a multi-tenant SaaS ecosystem.
  Global team collaboration: Experience working effectively with distributed, international teams, maintaining strong communication and alignment across multiple time zones.
  Strong product instinct: You think beyond whether a feature technically works and care about whether it is intuitive, fast and useful to the person using it.
  High ownership and independence: You are comfortable working in a small team and remotely, making good technical decisions and taking responsibility for getting things shipped.
  Missionary mindset: A mindset of full ownership of solutions. Own the metrics around delivering innovation and customer satisfaction
  Our Technology
  AI: LLM-powered and agentic workflows (OpenAI, Anthropic, LangChain, custom evaluation
  pipelines)
  Backend: Node.js, Python
  Data: PostgreSQL, Vector Databases
  Cloud: AWS / GCP
  Mobile and web frontend: React Native, TypeScript

Good to have

• Experience with consumer health, fitness or wellness products
  Experience building conversational consumer experiences
  Experience working in an early-stage startup

Roles & Responsibilities

Build and evolve AI agents: Design, deploy, and maintain multi-client agentic workflows within our SaaS architecture, ensuring they scale efficiently across different customer instances.
Run comprehensive evals: Develop and manage rigorous evaluation pipelines to continuously monitor AI performance, optimizing for cost, efficacy, clinical outcomes, conversational tone, and response quality.
Integrate and manage health data: Work securely with complex health datasets (medical records, wearables, lab reports) to contextualize agent responses, strictly adhering to privacy and compliance standards.
Build RAG systems
Iterate on multi-client SaaS deployments: Continuously monitor agent behaviors across diverse client environments, refining prompts, context windows, and routing logic based on real-world usage.
Own features end-to-end: Work directly with Product, Design and Backend from requirements and technical design through implementation, testing, and production.
Build with AI: Use modern AI development tools to improve engineering speed and quality while maintaining strong engineering standards.