AI Product Manager

Taskly Anything

United States

Remote

USD 120,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Taskly Technologies Inc. is seeking an AI Product Manager to own features where a language model decides or writes, including a classifier for 1,300 subcategories, content moderation, price suggestions, and semantic search.

You’ll work with Groq-hosted models, tracking cost and latency, and writing prompts and evaluation rubrics. The role emphasizes measurable outcomes, weekly reviews with engineers, and clear rules for when to hand decisions to humans.

Qualifications

  • 4+ years in product management with ML/LLM exposure.
  • Hands-on evaluation: labelled test sets, measured precision/recall.
  • grasps cost and latency trade-offs between model sizes, caching and fallbacks.
  • Ability to read logs and model outputs over summaries.
  • Ability to explain model limitations to non-technical teammates.

Responsibilities

  • Own the roadmap for AI features across posting, moderation, pricing and search, and decide which problems a model should or should not solve.
  • Build and maintain evaluation sets for the task classifier and price suggestions from real tasks in Canada and India, and report results before every prompt or model change.
  • Track cost and latency per feature, and set budgets that keep each call affordable at a firm marketplace price.
  • Design the trust layer: what a poster sees when the model is unsure, when a person reviews, and how a wrong suggestion gets corrected.
  • Write prompts, scoring rubrics and test cases, and review model errors with engineers weekly.
  • Tie AI quality to marketplace outcomes: tasks posted, offers received, edits to suggested prices and moderation false positives; review weekly with the founder.
  • Decide when to switch models, add a fallback or turn a feature off, and explain the call in writing.

Skills

LLM Experience
Prompt Engineering
SQL
Python
Product Analytics
A/B Testing
LangChain
LangSmith

Tools

LangChain
LangSmith
Promptfoo

Job description

As Taskly’s AI Product Manager (sometimes titled Product Manager, AI/ML or GenAI Product Manager), you own the features where a language model makes a decision or writes a sentence. Today that includes a classifier that sorts any task into about 1,300 subcategories, content moderation, price suggestions, voice and photo task posting, and semantic search. Each one fails in its own way, and you decide how much failure is acceptable.

You’ll work with engineers who call Groq-hosted models such as Llama and GPT-OSS, with operations who see failures first, and with the founder. In six months every AI feature should have a written evaluation, a cost per call you can quote, and a clear rule for when it hands the decision to a person.

What you’ll do
  • Own the roadmap for AI features across posting, moderation, pricing and search, and decide which problems a model should and should not solve. Say no to the ones where a rule or a person does it better.
  • Build and maintain evaluation sets for the task classifier and price suggestions from real tasks in Canada and India, and report results before every prompt or model change. No change ships on a hunch.
  • Track cost and latency per feature, and set budgets that keep each call affordable at a firm marketplace price.
  • Design the trust layer: what a poster sees when the model is unsure, when a person reviews, and how a wrong suggestion gets corrected.
  • Write prompts, scoring rubrics and test cases yourself, and review model errors with engineers every week.
  • Tie AI quality to marketplace outcomes: tasks posted, offers received, edits to suggested prices and moderation false positives. Review them weekly with the founder.
  • Decide when to switch models, add a fallback or turn a feature off, and explain the call in writing.
What you’ll need
  • 4+ years in product management, including at least 1 year shipping a feature powered by an LLM or machine-learning model to real users.
  • Hands-on evaluation: you have built a labelled test set, measured precision and recall, and used the result to make a decision.
  • A working grasp of cost and latency trade-offs between model sizes, caching and fallbacks.
  • SQL, and the habit of reading logs and real model outputs rather than summaries.
  • Judgment about when not to use a model: you can name tasks where a rule, a search or a person does the job better.
  • The ability to explain to a non-technical teammate why a model is wrong and what you will do about it.
Nice to have
  • Experience at a marketplace (Airbnb, Uber, Urban Company, Swiggy, Airtasker, TaskRabbit, Upwork) or another two-sided product.
  • Work on moderation, fraud or trust-and-safety models.
  • Python for analysis notebooks, and familiarity with LangChain, LangSmith or Promptfoo.
  • Experience with embeddings and semantic search.
Skills and tools

AI Product Management, LLM, Generative AI, Prompt Engineering, LLM Evaluation, Evals, Semantic Search, Embeddings, SQL, Python, LangChain, A/B Testing, Product Analytics.

Where you’ll work

Fully remote. Open to people who live and can legally work in India, the United States, Canada or the United Arab Emirates. You work from your own country, so there is no relocation and no visa to arrange.

Taskly Anything is a marketplace for getting things done, online or in person. Someone posts a task in their own words (typed, spoken or as a photo) and people who have been reviewed and approved send offers at a firm price. They pick one, and it gets done: a TV mounted, a website built, a parent taught to use their phone. We’re live in Canada and India and opening to more countries, built by a small team that works remotely across India, the US, Canada and the UAE.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer
AI Engineer

Taskly Anything • United States

Remote
USD 120,000 - 180,000
Product Manager
Product Manager

Taskly Anything • United States

Remote
USD 120,000 - 160,000
Prompt Engineer
Prompt Engineer

Taskly Anything • United States

Remote
USD 90,000 - 150,000
Machine Learning Engineer
Machine Learning Engineer

Taskly Anything • United States

Remote
USD 130,000 - 190,000
Data Analyst
Data Analyst

Taskly Anything • United States

Remote
USD 65,000 - 100,000
Performance Marketing Manager
Performance Marketing Manager

Taskly Anything • United States

Remote
USD 90,000 - 140,000
Community Manager
Community Manager

Taskly Anything • United States

Remote
USD 60,000 - 90,000
SEO Specialist
SEO Specialist

Taskly Anything • United States

Remote
USD 70,000 - 120,000
Remote work
Remote GenAI Product Manager for Marketplace AI
Remote GenAI Product Manager for Marketplace AI

Taskly Anything • United States

Remote
USD 120,000 - 190,000
Social Media Manager
Social Media Manager

Taskly Anything • United States

Remote
USD 70,000 - 100,000