Client QA & Operations Analyst

Rifa AI; United States; Remote; USD 60,000 - 90,000; Full time

Job summary

Rifa AI is seeking a QA/Operations professional to audit transcripts and bot performance for enterprise clients. You will review call and chat transcripts, score conversations, and identify compliance gaps, edge cases, and regressions.

You will translate findings into clear, actionable Linear/Jira tickets for the engineering team while supporting client QA and audit calls. You will be the bridge between clients and engineering, reconciling QA views with client audits and helping ensure the AI

Qualifications

• 1–3 years in QA, operations, quality analysis, or similar client-facing role.
• Comfort with data and transcripts as evidence; form your own view from logs or scores.
• Clear written and spoken English; issues tickets and client summaries.
• US hours overlap with ET/CT, extending to IST late afternoons/evenings.

Responsibilities

• Audit transcripts and bot performance across transcripts and metrics.
• Find and document issues with clear evidence (transcript or metric).
• Translate findings into Linear/Jira cards with steps and impact.
• Join client QA and audit calls; explain findings to client teams.
• Reconcile audits with client results and align on a shared view of quality.
• Support client relationship by feeding insights to the PM and influencing release communications.

Skills

QA & ops background

Data-driven analysis

English proficiency

US-hours overlap

Attention to detail

Tools

QA tooling

Observability dashboards

Linear/Jira

Job description

About us

Rifa AI is building the AI agents platform for contact centers in regulated industries.

Enterprises in these industries want AI agents handling their customer operations and mostly can't deploy them. It's not a model problem. Horizontal platforms lack governance, release processes, and change management, and in a domain where every call can be reviewed by a regulator, that's disqualifying. Building an AI agent has never been easier. Deploying one an enterprise can trust has never been harder. That harder problem is the one we work on.

Our platform turns a company's written procedures into AI agents: voicebots that hold real-time conversations, take actions in the client's CRM, and stay within the limits the client has set. Every release is gated by an automated testing suite, and every conversation feeds a post-analysis platform. We're live in production today, handling debt collection calls for US financial services clients.

The engineering convictions behind it: evaluation methodology, not model capability, is the bottleneck. Every rule and decision trace becomes part of a company's context graph. Observability goes beyond logging. And our Agent Studio lets engineers, non-engineers, and auditors collaborate to build and improve AI agents with the right guardrails to achieve the expected business outcomes.

Rifa was founded by Sameer Fulzele (IIT Bombay). We're a small team of exceptionally capable, passionate engineers with paying enterprise clients and growing revenue, backed by Seaborne Capital, a founder-first firm of exceptional industry operators that works closely with its founders, and by angel investors who are veterans of enterprise software and operators in the accounts receivable industry.

About the role

This is the hands-on quality and operations role behind our enterprise client relationships. You'll live in the transcripts and performance data: auditing how our AI agents handle real client conversations, catching issues before and after clients do, and turning what you find into clear, actionable work for the engineering team.

You'll be client-facing: on audit calls, walking client-side QA and compliance teams through findings, and reconciling our read of bot performance with theirs. It's a role for someone precise, curious, and organized, comfortable with data and detail, and confident explaining what they found and why it matters.

You'll report to the Technical Program / Product Manager, who owns the overall client relationship, and you'll be their eyes and ears on day-to-day quality.

What you'll do

• Audit transcripts and bot performance. Review call and chat transcripts in Reflect, our observability platform, evaluate how our AI agents performed against quality and compliance standards, and score conversations consistently and fairly.

• Find and document issues. Spot regressions, compliance gaps, mishandled flows, and edge cases in agent behavior, and document them clearly, with the transcript or metric as evidence.

• Convey issues to engineering. Translate what you find into well-written Linear cards that engineers can act on without a follow-up call: clear repro steps, the affected conversation, and why it matters to the client.

• Get on client calls. Join client QA and audit calls, walk their teams through findings, and answer questions on how our agents are performing.

• Reconcile audits with the client. Compare our QA findings against the client's own audit team's results, work through discrepancies, and align on a shared, defensible view of quality.

• Support the client relationship. Feed insights, recurring issues, and trends back to the Technical Program / Product Manager to inform release communications, weekly syncs, and monthly reviews.

What you'll bring

• 1 to 3 years in QA, operations, quality analysis, delivery support, or a similar client-facing role, ideally at a B2B SaaS, BPO, or financial-services company.

• Comfort with data and transcripts as evidence. You can read a call log or a QA scorecard, form your own view, and back it up, not just relay what someone else said.

• Clear written and spoken English. A large share of this job is written: issue tickets, audit notes, and client-facing summaries that hold up under scrutiny.

• US-hours overlap. Reliable daily overlap with US business hours (ET/CT), which in practice means a late-afternoon-into-evening IST schedule, and comfort being on a call with a client's ops or compliance team.

• Precision and follow-through. You're organized, detail-oriented, and you close the loop on what you find.

Even better...

• Experience in debt collections, lending, or another regulated financial-services domain, or familiarity with FDCPA / compliance workflows

• Hands-on experience with QA tooling, call-quality scoring, or observability/audit dashboards

• Familiarity with Linear (or similar issue trackers like Jira) and how good engineering tickets are written

• An interest in AI / conversational systems and how they behave in production

How we work

Small teams per client, with real ownership. We review each other's work, we write things down, and we'd rather hear an honest "I don't know yet" than a confident wrong answer.

Our values

• Trust: We do the right thing, especially when nobody is checking. Clients hand us regulated conversations with their own customers, and we earn that every day.

• Transparency: We write things down, share the real numbers, and say "I don't know yet" out loud, with each other and with clients.

• Technically best solution: We choose what's right, not what's easiest or trendiest. When we notice we got it wrong, we fix it.

• Decisiveness: We decide quickly with the information we have, commit, and correct course fast when reality disagrees.

• Simplicity: We keep systems, processes, and words simple. Complexity is a cost we pay only when it clearly buys something.