QA Engineer, AI Verification Systems

Pramaana Labs

India

On-site

INR 1,200,000 - 1,800,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Pramaana Labs is seeking a QA/SDET to test a rules-to-proof product across rule input, formal specs, prover outputs and proof viewers. You will raise defects and verify fixes, focusing on corner cases and security risks.

Ideal candidates have 3+ years in QA/SDET or ML/LLM evaluation, hands-on test automation (Python preferred) and experience with non-deterministic data-heavy systems. You will automate tests with CI/CD tooling and write precise bug reports.

Qualifications

  • 3+ years in QA, SDET or ML/LLM evaluation, hands-on test automation experience (Python preferred).
  • Experience testing non-deterministic or data-heavy systems (LLMs, ML pipelines, rules engines).
  • Automation and CI/CD experience (pytest or similar, GitHub Actions or Jenkins).
  • Logical rigor: edge cases, constraints, counterexamples.
  • Ability to turn dense rule-based text into precise test cases, and to write clear bug reports.

Responsibilities

  • Test the different parts of the product for functionality, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. Raise clear, reproducible defects and verify fixes.
  • Cover corner cases and potential security issues, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling risks.
  • As time goes on, work on automating these tests so that these are flagged without manual intervention.

Skills

QA/SDET experience
ML/LLM evaluation
Python test automation
CI/CD
Non-deterministic testing
Bug reporting

Tools

pytest
GitHub Actions
Jenkins

Job description

Company

Pramaana Labs is a frontier AI lab building the verification layer for AI. Founded in 2025 and headquartered in Palo Alto, we turn complex human knowledge, including tax codes, legal rules, clinical guidelines and security protocols, into a formal representation, so every AI answer can be traced, challenged, and proved. Pramaana’s architecture pairs foundation models trained to formalize and reason with a symbolic world model encoded in Lean 4. Pramaana was founded by a team out of Google, DeepMind, and Glean, combining frontier AI researchers and formal methods experts.

The Role

QA/SDET (Software Development Engineer in Test) for a rules-to-proof product. You test every stage of the pipeline, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. You raise clear, reproducible defects and verify fixes.

Focus areas: Corner cases and security risks, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling issues.

Long-term goal: Automate these tests so problems are flagged without manual intervention.

What You’ll Do
  • Test the different parts of the product for functionality, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. Raise clear, reproducible defects and verify fixes.

  • Cover corner cases and potential security issues, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling risks.

  • As time goes on, work on automating these tests so that these are flagged without manual intervention.

You Will Thrive in This Role If You Have
  • 3+ years in QA, SDET or ML/LLM evaluation, hands-on test automation experience (Python preferred)

  • Experience testing non-deterministic or data-heavy systems (LLMs, ML pipelines, rules engines).

  • Automation and CI/CD experience (pytest or similar, GitHub Actions or Jenkins).

  • Logical rigor: edge cases, constraints, counterexamples.

  • Ability to turn dense rule-based text into precise test cases, and to write clear bug reports.

Especially Strong Candidates May Also Have
  • LLM eval and benchmark design.

  • Tax, law or compliance background.

  • Property-based testing and API testing.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

QA Engineer, AI Verification Systems
QA Engineer, AI Verification Systems

Pramaana Labs • Bengaluru

On-site
INR 1,500,000 - 2,400,000
QA Engineer, AI Verification Systems
QA Engineer, AI Verification Systems

Pramaana • Bengaluru

On-site
INR 900,000 - 1,500,000
Staff QA Automation Engineer
Staff QA Automation Engineer

MeeruAI • Hyderabad

On-site
INR 3,000,000 - 5,500,000
QA Engineer - Proofline
QA Engineer - Proofline

Meraki • Bengaluru

On-site
INR 600,000 - 1,200,000
QA Engineer - Proofline
QA Engineer - Proofline

Meraki-Labs • Bengaluru

On-site
INR 600,000 - 900,000
QA Engineer - Proofline
QA Engineer - Proofline

Meraki Labs • Bengaluru

On-site
INR 600,000 - 1,100,000
Staff QA Automation Engineer
Staff QA Automation Engineer

Meeru AI Inc • Hyderabad

On-site
INR 1,800,000 - 2,800,000
Senior QA Engineer, AI
Senior QA Engineer, AI

ICE • Hyderabad

On-site
INR 1,800,000 - 3,000,000
QA Engineer – Manual, Automation & AI-Assisted Testing
QA Engineer – Manual, Automation & AI-Assisted Testing

Meera AI • India

On-site
INR 900,000 - 1,500,000
Senior Qa Automation Test Engineer
Senior Qa Automation Test Engineer

Acads360 India • Hyderabad

On-site
INR 1,200,000 - 2,000,000