Benchmarks & sources / Provisional studies — verification pending

analyst.ai: information lookup (provisional)

Published lookup study with 252 cases per product label: 180 live-web and 72 fixed-packet cases.

analyst.ai · Published 2026-10-21 · reviewed 2026-10-29

Verification pending. Product identity and primary evidence gaps remain unresolved. No product scores from this study enter PAEval leaderboards.

Scope and method

Four product labels; one first answer and a fixed recheck. Product histories and plans differ.

Separate correctness, trustworthiness, usability and recheck components. Twelve task-family/input panels contribute equally to the total.

How PAEval uses it

Provisional directory entry; no scores joined to verified product records.

Evidence family: analyst-personal-assistants-2026-10. Shared tasks and tracks are not independent evidence votes.

Limits and interpretation

  • The report explicitly says its Instinct account did not identify its provider.
  • Full prompts, answers, keys and adjudication evidence pack is not yet published; November 2026 is a target.
  • Seven-day monitoring is planned, not part of published first-answer results.

Sources and reuse

PAEval summarizes existing published evidence and runs no new tests. Public readability does not establish permission to redistribute full datasets, conversations or images.

Related tracks from the same family

analyst.ai: personal email (provisional) · analyst.ai: household money (provisional) · analyst.ai: investment research (provisional)

All benchmark sources → · How to read outcomes and intervention →