Benchmarks & sources / Provisional studies — verification pending

analyst.ai: household money (provisional)

72 synthetic household-finance packet tasks per product label. Published results concern analysis and constrained advice, not real account operation.

analyst.ai · Published 2026-10-21 · reviewed 2026-10-29

Verification pending. Product identity and primary evidence gaps remain unresolved. No product scores from this study enter PAEval leaderboards.

Scope and method

Six task groups; complete-task passes differ from arithmetic correctness. A reported recheck delivery fault changes one denominator.

All required gates must pass; first-answer and recheck outcomes are separate. Residual conversation context is a disclosed confound.

How PAEval uses it

Provisional method reference; no financial safety or transaction claims.

Evidence family: analyst-personal-assistants-2026-10. Shared tasks and tracks are not independent evidence votes.

Limits and interpretation

  • Shared unresolved product identity and missing full evidence pack.
  • Synthetic test assumptions do not establish real-world tax rules or suitability of financial advice.

Sources and reuse

PAEval summarizes existing published evidence and runs no new tests. Public readability does not establish permission to redistribute full datasets, conversations or images.

Related tracks from the same family

analyst.ai: information lookup (provisional) · analyst.ai: personal email (provisional) · analyst.ai: investment research (provisional)

All benchmark sources → · How to read outcomes and intervention →