Benchmarks & sources / Vendor case studies

DataDome: three demo-store orders

Three assistants are shown ordering a specified keyboard from the publisher's demo shop. Merchant-side records support the order observations.

DataDome / Jérôme Segura · Updated 2026-10-27 · reviewed 2026-10-29

Scope and method

One common task, three product records; failed-attempt denominator and repeat count not disclosed.

Client observations, approvals and merchant logs; DataDome also demonstrates its own detection service.

How PAEval uses it

Narrow transaction case evidence; excluded from independent scoreboards.

Evidence family: datadome-shopping-2026-10. Shared tasks and tracks are not independent evidence votes.

Shown purchase records

Approval, order creation, settlement and fulfillment remain distinct states.

ProductObservation
InstinctApproved order; reported order number matches server record
DotsLogin and payment approval before order
MuseConfirmed intended item and removed residual cart items before order

Limits and interpretation

  • Demo-store order creation does not independently establish real card settlement or physical delivery.
  • Initial cart state differs. Three displayed successes do not imply 100% reliability.
  • Traffic shares and detection labels are vendor observations, not independently verified conversion or detector-accuracy metrics.

Sources and reuse

PAEval summarizes existing published evidence and runs no new tests. Public readability does not establish permission to redistribute full datasets, conversations or images.

Related product records

Instinct · OpenAI dots · Meta Muse

All benchmark sources → · How to read outcomes and intervention →