Compare / Ollie vs Shuffle
Ollie vs Shuffle
Ollie is a home personal assistant from Confabulation Corporation (United States); Shuffle is a creation/entertainment companion assistant, including website execution from DNFT (United States). On Assistant Benchmark (1–10, updated 8 Oct 2026), Ollie scores 8.3 over 13 dimensions and Shuffle scores 7.8 over 10; both were scored on 9 of the same dimensions, shown below. PAEval holds 16 capability records for Ollie and 14 for Shuffle (as of 9 Oct 2026).
Scores stay on each evaluator's own scale and are never combined. PAEval does not pick a winner.
| Ollie | Shuffle | |
|---|---|---|
| Vendor | Confabulation Corporation | DNFT |
| HQ region | United States | United States |
| Type | Home personal assistant | Creation/entertainment companion assistant, including website execution |
| Pricing (as documented) | Public index price: Free 6 items per day + 50 items per month; Everyday $25/month, 10 per day + 150 per month; Always-On $100/month, 15… | Pro $8/month: Unlimited chat + 880 monthly picture/video/music credits; $1 daily pass and $4.99 weekly pass are unlimited chat. |
| Assistant Benchmark1–10 mean of scored dimensions | 8.3coverage 13/15 | 7.8coverage 10/15 |
| micro1 PersonalAgentBench% of 10 workflows with trusted completion | Not scored | Not scored |
| SuperCLUE-XClaw0–100 weighted total of 5 dimensions | Not scored | Not scored |
| Autonomy & background work | Independently observed | Partly disclosed / partly tested |
| Execution environments | Partly disclosed / partly tested | Documented |
| Calls, messages & identity | Partly disclosed / partly tested | Partly disclosed / partly tested |
| Connectors & tools | Documented | Not disclosed |
| Memory & personalization | Documented | Documented |
| Channels & interfaces | Documented | Documented |
| Research & deliverables | Partly disclosed / partly tested | Documented |
| Transactions & bookings | No record | No record |
| Collaboration & parallelism | Documented | Documented |
| Reliability & recovery | Not disclosed | Independently observed |
| Permissions, security & data | Documented | Documented |
| Capability records | 16 (2 independent) | 14 (1 independent) |
Capability cells show the strongest documented or observed status in each domain; availability is not task success.Add more products →
Assistant Benchmark, dimension by dimension
| Ollie | Shuffle | |
|---|---|---|
| Carrying out an online task | 9test | 7.5test |
| Travel booking | 7test | 9test |
| Recommendation quality | 7test | 9test |
| Purchasing a product | 8test | 8test |
| Responding to emails | 8test | 8test |
| Proactive behavior | 8test | Not tested |
| Running a routine | 10test | Not tested |
| Third-party integrations | 7test | 7test |
| Permissions & privacy | 8test | 7test |
| Memory | Not tested | 6test |
| Phone calls | n/a | n/a |
| Multiplayer / groups | 9test | n/a |
| Chained tasks | 8test | 7test |
| Proactive restraint | 10test | Not tested |
| Content creation / games | 9test | 9test |
Source scores on the 1–10 anchor scale. "Not tested" is missing evidence, not zero.Source ↗