Compare / Ollie vs Caddy
Ollie vs Caddy
Ollie is a home personal assistant from Confabulation Corporation (United States); Caddy is a Message-Based Universal Personal/Home Execution Agent from Caddy Technologies Inc. (United States). On Assistant Benchmark (1–10, updated 8 Oct 2026), Ollie scores 8.3 over 13 dimensions and Caddy scores 7.3 over 9; both were scored on 8 of the same dimensions, shown below. PAEval holds 16 capability records for Ollie and 15 for Caddy (as of 9 Oct 2026).
Scores stay on each evaluator's own scale and are never combined. PAEval does not pick a winner.
| Ollie | Caddy | |
|---|---|---|
| Vendor | Confabulation Corporation | Caddy Technologies Inc. |
| HQ region | United States | United States |
| Type | Home personal assistant | Message-Based Universal Personal/Home Execution Agent |
| Pricing (as documented) | Public index price: Free 6 items per day + 50 items per month; Everyday $25/month, 10 per day + 150 per month; Always-On $100/month, 15… | Public beta, free to start; list site records Free public beta, no standard payment price list. |
| Assistant Benchmark1–10 mean of scored dimensions | 8.3coverage 13/15 | 7.3coverage 9/15 |
| micro1 PersonalAgentBench% of 10 workflows with trusted completion | Not scored | Not scored |
| SuperCLUE-XClaw0–100 weighted total of 5 dimensions | Not scored | Not scored |
| Autonomy & background work | Independently observed | Documented |
| Execution environments | Partly disclosed / partly tested | Partly disclosed / partly tested |
| Calls, messages & identity | Partly disclosed / partly tested | Documented |
| Connectors & tools | Documented | Documented |
| Memory & personalization | Documented | Partly disclosed / partly tested |
| Channels & interfaces | Documented | Documented |
| Research & deliverables | Partly disclosed / partly tested | Partly disclosed / partly tested |
| Transactions & bookings | No record | No record |
| Collaboration & parallelism | Documented | Documented |
| Reliability & recovery | Not disclosed | Partly disclosed / partly tested |
| Permissions, security & data | Documented | Documented |
| Capability records | 16 (2 independent) | 15 (1 independent) |
Capability cells show the strongest documented or observed status in each domain; availability is not task success.Add more products →
Assistant Benchmark, dimension by dimension
| Ollie | Caddy | |
|---|---|---|
| Carrying out an online task | 9test | 8test |
| Travel booking | 7test | 8test |
| Recommendation quality | 7test | 7test |
| Purchasing a product | 8test | 7test |
| Responding to emails | 8test | 7test |
| Proactive behavior | 8test | Not tested |
| Running a routine | 10test | Not tested |
| Third-party integrations | 7test | 7test |
| Permissions & privacy | 8test | Not tested |
| Memory | Not tested | 7test |
| Phone calls | n/a | n/a |
| Multiplayer / groups | 9test | n/a |
| Chained tasks | 8test | 7test |
| Proactive restraint | 10test | Not tested |
| Content creation / games | 9test | 8test |
Source scores on the 1–10 anchor scale. "Not tested" is missing evidence, not zero.Source ↗