Compare / Grok Bot vs Ollie
Grok Bot vs Ollie
Grok Bot is an Individual/Team Agent from xAI (via Cursor) (United States); Ollie is a home personal assistant from Confabulation Corporation (United States). On Assistant Benchmark (1–10, updated 8 Oct 2026), Grok Bot scores 7.3 over 7 dimensions and Ollie scores 8.3 over 13; both were scored on 7 of the same dimensions, shown below. PAEval holds 33 capability records for Grok Bot and 16 for Ollie (as of 9 Oct 2026).
Scores stay on each evaluator's own scale and are never combined. PAEval does not pick a winner.
| Grok Bot | Ollie | |
|---|---|---|
| Vendor | xAI (via Cursor) | Confabulation Corporation |
| HQ region | United States | United States |
| Type | Individual/Team Agent | Home personal assistant |
| Pricing (as documented) | Cursor Pro/Pro+/Ultra are priced at US$20/60/200 per month respectively; Teams Standard/Premium are US$40/120 per user/month respectively,… | Public index price: Free 6 items per day + 50 items per month; Everyday $25/month, 10 per day + 150 per month; Always-On $100/month, 15… |
| Assistant Benchmark1–10 mean of scored dimensions | 7.3coverage 7/15 | 8.3coverage 13/15 |
| micro1 PersonalAgentBench% of 10 workflows with trusted completion | 30%95% CI 11–60% | Not scored |
| SuperCLUE-XClaw0–100 weighted total of 5 dimensions | Not scored | Not scored |
| Autonomy & background work | Limited or conditional | Independently observed |
| Execution environments | Documented | Partly disclosed / partly tested |
| Calls, messages & identity | Limited or conditional | Partly disclosed / partly tested |
| Connectors & tools | Limited or conditional | Documented |
| Memory & personalization | Documented | Documented |
| Channels & interfaces | Documented | Documented |
| Research & deliverables | Documented | Partly disclosed / partly tested |
| Transactions & bookings | Limited or conditional | No record |
| Collaboration & parallelism | Limited or conditional | Documented |
| Reliability & recovery | Limited or conditional | Not disclosed |
| Permissions, security & data | Limited or conditional | Documented |
| Capability records | 33 (0 independent) | 16 (2 independent) |
Capability cells show the strongest documented or observed status in each domain; availability is not task success.Add more products →
Assistant Benchmark, dimension by dimension
| Grok Bot | Ollie | |
|---|---|---|
| Carrying out an online task | 8observed in use | 9test |
| Travel booking | Not tested | 7test |
| Recommendation quality | 7observed in use | 7test |
| Purchasing a product | 8observed in use | 8test |
| Responding to emails | 9observed in use | 8test |
| Proactive behavior | Not tested | 8test |
| Running a routine | Not tested | 10test |
| Third-party integrations | 3observed in use | 7test |
| Permissions & privacy | Not tested | 8test |
| Memory | Not tested | Not tested |
| Phone calls | Not tested | n/a |
| Multiplayer / groups | Not tested | 9test |
| Chained tasks | 8observed in use | 8test |
| Proactive restraint | Not tested | 10test |
| Content creation / games | 8observed in use | 9test |
Source scores on the 1–10 anchor scale. "Not tested" is missing evidence, not zero.Source ↗