@devries-cameron20 / composio Mirror · read-only
Fork 0

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

Mirrored from https://github.com/Camo67/composio.git

Synced Nov 21, 07:15 UTC

next
md 14 lines 1.01 KB
Rendered Raw
1 # Batch 2026-11-11T18-24-23-claude-code-claude-haiku-5-5-dev-playground-execute-holdout
2
3 claude-code 2.1.310, claude-haiku-5-5, 5 run(s) per journey and arm.
4 Revision e4e5d922e with uncommitted changes; skill f6f4d7820d90; harness 9ff7364caa93.
5 Spent $0.020 on new runs; 0 run(s) reused.
6
7 | split | journey | arm | passed | pass@1 (95% CI) | pass@k | pass^k | wrong tree | mean cost | infra |
8 | ------- | ---------------------------------- | ----- | ------ | --------------- | ------ | ------ | ---------- | --------- | ----- |
9 | holdout | developer-auth-configs-and-execute | skill | 5/5 | 100% (57%–100%) | 100% | 100% | 0% | $0.002 | 0 |
10 | holdout | run-inline-script | skill | 5/5 | 100% (57%–100%) | 100% | 100% | 0% | $0.002 | 0 |
11
12 | split | arm | mean pass@1 | mean pass^k | mean wrong tree |
13 | ------- | ----- | ----------- | ----------- | --------------- |
14 | holdout | skill | 100% | 100% | 0% |