Requirements
- Target platform
- OpenClaw
- Install method
- Manual import
- Extraction
- Extract archive
- Prerequisites
- OpenClaw
- Primary doc
- SKILL.md
Compare models with A/B testing for selection
Compare models with A/B testing for selection
Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually.
I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete.
I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run.
Compare models with A/B testing for selection
This skill is derived from 20. Testing & Quality Assurance of the OpenClaw Agent Mastery Index v4.1. Sub-heading: A/B Testing Frameworks for Model Selection Complexity: high
NameTypeRequiredDescriptionmodel_astringYesFirst modelmodel_bstringYesSecond modeltest_promptsarrayYesTest prompts
{ "status": <string>, "details": <object>, "winner": <string>, "confidence": <number> }
const result = await openclaw.skill.run('ab-test-framework', { model_a: "value", model_b: "value", test_prompts: 123 });
const result = await openclaw.skill.run('ab-test-framework', { model_a: "value", model_b: "value", test_prompts: [] });
A/B test security per Category 8; prevent test manipulation
Input Validation: All inputs are validated before processing Least Privilege: Operations run with minimal required permissions Audit Logging: All actions are logged for security review Error Handling: Errors are sanitized before returning to caller
IssueCauseSolutionPermission deniedInsufficient privilegesCheck file/directory permissionsInvalid inputMalformed parametersValidate input formatDependency missingRequired module not installedRun npm install
Enable debug logging: openclaw.logger.setLevel('debug'); const result = await openclaw.skill.run('ab-test-framework', { ... });
model-routing-manager performance-benchmarker @param {string} params.model_a - First model @param {string} params.model_b - Second model @param {Array} params.test_prompts - Test prompts
Code helpers, APIs, CLIs, browser automation, testing, and developer operations.
Largest current source with strong distribution and engagement signals.