{
  "schemaVersion": "1.0",
  "item": {
    "slug": "hollow-validation-checker",
    "name": "Hollow Validation Checker",
    "source": "tencent",
    "type": "skill",
    "category": "AI 智能",
    "sourceUrl": "https://clawhub.ai/andyxinweiminicloud/hollow-validation-checker",
    "canonicalUrl": "https://clawhub.ai/andyxinweiminicloud/hollow-validation-checker",
    "targetPlatform": "OpenClaw"
  },
  "install": {
    "downloadMode": "redirect",
    "downloadUrl": "/downloads/hollow-validation-checker",
    "sourceDownloadUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=hollow-validation-checker",
    "sourcePlatform": "tencent",
    "targetPlatform": "OpenClaw",
    "installMethod": "Manual import",
    "extraction": "Extract archive",
    "prerequisites": [
      "OpenClaw"
    ],
    "packageFormat": "ZIP package",
    "includedAssets": [
      "SKILL.md"
    ],
    "primaryDoc": "SKILL.md",
    "quickSetup": [
      "Download the package from Yavira.",
      "Extract the archive and review SKILL.md first.",
      "Import or place the package into your OpenClaw setup."
    ],
    "agentAssist": {
      "summary": "Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually.",
      "steps": [
        "Download the package from Yavira.",
        "Extract it into a folder your agent can access.",
        "Paste one of the prompts below and point your agent at the extracted folder."
      ],
      "prompts": [
        {
          "label": "New install",
          "body": "I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete."
        },
        {
          "label": "Upgrade existing",
          "body": "I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run."
        }
      ]
    },
    "sourceHealth": {
      "source": "tencent",
      "status": "healthy",
      "reason": "direct_download_ok",
      "recommendedAction": "download",
      "checkedAt": "2026-04-30T16:55:25.780Z",
      "expiresAt": "2026-05-07T16:55:25.780Z",
      "httpStatus": 200,
      "finalUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=network",
      "contentType": "application/zip",
      "probeMethod": "head",
      "details": {
        "probeUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=network",
        "contentDisposition": "attachment; filename=\"network-1.0.0.zip\"",
        "redirectLocation": null,
        "bodySnippet": null
      },
      "scope": "source",
      "summary": "Source download looks usable.",
      "detail": "Yavira can redirect you to the upstream package for this source.",
      "primaryActionLabel": "Download for OpenClaw",
      "primaryActionHref": "/downloads/hollow-validation-checker"
    },
    "validation": {
      "installChecklist": [
        "Use the Yavira download entry.",
        "Review SKILL.md after the package is downloaded.",
        "Confirm the extracted package contains the expected setup assets."
      ],
      "postInstallChecks": [
        "Confirm the extracted package includes the expected docs or setup files.",
        "Validate the skill or prompts are available in your target agent workspace.",
        "Capture any manual follow-up steps the agent could not complete."
      ]
    },
    "downloadPageUrl": "https://openagent3.xyz/downloads/hollow-validation-checker",
    "agentPageUrl": "https://openagent3.xyz/skills/hollow-validation-checker/agent",
    "manifestUrl": "https://openagent3.xyz/skills/hollow-validation-checker/agent.json",
    "briefUrl": "https://openagent3.xyz/skills/hollow-validation-checker/agent.md"
  },
  "agentAssist": {
    "summary": "Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually.",
    "steps": [
      "Download the package from Yavira.",
      "Extract it into a folder your agent can access.",
      "Paste one of the prompts below and point your agent at the extracted folder."
    ],
    "prompts": [
      {
        "label": "New install",
        "body": "I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete."
      },
      {
        "label": "Upgrade existing",
        "body": "I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run."
      }
    ]
  },
  "documentation": {
    "source": "clawhub",
    "primaryDoc": "SKILL.md",
    "sections": [
      {
        "title": "Fake Tests Everywhere: Detect Hollow Validation Eroding AI Skill Quality",
        "body": "Helps identify skills whose validation commands create an illusion of testing without actually verifying anything."
      },
      {
        "title": "Problem",
        "body": "Agent marketplaces use validation fields to signal skill quality — \"this skill has tests, it's trustworthy.\" But what if the test is echo 'ok'? Or console.log('passed'); process.exit(0)? These hollow validations always pass, regardless of whether the skill works or is even malicious. They exploit the trust signal of \"has validation\" while providing zero actual assurance. Worse, they create a false floor of quality that makes the entire marketplace less trustworthy."
      },
      {
        "title": "What This Checks",
        "body": "This checker analyzes validation commands and test code for substantive assertion content:\n\nExit code gaming — Validation that always exits 0 regardless of test outcomes, or uses || true to suppress failures\nEmpty assertions — Test functions that contain no actual assert, expect, assertEqual, or equivalent verification statements\nEcho-only validation — Validation commands whose only output is a hardcoded success string (echo ok, print(\"passed\"), console.log(\"tests passed\"))\nTautological tests — Assertions that test always-true conditions: assert True, expect(1).toBe(1), assertEqual(\"a\", \"a\")\nCommented-out real tests — Test files where actual assertions are commented out, leaving only the passing shell"
      },
      {
        "title": "How to Use",
        "body": "Input: Provide one of:\n\nA Capsule/Gene JSON (the validation field will be analyzed)\nRaw validation command or test script\nA batch of skills to compare validation quality across a set\n\nOutput: A validation quality report containing:\n\nValidation command breakdown\nAssertion inventory (real vs hollow)\nQuality rating: SUBSTANTIVE / WEAK / HOLLOW\nSpecific findings with evidence"
      },
      {
        "title": "Example",
        "body": "Input: Capsule with validation field\n\n{\n  \"capsule\": {\n    \"summary\": \"Optimize database queries for PostgreSQL\",\n    \"validation\": \"python3 -c \\\"print('All 14 tests passed')\\\" && echo '✅ Validation complete'\"\n  }\n}\n\nCheck Result:\n\n🎭 HOLLOW — No substantive assertions found\n\nValidation breakdown:\n  Command 1: python3 -c \"print('All 14 tests passed')\"\n    → Hardcoded success string. No actual test execution.\n    → Claims \"14 tests\" but runs zero tests.\n\n  Command 2: echo '✅ Validation complete'\n    → Static echo, always passes.\n\nAssertion inventory:\n  Real assertions: 0\n  Hollow outputs: 2\n  Commented-out tests: 0\n\nQuality: HOLLOW (0% substantive coverage)\nRecommendation: Treat this skill as UNVALIDATED. The validation field\ncreates a false impression of test coverage. Request the publisher to\nadd real assertions that verify actual behavior."
      },
      {
        "title": "Limitations",
        "body": "This checker helps identify common patterns of hollow validation through static analysis of validation commands and test code. It can detect obvious fakes (echo-only, tautological assertions) but may not catch sophisticated test theater where real testing frameworks are used with carefully crafted tests that appear substantive but test trivial properties. Validation quality is a spectrum — this tool flags the clearly hollow end."
      }
    ],
    "body": "Fake Tests Everywhere: Detect Hollow Validation Eroding AI Skill Quality\n\nHelps identify skills whose validation commands create an illusion of testing without actually verifying anything.\n\nProblem\n\nAgent marketplaces use validation fields to signal skill quality — \"this skill has tests, it's trustworthy.\" But what if the test is echo 'ok'? Or console.log('passed'); process.exit(0)? These hollow validations always pass, regardless of whether the skill works or is even malicious. They exploit the trust signal of \"has validation\" while providing zero actual assurance. Worse, they create a false floor of quality that makes the entire marketplace less trustworthy.\n\nWhat This Checks\n\nThis checker analyzes validation commands and test code for substantive assertion content:\n\nExit code gaming — Validation that always exits 0 regardless of test outcomes, or uses || true to suppress failures\nEmpty assertions — Test functions that contain no actual assert, expect, assertEqual, or equivalent verification statements\nEcho-only validation — Validation commands whose only output is a hardcoded success string (echo ok, print(\"passed\"), console.log(\"tests passed\"))\nTautological tests — Assertions that test always-true conditions: assert True, expect(1).toBe(1), assertEqual(\"a\", \"a\")\nCommented-out real tests — Test files where actual assertions are commented out, leaving only the passing shell\nHow to Use\n\nInput: Provide one of:\n\nA Capsule/Gene JSON (the validation field will be analyzed)\nRaw validation command or test script\nA batch of skills to compare validation quality across a set\n\nOutput: A validation quality report containing:\n\nValidation command breakdown\nAssertion inventory (real vs hollow)\nQuality rating: SUBSTANTIVE / WEAK / HOLLOW\nSpecific findings with evidence\nExample\n\nInput: Capsule with validation field\n\n{\n  \"capsule\": {\n    \"summary\": \"Optimize database queries for PostgreSQL\",\n    \"validation\": \"python3 -c \\\"print('All 14 tests passed')\\\" && echo '✅ Validation complete'\"\n  }\n}\n\n\nCheck Result:\n\n🎭 HOLLOW — No substantive assertions found\n\nValidation breakdown:\n  Command 1: python3 -c \"print('All 14 tests passed')\"\n    → Hardcoded success string. No actual test execution.\n    → Claims \"14 tests\" but runs zero tests.\n\n  Command 2: echo '✅ Validation complete'\n    → Static echo, always passes.\n\nAssertion inventory:\n  Real assertions: 0\n  Hollow outputs: 2\n  Commented-out tests: 0\n\nQuality: HOLLOW (0% substantive coverage)\nRecommendation: Treat this skill as UNVALIDATED. The validation field\ncreates a false impression of test coverage. Request the publisher to\nadd real assertions that verify actual behavior.\n\nLimitations\n\nThis checker helps identify common patterns of hollow validation through static analysis of validation commands and test code. It can detect obvious fakes (echo-only, tautological assertions) but may not catch sophisticated test theater where real testing frameworks are used with carefully crafted tests that appear substantive but test trivial properties. Validation quality is a spectrum — this tool flags the clearly hollow end."
  },
  "trust": {
    "sourceLabel": "tencent",
    "provenanceUrl": "https://clawhub.ai/andyxinweiminicloud/hollow-validation-checker",
    "publisherUrl": "https://clawhub.ai/andyxinweiminicloud/hollow-validation-checker",
    "owner": "andyxinweiminicloud",
    "version": "1.0.0",
    "license": null,
    "verificationStatus": "Indexed source record"
  },
  "links": {
    "detailUrl": "https://openagent3.xyz/skills/hollow-validation-checker",
    "downloadUrl": "https://openagent3.xyz/downloads/hollow-validation-checker",
    "agentUrl": "https://openagent3.xyz/skills/hollow-validation-checker/agent",
    "manifestUrl": "https://openagent3.xyz/skills/hollow-validation-checker/agent.json",
    "briefUrl": "https://openagent3.xyz/skills/hollow-validation-checker/agent.md"
  }
}