Conformance Suite¶
Status: Normative (fixtures) / Informative (narrative + lab reports)
This suite proves that UHQS math, weights, and grade bands match the reference harness. Fixtures and published lab reports are the only place in the public docs where specific deception products are named — as evaluation proof (not as UHBS requirements).
Lab reports (start here for real runs)¶
Published quick + full Docker grades, tutorials, and provenance:
| Honeypot | Quick | Full | Tutorial |
|---|---|---|---|
| ESPot | 49.34 / F | 63.33 / D | TUTORIAL |
| miniprint | 41.83 / F | 50.43 / D | TUTORIAL |
| Conpot | 44.55 / F | 55.4 / D | TUTORIAL |
| Cowrie | 82.76 / B | 61.37 / D | TUTORIAL |
| Endlessh | 46.55 / F | 54.07 / D | TUTORIAL |
| OpenCanary | see hub | see hub | TUTORIAL |
Fixtures¶
| Fixture | Proof target | Expected UHQS | Grade |
|---|---|---|---|
fixtures/cowrie-low-interaction.scorecard.json |
Cowrie (SSH / Low-Interaction, full lab) | 61.37 | D |
fixtures/posix-shell-lab.scorecard.json |
CyberHalluciNet (POSIX-Shell lab) | 80.33 | B |
fixtures/espot-web-api.scorecard.json |
ESPot (Web-API, full lab) | 63.33 | D |
fixtures/miniprint-low-interaction.scorecard.json |
miniprint (PJL / Low-Interaction, full) | 50.43 | D |
fixtures/conpot-ics-scada.scorecard.json |
Conpot (ICS-SCADA / Modbus, full) | 55.4 | D |
fixtures/opencanary-web-api.scorecard.json |
OpenCanary (Web-API / HTTP, full) | 66.02 | D |
fixtures/opencanary-ftp.scorecard.json |
OpenCanary (FTP, full) | 61.5 | D |
fixtures/opencanary-ssh.scorecard.json |
OpenCanary (SSH, full) | 35.64 | F |
fixtures/opencanary-telnet.scorecard.json |
OpenCanary (Telnet, full) | 64.9 | D |
fixtures/opencanary-redis.scorecard.json |
OpenCanary (Redis, full) | 53.72 | D |
fixtures/endlessh-low-interaction.scorecard.json |
Endlessh (SSH tarpit / ssh_tarpit, full) |
54.07 | D |
fixtures/safety-gate-fail.scorecard.json |
Synthetic δ_C penalty case | 0.0 | F |
How to run¶
pip install -e ".[dev]"
pytest tests/test_conformance.py -q
uhbs validate-scorecard docs/conformance/fixtures/cowrie-low-interaction.scorecard.json --strict
uhbs validate-scorecard docs/conformance/fixtures/espot-web-api.scorecard.json --strict
uhbs validate-scorecard docs/conformance/fixtures/miniprint-low-interaction.scorecard.json --strict
uhbs validate-scorecard docs/conformance/fixtures/conpot-ics-scada.scorecard.json --strict
uhbs validate-scorecard docs/conformance/fixtures/opencanary-web-api.scorecard.json --strict
Relationship to the lab harness¶
Fixtures and reports were produced by uhbs_core.run_benchmark (Modules A–F)
and verified with compute_uhqs. See reference-implementation.md
and the per-honeypot reports.
Naming policy: Outside this conformance tree, docs and templates MUST use
decoy classes and protocols only (see repository GOVERNANCE.md).