Skip to content

Commit cd06d12

Browse files
committed
docs: apply PR review feedback to EXPERIMENTS.md
1 parent 482cdc7 commit cd06d12

1 file changed

Lines changed: 4 additions & 3 deletions

File tree

EXPERIMENTS.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,7 @@ A running log of every validation run, benchmark, and cross-domain test for CNSD
2121
| 3 | Cross-condition robustness (AWGN) | Bearing (CWRU) | preliminary |
2222
| 4 | Multi-seed headline | Bearing (CWRU) | planned |
2323
| 5 | Cross-domain: SEU gearbox | Gear (SEU) | preliminary (failed) |
24+
| 6 | Cross-domain: Paderborn (PU) | Bearing (PU) | planned |
2425

2526
---
2627

@@ -60,7 +61,7 @@ data: 5806 train / 2019 test samples
6061

6162
## 2. CWRU Threshold Sweep — Held-out Calibration Split
6263

63-
* **Status:** validated
64+
* **Status:** preliminary
6465
* **Purpose:** rigorously prove that filtering by physics verification increases CNN reliability, avoiding test-set leakage by tuning the threshold `tau` on a completely unseen calibration split.
6566
* **Setup:** CNN trained only on Motor Loads 0 and 1. Sweep performed on Load 2 to select optimal `tau` (1.0). Frozen model and threshold applied to Load 3 (Test).
6667

@@ -84,9 +85,9 @@ frozen_tau: 1.0
8485
| CONFIRMED | 995 | 0.980 |
8586
| CONFLICT | 1019 | 0.790 |
8687
| INCONCLUSIVE | 5 | 1.000 |
87-
| **Gap (CONFIRMED - CONFLICT)** | | **+0.190 (VALIDATED)** |
88+
| **Gap (CONFIRMED - CONFLICT)** | | **+0.190** |
8889

89-
* **Notes / limitations:** The gap is a massively positive +0.190, definitively proving that when the physics engine CONFIRMS the CNN prediction, the diagnosis is significantly more reliable than when they CONFLICT.
90+
* **Notes / limitations:** The gap is a massively positive +0.190 on this dataset, indicating that when the physics engine CONFIRMS the CNN prediction, the diagnosis is significantly more reliable than when they CONFLICT.
9091

9192
---
9293

0 commit comments

Comments
 (0)