|
|
@@ -4843,3 +4843,894 @@ RuntimeError: Error(s) in loading state_dict for CNN3D:
|
|
|
2026-07-15 10:24:47,259 - INFO - [Analyze Evaluations] Task completed.
|
|
|
2026-07-15 10:24:47,261 - INFO - [SYSTEM] All tasks finished successfully!
|
|
|
2026-07-15 11:53:52,291 - INFO - [SYSTEM] Application initialized and ready.
|
|
|
+2026-07-26 19:05:57,057 - INFO - [SYSTEM] Application initialized and ready.
|
|
|
+2026-07-26 19:05:57,058 - INFO - [SYSTEM] Successfully loaded config from ./outputs/exp1/config.toml
|
|
|
+2026-07-26 19:06:10,314 - INFO - [SYSTEM] Initiating Scenario: 2. Load, Evaluate (test+val), Noise, & Analyze
|
|
|
+2026-07-26 19:06:10,328 - INFO - [SYSTEM] Starting Task 1/10: Load Image and ADNIMERGE
|
|
|
+2026-07-26 19:06:10,463 - INFO - [Load Image and ADNIMERGE] Seeded RNGs with base seed 42
|
|
|
+2026-07-26 19:06:10,469 - INFO - [Load Image and ADNIMERGE] Loading Files
|
|
|
+2026-07-26 19:06:15,619 - INFO - [Load Image and ADNIMERGE] Dataloaders initalized
|
|
|
+2026-07-26 19:06:15,625 - INFO - [Load Image and ADNIMERGE] Task completed.
|
|
|
+2026-07-26 19:06:15,627 - INFO - [SYSTEM] Starting Task 2/10: Load Saved Models
|
|
|
+2026-07-26 19:06:15,628 - INFO - [Load Saved Models] Found 30 normal model(s) in normal_models/.
|
|
|
+2026-07-26 19:06:15,629 - INFO - [Load Saved Models] Found 30 bayesian model(s) in bayesian_models/.
|
|
|
+2026-07-26 19:06:15,630 - INFO - [Load Saved Models] Task completed.
|
|
|
+2026-07-26 19:06:15,631 - INFO - [SYSTEM] Starting Task 3/10: Evaluate Regular Models
|
|
|
+2026-07-26 19:06:15,897 - INFO - [Evaluate Regular Models] Evaluating 30 normal model(s) on 97 test samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 19:06:15,904 - INFO - [Evaluate Regular Models] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 19:06:17,346 - INFO - [Evaluate Regular Models] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 19:06:18,553 - INFO - [Evaluate Regular Models] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 19:06:19,746 - INFO - [Evaluate Regular Models] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 19:06:20,937 - INFO - [Evaluate Regular Models] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 19:06:22,122 - INFO - [Evaluate Regular Models] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 19:06:23,317 - INFO - [Evaluate Regular Models] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 19:06:24,506 - INFO - [Evaluate Regular Models] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 19:06:25,691 - INFO - [Evaluate Regular Models] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 19:06:26,875 - INFO - [Evaluate Regular Models] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 19:06:28,060 - INFO - [Evaluate Regular Models] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 19:06:29,249 - INFO - [Evaluate Regular Models] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 19:06:30,443 - INFO - [Evaluate Regular Models] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 19:06:31,632 - INFO - [Evaluate Regular Models] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 19:06:32,825 - INFO - [Evaluate Regular Models] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 19:06:34,010 - INFO - [Evaluate Regular Models] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 19:06:35,173 - INFO - [Evaluate Regular Models] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 19:06:36,369 - INFO - [Evaluate Regular Models] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 19:06:37,543 - INFO - [Evaluate Regular Models] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 19:06:38,732 - INFO - [Evaluate Regular Models] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 19:06:39,929 - INFO - [Evaluate Regular Models] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 19:06:41,115 - INFO - [Evaluate Regular Models] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 19:06:42,305 - INFO - [Evaluate Regular Models] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 19:06:43,500 - INFO - [Evaluate Regular Models] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 19:06:44,697 - INFO - [Evaluate Regular Models] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 19:06:45,896 - INFO - [Evaluate Regular Models] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 19:06:47,110 - INFO - [Evaluate Regular Models] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 19:06:48,305 - INFO - [Evaluate Regular Models] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 19:06:49,501 - INFO - [Evaluate Regular Models] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 19:06:50,699 - INFO - [Evaluate Regular Models] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 19:06:51,938 - INFO - [Evaluate Regular Models] Saved normal test evaluation to outputs/exp1/evaluations/normal.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 19:06:51,939 - INFO - [Evaluate Regular Models] Task completed.
|
|
|
+2026-07-26 19:06:51,941 - INFO - [SYSTEM] Starting Task 4/10: Evaluate Bayesian Models
|
|
|
+2026-07-26 19:06:52,018 - INFO - [Evaluate Bayesian Models] Evaluating 30 bayesian model(s) on 97 test samples, 1 noise level(s), 30 MC pass(es) each.
|
|
|
+2026-07-26 19:06:52,025 - INFO - [Evaluate Bayesian Models] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 19:07:20,836 - INFO - [Evaluate Bayesian Models] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 19:07:49,761 - INFO - [Evaluate Bayesian Models] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 19:08:18,725 - INFO - [Evaluate Bayesian Models] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 19:08:47,655 - INFO - [Evaluate Bayesian Models] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 19:09:16,588 - INFO - [Evaluate Bayesian Models] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 19:09:45,521 - INFO - [Evaluate Bayesian Models] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 19:10:14,520 - INFO - [Evaluate Bayesian Models] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 19:10:43,509 - INFO - [Evaluate Bayesian Models] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 19:11:12,503 - INFO - [Evaluate Bayesian Models] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 19:11:41,451 - INFO - [Evaluate Bayesian Models] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 19:12:10,455 - INFO - [Evaluate Bayesian Models] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 19:12:39,453 - INFO - [Evaluate Bayesian Models] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-26 19:13:08,458 - INFO - [Evaluate Bayesian Models] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-26 19:13:37,438 - INFO - [Evaluate Bayesian Models] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-26 19:14:06,437 - INFO - [Evaluate Bayesian Models] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-26 19:14:35,478 - INFO - [Evaluate Bayesian Models] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-26 19:15:04,534 - INFO - [Evaluate Bayesian Models] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-26 19:15:33,620 - INFO - [Evaluate Bayesian Models] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-26 19:16:02,721 - INFO - [Evaluate Bayesian Models] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-26 19:16:31,815 - INFO - [Evaluate Bayesian Models] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-26 19:17:00,869 - INFO - [Evaluate Bayesian Models] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-26 19:17:30,007 - INFO - [Evaluate Bayesian Models] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-26 19:17:59,099 - INFO - [Evaluate Bayesian Models] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-26 19:18:28,155 - INFO - [Evaluate Bayesian Models] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-26 19:18:57,232 - INFO - [Evaluate Bayesian Models] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-26 19:19:26,222 - INFO - [Evaluate Bayesian Models] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-26 19:19:55,221 - INFO - [Evaluate Bayesian Models] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-26 19:20:24,279 - INFO - [Evaluate Bayesian Models] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-26 19:20:53,366 - INFO - [Evaluate Bayesian Models] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-26 19:21:22,526 - INFO - [Evaluate Bayesian Models] Saved bayesian test evaluation to outputs/exp1/evaluations/bayesian.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 19:21:22,538 - INFO - [Evaluate Bayesian Models] Task completed.
|
|
|
+2026-07-26 19:21:22,543 - INFO - [SYSTEM] Starting Task 5/10: Evaluate Regular Models (Validation)
|
|
|
+2026-07-26 19:21:22,654 - INFO - [Evaluate Regular Models (Validation)] Evaluating 30 normal model(s) on 149 val samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 19:21:22,661 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 19:21:24,315 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 19:21:25,974 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 19:21:27,633 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 19:21:29,286 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 19:21:30,932 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 19:21:32,586 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 19:21:34,236 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 19:21:35,887 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 19:21:37,532 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 19:21:39,185 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 19:21:40,830 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 19:21:42,484 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 19:21:44,143 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 19:21:45,801 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 19:21:47,461 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 19:21:49,118 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 19:21:50,754 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 19:21:52,399 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 19:21:54,050 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 19:21:55,709 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 19:21:57,349 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 19:21:58,999 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 19:22:00,649 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 19:22:02,305 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 19:22:03,957 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 19:22:05,611 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 19:22:07,244 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 19:22:08,888 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 19:22:10,533 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 19:22:12,195 - INFO - [Evaluate Regular Models (Validation)] Saved normal val evaluation to outputs/exp1/evaluations/val_normal.nc (models=30, samples=149, noise_levels=1).
|
|
|
+2026-07-26 19:22:12,196 - INFO - [Evaluate Regular Models (Validation)] Task completed.
|
|
|
+2026-07-26 19:22:12,205 - INFO - [SYSTEM] Starting Task 6/10: Evaluate Bayesian Models (Validation)
|
|
|
+2026-07-26 19:22:12,318 - INFO - [Evaluate Bayesian Models (Validation)] Evaluating 30 bayesian model(s) on 149 val samples, 1 noise level(s), 30 MC pass(es) each.
|
|
|
+2026-07-26 19:22:12,326 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 19:22:56,832 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 19:23:44,487 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 19:36:39,616 - ERROR - [SYSTEM] Stop requested! Terminating gracefully...
|
|
|
+2026-07-26 19:36:39,930 - ERROR - [SYSTEM] STOPPED: Pipeline execution stopped by user.
|
|
|
+2026-07-26 19:38:26,304 - INFO - [SYSTEM] Application initialized and ready.
|
|
|
+2026-07-26 19:38:26,305 - INFO - [SYSTEM] Successfully loaded config from ./outputs/exp1/config.toml
|
|
|
+2026-07-26 19:38:32,149 - INFO - [SYSTEM] Initiating Scenario: 2. Load, Evaluate (test+val), Noise, & Analyze
|
|
|
+2026-07-26 19:38:32,163 - INFO - [SYSTEM] Starting Task 1/10: Load Image and ADNIMERGE
|
|
|
+2026-07-26 19:38:32,307 - INFO - [Load Image and ADNIMERGE] Seeded RNGs with base seed 42
|
|
|
+2026-07-26 19:38:32,311 - INFO - [Load Image and ADNIMERGE] Loading Files
|
|
|
+2026-07-26 19:38:36,636 - INFO - [Load Image and ADNIMERGE] Dataloaders initalized
|
|
|
+2026-07-26 19:38:36,637 - INFO - [Load Image and ADNIMERGE] Task completed.
|
|
|
+2026-07-26 19:38:36,643 - INFO - [SYSTEM] Starting Task 2/10: Load Saved Models
|
|
|
+2026-07-26 19:38:36,645 - INFO - [Load Saved Models] Found 30 normal model(s) in normal_models/.
|
|
|
+2026-07-26 19:38:36,646 - INFO - [Load Saved Models] Found 30 bayesian model(s) in bayesian_models/.
|
|
|
+2026-07-26 19:38:36,647 - INFO - [Load Saved Models] Task completed.
|
|
|
+2026-07-26 19:38:36,648 - INFO - [SYSTEM] Starting Task 3/10: Evaluate Regular Models
|
|
|
+2026-07-26 19:38:36,919 - INFO - [Evaluate Regular Models] Evaluating 30 normal model(s) on 97 test samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 19:38:36,926 - INFO - [Evaluate Regular Models] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 19:38:38,362 - INFO - [Evaluate Regular Models] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 19:38:39,580 - INFO - [Evaluate Regular Models] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 19:38:40,778 - INFO - [Evaluate Regular Models] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 19:38:41,971 - INFO - [Evaluate Regular Models] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 19:38:43,151 - INFO - [Evaluate Regular Models] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 19:38:44,350 - INFO - [Evaluate Regular Models] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 19:38:45,555 - INFO - [Evaluate Regular Models] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 19:38:46,752 - INFO - [Evaluate Regular Models] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 19:38:47,954 - INFO - [Evaluate Regular Models] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 19:38:49,140 - INFO - [Evaluate Regular Models] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 19:38:50,334 - INFO - [Evaluate Regular Models] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 19:38:51,524 - INFO - [Evaluate Regular Models] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 19:38:52,718 - INFO - [Evaluate Regular Models] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 19:38:53,920 - INFO - [Evaluate Regular Models] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 19:38:55,118 - INFO - [Evaluate Regular Models] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 19:38:56,320 - INFO - [Evaluate Regular Models] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 19:38:57,517 - INFO - [Evaluate Regular Models] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 19:38:58,710 - INFO - [Evaluate Regular Models] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 19:38:59,910 - INFO - [Evaluate Regular Models] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 19:39:01,102 - INFO - [Evaluate Regular Models] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 19:39:02,296 - INFO - [Evaluate Regular Models] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 19:39:03,497 - INFO - [Evaluate Regular Models] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 19:39:04,707 - INFO - [Evaluate Regular Models] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 19:39:05,902 - INFO - [Evaluate Regular Models] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 19:39:07,108 - INFO - [Evaluate Regular Models] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 19:39:08,312 - INFO - [Evaluate Regular Models] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 19:39:09,510 - INFO - [Evaluate Regular Models] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 19:39:10,702 - INFO - [Evaluate Regular Models] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 19:39:11,904 - INFO - [Evaluate Regular Models] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 19:39:13,119 - INFO - [Evaluate Regular Models] Saved normal test evaluation to outputs/exp1/evaluations/normal.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 19:39:13,120 - INFO - [Evaluate Regular Models] Task completed.
|
|
|
+2026-07-26 19:39:13,121 - INFO - [SYSTEM] Starting Task 4/10: Evaluate Bayesian Models
|
|
|
+2026-07-26 19:39:13,200 - INFO - [Evaluate Bayesian Models] Evaluating 30 bayesian model(s) on 97 test samples, 1 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 19:39:13,208 - INFO - [Evaluate Bayesian Models] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 19:39:32,654 - INFO - [Evaluate Bayesian Models] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 19:39:52,160 - INFO - [Evaluate Bayesian Models] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 19:40:11,703 - INFO - [Evaluate Bayesian Models] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 19:40:31,162 - INFO - [Evaluate Bayesian Models] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 19:40:50,650 - INFO - [Evaluate Bayesian Models] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 19:41:10,087 - INFO - [Evaluate Bayesian Models] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 19:41:29,551 - INFO - [Evaluate Bayesian Models] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 19:41:49,042 - INFO - [Evaluate Bayesian Models] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 19:42:08,547 - INFO - [Evaluate Bayesian Models] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 19:42:28,069 - INFO - [Evaluate Bayesian Models] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 19:42:47,656 - INFO - [Evaluate Bayesian Models] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 19:43:07,207 - INFO - [Evaluate Bayesian Models] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-26 19:43:26,738 - INFO - [Evaluate Bayesian Models] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-26 19:43:46,257 - INFO - [Evaluate Bayesian Models] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-26 19:44:05,766 - INFO - [Evaluate Bayesian Models] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-26 19:44:25,258 - INFO - [Evaluate Bayesian Models] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-26 19:44:44,751 - INFO - [Evaluate Bayesian Models] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-26 19:45:04,257 - INFO - [Evaluate Bayesian Models] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-26 19:45:23,755 - INFO - [Evaluate Bayesian Models] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-26 19:45:43,267 - INFO - [Evaluate Bayesian Models] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-26 19:46:02,794 - INFO - [Evaluate Bayesian Models] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-26 19:46:22,251 - INFO - [Evaluate Bayesian Models] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-26 19:46:41,741 - INFO - [Evaluate Bayesian Models] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-26 19:47:01,218 - INFO - [Evaluate Bayesian Models] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-26 19:47:20,707 - INFO - [Evaluate Bayesian Models] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-26 19:47:40,151 - INFO - [Evaluate Bayesian Models] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-26 19:47:59,609 - INFO - [Evaluate Bayesian Models] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-26 19:48:19,085 - INFO - [Evaluate Bayesian Models] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-26 19:48:38,609 - INFO - [Evaluate Bayesian Models] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-26 19:48:58,670 - INFO - [Evaluate Bayesian Models] Saved bayesian test evaluation to outputs/exp1/evaluations/bayesian.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 19:48:58,674 - INFO - [Evaluate Bayesian Models] Task completed.
|
|
|
+2026-07-26 19:48:58,676 - INFO - [SYSTEM] Starting Task 5/10: Evaluate Regular Models (Validation)
|
|
|
+2026-07-26 19:48:58,791 - INFO - [Evaluate Regular Models (Validation)] Evaluating 30 normal model(s) on 149 val samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 19:48:58,798 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 19:49:00,741 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 19:49:02,506 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 19:49:04,275 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 19:49:06,051 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 19:49:07,818 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 19:49:09,590 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 19:49:11,351 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 19:49:13,113 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 19:49:14,868 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 19:49:16,639 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 19:49:18,408 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 19:49:20,175 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 19:49:21,959 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 19:49:23,721 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 19:49:25,496 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 19:49:27,261 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 19:49:29,026 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 19:49:30,792 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 19:49:32,558 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 19:49:34,321 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 19:49:36,091 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 19:49:37,854 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 19:49:39,617 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 19:49:41,388 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 19:49:43,152 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 19:49:44,922 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 19:49:46,680 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 19:49:48,447 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 19:49:50,202 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 19:49:51,988 - INFO - [Evaluate Regular Models (Validation)] Saved normal val evaluation to outputs/exp1/evaluations/val_normal.nc (models=30, samples=149, noise_levels=1).
|
|
|
+2026-07-26 19:49:51,989 - INFO - [Evaluate Regular Models (Validation)] Task completed.
|
|
|
+2026-07-26 19:49:51,991 - INFO - [SYSTEM] Starting Task 6/10: Evaluate Bayesian Models (Validation)
|
|
|
+2026-07-26 19:49:52,112 - INFO - [Evaluate Bayesian Models (Validation)] Evaluating 30 bayesian model(s) on 149 val samples, 1 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 19:49:52,122 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 20:09:01,077 - INFO - [SYSTEM] Application initialized and ready.
|
|
|
+2026-07-26 20:09:01,078 - INFO - [SYSTEM] Successfully loaded config from ./outputs/exp1/config.toml
|
|
|
+2026-07-26 20:09:10,133 - INFO - [SYSTEM] Initiating Scenario: 2. Load, Evaluate (test+val), Noise, & Analyze
|
|
|
+2026-07-26 20:09:10,147 - INFO - [SYSTEM] Starting Task 1/10: Load Image and ADNIMERGE
|
|
|
+2026-07-26 20:09:10,299 - INFO - [Load Image and ADNIMERGE] Seeded RNGs with base seed 42
|
|
|
+2026-07-26 20:09:10,299 - INFO - [Load Image and ADNIMERGE] Loading Files
|
|
|
+2026-07-26 20:09:13,745 - INFO - [Load Image and ADNIMERGE] Dataloaders initalized
|
|
|
+2026-07-26 20:09:13,750 - INFO - [Load Image and ADNIMERGE] Task completed.
|
|
|
+2026-07-26 20:09:13,752 - INFO - [SYSTEM] Starting Task 2/10: Load Saved Models
|
|
|
+2026-07-26 20:09:13,753 - INFO - [Load Saved Models] Found 30 normal model(s) in normal_models/.
|
|
|
+2026-07-26 20:09:13,754 - INFO - [Load Saved Models] Found 30 bayesian model(s) in bayesian_models/.
|
|
|
+2026-07-26 20:09:13,755 - INFO - [Load Saved Models] Task completed.
|
|
|
+2026-07-26 20:09:13,757 - INFO - [SYSTEM] Starting Task 3/10: Evaluate Regular Models
|
|
|
+2026-07-26 20:09:14,021 - INFO - [Evaluate Regular Models] Evaluating 30 normal model(s) on 97 test samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 20:09:14,028 - INFO - [Evaluate Regular Models] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 20:09:15,384 - INFO - [Evaluate Regular Models] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 20:09:16,597 - INFO - [Evaluate Regular Models] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 20:09:17,829 - INFO - [Evaluate Regular Models] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 20:09:19,047 - INFO - [Evaluate Regular Models] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 20:09:20,255 - INFO - [Evaluate Regular Models] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 20:09:21,471 - INFO - [Evaluate Regular Models] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 20:09:22,697 - INFO - [Evaluate Regular Models] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 20:09:23,905 - INFO - [Evaluate Regular Models] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 20:09:25,126 - INFO - [Evaluate Regular Models] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 20:09:26,338 - INFO - [Evaluate Regular Models] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 20:09:27,570 - INFO - [Evaluate Regular Models] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 20:09:28,783 - INFO - [Evaluate Regular Models] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 20:09:30,001 - INFO - [Evaluate Regular Models] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 20:09:31,203 - INFO - [Evaluate Regular Models] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 20:09:32,409 - INFO - [Evaluate Regular Models] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 20:09:33,609 - INFO - [Evaluate Regular Models] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 20:09:34,809 - INFO - [Evaluate Regular Models] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 20:09:36,016 - INFO - [Evaluate Regular Models] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 20:09:37,209 - INFO - [Evaluate Regular Models] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 20:09:38,393 - INFO - [Evaluate Regular Models] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 20:09:39,579 - INFO - [Evaluate Regular Models] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 20:09:40,778 - INFO - [Evaluate Regular Models] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 20:09:41,995 - INFO - [Evaluate Regular Models] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 20:09:43,182 - INFO - [Evaluate Regular Models] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 20:09:44,375 - INFO - [Evaluate Regular Models] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 20:09:45,566 - INFO - [Evaluate Regular Models] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 20:09:46,754 - INFO - [Evaluate Regular Models] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 20:09:47,929 - INFO - [Evaluate Regular Models] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 20:09:49,135 - INFO - [Evaluate Regular Models] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 20:09:50,356 - INFO - [Evaluate Regular Models] Saved normal test evaluation to outputs/exp1/evaluations/normal.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 20:09:50,361 - INFO - [Evaluate Regular Models] Task completed.
|
|
|
+2026-07-26 20:09:50,363 - INFO - [SYSTEM] Starting Task 4/10: Evaluate Bayesian Models
|
|
|
+2026-07-26 20:09:50,436 - INFO - [Evaluate Bayesian Models] Evaluating 30 bayesian model(s) on 97 test samples, 1 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 20:09:50,444 - INFO - [Evaluate Bayesian Models] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 20:10:09,943 - INFO - [Evaluate Bayesian Models] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 20:10:29,448 - INFO - [Evaluate Bayesian Models] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 20:10:48,953 - INFO - [Evaluate Bayesian Models] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 20:11:08,475 - INFO - [Evaluate Bayesian Models] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 20:11:28,045 - INFO - [Evaluate Bayesian Models] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 20:11:47,667 - INFO - [Evaluate Bayesian Models] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 20:12:07,261 - INFO - [Evaluate Bayesian Models] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 20:12:26,817 - INFO - [Evaluate Bayesian Models] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 20:12:46,392 - INFO - [Evaluate Bayesian Models] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 20:13:05,960 - INFO - [Evaluate Bayesian Models] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 20:13:25,560 - INFO - [Evaluate Bayesian Models] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 20:13:45,102 - INFO - [Evaluate Bayesian Models] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-26 20:14:04,728 - INFO - [Evaluate Bayesian Models] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-26 20:14:24,348 - INFO - [Evaluate Bayesian Models] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-26 20:14:44,001 - INFO - [Evaluate Bayesian Models] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-26 20:15:03,615 - INFO - [Evaluate Bayesian Models] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-26 20:15:23,233 - INFO - [Evaluate Bayesian Models] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-26 20:15:42,849 - INFO - [Evaluate Bayesian Models] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-26 20:16:02,515 - INFO - [Evaluate Bayesian Models] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-26 20:16:22,193 - INFO - [Evaluate Bayesian Models] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-26 20:16:41,978 - INFO - [Evaluate Bayesian Models] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-26 20:17:01,767 - INFO - [Evaluate Bayesian Models] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-26 20:17:21,532 - INFO - [Evaluate Bayesian Models] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-26 20:17:41,242 - INFO - [Evaluate Bayesian Models] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-26 20:18:00,902 - INFO - [Evaluate Bayesian Models] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-26 20:18:20,606 - INFO - [Evaluate Bayesian Models] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-26 20:18:40,279 - INFO - [Evaluate Bayesian Models] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-26 20:18:59,965 - INFO - [Evaluate Bayesian Models] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-26 20:19:19,738 - INFO - [Evaluate Bayesian Models] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-26 20:19:39,484 - INFO - [Evaluate Bayesian Models] Saved bayesian test evaluation to outputs/exp1/evaluations/bayesian.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 20:19:39,485 - INFO - [Evaluate Bayesian Models] Task completed.
|
|
|
+2026-07-26 20:19:39,486 - INFO - [SYSTEM] Starting Task 5/10: Evaluate Regular Models (Validation)
|
|
|
+2026-07-26 20:19:39,600 - INFO - [Evaluate Regular Models (Validation)] Evaluating 30 normal model(s) on 149 val samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 20:19:39,607 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 20:19:41,264 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 20:19:42,920 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 20:19:44,572 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 20:19:46,234 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 20:19:47,887 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 20:19:49,537 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 20:19:51,182 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 20:19:52,835 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 20:19:54,482 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 20:19:56,136 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 20:19:57,794 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 20:19:59,443 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 20:20:01,100 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 20:20:02,748 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 20:20:04,393 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 20:20:06,050 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 20:20:07,702 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 20:20:09,347 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 20:20:11,002 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 20:20:12,652 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 20:20:14,300 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 20:20:15,947 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 20:20:17,599 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 20:20:19,255 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 20:20:20,920 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 20:20:22,565 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 20:20:24,213 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 20:20:25,866 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 20:20:27,513 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 20:20:29,180 - INFO - [Evaluate Regular Models (Validation)] Saved normal val evaluation to outputs/exp1/evaluations/val_normal.nc (models=30, samples=149, noise_levels=1).
|
|
|
+2026-07-26 20:20:29,181 - INFO - [Evaluate Regular Models (Validation)] Task completed.
|
|
|
+2026-07-26 20:20:29,183 - INFO - [SYSTEM] Starting Task 6/10: Evaluate Bayesian Models (Validation)
|
|
|
+2026-07-26 20:20:29,310 - INFO - [Evaluate Bayesian Models (Validation)] Evaluating 30 bayesian model(s) on 149 val samples, 1 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 20:20:29,318 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 20:20:58,893 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 20:21:28,592 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 20:21:58,338 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 20:22:28,031 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 20:22:57,765 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 20:23:27,460 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 20:23:57,211 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 20:24:26,962 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 20:24:56,680 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 20:25:26,332 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 20:25:56,002 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 20:26:25,644 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-26 20:26:55,361 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-26 20:27:25,109 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-26 20:27:54,829 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-26 20:28:24,492 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-26 20:28:54,143 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-26 20:29:23,871 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-26 20:29:53,536 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-26 20:30:23,159 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-26 20:30:52,809 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-26 20:31:22,460 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-26 20:31:52,100 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-26 20:32:21,637 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-26 20:32:51,255 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-26 20:33:20,904 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-26 20:33:50,542 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-26 20:34:20,202 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-26 20:34:49,853 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-26 20:35:19,569 - INFO - [Evaluate Bayesian Models (Validation)] Saved bayesian val evaluation to outputs/exp1/evaluations/val_bayesian.nc (models=30, samples=149, noise_levels=1).
|
|
|
+2026-07-26 20:35:19,570 - INFO - [Evaluate Bayesian Models (Validation)] Task completed.
|
|
|
+2026-07-26 20:35:19,571 - INFO - [SYSTEM] Starting Task 7/10: Evaluate Models on Noised Data
|
|
|
+2026-07-26 20:35:19,654 - INFO - [Evaluate Models on Noised Data] Evaluating 30 normal model(s) on 97 test samples, 13 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 20:35:19,662 - INFO - [Evaluate Models on Noised Data] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 20:35:32,269 - INFO - [Evaluate Models on Noised Data] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 20:35:44,897 - INFO - [Evaluate Models on Noised Data] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 20:35:57,489 - INFO - [Evaluate Models on Noised Data] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 20:36:10,127 - INFO - [Evaluate Models on Noised Data] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 20:36:22,750 - INFO - [Evaluate Models on Noised Data] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 20:36:35,343 - INFO - [Evaluate Models on Noised Data] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 20:36:47,937 - INFO - [Evaluate Models on Noised Data] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 20:37:00,570 - INFO - [Evaluate Models on Noised Data] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 20:37:13,186 - INFO - [Evaluate Models on Noised Data] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 20:37:25,784 - INFO - [Evaluate Models on Noised Data] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 20:37:38,380 - INFO - [Evaluate Models on Noised Data] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 20:37:50,979 - INFO - [Evaluate Models on Noised Data] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 20:38:03,550 - INFO - [Evaluate Models on Noised Data] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 20:38:16,148 - INFO - [Evaluate Models on Noised Data] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 20:38:28,780 - INFO - [Evaluate Models on Noised Data] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 20:38:41,380 - INFO - [Evaluate Models on Noised Data] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 20:38:53,982 - INFO - [Evaluate Models on Noised Data] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 20:39:06,605 - INFO - [Evaluate Models on Noised Data] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 20:39:19,242 - INFO - [Evaluate Models on Noised Data] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 20:39:31,911 - INFO - [Evaluate Models on Noised Data] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 20:39:44,533 - INFO - [Evaluate Models on Noised Data] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 20:39:57,166 - INFO - [Evaluate Models on Noised Data] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 20:40:09,801 - INFO - [Evaluate Models on Noised Data] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 20:40:22,415 - INFO - [Evaluate Models on Noised Data] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 20:40:35,005 - INFO - [Evaluate Models on Noised Data] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 20:40:47,598 - INFO - [Evaluate Models on Noised Data] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 20:41:00,209 - INFO - [Evaluate Models on Noised Data] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 20:41:12,814 - INFO - [Evaluate Models on Noised Data] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 20:41:25,396 - INFO - [Evaluate Models on Noised Data] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 20:41:38,032 - INFO - [Evaluate Models on Noised Data] Saved normal test evaluation to outputs/exp1/evaluations/noisy_normal.nc (models=30, samples=97, noise_levels=13).
|
|
|
+2026-07-26 20:41:38,109 - INFO - [Evaluate Models on Noised Data] Evaluating 30 bayesian model(s) on 97 test samples, 13 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 20:41:38,116 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 20:45:49,154 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 20:50:00,058 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 20:54:10,435 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 20:58:20,922 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 21:02:31,301 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 21:06:41,600 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 21:10:51,530 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 21:15:01,340 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 21:19:12,200 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 21:23:22,781 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 21:27:32,933 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 21:28:41,293 - ERROR - Pipeline failed: App is not running
|
|
|
+Traceback (most recent call last):
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/main.py", line 326, in run_background_pipeline
|
|
|
+ task_func(task_tracker, task_logger, config, pipeline_state)
|
|
|
+ ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 378, in evaluate_noisy_task
|
|
|
+ _evaluate_noisy(track, log, config, state, SPLIT_TEST)
|
|
|
+ ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 347, in _evaluate_noisy
|
|
|
+ _evaluate_ensemble(
|
|
|
+ ~~~~~~~~~~~~~~~~~~^
|
|
|
+ model_paths=paths,
|
|
|
+ ^^^^^^^^^^^^^^^^^^
|
|
|
+ ...<8 lines>...
|
|
|
+ split=split,
|
|
|
+ ^^^^^^^^^^^^
|
|
|
+ )
|
|
|
+ ^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 225, in _evaluate_ensemble
|
|
|
+ mc_probs = _run_mc_passes(
|
|
|
+ model=model,
|
|
|
+ ...<10 lines>...
|
|
|
+ noise_relative=noise_relative,
|
|
|
+ )
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 171, in _run_mc_passes
|
|
|
+ batch_tracker.update(advance=1)
|
|
|
+ ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/util/progress.py", line 70, in update
|
|
|
+ self.app.call_from_thread(_do_update)
|
|
|
+ ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/.venv/lib64/python3.14/site-packages/textual/app.py", line 1819, in call_from_thread
|
|
|
+ raise RuntimeError("App is not running")
|
|
|
+RuntimeError: App is not running
|
|
|
+2026-07-26 21:28:41,294 - ERROR - [SYSTEM] ERROR: App is not running
|
|
|
+2026-07-26 21:29:22,266 - INFO - [SYSTEM] Application initialized and ready.
|
|
|
+2026-07-26 21:29:22,267 - INFO - [SYSTEM] Successfully loaded config from ./outputs/exp1/config.toml
|
|
|
+2026-07-26 21:29:25,063 - INFO - [SYSTEM] Initiating Scenario: 2. Load, Evaluate (test+val), Noise, & Analyze
|
|
|
+2026-07-26 21:29:25,077 - INFO - [SYSTEM] Starting Task 1/10: Load Image and ADNIMERGE
|
|
|
+2026-07-26 21:29:25,215 - INFO - [Load Image and ADNIMERGE] Seeded RNGs with base seed 42
|
|
|
+2026-07-26 21:29:25,216 - INFO - [Load Image and ADNIMERGE] Loading Files
|
|
|
+2026-07-26 21:29:28,608 - INFO - [Load Image and ADNIMERGE] Dataloaders initalized
|
|
|
+2026-07-26 21:29:28,619 - INFO - [Load Image and ADNIMERGE] Task completed.
|
|
|
+2026-07-26 21:29:28,624 - INFO - [SYSTEM] Starting Task 2/10: Load Saved Models
|
|
|
+2026-07-26 21:29:28,625 - INFO - [Load Saved Models] Found 30 normal model(s) in normal_models/.
|
|
|
+2026-07-26 21:29:28,626 - INFO - [Load Saved Models] Found 30 bayesian model(s) in bayesian_models/.
|
|
|
+2026-07-26 21:29:28,627 - INFO - [Load Saved Models] Task completed.
|
|
|
+2026-07-26 21:29:28,628 - INFO - [SYSTEM] Starting Task 3/10: Evaluate Regular Models
|
|
|
+2026-07-26 21:29:28,903 - INFO - [Evaluate Regular Models] Evaluating 30 normal model(s) on 97 test samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 21:29:28,910 - INFO - [Evaluate Regular Models] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 21:29:30,321 - INFO - [Evaluate Regular Models] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 21:29:31,544 - INFO - [Evaluate Regular Models] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 21:29:32,760 - INFO - [Evaluate Regular Models] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 21:29:33,970 - INFO - [Evaluate Regular Models] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 21:29:35,186 - INFO - [Evaluate Regular Models] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 21:29:36,397 - INFO - [Evaluate Regular Models] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 21:29:37,598 - INFO - [Evaluate Regular Models] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 21:29:38,816 - INFO - [Evaluate Regular Models] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 21:29:40,033 - INFO - [Evaluate Regular Models] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 21:29:41,244 - INFO - [Evaluate Regular Models] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 21:29:42,490 - INFO - [Evaluate Regular Models] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 21:29:43,705 - INFO - [Evaluate Regular Models] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 21:29:44,917 - INFO - [Evaluate Regular Models] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 21:29:46,115 - INFO - [Evaluate Regular Models] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 21:29:47,344 - INFO - [Evaluate Regular Models] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 21:29:48,569 - INFO - [Evaluate Regular Models] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 21:29:49,781 - INFO - [Evaluate Regular Models] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 21:29:51,005 - INFO - [Evaluate Regular Models] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 21:29:52,199 - INFO - [Evaluate Regular Models] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 21:29:53,408 - INFO - [Evaluate Regular Models] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 21:29:54,643 - INFO - [Evaluate Regular Models] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 21:29:56,028 - INFO - [Evaluate Regular Models] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 21:29:56,168 - ERROR - Pipeline failed: App is not running
|
|
|
+Traceback (most recent call last):
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/main.py", line 326, in run_background_pipeline
|
|
|
+ task_func(task_tracker, task_logger, config, pipeline_state)
|
|
|
+ ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 368, in evaluate_normal_task
|
|
|
+ _evaluate_clean(track, log, config, state, KIND_NORMAL, SPLIT_TEST)
|
|
|
+ ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 314, in _evaluate_clean
|
|
|
+ _evaluate_ensemble(
|
|
|
+ ~~~~~~~~~~~~~~~~~~^
|
|
|
+ model_paths=paths,
|
|
|
+ ^^^^^^^^^^^^^^^^^^
|
|
|
+ ...<8 lines>...
|
|
|
+ split=split,
|
|
|
+ ^^^^^^^^^^^^
|
|
|
+ )
|
|
|
+ ^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 225, in _evaluate_ensemble
|
|
|
+ mc_probs = _run_mc_passes(
|
|
|
+ model=model,
|
|
|
+ ...<10 lines>...
|
|
|
+ noise_relative=noise_relative,
|
|
|
+ )
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/tasks/evaluate.py", line 131, in _run_mc_passes
|
|
|
+ pass_tracker = parent_tracker.get_sub_tracker(label)
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/util/progress.py", line 28, in get_sub_tracker
|
|
|
+ sub.set_title(title)
|
|
|
+ ~~~~~~~~~~~~~^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/util/progress.py", line 38, in set_title
|
|
|
+ self.app.call_from_thread(_update_title)
|
|
|
+ ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
|
|
|
+ File "/home/nschense/Documents/Medphys_Research/alnn_rewrite/.venv/lib64/python3.14/site-packages/textual/app.py", line 1819, in call_from_thread
|
|
|
+ raise RuntimeError("App is not running")
|
|
|
+RuntimeError: App is not running
|
|
|
+2026-07-26 21:29:56,169 - ERROR - [SYSTEM] ERROR: App is not running
|
|
|
+2026-07-26 21:30:03,892 - INFO - [SYSTEM] Application initialized and ready.
|
|
|
+2026-07-26 21:30:03,893 - INFO - [SYSTEM] Successfully loaded config from ./outputs/exp1/config.toml
|
|
|
+2026-07-26 21:30:09,149 - INFO - [SYSTEM] Initiating Scenario: 2. Load, Evaluate (test+val), Noise, & Analyze
|
|
|
+2026-07-26 21:30:09,162 - INFO - [SYSTEM] Starting Task 1/10: Load Image and ADNIMERGE
|
|
|
+2026-07-26 21:30:09,307 - INFO - [Load Image and ADNIMERGE] Seeded RNGs with base seed 42
|
|
|
+2026-07-26 21:30:09,308 - INFO - [Load Image and ADNIMERGE] Loading Files
|
|
|
+2026-07-26 21:30:12,642 - INFO - [Load Image and ADNIMERGE] Dataloaders initalized
|
|
|
+2026-07-26 21:30:12,648 - INFO - [Load Image and ADNIMERGE] Task completed.
|
|
|
+2026-07-26 21:30:12,650 - INFO - [SYSTEM] Starting Task 2/10: Load Saved Models
|
|
|
+2026-07-26 21:30:12,651 - INFO - [Load Saved Models] Found 30 normal model(s) in normal_models/.
|
|
|
+2026-07-26 21:30:12,653 - INFO - [Load Saved Models] Found 30 bayesian model(s) in bayesian_models/.
|
|
|
+2026-07-26 21:30:12,653 - INFO - [Load Saved Models] Task completed.
|
|
|
+2026-07-26 21:30:12,655 - INFO - [SYSTEM] Starting Task 3/10: Evaluate Regular Models
|
|
|
+2026-07-26 21:30:12,932 - INFO - [Evaluate Regular Models] Evaluating 30 normal model(s) on 97 test samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 21:30:12,939 - INFO - [Evaluate Regular Models] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 21:30:14,364 - INFO - [Evaluate Regular Models] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 21:30:15,575 - INFO - [Evaluate Regular Models] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 21:30:16,767 - INFO - [Evaluate Regular Models] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 21:30:17,947 - INFO - [Evaluate Regular Models] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 21:30:19,126 - INFO - [Evaluate Regular Models] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 21:30:20,309 - INFO - [Evaluate Regular Models] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 21:30:21,489 - INFO - [Evaluate Regular Models] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 21:30:22,674 - INFO - [Evaluate Regular Models] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 21:30:23,861 - INFO - [Evaluate Regular Models] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 21:30:25,040 - INFO - [Evaluate Regular Models] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 21:30:26,228 - INFO - [Evaluate Regular Models] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 21:30:27,409 - INFO - [Evaluate Regular Models] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 21:30:28,599 - INFO - [Evaluate Regular Models] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 21:30:29,784 - INFO - [Evaluate Regular Models] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 21:30:30,968 - INFO - [Evaluate Regular Models] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 21:30:32,149 - INFO - [Evaluate Regular Models] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 21:30:33,329 - INFO - [Evaluate Regular Models] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 21:30:34,513 - INFO - [Evaluate Regular Models] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 21:30:35,699 - INFO - [Evaluate Regular Models] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 21:30:36,882 - INFO - [Evaluate Regular Models] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 21:30:38,076 - INFO - [Evaluate Regular Models] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 21:30:39,262 - INFO - [Evaluate Regular Models] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 21:30:40,449 - INFO - [Evaluate Regular Models] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 21:30:41,620 - INFO - [Evaluate Regular Models] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 21:30:42,794 - INFO - [Evaluate Regular Models] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 21:30:43,959 - INFO - [Evaluate Regular Models] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 21:30:45,127 - INFO - [Evaluate Regular Models] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 21:30:46,302 - INFO - [Evaluate Regular Models] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 21:30:47,470 - INFO - [Evaluate Regular Models] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 21:30:48,680 - INFO - [Evaluate Regular Models] Saved normal test evaluation to outputs/exp1/evaluations/normal.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 21:30:48,681 - INFO - [Evaluate Regular Models] Task completed.
|
|
|
+2026-07-26 21:30:48,683 - INFO - [SYSTEM] Starting Task 4/10: Evaluate Bayesian Models
|
|
|
+2026-07-26 21:30:48,762 - INFO - [Evaluate Bayesian Models] Evaluating 30 bayesian model(s) on 97 test samples, 1 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 21:30:48,770 - INFO - [Evaluate Bayesian Models] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 21:31:08,258 - INFO - [Evaluate Bayesian Models] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 21:31:27,760 - INFO - [Evaluate Bayesian Models] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 21:31:47,244 - INFO - [Evaluate Bayesian Models] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 21:32:06,726 - INFO - [Evaluate Bayesian Models] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 21:32:26,212 - INFO - [Evaluate Bayesian Models] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 21:32:45,670 - INFO - [Evaluate Bayesian Models] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 21:33:05,131 - INFO - [Evaluate Bayesian Models] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 21:33:24,641 - INFO - [Evaluate Bayesian Models] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 21:33:44,169 - INFO - [Evaluate Bayesian Models] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 21:34:03,687 - INFO - [Evaluate Bayesian Models] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 21:34:23,231 - INFO - [Evaluate Bayesian Models] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 21:34:42,710 - INFO - [Evaluate Bayesian Models] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-26 21:35:02,165 - INFO - [Evaluate Bayesian Models] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-26 21:35:21,624 - INFO - [Evaluate Bayesian Models] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-26 21:35:41,027 - INFO - [Evaluate Bayesian Models] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-26 21:36:00,502 - INFO - [Evaluate Bayesian Models] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-26 21:36:19,957 - INFO - [Evaluate Bayesian Models] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-26 21:36:39,437 - INFO - [Evaluate Bayesian Models] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-26 21:36:58,895 - INFO - [Evaluate Bayesian Models] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-26 21:37:18,381 - INFO - [Evaluate Bayesian Models] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-26 21:37:37,841 - INFO - [Evaluate Bayesian Models] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-26 21:37:57,293 - INFO - [Evaluate Bayesian Models] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-26 21:38:16,717 - INFO - [Evaluate Bayesian Models] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-26 21:38:36,164 - INFO - [Evaluate Bayesian Models] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-26 21:38:55,626 - INFO - [Evaluate Bayesian Models] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-26 21:39:15,089 - INFO - [Evaluate Bayesian Models] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-26 21:39:34,541 - INFO - [Evaluate Bayesian Models] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-26 21:39:54,016 - INFO - [Evaluate Bayesian Models] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-26 21:40:13,563 - INFO - [Evaluate Bayesian Models] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-26 21:40:33,116 - INFO - [Evaluate Bayesian Models] Saved bayesian test evaluation to outputs/exp1/evaluations/bayesian.nc (models=30, samples=97, noise_levels=1).
|
|
|
+2026-07-26 21:40:33,117 - INFO - [Evaluate Bayesian Models] Task completed.
|
|
|
+2026-07-26 21:40:33,119 - INFO - [SYSTEM] Starting Task 5/10: Evaluate Regular Models (Validation)
|
|
|
+2026-07-26 21:40:33,226 - INFO - [Evaluate Regular Models (Validation)] Evaluating 30 normal model(s) on 149 val samples, 1 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 21:40:33,233 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 21:40:34,882 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 21:40:36,523 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 21:40:38,176 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 21:40:39,811 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 21:40:41,453 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 21:40:43,095 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 21:40:44,729 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 21:40:46,363 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 21:40:48,002 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 21:40:49,644 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 21:40:51,283 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 21:40:52,924 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 21:40:54,565 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 21:40:56,198 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 21:40:57,842 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 21:40:59,500 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 21:41:01,130 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 21:41:02,770 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 21:41:04,400 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 21:41:06,036 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 21:41:07,667 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 21:41:09,300 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 21:41:10,930 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 21:41:12,565 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 21:41:14,204 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 21:41:15,848 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 21:41:17,492 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 21:41:19,131 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 21:41:20,765 - INFO - [Evaluate Regular Models (Validation)] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 21:41:22,416 - INFO - [Evaluate Regular Models (Validation)] Saved normal val evaluation to outputs/exp1/evaluations/val_normal.nc (models=30, samples=149, noise_levels=1).
|
|
|
+2026-07-26 21:41:22,416 - INFO - [Evaluate Regular Models (Validation)] Task completed.
|
|
|
+2026-07-26 21:41:22,418 - INFO - [SYSTEM] Starting Task 6/10: Evaluate Bayesian Models (Validation)
|
|
|
+2026-07-26 21:41:22,535 - INFO - [Evaluate Bayesian Models (Validation)] Evaluating 30 bayesian model(s) on 149 val samples, 1 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 21:41:22,543 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 21:41:51,939 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 21:42:21,312 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 21:42:50,691 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 21:43:20,097 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 21:43:49,458 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 21:44:18,835 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 21:44:48,226 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 21:45:17,606 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 21:45:46,980 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 21:46:16,342 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 21:46:45,707 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 21:47:15,124 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-26 21:47:44,534 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-26 21:48:13,890 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-26 21:48:43,260 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-26 21:49:12,650 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-26 21:49:42,043 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-26 21:50:11,409 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-26 21:50:40,774 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-26 21:51:10,160 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-26 21:51:39,542 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-26 21:52:08,928 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-26 21:52:38,412 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-26 21:53:07,824 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-26 21:53:37,228 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-26 21:54:06,614 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-26 21:54:36,019 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-26 21:55:05,383 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-26 21:55:34,728 - INFO - [Evaluate Bayesian Models (Validation)] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-26 21:56:04,133 - INFO - [Evaluate Bayesian Models (Validation)] Saved bayesian val evaluation to outputs/exp1/evaluations/val_bayesian.nc (models=30, samples=149, noise_levels=1).
|
|
|
+2026-07-26 21:56:04,134 - INFO - [Evaluate Bayesian Models (Validation)] Task completed.
|
|
|
+2026-07-26 21:56:04,135 - INFO - [SYSTEM] Starting Task 7/10: Evaluate Models on Noised Data
|
|
|
+2026-07-26 21:56:04,213 - INFO - [Evaluate Models on Noised Data] Evaluating 30 normal model(s) on 97 test samples, 13 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-26 21:56:04,221 - INFO - [Evaluate Models on Noised Data] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-26 21:56:16,752 - INFO - [Evaluate Models on Noised Data] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-26 21:56:29,265 - INFO - [Evaluate Models on Noised Data] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-26 21:56:41,790 - INFO - [Evaluate Models on Noised Data] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-26 21:56:54,333 - INFO - [Evaluate Models on Noised Data] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-26 21:57:06,851 - INFO - [Evaluate Models on Noised Data] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-26 21:57:19,390 - INFO - [Evaluate Models on Noised Data] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-26 21:57:31,917 - INFO - [Evaluate Models on Noised Data] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-26 21:57:44,433 - INFO - [Evaluate Models on Noised Data] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-26 21:57:56,966 - INFO - [Evaluate Models on Noised Data] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-26 21:58:09,480 - INFO - [Evaluate Models on Noised Data] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-26 21:58:21,987 - INFO - [Evaluate Models on Noised Data] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-26 21:58:34,507 - INFO - [Evaluate Models on Noised Data] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-26 21:58:47,017 - INFO - [Evaluate Models on Noised Data] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-26 21:58:59,540 - INFO - [Evaluate Models on Noised Data] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-26 21:59:12,079 - INFO - [Evaluate Models on Noised Data] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-26 21:59:24,599 - INFO - [Evaluate Models on Noised Data] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-26 21:59:37,117 - INFO - [Evaluate Models on Noised Data] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-26 21:59:49,625 - INFO - [Evaluate Models on Noised Data] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-26 22:00:02,151 - INFO - [Evaluate Models on Noised Data] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-26 22:00:14,666 - INFO - [Evaluate Models on Noised Data] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-26 22:00:27,181 - INFO - [Evaluate Models on Noised Data] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-26 22:00:39,694 - INFO - [Evaluate Models on Noised Data] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-26 22:00:52,217 - INFO - [Evaluate Models on Noised Data] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-26 22:01:04,701 - INFO - [Evaluate Models on Noised Data] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-26 22:01:17,216 - INFO - [Evaluate Models on Noised Data] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-26 22:01:29,749 - INFO - [Evaluate Models on Noised Data] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-26 22:01:42,287 - INFO - [Evaluate Models on Noised Data] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-26 22:01:54,820 - INFO - [Evaluate Models on Noised Data] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-26 22:02:07,392 - INFO - [Evaluate Models on Noised Data] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-26 22:02:19,929 - INFO - [Evaluate Models on Noised Data] Saved normal test evaluation to outputs/exp1/evaluations/noisy_normal.nc (models=30, samples=97, noise_levels=13).
|
|
|
+2026-07-26 22:02:20,004 - INFO - [Evaluate Models on Noised Data] Evaluating 30 bayesian model(s) on 97 test samples, 13 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-26 22:02:20,011 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-26 22:06:28,700 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-26 22:10:37,088 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-26 22:14:45,447 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-26 22:18:54,005 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-26 22:23:02,465 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-26 22:27:11,601 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-26 22:31:20,867 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-26 22:35:30,599 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-26 22:39:40,346 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-26 22:43:49,483 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-26 22:47:58,410 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-26 22:52:07,309 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-26 22:56:16,703 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-26 23:00:26,279 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-26 23:04:36,108 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-26 23:08:45,318 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-26 23:12:54,852 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-26 23:17:04,563 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-26 23:21:14,581 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-26 23:25:24,641 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-26 23:29:34,434 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-26 23:33:44,269 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-26 23:37:53,862 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-26 23:42:03,032 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-26 23:46:12,283 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-26 23:50:21,331 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-26 23:54:30,682 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-26 23:58:39,998 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-27 00:02:49,246 - INFO - [Evaluate Models on Noised Data] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-27 00:06:58,432 - INFO - [Evaluate Models on Noised Data] Saved bayesian test evaluation to outputs/exp1/evaluations/noisy_bayesian.nc (models=30, samples=97, noise_levels=13).
|
|
|
+2026-07-27 00:06:58,433 - INFO - [Evaluate Models on Noised Data] Task completed.
|
|
|
+2026-07-27 00:06:58,435 - INFO - [SYSTEM] Starting Task 8/10: Evaluate Models on Noised Data (Validation)
|
|
|
+2026-07-27 00:06:58,541 - INFO - [Evaluate Models on Noised Data (Validation)] Evaluating 30 normal model(s) on 149 val samples, 13 noise level(s), 1 MC pass(es) each.
|
|
|
+2026-07-27 00:06:58,550 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 1/30: model_1.pt
|
|
|
+2026-07-27 00:07:17,570 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 2/30: model_2.pt
|
|
|
+2026-07-27 00:07:36,569 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 3/30: model_3.pt
|
|
|
+2026-07-27 00:07:55,540 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 4/30: model_4.pt
|
|
|
+2026-07-27 00:08:14,550 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 5/30: model_5.pt
|
|
|
+2026-07-27 00:08:33,559 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 6/30: model_6.pt
|
|
|
+2026-07-27 00:08:52,549 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 7/30: model_7.pt
|
|
|
+2026-07-27 00:09:11,549 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 8/30: model_8.pt
|
|
|
+2026-07-27 00:09:30,582 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 9/30: model_9.pt
|
|
|
+2026-07-27 00:09:49,518 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 10/30: model_10.pt
|
|
|
+2026-07-27 00:10:08,470 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 11/30: model_11.pt
|
|
|
+2026-07-27 00:10:27,459 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 12/30: model_12.pt
|
|
|
+2026-07-27 00:10:46,450 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 13/30: model_13.pt
|
|
|
+2026-07-27 00:11:05,434 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 14/30: model_14.pt
|
|
|
+2026-07-27 00:11:24,413 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 15/30: model_15.pt
|
|
|
+2026-07-27 00:11:43,391 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 16/30: model_16.pt
|
|
|
+2026-07-27 00:12:02,353 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 17/30: model_17.pt
|
|
|
+2026-07-27 00:12:21,362 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 18/30: model_18.pt
|
|
|
+2026-07-27 00:12:40,346 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 19/30: model_19.pt
|
|
|
+2026-07-27 00:12:59,316 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 20/30: model_20.pt
|
|
|
+2026-07-27 00:13:18,266 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 21/30: model_21.pt
|
|
|
+2026-07-27 00:13:37,229 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 22/30: model_22.pt
|
|
|
+2026-07-27 00:13:56,199 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 23/30: model_23.pt
|
|
|
+2026-07-27 00:14:15,130 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 24/30: model_24.pt
|
|
|
+2026-07-27 00:14:34,133 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 25/30: model_25.pt
|
|
|
+2026-07-27 00:14:53,068 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 26/30: model_26.pt
|
|
|
+2026-07-27 00:15:11,992 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 27/30: model_27.pt
|
|
|
+2026-07-27 00:15:30,963 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 28/30: model_28.pt
|
|
|
+2026-07-27 00:15:49,966 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 29/30: model_29.pt
|
|
|
+2026-07-27 00:16:08,911 - INFO - [Evaluate Models on Noised Data (Validation)] Loading normal model 30/30: model_30.pt
|
|
|
+2026-07-27 00:16:27,928 - INFO - [Evaluate Models on Noised Data (Validation)] Saved normal val evaluation to outputs/exp1/evaluations/val_noisy_normal.nc (models=30, samples=149, noise_levels=13).
|
|
|
+2026-07-27 00:16:28,034 - INFO - [Evaluate Models on Noised Data (Validation)] Evaluating 30 bayesian model(s) on 149 val samples, 13 noise level(s), 20 MC pass(es) each.
|
|
|
+2026-07-27 00:16:28,041 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 1/30: model_1.pt
|
|
|
+2026-07-27 00:22:45,767 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 2/30: model_2.pt
|
|
|
+2026-07-27 00:29:03,466 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 3/30: model_3.pt
|
|
|
+2026-07-27 00:35:21,431 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 4/30: model_4.pt
|
|
|
+2026-07-27 00:41:39,274 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 5/30: model_5.pt
|
|
|
+2026-07-27 00:47:57,182 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 6/30: model_6.pt
|
|
|
+2026-07-27 00:54:14,917 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 7/30: model_7.pt
|
|
|
+2026-07-27 01:00:32,270 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 8/30: model_8.pt
|
|
|
+2026-07-27 01:06:50,205 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 9/30: model_9.pt
|
|
|
+2026-07-27 01:13:07,953 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 10/30: model_10.pt
|
|
|
+2026-07-27 01:19:26,249 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 11/30: model_11.pt
|
|
|
+2026-07-27 01:25:44,385 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 12/30: model_12.pt
|
|
|
+2026-07-27 01:32:02,203 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 13/30: model_13.pt
|
|
|
+2026-07-27 01:38:19,974 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 14/30: model_14.pt
|
|
|
+2026-07-27 01:44:37,705 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 15/30: model_15.pt
|
|
|
+2026-07-27 01:50:55,216 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 16/30: model_16.pt
|
|
|
+2026-07-27 01:57:12,992 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 17/30: model_17.pt
|
|
|
+2026-07-27 02:03:30,447 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 18/30: model_18.pt
|
|
|
+2026-07-27 02:09:47,766 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 19/30: model_19.pt
|
|
|
+2026-07-27 02:16:05,146 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 20/30: model_20.pt
|
|
|
+2026-07-27 02:22:22,880 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 21/30: model_21.pt
|
|
|
+2026-07-27 02:28:40,602 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 22/30: model_22.pt
|
|
|
+2026-07-27 02:34:58,419 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 23/30: model_23.pt
|
|
|
+2026-07-27 02:41:16,000 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 24/30: model_24.pt
|
|
|
+2026-07-27 02:47:33,565 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 25/30: model_25.pt
|
|
|
+2026-07-27 02:53:51,021 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 26/30: model_26.pt
|
|
|
+2026-07-27 03:00:08,667 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 27/30: model_27.pt
|
|
|
+2026-07-27 03:06:26,116 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 28/30: model_28.pt
|
|
|
+2026-07-27 03:12:43,714 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 29/30: model_29.pt
|
|
|
+2026-07-27 03:19:01,400 - INFO - [Evaluate Models on Noised Data (Validation)] Loading bayesian model 30/30: model_30.pt
|
|
|
+2026-07-27 03:25:18,763 - INFO - [Evaluate Models on Noised Data (Validation)] Saved bayesian val evaluation to outputs/exp1/evaluations/val_noisy_bayesian.nc (models=30, samples=149, noise_levels=13).
|
|
|
+2026-07-27 03:25:18,765 - INFO - [Evaluate Models on Noised Data (Validation)] Task completed.
|
|
|
+2026-07-27 03:25:18,766 - INFO - [SYSTEM] Starting Task 9/10: Combine Split Evaluations
|
|
|
+2026-07-27 03:25:18,802 - INFO - [Combine Split Evaluations] combine_evaluations: wrote combined_normal.nc (246 samples from normal.nc, val_normal.nc).
|
|
|
+2026-07-27 03:25:18,841 - INFO - [Combine Split Evaluations] combine_evaluations: wrote combined_noisy_normal.nc (246 samples from noisy_normal.nc, val_noisy_normal.nc).
|
|
|
+2026-07-27 03:25:18,867 - INFO - [Combine Split Evaluations] combine_evaluations: wrote combined_bayesian.nc (246 samples from bayesian.nc, val_bayesian.nc).
|
|
|
+2026-07-27 03:25:18,903 - INFO - [Combine Split Evaluations] combine_evaluations: wrote combined_noisy_bayesian.nc (246 samples from noisy_bayesian.nc, val_noisy_bayesian.nc).
|
|
|
+2026-07-27 03:25:18,909 - INFO - [Combine Split Evaluations] Task completed.
|
|
|
+2026-07-27 03:25:18,910 - INFO - [SYSTEM] Starting Task 10/10: Analyze Evaluations
|
|
|
+2026-07-27 03:25:19,685 - INFO - generated new fontManager
|
|
|
+2026-07-27 03:25:19,962 - INFO - [Analyze Evaluations] Loaded evaluation 'bayesian' with dims {'model': 30, 'noise_level': 1, 'sample': 97, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:19,971 - INFO - [Analyze Evaluations] Loaded evaluation 'combined_bayesian' with dims {'model': 30, 'noise_level': 1, 'sample': 246, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:19,975 - INFO - [Analyze Evaluations] Loaded evaluation 'combined_noisy_bayesian' with dims {'model': 30, 'noise_level': 13, 'sample': 246, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:19,979 - INFO - [Analyze Evaluations] Loaded evaluation 'combined_noisy_normal' with dims {'model': 30, 'noise_level': 13, 'sample': 246, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:19,982 - INFO - [Analyze Evaluations] Loaded evaluation 'combined_normal' with dims {'model': 30, 'noise_level': 1, 'sample': 246, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:19,985 - INFO - [Analyze Evaluations] Loaded evaluation 'noisy_bayesian' with dims {'model': 30, 'noise_level': 13, 'sample': 97, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:19,995 - INFO - [Analyze Evaluations] Loaded evaluation 'noisy_normal' with dims {'model': 30, 'noise_level': 13, 'sample': 97, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:19,999 - INFO - [Analyze Evaluations] Loaded evaluation 'normal' with dims {'model': 30, 'noise_level': 1, 'sample': 97, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:20,002 - INFO - [Analyze Evaluations] Loaded evaluation 'val_bayesian' with dims {'model': 30, 'noise_level': 1, 'sample': 149, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:20,013 - INFO - [Analyze Evaluations] Loaded evaluation 'val_noisy_bayesian' with dims {'model': 30, 'noise_level': 13, 'sample': 149, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:20,016 - INFO - [Analyze Evaluations] Loaded evaluation 'val_noisy_normal' with dims {'model': 30, 'noise_level': 13, 'sample': 149, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:20,020 - INFO - [Analyze Evaluations] Loaded evaluation 'val_normal' with dims {'model': 30, 'noise_level': 1, 'sample': 149, 'class_name': 2}.
|
|
|
+2026-07-27 03:25:20,028 - INFO - [Analyze Evaluations] Running analysis: model_report — Per-model accuracy and uncertainty summary (PDF)
|
|
|
+2026-07-27 03:25:20,098 - INFO - [Analyze Evaluations] model_report: wrote model_report.pdf (2 family/families, 60 model(s)).
|
|
|
+2026-07-27 03:25:20,099 - INFO - [Analyze Evaluations] Running analysis: ensemble_size_accuracy — Accuracy vs. number of ensemble members
|
|
|
+2026-07-27 03:25:20,113 - INFO - [Analyze Evaluations] ensemble_size_accuracy: normal - sizes 1..30, up to 30 configs each.
|
|
|
+2026-07-27 03:25:20,137 - INFO - [Analyze Evaluations] ensemble_size_accuracy: bayesian - sizes 1..30, up to 30 configs each.
|
|
|
+2026-07-27 03:25:20,557 - INFO - [Analyze Evaluations] ensemble_size_accuracy: wrote ensemble_size_accuracy.png (2 family/families).
|
|
|
+2026-07-27 03:25:20,565 - INFO - [Analyze Evaluations] Running analysis: bootstrap_ensemble_ci — Bootstrap confidence intervals for ensemble accuracy
|
|
|
+2026-07-27 03:25:20,708 - INFO - [Analyze Evaluations] bootstrap_ensemble_ci: normal full-ensemble acc = 71.5% (95% CI 62.4-79.9%, n=246 scans / 129 patients).
|
|
|
+2026-07-27 03:25:20,747 - INFO - [Analyze Evaluations] bootstrap_ensemble_ci: bayesian full-ensemble acc = 80.5% (95% CI 72.3-87.9%, n=246 scans / 129 patients).
|
|
|
+2026-07-27 03:25:20,869 - INFO - [Analyze Evaluations] bootstrap_ensemble_ci: wrote bootstrap_ci.png (2 family/families).
|
|
|
+2026-07-27 03:25:20,876 - INFO - [Analyze Evaluations] Running analysis: coverage — Coverage curves: accuracy and F1 vs. retained fraction
|
|
|
+2026-07-27 03:25:21,442 - INFO - [Analyze Evaluations] coverage: wrote coverage_accuracy.png (5 measure panels).
|
|
|
+2026-07-27 03:25:21,957 - INFO - [Analyze Evaluations] coverage: wrote coverage_f1.png (5 measure panels).
|
|
|
+2026-07-27 03:25:21,966 - INFO - [Analyze Evaluations] coverage: mean_output_entropy / normal_ensemble — AURC=0.1189 (accuracy at full coverage 0.715).
|
|
|
+2026-07-27 03:25:21,967 - INFO - [Analyze Evaluations] coverage: mean_output_entropy / normal_single — AURC=0.1335 (accuracy at full coverage 0.725).
|
|
|
+2026-07-27 03:25:21,967 - INFO - [Analyze Evaluations] coverage: mean_output_entropy / bayesian_ensemble — AURC=0.0763 (accuracy at full coverage 0.805).
|
|
|
+2026-07-27 03:25:21,968 - INFO - [Analyze Evaluations] coverage: mean_output_entropy / bayesian_single — AURC=0.1594 (accuracy at full coverage 0.699).
|
|
|
+2026-07-27 03:25:21,968 - INFO - [Analyze Evaluations] coverage: mean_predictive_entropy / normal_ensemble — AURC=0.1096 (accuracy at full coverage 0.715).
|
|
|
+2026-07-27 03:25:21,969 - INFO - [Analyze Evaluations] coverage: mean_predictive_entropy / bayesian_ensemble — AURC=0.0923 (accuracy at full coverage 0.805).
|
|
|
+2026-07-27 03:25:21,969 - INFO - [Analyze Evaluations] coverage: ensemble_std / normal_ensemble — AURC=0.2589 (accuracy at full coverage 0.715).
|
|
|
+2026-07-27 03:25:21,970 - INFO - [Analyze Evaluations] coverage: ensemble_std / bayesian_ensemble — AURC=0.0979 (accuracy at full coverage 0.805).
|
|
|
+2026-07-27 03:25:21,970 - INFO - [Analyze Evaluations] coverage: ensemble_mutual_information / normal_ensemble — AURC=0.2778 (accuracy at full coverage 0.715).
|
|
|
+2026-07-27 03:25:21,970 - INFO - [Analyze Evaluations] coverage: ensemble_mutual_information / bayesian_ensemble — AURC=0.1134 (accuracy at full coverage 0.805).
|
|
|
+2026-07-27 03:25:21,971 - INFO - [Analyze Evaluations] coverage: mean_mutual_information / bayesian_ensemble — AURC=0.1170 (accuracy at full coverage 0.805).
|
|
|
+2026-07-27 03:25:21,971 - INFO - [Analyze Evaluations] coverage: mean_mutual_information / bayesian_single — AURC=0.2047 (accuracy at full coverage 0.699).
|
|
|
+2026-07-27 03:25:21,973 - INFO - [Analyze Evaluations] Running analysis: noise_performance — Accuracy and uncertainty vs. input noise
|
|
|
+2026-07-27 03:25:22,822 - INFO - [Analyze Evaluations] noise_performance: normal_ensemble — accuracy 0.715 at σ=0 → 0.589 at σ=8.
|
|
|
+2026-07-27 03:25:22,828 - INFO - [Analyze Evaluations] noise_performance: normal_single — accuracy 0.725 at σ=0 → 0.597 at σ=8.
|
|
|
+2026-07-27 03:25:22,829 - INFO - [Analyze Evaluations] noise_performance: bayesian_ensemble — accuracy 0.809 at σ=0 → 0.476 at σ=8.
|
|
|
+2026-07-27 03:25:22,830 - INFO - [Analyze Evaluations] noise_performance: bayesian_single — accuracy 0.686 at σ=0 → 0.492 at σ=8.
|
|
|
+2026-07-27 03:25:22,830 - INFO - [Analyze Evaluations] noise_performance: wrote noise_performance.png (7 panels).
|
|
|
+2026-07-27 03:25:22,831 - INFO - [Analyze Evaluations] Running analysis: noise_correlation — Uncertainty vs. accuracy across noise levels (with fit)
|
|
|
+2026-07-27 03:25:24,479 - INFO - [Analyze Evaluations] noise_correlation: wrote noise_correlation_mean_output_entropy.png.
|
|
|
+2026-07-27 03:25:24,485 - INFO - [Analyze Evaluations] noise_correlation: mean_output_entropy / normal_ensemble — exponential fit R²=0.747, Spearman ρ=-0.877.
|
|
|
+2026-07-27 03:25:24,486 - INFO - [Analyze Evaluations] noise_correlation: mean_output_entropy / normal_single — exponential fit R²=0.884, Spearman ρ=-0.926.
|
|
|
+2026-07-27 03:25:24,487 - INFO - [Analyze Evaluations] noise_correlation: mean_output_entropy / bayesian_ensemble — exponential fit R²=0.203, Spearman ρ=-0.488.
|
|
|
+2026-07-27 03:25:24,487 - INFO - [Analyze Evaluations] noise_correlation: mean_output_entropy / bayesian_single — exponential fit R²=0.395, Spearman ρ=-0.624.
|
|
|
+2026-07-27 03:25:24,813 - INFO - [Analyze Evaluations] noise_correlation: wrote noise_correlation_mean_predictive_entropy.png.
|
|
|
+2026-07-27 03:25:24,819 - INFO - [Analyze Evaluations] noise_correlation: mean_predictive_entropy / normal_ensemble — exponential fit R²=0.806, Spearman ρ=-0.907.
|
|
|
+2026-07-27 03:25:24,821 - INFO - [Analyze Evaluations] noise_correlation: mean_predictive_entropy / bayesian_ensemble — exponential fit R²=0.178, Spearman ρ=-0.435.
|
|
|
+2026-07-27 03:25:25,154 - INFO - [Analyze Evaluations] noise_correlation: wrote noise_correlation_ensemble_std.png.
|
|
|
+2026-07-27 03:25:25,160 - INFO - [Analyze Evaluations] noise_correlation: ensemble_std / normal_ensemble — exponential fit R²=0.044, Spearman ρ=-0.206.
|
|
|
+2026-07-27 03:25:25,162 - INFO - [Analyze Evaluations] noise_correlation: ensemble_std / bayesian_ensemble — exponential fit R²=0.389, Spearman ρ=-0.598.
|
|
|
+2026-07-27 03:25:25,641 - INFO - [Analyze Evaluations] noise_correlation: wrote noise_correlation_ensemble_mutual_information.png.
|
|
|
+2026-07-27 03:25:25,647 - INFO - [Analyze Evaluations] noise_correlation: ensemble_mutual_information / normal_ensemble — exponential fit R²=0.001, Spearman ρ=0.004.
|
|
|
+2026-07-27 03:25:25,648 - INFO - [Analyze Evaluations] noise_correlation: ensemble_mutual_information / bayesian_ensemble — exponential fit R²=0.393, Spearman ρ=-0.629.
|
|
|
+2026-07-27 03:25:25,990 - INFO - [Analyze Evaluations] noise_correlation: wrote noise_correlation_mean_mutual_information.png.
|
|
|
+2026-07-27 03:25:25,997 - INFO - [Analyze Evaluations] noise_correlation: mean_mutual_information / bayesian_ensemble — exponential fit R²=0.270, Spearman ρ=-0.507.
|
|
|
+2026-07-27 03:25:25,997 - INFO - [Analyze Evaluations] noise_correlation: mean_mutual_information / bayesian_single — exponential fit R²=0.494, Spearman ρ=-0.666.
|
|
|
+2026-07-27 03:25:26,000 - INFO - [Analyze Evaluations] Analysis artifacts written to outputs/exp1/analysis/.
|
|
|
+2026-07-27 03:25:26,003 - INFO - [Analyze Evaluations] Task completed.
|
|
|
+2026-07-27 03:25:26,005 - INFO - [SYSTEM] All tasks finished successfully!
|
Nicholas Schense