CHL Preflight Night 61161
Executing preflight for 61161 at Thu Apr 30 17:10:21 -04 2026.
Log can be found in /atlas/obs/04/61161/preflight.dat.
Setting donefile '/atlas/obs/04/61161/preflight_complete.20260430211021.27811' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260430211021.27811.
Thu Apr 30 17:10:21 -04 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Thu Apr 30 17:10:21 -04 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-CHL [9c7b9d11-56b0-4459-94d4-57a375ef1a16;1800]
Thu Apr 30 17:10:21 -04 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw 3 ON redLED
Thu Apr 30 17:10:22 -04 2026 [elapsed=0 sec] About to start CHL preflight. Point your web browser at http://localhost:7454.
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] auxcam is disabled.
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1777583414
OK
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Thu Apr 30 17:10:23 -04 2026 [elapsed=2 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-04a...OK
proc1 prochain-redpost-04x...OK
Thu Apr 30 17:10:24 -04 2026 [elapsed=3 sec] QUEUE
0 observations queued.
Thu Apr 30 17:10:24 -04 2026 [elapsed=3 sec] CLOCKS
admin: Thu Apr 30 21:10:24 UTC 2026
met: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
+metbox2.chl.atl .PPS. 1 u 366 1024 377 0.315 1.267 0.756
*10.0.11.4 .GPS. 1 u 18 1024 377 0.574 1.450 0.690
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
-185.125.190.57 99.220.8.133 2 u 1024 1024 377 222.944 -6.757 2.171
-185.125.190.58 146.131.121.246 2 u 815 1024 377 223.222 -6.035 1.804
+alphyn.canonica 132.163.96.1 2 u 266 1024 337 150.568 -4.384 0.946
-185.125.190.56 146.131.121.246 2 u 561 1024 377 222.758 -5.796 1.745
Thu Apr 30 17:10:25 -04 2026 [elapsed=4 sec] DISKS
200GB available in /atlas/obs...OK (3648GB)
200GB available in /atlas/red...OK (7441GB)
Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p1 11T 6.8T 3.5T 66% /
admin:/dev/loop0 106M 106M 0 100% /snap/core/17284
admin:/dev/loop1 106M 106M 0 100% /snap/core/17292
archon:/dev/mapper/ubuntu--vg-ubuntu--lv 58G 20G 35G 37% /
archon:/dev/loop0 106M 106M 0 100% /snap/core/17284
archon:/dev/sda2 974M 321M 586M 36% /boot
archon:/dev/sda1 511M 4.4M 507M 1% /boot/efi
archon:/dev/loop2 106M 106M 0 100% /snap/core/17292
proc1:/dev/md0p1 15T 6.6T 7.1T 48% /
proc1:/dev/sda1 511M 6.7M 505M 2% /boot/efi
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc1:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc2:/dev/md0p1 15T 447G 13T 4% /
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc2:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc3:/dev/md0p1 15T 903G 13T 7% /
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc3:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc4:/dev/md0p1 15T 693G 13T 6% /
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc4:/dev/loop1 106M 106M 0 100% /snap/core/17292
Thu Apr 30 17:10:25 -04 2026 [elapsed=4 sec] SERVICES1
xcam
chiller...FAIL
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Preflight failed:
service chiller in ERROR state;
Thu Apr 30 17:10:26 -04 2026 [elapsed=5 sec] Preflight took 5 seconds to complete.
Thu Apr 30 17:10:26 -04 2026 [elapsed=5 sec] STARTING CLEANUP
Turning off LEDs
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL
Preflight image
Shutter acutation data:
A 0.020s 4 0.0% A 0.051s 114 1.2% A 0.081s 386 4.2% A 0.112s 736 8.0% A 0.142s 1197 13.1% A 0.173s 1803 19.7% A 0.203s 2489 27.2% A 0.234s 3295 36.0% A 0.264s 4205 45.9% A 0.294s 5133 56.1% A 0.325s 6052 66.1% A 0.355s 6797 74.3% A 0.386s 7474 81.6% A 0.416s 8038 87.8% A 0.446s 8481 92.6% A 0.476s 8811 96.3% A 0.507s 9038 98.7% A 0.537s 9140 99.8% A 0.567s 9153 100.0% B 0.020s 2 0.0% B 0.050s 112 1.2% B 0.081s 379 4.1% B 0.111s 728 8.0% B 0.141s 1203 13.1% B 0.172s 1773 19.4% B 0.202s 2466 26.9% B 0.232s 3268 35.7% B 0.262s 4168 45.5% B 0.293s 5104 55.8% B 0.323s 5987 65.4% B 0.353s 6771 74.0% B 0.383s 7441 81.3% B 0.414s 8002 87.4% B 0.444s 8456 92.4% B 0.474s 8794 96.1% B 0.504s 9022 98.6% B 0.534s 9139 99.8% B 0.565s 9156 100.0% sleeping 3 sec between shutter moves... A 0.020s 9151 100.0% A 0.051s 9051 98.9% A 0.081s 8777 95.9% A 0.111s 8420 92.0% A 0.141s 7959 86.9% A 0.172s 7380 80.6% A 0.202s 6691 73.1% A 0.232s 5894 64.4% A 0.262s 4981 54.4% A 0.293s 4039 44.1% A 0.323s 3165 34.6% A 0.353s 2387 26.1% A 0.383s 1711 18.7% A 0.414s 1147 12.5% A 0.444s 693 7.6% A 0.474s 367 4.0% A 0.504s 125 1.4% A 0.535s 15 0.2% A 0.565s 1 0.0% B 0.020s 9145 99.9% B 0.050s 9019 98.5% B 0.081s 8771 95.8% B 0.111s 8422 92.0% B 0.141s 7951 86.9% B 0.171s 7379 80.6% B 0.202s 6689 73.1% B 0.232s 5891 64.4% B 0.262s 4983 54.4% B 0.292s 4055 44.3% B 0.322s 3191 34.9% B 0.353s 2414 26.4% B 0.383s 1724 18.8% B 0.413s 1165 12.7% B 0.443s 712 7.8% B 0.474s 367 4.0% B 0.504s 138 1.5% B 0.534s 17 0.2% B 0.564s 0 0.0% A 1 0.0mm 15 N F R | B 0 0.0mm 15 N F R