CHL Preflight Night 61161
Executing preflight for 61161 at Thu Apr 30 17:10:21 -04 2026.
Log can be found in /atlas/obs/04/61161/preflight.dat.
Setting donefile '/atlas/obs/04/61161/preflight_complete.20260430211021.27811' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260430211021.27811.
Thu Apr 30 17:10:21 -04 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Thu Apr 30 17:10:21 -04 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-CHL [9c7b9d11-56b0-4459-94d4-57a375ef1a16;1800]
Thu Apr 30 17:10:21 -04 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw 3 ON redLED
Thu Apr 30 17:10:22 -04 2026 [elapsed=0 sec] About to start CHL preflight. Point your web browser at http://localhost:7454.
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] auxcam is disabled.
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1777583414
OK
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Thu Apr 30 17:10:22 -04 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Thu Apr 30 17:10:23 -04 2026 [elapsed=2 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-04a...OK
proc1 prochain-redpost-04x...OK
Thu Apr 30 17:10:24 -04 2026 [elapsed=3 sec] QUEUE
0 observations queued.
Thu Apr 30 17:10:24 -04 2026 [elapsed=3 sec] CLOCKS
admin: Thu Apr 30 21:10:24 UTC 2026
met: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
+metbox2.chl.atl .PPS. 1 u 366 1024 377 0.315 1.267 0.756
*10.0.11.4 .GPS. 1 u 18 1024 377 0.574 1.450 0.690
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
-185.125.190.57 99.220.8.133 2 u 1024 1024 377 222.944 -6.757 2.171
-185.125.190.58 146.131.121.246 2 u 815 1024 377 223.222 -6.035 1.804
+alphyn.canonica 132.163.96.1 2 u 266 1024 337 150.568 -4.384 0.946
-185.125.190.56 146.131.121.246 2 u 561 1024 377 222.758 -5.796 1.745
Thu Apr 30 17:10:25 -04 2026 [elapsed=4 sec] DISKS
200GB available in /atlas/obs...OK (3648GB)
200GB available in /atlas/red...OK (7441GB)
Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p1 11T 6.8T 3.5T 66% /
admin:/dev/loop0 106M 106M 0 100% /snap/core/17284
admin:/dev/loop1 106M 106M 0 100% /snap/core/17292
archon:/dev/mapper/ubuntu--vg-ubuntu--lv 58G 20G 35G 37% /
archon:/dev/loop0 106M 106M 0 100% /snap/core/17284
archon:/dev/sda2 974M 321M 586M 36% /boot
archon:/dev/sda1 511M 4.4M 507M 1% /boot/efi
archon:/dev/loop2 106M 106M 0 100% /snap/core/17292
proc1:/dev/md0p1 15T 6.6T 7.1T 48% /
proc1:/dev/sda1 511M 6.7M 505M 2% /boot/efi
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc1:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc2:/dev/md0p1 15T 447G 13T 4% /
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc2:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc3:/dev/md0p1 15T 903G 13T 7% /
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc3:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc4:/dev/md0p1 15T 693G 13T 6% /
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc4:/dev/loop1 106M 106M 0 100% /snap/core/17292
Thu Apr 30 17:10:25 -04 2026 [elapsed=4 sec] SERVICES1
xcam
chiller...FAIL
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Preflight failed:
service chiller in ERROR state;
Thu Apr 30 17:10:26 -04 2026 [elapsed=5 sec] Preflight took 5 seconds to complete.
Thu Apr 30 17:10:26 -04 2026 [elapsed=5 sec] STARTING CLEANUP
Turning off LEDs
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL
Preflight image
Shutter acutation data:
A 0.020s 3 0.0% A 0.050s 115 1.3% A 0.081s 375 4.1% A 0.111s 723 7.9% A 0.141s 1180 12.9% A 0.171s 1761 19.2% A 0.202s 2443 26.7% A 0.232s 3239 35.4% A 0.262s 4144 45.3% A 0.292s 5074 55.4% A 0.323s 5969 65.2% A 0.353s 6752 73.8% A 0.383s 7413 81.0% A 0.413s 7990 87.3% A 0.444s 8444 92.2% A 0.474s 8782 95.9% A 0.504s 9022 98.6% A 0.534s 9135 99.8% A 0.565s 9153 100.0% B 0.020s 2 0.0% B 0.051s 112 1.2% B 0.081s 380 4.2% B 0.111s 730 8.0% B 0.141s 1202 13.1% B 0.172s 1775 19.4% B 0.202s 2466 26.9% B 0.232s 3243 35.4% B 0.262s 4139 45.2% B 0.293s 5103 55.7% B 0.323s 5961 65.1% B 0.353s 6749 73.7% B 0.383s 7421 81.1% B 0.414s 7985 87.2% B 0.444s 8443 92.2% B 0.474s 8786 96.0% B 0.504s 9016 98.5% B 0.534s 9137 99.8% B 0.565s 9155 100.0% sleeping 3 sec between shutter moves... A 0.020s 9153 100.0% A 0.050s 9057 98.9% A 0.081s 8788 96.0% A 0.111s 8432 92.1% A 0.141s 7975 87.1% A 0.172s 7400 80.8% A 0.202s 6715 73.4% A 0.232s 5922 64.7% A 0.263s 5011 54.7% A 0.293s 4069 44.5% A 0.323s 3193 34.9% A 0.353s 2409 26.3% A 0.383s 1731 18.9% A 0.414s 1164 12.7% A 0.444s 707 7.7% A 0.474s 368 4.0% A 0.504s 131 1.4% A 0.535s 15 0.2% A 0.565s 2 0.0% B 0.020s 9147 99.9% B 0.050s 9025 98.6% B 0.081s 8781 95.9% B 0.111s 8434 92.1% B 0.141s 7969 87.1% B 0.172s 7399 80.8% B 0.202s 6712 73.3% B 0.232s 5918 64.6% B 0.262s 5012 54.8% B 0.293s 4084 44.6% B 0.323s 3192 34.9% B 0.353s 2415 26.4% B 0.384s 1723 18.8% B 0.414s 1165 12.7% B 0.444s 712 7.8% B 0.474s 368 4.0% B 0.505s 140 1.5% B 0.535s 16 0.2% B 0.565s 1 0.0% A 0 0.0mm 15 N F R | B 1 0.0mm 15 N F R