CHL Preflight Night 61158
Executing preflight for 61158 at Mon Apr 27 17:13:06 -04 2026.
Log can be found in /atlas/obs/04/61158/preflight.dat.
Setting donefile '/atlas/obs/04/61158/preflight_complete.20260427211306.25426' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260427211306.25426.
Mon Apr 27 17:13:06 -04 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Mon Apr 27 17:13:06 -04 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-CHL [a33ad5f4-1b90-4a37-8685-c643eaf5133d;1800]
Mon Apr 27 17:13:06 -04 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw 3 ON redLED
Mon Apr 27 17:13:07 -04 2026 [elapsed=1 sec] About to start CHL preflight. Point your web browser at http://localhost:7454.
Mon Apr 27 17:13:07 -04 2026 [elapsed=1 sec] auxcam is disabled.
Mon Apr 27 17:13:07 -04 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Mon Apr 27 17:13:07 -04 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1777324384
OK
Mon Apr 27 17:13:07 -04 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Mon Apr 27 17:13:07 -04 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Mon Apr 27 17:13:09 -04 2026 [elapsed=3 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-04a...OK
proc1 prochain-redpost-04x...OK
Mon Apr 27 17:13:09 -04 2026 [elapsed=3 sec] QUEUE
0 observations queued.
Mon Apr 27 17:13:09 -04 2026 [elapsed=3 sec] CLOCKS
admin: Mon Apr 27 21:13:09 UTC 2026
met: OK
proc1: OK
proc2: NOK (delta=3 sec)
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
*metbox2.chl.atl .PPS. 1 u 373 1024 377 0.300 1.592 0.254
+10.0.11.4 .GPS. 1 u 779 1024 377 0.542 1.769 0.285
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
-185.125.190.57 99.220.8.133 2 u 340 1024 377 216.109 -2.768 3.328
-185.125.190.58 146.131.121.246 2 u 791 1024 377 216.661 -2.509 3.103
-alphyn.canonica 132.163.96.1 2 u 824 1024 377 152.127 -4.678 2.685
+185.125.190.56 146.131.121.246 2 u 1031 1024 377 216.069 -2.011 4.579
Mon Apr 27 17:13:12 -04 2026 [elapsed=6 sec] DISKS
200GB available in /atlas/obs...OK (3699GB)
200GB available in /atlas/red...OK (7386GB)
Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p1 11T 6.7T 3.6T 66% /
admin:/dev/loop0 106M 106M 0 100% /snap/core/17284
admin:/dev/loop1 106M 106M 0 100% /snap/core/17292
archon:/dev/mapper/ubuntu--vg-ubuntu--lv 58G 20G 36G 36% /
archon:/dev/loop0 106M 106M 0 100% /snap/core/17284
archon:/dev/sda2 974M 321M 586M 36% /boot
archon:/dev/sda1 511M 4.4M 507M 1% /boot/efi
archon:/dev/loop2 106M 106M 0 100% /snap/core/17292
proc1:/dev/md0p1 15T 6.7T 7.1T 49% /
proc1:/dev/sda1 511M 6.7M 505M 2% /boot/efi
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc1:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc2:/dev/md0p1 15T 594G 13T 5% /
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc2:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc3:/dev/md0p1 15T 902G 13T 7% /
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc3:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc4:/dev/md0p1 15T 692G 13T 6% /
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc4:/dev/loop1 106M 106M 0 100% /snap/core/17292
Mon Apr 27 17:13:12 -04 2026 [elapsed=6 sec] SERVICES1
xcam
chiller...OK
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Preflight failed:
proc2: clock differs by 3 seconds;
Mon Apr 27 17:13:14 -04 2026 [elapsed=8 sec] Preflight took 8 seconds to complete.
Mon Apr 27 17:13:14 -04 2026 [elapsed=8 sec] STARTING CLEANUP
Turning off LEDs
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL
Preflight image
Shutter acutation data:
A 0.020s 2 0.0% A 0.050s 107 1.2% A 0.081s 376 4.1% A 0.111s 722 7.9% A 0.141s 1180 12.9% A 0.171s 1761 19.2% A 0.201s 2442 26.7% A 0.232s 3238 35.4% A 0.262s 4144 45.3% A 0.292s 5074 55.4% A 0.323s 5969 65.2% A 0.353s 6753 73.8% A 0.383s 7413 81.0% A 0.413s 7988 87.3% A 0.443s 8445 92.3% A 0.474s 8783 95.9% A 0.504s 9022 98.6% A 0.534s 9136 99.8% A 0.564s 9153 100.0% B 0.020s 1 0.0% B 0.050s 117 1.3% B 0.081s 388 4.2% B 0.111s 741 8.1% B 0.141s 1219 13.3% B 0.171s 1794 19.6% B 0.202s 2490 27.2% B 0.232s 3293 36.0% B 0.262s 4198 45.9% B 0.293s 5134 56.1% B 0.323s 6015 65.7% B 0.353s 6793 74.2% B 0.383s 7461 81.5% B 0.414s 8017 87.6% B 0.444s 8469 92.5% B 0.474s 8805 96.2% B 0.504s 9028 98.6% B 0.534s 9140 99.8% B 0.565s 9157 100.0% sleeping 3 sec between shutter moves... A 0.020s 9150 100.0% A 0.051s 9044 98.8% A 0.081s 8767 95.8% A 0.111s 8408 91.9% A 0.141s 7942 86.8% A 0.171s 7359 80.4% A 0.202s 6691 73.1% A 0.232s 5894 64.4% A 0.262s 4982 54.4% A 0.292s 4039 44.1% A 0.323s 3165 34.6% A 0.353s 2387 26.1% A 0.383s 1710 18.7% A 0.413s 1147 12.5% A 0.444s 694 7.6% A 0.474s 358 3.9% A 0.504s 125 1.4% A 0.535s 14 0.2% A 0.565s 2 0.0% B 0.020s 9144 99.9% B 0.050s 9012 98.4% B 0.081s 8762 95.7% B 0.111s 8407 91.8% B 0.141s 7934 86.7% B 0.172s 7356 80.4% B 0.202s 6665 72.8% B 0.232s 5866 64.1% B 0.262s 4951 54.1% B 0.292s 4052 44.3% B 0.323s 3162 34.5% B 0.353s 2392 26.1% B 0.383s 1705 18.6% B 0.413s 1147 12.5% B 0.444s 700 7.6% B 0.474s 357 3.9% B 0.504s 132 1.4% B 0.534s 14 0.2% B 0.565s 1 0.0% A -1 -0.0mm 15 N F R | B 1 0.0mm 15 N F R