CHL Preflight Night 61119
Executing preflight for 61119 at Thu Mar 19 18:57:13 -03 2026.
Log can be found in /atlas/obs/04/61119/preflight.dat.
Setting donefile '/atlas/obs/04/61119/preflight_complete.20260319215713.2173' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260319215713.2173.
Thu Mar 19 18:57:13 -03 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Thu Mar 19 18:57:13 -03 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-CHL [d9933a76-243d-45c5-af74-a2aaf26b5350;1800]
Thu Mar 19 18:57:13 -03 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw 3 ON redLED
Thu Mar 19 18:57:14 -03 2026 [elapsed=1 sec] About to start CHL preflight. Point your web browser at http://localhost:7454.
Thu Mar 19 18:57:14 -03 2026 [elapsed=1 sec] auxcam is disabled.
Thu Mar 19 18:57:14 -03 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Thu Mar 19 18:57:14 -03 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response:
FAIL
Thu Mar 19 18:57:14 -03 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Thu Mar 19 18:57:14 -03 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Thu Mar 19 18:57:17 -03 2026 [elapsed=4 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-04a...OK
proc1 prochain-redpost-04x...OK
Thu Mar 19 18:57:18 -03 2026 [elapsed=5 sec] QUEUE
0 observations queued.
Thu Mar 19 18:57:18 -03 2026 [elapsed=5 sec] CLOCKS
admin: Thu Mar 19 21:57:18 UTC 2026
met: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
*metbox2.chl.atl .PPS. 1 u 55 512 377 0.319 0.397 0.094
+10.0.11.4 .GPS. 1 u 349 512 377 0.590 0.496 0.159
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
-185.125.190.57 194.121.207.249 2 u 154 1024 377 223.590 -7.987 1.084
-185.125.190.58 145.238.80.80 2 u 155 1024 277 220.455 -5.556 1.717
+alphyn.canonica 132.163.96.1 2 u 4 512 377 157.362 -1.920 0.677
-185.125.190.56 79.243.60.50 2 u 156 1024 377 225.008 -7.333 0.626
Thu Mar 19 18:57:19 -03 2026 [elapsed=6 sec] DISKS
200GB available in /atlas/obs...OK (4713GB)
200GB available in /atlas/red...OK (8146GB)
Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p1 11T 5.8T 4.5T 56% /
admin:/dev/loop2 105M 105M 0 100% /snap/core/17272
admin:/dev/loop0 106M 106M 0 100% /snap/core/17284
archon:/dev/mapper/ubuntu--vg-ubuntu--lv 58G 20G 35G 37% /
archon:/dev/loop0 106M 106M 0 100% /snap/core/17284
archon:/dev/loop1 105M 105M 0 100% /snap/core/17272
archon:/dev/sda2 974M 321M 586M 36% /boot
archon:/dev/sda1 511M 4.4M 507M 1% /boot/efi
proc1:/dev/md0p1 15T 5.9T 7.8T 44% /
proc1:/dev/sda1 511M 6.7M 505M 2% /boot/efi
proc1:/dev/loop2 105M 105M 0 100% /snap/core/17272
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc2:/dev/md0p1 15T 618G 13T 5% /
proc2:/dev/loop2 105M 105M 0 100% /snap/core/17272
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc3:/dev/md0p1 15T 902G 13T 7% /
proc3:/dev/loop2 105M 105M 0 100% /snap/core/17272
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc4:/dev/md0p1 15T 691G 13T 6% /
proc4:/dev/loop2 105M 105M 0 100% /snap/core/17272
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17284
Thu Mar 19 18:57:19 -03 2026 [elapsed=6 sec] SERVICES1
xcam
chiller...OK
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Preflight failed:
deadman:running heartbeat not detected;
Thu Mar 19 18:57:21 -03 2026 [elapsed=8 sec] Preflight took 8 seconds to complete.
Thu Mar 19 18:57:21 -03 2026 [elapsed=8 sec] STARTING CLEANUP
Turning off LEDs
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL
Preflight image
Shutter acutation data:
A 0.020s 3 0.0% A 0.050s 116 1.3% A 0.081s 373 4.1% A 0.111s 718 7.8% A 0.141s 1182 12.9% A 0.171s 1759 19.2% A 0.202s 2441 26.7% A 0.232s 3238 35.4% A 0.262s 4144 45.3% A 0.292s 5077 55.5% A 0.322s 5963 65.1% A 0.353s 6756 73.8% A 0.383s 7412 81.0% A 0.413s 7991 87.3% A 0.444s 8446 92.3% A 0.474s 8779 95.9% A 0.504s 9023 98.6% A 0.534s 9137 99.8% A 0.565s 9152 100.0% B 0.020s -1 -0.0% B 0.050s 105 1.1% B 0.081s 378 4.1% B 0.111s 714 7.8% B 0.141s 1185 12.9% B 0.171s 1753 19.2% B 0.202s 2441 26.7% B 0.232s 3240 35.4% B 0.262s 4135 45.2% B 0.292s 5074 55.4% B 0.322s 5959 65.1% B 0.352s 6749 73.7% B 0.383s 7418 81.0% B 0.413s 7986 87.2% B 0.443s 8431 92.1% B 0.473s 8778 95.9% B 0.503s 9012 98.4% B 0.534s 9133 99.8% B 0.564s 9156 100.0% sleeping 3 sec between shutter moves... A 0.020s 9155 100.0% A 0.050s 9050 98.9% A 0.081s 8783 95.9% A 0.111s 8430 92.1% A 0.141s 7965 87.0% A 0.171s 7385 80.7% A 0.202s 6694 73.1% A 0.232s 5903 64.5% A 0.262s 4982 54.4% A 0.293s 4045 44.2% A 0.323s 3172 34.7% A 0.353s 2381 26.0% A 0.383s 1714 18.7% A 0.414s 1146 12.5% A 0.444s 692 7.6% A 0.474s 360 3.9% A 0.504s 125 1.4% A 0.535s 15 0.2% A 0.565s 4 0.0% B 0.020s 9144 99.9% B 0.050s 9009 98.4% B 0.081s 8770 95.8% B 0.111s 8420 92.0% B 0.141s 7951 86.9% B 0.171s 7377 80.6% B 0.202s 6687 73.1% B 0.232s 5892 64.4% B 0.262s 4983 54.4% B 0.292s 4052 44.3% B 0.322s 3161 34.5% B 0.353s 2393 26.1% B 0.383s 1704 18.6% B 0.413s 1147 12.5% B 0.443s 700 7.6% B 0.474s 355 3.9% B 0.504s 133 1.5% B 0.534s 13 0.1% B 0.564s 0 0.0% A -1 -0.0mm 15 N F R | B 0 0.0mm 15 N F R