CHL Preflight Night 61105
Executing preflight for 61105 at Thu Mar 5 19:32:12 -03 2026.
Log can be found in /atlas/obs/04/61105/preflight.dat.
Setting donefile '/atlas/obs/04/61105/preflight_complete.20260305223212.9713' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260305223212.9713.
Thu Mar 5 19:32:12 -03 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Thu Mar 5 19:32:12 -03 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-CHL [1e609b56-bbf4-49f2-b4a0-62f0514e18f9;1800]
Thu Mar 5 19:32:13 -03 2026 [elapsed=1 sec] Enabling red LEDs for preflight.
sitepsw 3 ON redLED
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] About to start CHL preflight. Point your web browser at http://localhost:7454.
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] auxcam is disabled.
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] Skipping auxcam.
error: unknown module: vent
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response:
FAIL
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] OPSEC
AUTO mode: ...OK
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Thu Mar 5 19:32:15 -03 2026 [elapsed=3 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-04a...OK
proc1 prochain-redpost-04x...OK
Thu Mar 5 19:32:16 -03 2026 [elapsed=4 sec] QUEUE
0 observations queued.
Thu Mar 5 19:32:16 -03 2026 [elapsed=4 sec] CLOCKS
admin: Thu Mar 5 22:32:16 UTC 2026
met: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
+metbox2.chl.atl .PPS. 1 u 526 1024 377 0.295 -0.244 0.324
*10.0.11.4 .GPS. 1 u 556 1024 377 0.637 -0.189 0.439
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
-185.125.190.57 194.121.207.249 2 u 48 1024 377 222.304 -7.973 1.080
-185.125.190.58 145.238.80.80 2 u 837 1024 377 224.996 -7.774 1.057
+alphyn.canonica 132.163.96.1 2 u 647 1024 377 156.987 -1.762 0.498
-185.125.190.56 194.121.207.249 2 u 134 1024 377 223.431 -8.141 1.231
Thu Mar 5 19:32:17 -03 2026 [elapsed=5 sec] DISKS
200GB available in /atlas/obs...OK (4888GB)
200GB available in /atlas/red...OK (8710GB)
Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p1 11T 5.6T 4.7T 55% /
admin:/dev/loop1 105M 105M 0 100% /snap/core/17247
admin:/dev/loop2 105M 105M 0 100% /snap/core/17272
archon:/dev/mapper/ubuntu--vg-ubuntu--lv 58G 20G 35G 37% /
archon:/dev/loop0 105M 105M 0 100% /snap/core/17247
archon:/dev/loop1 105M 105M 0 100% /snap/core/17272
archon:/dev/sda2 974M 321M 586M 36% /boot
archon:/dev/sda1 511M 4.4M 507M 1% /boot/efi
proc1:/dev/md0p1 15T 5.4T 8.4T 40% /
proc1:/dev/loop0 105M 105M 0 100% /snap/core/17247
proc1:/dev/sda1 511M 6.7M 505M 2% /boot/efi
proc1:/dev/loop2 105M 105M 0 100% /snap/core/17272
proc2:/dev/md0p1 15T 438G 13T 4% /
proc2:/dev/loop0 105M 105M 0 100% /snap/core/17247
proc2:/dev/loop2 105M 105M 0 100% /snap/core/17272
proc3:/dev/md0p1 15T 901G 13T 7% /
proc3:/dev/loop1 105M 105M 0 100% /snap/core/17247
proc3:/dev/loop2 105M 105M 0 100% /snap/core/17272
proc4:/dev/md0p1 15T 691G 13T 6% /
proc4:/dev/loop1 105M 105M 0 100% /snap/core/17247
proc4:/dev/loop2 105M 105M 0 100% /snap/core/17272
Thu Mar 5 19:32:17 -03 2026 [elapsed=5 sec] SERVICES1
xcam
chiller...OK
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Preflight failed:
deadman:running heartbeat not detected;
Thu Mar 5 19:32:18 -03 2026 [elapsed=6 sec] Preflight took 6 seconds to complete.
Thu Mar 5 19:32:18 -03 2026 [elapsed=6 sec] STARTING CLEANUP
Turning off LEDs
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL
Preflight image
Shutter acutation data:
A 0.020s 4 0.0% A 0.050s 117 1.3% A 0.081s 382 4.2% A 0.111s 731 8.0% A 0.141s 1198 13.1% A 0.171s 1780 19.4% A 0.202s 2465 26.9% A 0.232s 3266 35.7% A 0.262s 4174 45.6% A 0.292s 5107 55.8% A 0.322s 5991 65.4% A 0.353s 6779 74.1% A 0.383s 7432 81.2% A 0.413s 8009 87.5% A 0.443s 8458 92.4% A 0.473s 8778 95.9% A 0.504s 9024 98.6% A 0.534s 9139 99.8% A 0.564s 9151 100.0% B 0.020s 2 0.0% B 0.050s 116 1.3% B 0.081s 380 4.2% B 0.111s 730 8.0% B 0.141s 1202 13.1% B 0.172s 1775 19.4% B 0.202s 2469 27.0% B 0.232s 3267 35.7% B 0.262s 4168 45.5% B 0.293s 5104 55.8% B 0.323s 5990 65.4% B 0.353s 6773 74.0% B 0.383s 7439 81.3% B 0.414s 8002 87.4% B 0.444s 8456 92.4% B 0.474s 8796 96.1% B 0.504s 9023 98.6% B 0.534s 9139 99.8% B 0.565s 9155 100.0% sleeping 3 sec between shutter moves... A 0.020s 9149 99.9% A 0.050s 9044 98.8% A 0.081s 8774 95.8% A 0.111s 8422 92.0% A 0.141s 7958 86.9% A 0.171s 7377 80.6% A 0.202s 6686 73.0% A 0.232s 5924 64.7% A 0.262s 5007 54.7% A 0.292s 4036 44.1% A 0.323s 3165 34.6% A 0.353s 2380 26.0% A 0.383s 1715 18.7% A 0.414s 1143 12.5% A 0.444s 692 7.6% A 0.474s 359 3.9% A 0.504s 123 1.3% A 0.535s 14 0.2% A 0.565s 3 0.0% B 0.020s 9144 99.9% B 0.050s 9018 98.5% B 0.081s 8771 95.8% B 0.111s 8423 92.0% B 0.141s 7953 86.9% B 0.171s 7381 80.6% B 0.202s 6690 73.1% B 0.232s 5894 64.4% B 0.262s 4981 54.4% B 0.292s 4054 44.3% B 0.323s 3165 34.6% B 0.353s 2393 26.1% B 0.383s 1702 18.6% B 0.413s 1147 12.5% B 0.444s 711 7.8% B 0.474s 366 4.0% B 0.504s 137 1.5% B 0.534s 16 0.2% B 0.565s 1 0.0% A -1 -0.0mm 15 N F R | B 0 0.0mm 15 N F R