CHL Preflight Night 61105

Executing preflight for 61105 at Thu Mar  5 19:32:12 -03 2026.
Log can be found in /atlas/obs/04/61105/preflight.dat.
Setting donefile '/atlas/obs/04/61105/preflight_complete.20260305223212.9713' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260305223212.9713.
Thu Mar 5 19:32:12 -03 2026 [elapsed=0 sec] DFM (initialization)
  get service string...OK
  service is running...OK
  is initialized...OK

Thu Mar 5 19:32:12 -03 2026 [elapsed=0 sec] Getting TCS lock.

OK TCS lock granted to preflight-CHL [1e609b56-bbf4-49f2-b4a0-62f0514e18f9;1800]
Thu Mar 5 19:32:13 -03 2026 [elapsed=1 sec] Enabling red LEDs for preflight.
sitepsw  3  ON redLED
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] About to start CHL preflight.  Point your web browser at http://localhost:7454.
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec]   auxcam is disabled.
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec]   Skipping auxcam.
error: unknown module: vent
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] DEADMAN
  Get heartbeat host ... got 'tcs'
  Fetching timestamp (redis-cli -h tcs) ... done. Got response: 
FAIL
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] OPSEC
  AUTO mode:  ...OK
Thu Mar 5 19:32:14 -03 2026 [elapsed=2 sec] CLUSTER NFS MOUNTS
  admin proc1:/export/atlas-cal...OK
  admin proc1:/export/atlas-red...OK
  proc1 admin:/export/atlas-obs...OK
  proc2 admin:/export/atlas-obs...OK
  proc2 proc1:/export/atlas-cal...OK
  proc2 proc1:/export/atlas-red...OK
  proc3 admin:/export/atlas-obs...OK
  proc3 proc1:/export/atlas-cal...OK
  proc3 proc1:/export/atlas-red...OK
  proc4 admin:/export/atlas-obs...OK
  proc4 proc1:/export/atlas-cal...OK
  proc4 proc1:/export/atlas-red...OK

Thu Mar 5 19:32:15 -03 2026 [elapsed=3 sec] SCREENS
  admin dash-tcsdata...OK
  admin dash-recent...OK
  admin dash-skycoverage...OK
  admin dash-logstamp...OK
  proc1 redq...OK
  proc1 prochain-redpost-04a...OK
  proc1 prochain-redpost-04x...OK

Thu Mar 5 19:32:16 -03 2026 [elapsed=4 sec] QUEUE
  0 observations queued.

Thu Mar 5 19:32:16 -03 2026 [elapsed=4 sec] CLOCKS
  admin:      Thu Mar  5 22:32:16 UTC 2026
  met:        OK
  proc1:      OK
  proc2:      OK
  proc3:      OK
  proc4:      OK
  archon:     OK

  NTP:
       remote           refid      st t when poll reach   delay   offset  jitter
  ==============================================================================
  +metbox2.chl.atl .PPS.            1 u  526 1024  377    0.295   -0.244   0.324
  *10.0.11.4       .GPS.            1 u  556 1024  377    0.637   -0.189   0.439
   ntp.ubuntu.com  .POOL.          16 p    -   64    0    0.000    0.000   0.000
  -185.125.190.57  194.121.207.249  2 u   48 1024  377  222.304   -7.973   1.080
  -185.125.190.58  145.238.80.80    2 u  837 1024  377  224.996   -7.774   1.057
  +alphyn.canonica 132.163.96.1     2 u  647 1024  377  156.987   -1.762   0.498
  -185.125.190.56  194.121.207.249  2 u  134 1024  377  223.431   -8.141   1.231

Thu Mar 5 19:32:17 -03 2026 [elapsed=5 sec] DISKS
  200GB available in /atlas/obs...OK (4888GB)
  200GB available in /atlas/red...OK (8710GB)

  Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done

  Filesystem                                Size  Used  Avail  Use%  Mounted_on
  admin:/dev/md0p1                          11T   5.6T  4.7T   55%   /
  admin:/dev/loop1                          105M  105M  0      100%  /snap/core/17247
  admin:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  archon:/dev/mapper/ubuntu--vg-ubuntu--lv  58G   20G   35G    37%   /
  archon:/dev/loop0                         105M  105M  0      100%  /snap/core/17247
  archon:/dev/loop1                         105M  105M  0      100%  /snap/core/17272
  archon:/dev/sda2                          974M  321M  586M   36%   /boot
  archon:/dev/sda1                          511M  4.4M  507M   1%    /boot/efi
  proc1:/dev/md0p1                          15T   5.4T  8.4T   40%   /
  proc1:/dev/loop0                          105M  105M  0      100%  /snap/core/17247
  proc1:/dev/sda1                           511M  6.7M  505M   2%    /boot/efi
  proc1:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc2:/dev/md0p1                          15T   438G  13T    4%    /
  proc2:/dev/loop0                          105M  105M  0      100%  /snap/core/17247
  proc2:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc3:/dev/md0p1                          15T   901G  13T    7%    /
  proc3:/dev/loop1                          105M  105M  0      100%  /snap/core/17247
  proc3:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc4:/dev/md0p1                          15T   691G  13T    6%    /
  proc4:/dev/loop1                          105M  105M  0      100%  /snap/core/17247
  proc4:/dev/loop2                          105M  105M  0      100%  /snap/core/17272

Thu Mar 5 19:32:17 -03 2026 [elapsed=5 sec] SERVICES1
xcam
  chiller...OK
  dome...OK
  mount...OK
  modo...OK
  cam...OK
  acam...OK
  weather...OK
  met...OK
  sentry...OK
  dfm...OK
  duplicates...OK

sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Preflight failed:
deadman:running heartbeat not detected;

Thu Mar 5 19:32:18 -03 2026 [elapsed=6 sec] Preflight took 6 seconds to complete.


Thu Mar 5 19:32:18 -03 2026 [elapsed=6 sec] STARTING CLEANUP
Turning off LEDs
sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL

  
Azimuth check

Preflight image

Dome audio


Shutter audio

Shutter acutation data:

A  0.020s     4   0.0%
A  0.050s   117   1.3%
A  0.081s   382   4.2%
A  0.111s   731   8.0%
A  0.141s  1198  13.1%
A  0.171s  1780  19.4%
A  0.202s  2465  26.9%
A  0.232s  3266  35.7%
A  0.262s  4174  45.6%
A  0.292s  5107  55.8%
A  0.322s  5991  65.4%
A  0.353s  6779  74.1%
A  0.383s  7432  81.2%
A  0.413s  8009  87.5%
A  0.443s  8458  92.4%
A  0.473s  8778  95.9%
A  0.504s  9024  98.6%
A  0.534s  9139  99.8%
A  0.564s  9151 100.0%
B  0.020s     2   0.0%
B  0.050s   116   1.3%
B  0.081s   380   4.2%
B  0.111s   730   8.0%
B  0.141s  1202  13.1%
B  0.172s  1775  19.4%
B  0.202s  2469  27.0%
B  0.232s  3267  35.7%
B  0.262s  4168  45.5%
B  0.293s  5104  55.8%
B  0.323s  5990  65.4%
B  0.353s  6773  74.0%
B  0.383s  7439  81.3%
B  0.414s  8002  87.4%
B  0.444s  8456  92.4%
B  0.474s  8796  96.1%
B  0.504s  9023  98.6%
B  0.534s  9139  99.8%
B  0.565s  9155 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9149  99.9%
A  0.050s  9044  98.8%
A  0.081s  8774  95.8%
A  0.111s  8422  92.0%
A  0.141s  7958  86.9%
A  0.171s  7377  80.6%
A  0.202s  6686  73.0%
A  0.232s  5924  64.7%
A  0.262s  5007  54.7%
A  0.292s  4036  44.1%
A  0.323s  3165  34.6%
A  0.353s  2380  26.0%
A  0.383s  1715  18.7%
A  0.414s  1143  12.5%
A  0.444s   692   7.6%
A  0.474s   359   3.9%
A  0.504s   123   1.3%
A  0.535s    14   0.2%
A  0.565s     3   0.0%
B  0.020s  9144  99.9%
B  0.050s  9018  98.5%
B  0.081s  8771  95.8%
B  0.111s  8423  92.0%
B  0.141s  7953  86.9%
B  0.171s  7381  80.6%
B  0.202s  6690  73.1%
B  0.232s  5894  64.4%
B  0.262s  4981  54.4%
B  0.292s  4054  44.3%
B  0.323s  3165  34.6%
B  0.353s  2393  26.1%
B  0.383s  1702  18.6%
B  0.413s  1147  12.5%
B  0.444s   711   7.8%
B  0.474s   366   4.0%
B  0.504s   137   1.5%
B  0.534s    16   0.2%
B  0.565s     1   0.0%
A    -1 -0.0mm   15 N F R | B     0  0.0mm   15 N F R