CHL Preflight Night 61203

Executing preflight for 61203 at Thu Jun 11 16:51:22 -04 2026.
Log can be found in /atlas/obs/04/61203/preflight.dat.
Setting donefile '/atlas/obs/04/61203/preflight_complete.20260611205122.19784' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260611205122.19784.
Thu Jun 11 16:51:22 -04 2026 [elapsed=0 sec] DFM (initialization)
  get service string...OK
  service is running...OK
  is initialized...OK

Thu Jun 11 16:51:22 -04 2026 [elapsed=0 sec] Getting TCS lock.

OK TCS lock granted to preflight-CHL [729b4ab2-3076-4b14-baa9-a6e5f2d15695;1800]
Thu Jun 11 16:51:22 -04 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw  3  ON redLED
Thu Jun 11 16:51:23 -04 2026 [elapsed=1 sec] About to start CHL preflight.  Point your web browser at http://localhost:7454.
Thu Jun 11 16:51:23 -04 2026 [elapsed=1 sec]   auxcam is disabled.
Thu Jun 11 16:51:23 -04 2026 [elapsed=1 sec]   Skipping auxcam.
error: unknown module: vent
Thu Jun 11 16:51:23 -04 2026 [elapsed=1 sec] DEADMAN
  Get heartbeat host ... got 'tcs'
  Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1781211074
OK
Thu Jun 11 16:51:23 -04 2026 [elapsed=1 sec] OPSEC
  AUTO mode:  ...OK
Thu Jun 11 16:51:23 -04 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
  admin proc1:/export/atlas-cal...OK
  admin proc1:/export/atlas-red...OK
  proc1 admin:/export/atlas-obs...OK
  proc2 admin:/export/atlas-obs...OK
  proc2 proc1:/export/atlas-cal...OK
  proc2 proc1:/export/atlas-red...OK
  proc3 admin:/export/atlas-obs...OK
  proc3 proc1:/export/atlas-cal...OK
  proc3 proc1:/export/atlas-red...OK
  proc4 admin:/export/atlas-obs...OK
  proc4 proc1:/export/atlas-cal...OK
  proc4 proc1:/export/atlas-red...OK

Thu Jun 11 16:51:26 -04 2026 [elapsed=4 sec] SCREENS
  admin dash-tcsdata...OK
  admin dash-recent...OK
  admin dash-skycoverage...OK
  admin dash-logstamp...OK
  proc1 redq...OK
  proc1 prochain-redpost-04a...OK
  proc1 prochain-redpost-04x...OK

Thu Jun 11 16:51:27 -04 2026 [elapsed=5 sec] QUEUE
  0 observations queued.

Thu Jun 11 16:51:27 -04 2026 [elapsed=5 sec] CLOCKS
  admin:      Thu Jun 11 20:51:27 UTC 2026
  met:        OK
  proc1:      OK
  proc2:      NOK (delta=6 sec)
  proc3:      OK
  proc4:      OK
  archon:     OK

  NTP:
       remote           refid      st t when poll reach   delay   offset  jitter
  ==============================================================================
  +metbox2.chl.atl .PPS.            1 u  427 1024  377    0.312   -0.036   0.092
  *10.0.11.4       .GPS.            1 u  480 1024  377    0.562    0.070   0.068
   ntp.ubuntu.com  .POOL.          16 p    -   64    0    0.000    0.000   0.000
  -185.125.190.56  99.220.8.133     2 u  511 1024  377  217.848   -3.859   1.374
  -185.125.190.58  146.131.121.246  2 u  480 1024  377  217.230   -3.937   0.841
  +alphyn.canonica 132.163.96.1     2 u  908 1024  377  145.948   -4.080   2.321
  -185.125.190.57  99.220.8.133     2 u  679 1024  377  216.567   -3.950   1.517

Thu Jun 11 16:51:33 -04 2026 [elapsed=11 sec] DISKS
  200GB available in /atlas/obs...OK (4026GB)
  200GB available in /atlas/red...OK (8160GB)

  Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done

  Filesystem                                Size  Used  Avail  Use%  Mounted_on
  admin:/dev/md0p1                          11T   6.4T  3.9T   63%   /
  admin:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  admin:/dev/loop1                          106M  106M  0      100%  /snap/core/17292
  archon:/dev/mapper/ubuntu--vg-ubuntu--lv  58G   18G   38G    32%   /
  archon:/dev/loop0                         106M  106M  0      100%  /snap/core/17292
  archon:/dev/loop1                         106M  106M  0      100%  /snap/core/17284
  archon:/dev/sda2                          974M  321M  586M   36%   /boot
  archon:/dev/sda1                          511M  4.4M  507M   1%    /boot/efi
  proc1:/dev/md0p1                          15T   5.9T  7.8T   43%   /
  proc1:/dev/loop0                          106M  106M  0      100%  /snap/core/17292
  proc1:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  proc1:/dev/sda1                           511M  6.7M  505M   2%    /boot/efi
  proc2:/dev/md0p1                          15T   572G  13T    5%    /
  proc2:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  proc2:/dev/loop1                          106M  106M  0      100%  /snap/core/17292
  proc3:/dev/md0p1                          15T   903G  13T    7%    /
  proc3:/dev/loop0                          106M  106M  0      100%  /snap/core/17292
  proc3:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  proc4:/dev/md0p1                          15T   696G  13T    6%    /
  proc4:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  proc4:/dev/loop1                          106M  106M  0      100%  /snap/core/17292

Thu Jun 11 16:51:33 -04 2026 [elapsed=11 sec] SERVICES1
xcam
  chiller...OK
  dome...OK
  mount...OK
  modo...OK
  cam...OK
  acam...OK
  weather...OK
  met...OK
  sentry...OK
  dfm...OK
  duplicates...OK

sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Preflight failed:
proc2: clock differs by 6 seconds;

Thu Jun 11 16:51:35 -04 2026 [elapsed=13 sec] Preflight took 13 seconds to complete.


Thu Jun 11 16:51:35 -04 2026 [elapsed=13 sec] STARTING CLEANUP
Turning off LEDs
sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL

  
Azimuth check

Preflight image

Dome audio


Shutter audio

Shutter acutation data:

A  0.020s     3   0.0%
A  0.050s   115   1.3%
A  0.081s   386   4.2%
A  0.111s   736   8.0%
A  0.141s  1196  13.1%
A  0.171s  1783  19.5%
A  0.202s  2466  26.9%
A  0.232s  3266  35.7%
A  0.262s  4174  45.6%
A  0.292s  5104  55.8%
A  0.322s  5997  65.5%
A  0.353s  6775  74.0%
A  0.383s  7413  81.0%
A  0.413s  7990  87.3%
A  0.443s  8445  92.3%
A  0.473s  8783  95.9%
A  0.504s  9021  98.5%
A  0.534s  9136  99.8%
A  0.564s  9153 100.0%
B  0.020s    -1  -0.0%
B  0.050s   105   1.1%
B  0.081s   369   4.0%
B  0.111s   713   7.8%
B  0.141s  1186  13.0%
B  0.171s  1752  19.1%
B  0.201s  2442  26.7%
B  0.232s  3238  35.4%
B  0.262s  4136  45.2%
B  0.292s  5074  55.4%
B  0.322s  5960  65.1%
B  0.353s  6747  73.7%
B  0.383s  7419  81.0%
B  0.413s  7986  87.2%
B  0.443s  8444  92.2%
B  0.474s  8787  96.0%
B  0.504s  9012  98.4%
B  0.534s  9135  99.8%
B  0.564s  9156 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9151 100.0%
A  0.050s  9043  98.8%
A  0.081s  8767  95.8%
A  0.111s  8420  92.0%
A  0.141s  7958  86.9%
A  0.171s  7381  80.6%
A  0.202s  6692  73.1%
A  0.232s  5895  64.4%
A  0.262s  4981  54.4%
A  0.292s  4039  44.1%
A  0.323s  3165  34.6%
A  0.353s  2386  26.1%
A  0.383s  1711  18.7%
A  0.413s  1147  12.5%
A  0.443s   694   7.6%
A  0.474s   357   3.9%
A  0.504s   126   1.4%
A  0.534s    14   0.2%
A  0.564s     1   0.0%
B  0.020s  9143  99.9%
B  0.050s  9018  98.5%
B  0.081s  8770  95.8%
B  0.111s  8420  92.0%
B  0.141s  7951  86.9%
B  0.171s  7376  80.6%
B  0.202s  6689  73.1%
B  0.232s  5892  64.4%
B  0.262s  4981  54.4%
B  0.292s  4052  44.3%
B  0.323s  3162  34.5%
B  0.353s  2392  26.1%
B  0.383s  1704  18.6%
B  0.413s  1146  12.5%
B  0.444s   713   7.8%
B  0.474s   364   4.0%
B  0.504s   137   1.5%
B  0.534s    15   0.2%
B  0.564s     0   0.0%
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R