CHL Preflight Night 61146

Executing preflight for 61146 at Wed Apr 15 17:25:14 -04 2026.
Log can be found in /atlas/obs/04/61146/preflight.dat.
Setting donefile '/atlas/obs/04/61146/preflight_complete.20260415212514.11519' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260415212514.11519.
Wed Apr 15 17:25:14 -04 2026 [elapsed=0 sec] DFM (initialization)
  get service string...OK
  service is running...OK
  is initialized...OK

Wed Apr 15 17:25:14 -04 2026 [elapsed=0 sec] Getting TCS lock.

OK TCS lock granted to preflight-CHL [f40b604b-9427-4ad4-a2fd-3ea21a886de0;1800]
Wed Apr 15 17:25:14 -04 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw  3  ON redLED
Wed Apr 15 17:25:15 -04 2026 [elapsed=1 sec] About to start CHL preflight.  Point your web browser at http://localhost:7454.
Wed Apr 15 17:25:15 -04 2026 [elapsed=1 sec]   auxcam is disabled.
Wed Apr 15 17:25:15 -04 2026 [elapsed=1 sec]   Skipping auxcam.
error: unknown module: vent
Wed Apr 15 17:25:15 -04 2026 [elapsed=1 sec] DEADMAN
  Get heartbeat host ... got 'tcs'
  Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1776288305
OK
Wed Apr 15 17:25:15 -04 2026 [elapsed=1 sec] OPSEC
  AUTO mode:  ...OK
Wed Apr 15 17:25:15 -04 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
  admin proc1:/export/atlas-cal...OK
  admin proc1:/export/atlas-red...OK
  proc1 admin:/export/atlas-obs...OK
  proc2 admin:/export/atlas-obs...OK
  proc2 proc1:/export/atlas-cal...OK
  proc2 proc1:/export/atlas-red...OK
  proc3 admin:/export/atlas-obs...OK
  proc3 proc1:/export/atlas-cal...OK
  proc3 proc1:/export/atlas-red...OK
  proc4 admin:/export/atlas-obs...OK
  proc4 proc1:/export/atlas-cal...OK
  proc4 proc1:/export/atlas-red...OK

Wed Apr 15 17:25:19 -04 2026 [elapsed=5 sec] SCREENS
  admin dash-tcsdata...OK
  admin dash-recent...OK
  admin dash-skycoverage...OK
  admin dash-logstamp...OK
  proc1 redq...OK
  proc1 prochain-redpost-04a...OK
  proc1 prochain-redpost-04x...OK

Wed Apr 15 17:25:19 -04 2026 [elapsed=5 sec] QUEUE
  0 observations queued.

Wed Apr 15 17:25:19 -04 2026 [elapsed=5 sec] CLOCKS
  admin:      Wed Apr 15 21:25:19 UTC 2026
  met:        OK
  proc1:      OK
  proc2:      NOK (delta=3 sec)
  proc3:      OK
  proc4:      OK
  archon:     OK

  NTP:
       remote           refid      st t when poll reach   delay   offset  jitter
  ==============================================================================
  +metbox2.chl.atl .PPS.            1 u  120  256  377    0.213    0.860   0.058
  *10.0.11.4       .GPS.            1 u  214  256  377    0.515    0.906   0.085
   ntp.ubuntu.com  .POOL.          16 p    -   64    0    0.000    0.000   0.000
  -185.125.190.57  99.220.8.133     2 u  123  512  377  215.453   -3.941   1.340
  -185.125.190.58  99.220.8.133     2 u   16  256  377  212.453   -0.943   0.629
  +alphyn.canonica 132.163.96.1     2 u  163  256  377  142.623   -1.012   2.004
  -185.125.190.56  146.131.121.246  2 u  412  512  377  217.031   -3.688   1.917

Wed Apr 15 17:25:22 -04 2026 [elapsed=8 sec] DISKS
  200GB available in /atlas/obs...OK (3990GB)
  200GB available in /atlas/red...OK (7661GB)

  Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done

  Filesystem                                Size  Used  Avail  Use%  Mounted_on
  admin:/dev/md0p1                          11T   6.4T  3.9T   63%   /
  admin:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  admin:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  archon:/dev/mapper/ubuntu--vg-ubuntu--lv  58G   20G   35G    37%   /
  archon:/dev/loop0                         106M  106M  0      100%  /snap/core/17284
  archon:/dev/loop1                         105M  105M  0      100%  /snap/core/17272
  archon:/dev/sda2                          974M  321M  586M   36%   /boot
  archon:/dev/sda1                          511M  4.4M  507M   1%    /boot/efi
  proc1:/dev/md0p1                          15T   6.4T  7.4T   47%   /
  proc1:/dev/sda1                           511M  6.7M  505M   2%    /boot/efi
  proc1:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc1:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  proc2:/dev/md0p1                          15T   648G  13T    5%    /
  proc2:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc2:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  proc3:/dev/md0p1                          15T   903G  13T    7%    /
  proc3:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc3:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  proc4:/dev/md0p1                          15T   692G  13T    6%    /
  proc4:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc4:/dev/loop0                          106M  106M  0      100%  /snap/core/17284

Wed Apr 15 17:25:23 -04 2026 [elapsed=9 sec] SERVICES1
xcam
  chiller...OK
  dome...OK
  mount...OK
  modo...OK
  cam...OK
  acam...OK
  weather...OK
  met...OK
  sentry...OK
  dfm...OK
  duplicates...OK

sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Preflight failed:
proc2: clock differs by 3 seconds;

Wed Apr 15 17:25:24 -04 2026 [elapsed=10 sec] Preflight took 10 seconds to complete.


Wed Apr 15 17:25:24 -04 2026 [elapsed=10 sec] STARTING CLEANUP
Turning off LEDs
sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL

  
Azimuth check

Preflight image

Dome audio


Shutter audio

Shutter acutation data:

A  0.020s     4   0.0%
A  0.051s   122   1.3%
A  0.082s   405   4.4%
A  0.112s   762   8.3%
A  0.143s  1231  13.4%
A  0.173s  1843  20.1%
A  0.203s  2538  27.7%
A  0.234s  3350  36.6%
A  0.264s  4265  46.6%
A  0.295s  5191  56.7%
A  0.325s  6078  66.4%
A  0.356s  6843  74.8%
A  0.386s  7513  82.1%
A  0.417s  8071  88.2%
A  0.447s  8507  92.9%
A  0.478s  8828  96.4%
A  0.508s  9049  98.9%
A  0.538s  9146  99.9%
B  0.020s     2   0.0%
B  0.051s   110   1.2%
B  0.081s   387   4.2%
B  0.111s   741   8.1%
B  0.142s  1219  13.3%
B  0.172s  1796  19.6%
B  0.203s  2492  27.2%
B  0.233s  3322  36.3%
B  0.264s  4229  46.2%
B  0.294s  5161  56.4%
B  0.324s  6044  66.0%
B  0.355s  6818  74.5%
B  0.386s  7480  81.7%
B  0.416s  8050  87.9%
B  0.447s  8493  92.8%
B  0.477s  8822  96.4%
B  0.508s  9039  98.7%
B  0.538s  9144  99.9%
B  0.569s  9156 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9152 100.0%
A  0.051s  9050  98.9%
A  0.081s  8777  95.9%
A  0.112s  8408  91.9%
A  0.142s  7941  86.7%
A  0.173s  7359  80.4%
A  0.203s  6668  72.8%
A  0.234s  5839  63.8%
A  0.264s  4920  53.7%
A  0.295s  3979  43.5%
A  0.325s  3111  34.0%
A  0.355s  2340  25.6%
A  0.386s  1670  18.2%
A  0.416s  1114  12.2%
A  0.446s   669   7.3%
A  0.477s   339   3.7%
A  0.507s   114   1.2%
A  0.538s    10   0.1%
A  0.568s     2   0.0%
B  0.020s  9145  99.9%
B  0.051s  9018  98.5%
B  0.081s  8772  95.8%
B  0.111s  8420  92.0%
B  0.142s  7951  86.9%
B  0.172s  7378  80.6%
B  0.203s  6690  73.1%
B  0.233s  5865  64.1%
B  0.264s  4950  54.1%
B  0.294s  4022  43.9%
B  0.324s  3137  34.3%
B  0.355s  2370  25.9%
B  0.385s  1683  18.4%
B  0.415s  1131  12.4%
B  0.445s   687   7.5%
B  0.476s   347   3.8%
B  0.506s   127   1.4%
B  0.536s    12   0.1%
B  0.566s     1   0.0%
A     0  0.0mm   15 N F R | B     1  0.0mm   15 N F R