CHL Preflight Night 61289

Executing preflight for 61289 at Sat Sep  5 21:50:04 -04 2026.
Log can be found in /atlas/obs/04/61289/preflight.dat.
Setting donefile '/atlas/obs/04/61289/preflight_complete.20260906015004.23889' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260906015004.23889.
Sat Sep 5 21:50:04 -04 2026 [elapsed=0 sec] DFM (initialization)
  get service string...OK
  service is running...OK
  is initialized...OK

Sat Sep 5 21:50:04 -04 2026 [elapsed=0 sec] Getting TCS lock.

OK TCS lock granted to preflight-CHL [2eaf3a34-0148-4432-9264-deb916ff37ef;1800]
Sat Sep 5 21:50:04 -04 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw  3  ON redLED
Sat Sep 5 21:50:05 -04 2026 [elapsed=1 sec] About to start CHL preflight.  Point your web browser at http://localhost:7454.
Sat Sep 5 21:50:05 -04 2026 [elapsed=1 sec]   auxcam is disabled.
Sat Sep 5 21:50:05 -04 2026 [elapsed=1 sec]   Skipping auxcam.
error: unknown module: vent
Sat Sep 5 21:50:05 -04 2026 [elapsed=1 sec] DEADMAN
  Get heartbeat host ... got 'tcs'
  Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1788659402
OK
Sat Sep 5 21:50:05 -04 2026 [elapsed=1 sec] OPSEC
  AUTO mode:  ...OK
Sat Sep 5 21:50:05 -04 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
  admin proc1:/export/atlas-cal...OK
  admin proc1:/export/atlas-red...OK
  proc1 admin:/export/atlas-obs...OK
  proc2 admin:/export/atlas-obs...OK
  proc2 proc1:/export/atlas-cal...OK
  proc2 proc1:/export/atlas-red...OK
  proc3 admin:/export/atlas-obs...OK
  proc3 proc1:/export/atlas-cal...OK
  proc3 proc1:/export/atlas-red...OK
  proc4 admin:/export/atlas-obs...OK
  proc4 proc1:/export/atlas-cal...OK
  proc4 proc1:/export/atlas-red...OK

Sat Sep 5 21:50:07 -04 2026 [elapsed=3 sec] SCREENS
  admin dash-tcsdata...OK
  admin dash-recent...OK
  admin dash-skycoverage...OK
  admin dash-logstamp...OK
  proc1 redq...OK
  proc1 prochain-redpost-04a...OK
  proc1 prochain-redpost-04x...OK

Sat Sep 5 21:50:07 -04 2026 [elapsed=3 sec] QUEUE
  0 observations queued.

Sat Sep 5 21:50:07 -04 2026 [elapsed=3 sec] CLOCKS
  admin:      Sun Sep  6 01:50:07 UTC 2026
  metbox:     OK
  proc1:      OK
  proc2:      OK
  proc3:      OK
  proc4:      OK
  archon:     OK

  NTP:
       remote           refid      st t when poll reach   delay   offset  jitter
  ==============================================================================
  *metbox2.chl.atl .PPS.            1 u  867 1024  377    0.230    0.488   0.122
  +10.0.11.4       .GPS.            1 u 1007 1024  377    0.489    0.552   0.118
   ntp.ubuntu.com  .POOL.          16 p    -   64    0    0.000    0.000   0.000
  +alphyn.canonica 132.163.96.1     2 u   49 1024  373  159.270    0.361   1.457
  -185.125.190.57  29.88.99.4       2 u  766 1024  377  223.408   -8.530   3.452
  -185.125.190.56  29.88.99.4       2 u  725 1024  377  226.211   -9.293   0.702
  -185.125.190.58  29.88.99.4       2 u  785 1024  377  234.404  -13.497   1.155

Sat Sep 5 21:50:08 -04 2026 [elapsed=4 sec] DISKS
  200GB available in /atlas/obs...OK (9829GB)
  200GB available in /atlas/red...OK (13648GB)

  Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done

  Filesystem                                Size  Used  Avail  Use%  Mounted_on
  admin:/dev/md0p1                          11T   849G  9.4T   9%    /
  admin:/dev/loop0                          106M  106M  0      100%  /snap/core/17292
  admin:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  archon:/dev/mapper/ubuntu--vg-ubuntu--lv  58G   18G   38G    32%   /
  archon:/dev/loop0                         106M  106M  0      100%  /snap/core/17292
  archon:/dev/loop1                         106M  106M  0      100%  /snap/core/17284
  archon:/dev/sda2                          974M  321M  586M   36%   /boot
  archon:/dev/sda1                          511M  4.4M  507M   1%    /boot/efi
  proc1:/dev/md0p1                          15T   645G  14T    5%    /
  proc1:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  proc1:/dev/loop1                          106M  106M  0      100%  /snap/core/17292
  proc1:/dev/sda1                           511M  6.7M  505M   2%    /boot/efi
  proc2:/dev/md0p1                          15T   452G  13T    4%    /
  proc2:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  proc2:/dev/loop1                          106M  106M  0      100%  /snap/core/17292
  proc3:/dev/md0p1                          15T   903G  13T    7%    /
  proc3:/dev/loop0                          106M  106M  0      100%  /snap/core/17292
  proc3:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  proc4:/dev/md0p1                          15T   696G  13T    6%    /
  proc4:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  proc4:/dev/loop1                          106M  106M  0      100%  /snap/core/17292

Sat Sep 5 21:50:08 -04 2026 [elapsed=4 sec] SERVICES1
xcam
  chiller...OK
  dome...OK
  mount...OK
  modo...OK
  cam...OK
  acam...OK
  weather...OK
  met...OK
  sentry...OK
  dfm...OK
  duplicates...OK

Sat Sep 5 21:50:08 -04 2026 [elapsed=4 sec] Disabling mount tracking.
Sat Sep 5 21:50:08 -04 2026 [elapsed=4 sec] SERVICES2

Sat Sep 5 21:50:08 -04 2026 [elapsed=4 sec] CHILLER
  status...OK
  chiller: 3.0/3.0C ? chiller=ON dryer=? IDLE


Sat Sep 5 21:50:12 -04 2026 [elapsed=8 sec] DOME
  status...OK
  audio setup: using amcam-mezz-s to record
  Pointing webcam to azcheck position ... done
  Homing the dome ... waiting ... done
  Attempting audio conversion ... size=     912kB time=00:00:29.18 bitrate= 256.0kbits/s speed=1.54e+03x    
audio converted to domehome.wav.
  Copy dome audio to dashboards ... done
  slewing to azimuth 0 (N)...OK
  Copy azcheck JPEG to dashboards ... done
  parking...OK
  dome: AZ=35.00 CLOSED/CLOSED (0%) IDLE


Sat Sep 5 21:53:01 -04 2026 [elapsed=177 sec] MOUNT
  blinky  status...OK
  motor logs...OK
  slewing to az=70,alt=70...OK
  slewing to az=290,alt=70...OK
  parking...OK
  mount: 300.54 -27.58, az/alt=324.64 +86.48 idle(e) IDLE


Sat Sep 5 21:53:41 -04 2026 [elapsed=217 sec] MODO
  status...OK
  slewing to az=60,alt=60...OK
  modo: dome=stopped mount=tracking IDLE


Sat Sep 5 21:54:03 -04 2026 [elapsed=239 sec] CAM SERVICE
  status...OK
  cam: main=[idle] aux=[off] N=0/0 spi=38.6 IDLE

Sat Sep 5 21:54:03 -04 2026 [elapsed=239 sec] ACAM
  status  Camera tripped exists... OK
  Camera tripped is current... OK (9 seconds old)
  Software failsafe ready... OK (NA)
  CCD on...OK
  ION pump on...OK
  CCD temp...OK (-56.4C)
  Checking CCD plane: Z0=-192.00  DZDX=+458.00  DZDY=-420.00 
  acam: -56C CCD TEC ION e=30.0s d=0.6s N=0 IDLE

Sat Sep 5 21:54:03 -04 2026 [elapsed=239 sec] WEATHER
  status  weather: clear 15.2C 35% 2/2kph@110 DP14.9C/-17C/d IDLE
...OK

Sat Sep 5 21:54:04 -04 2026 [elapsed=240 sec] MET
  status...OK
  met: c=N o=Y Ro1d Co1d Wo1d Ho1d To1d Do1d  IDLE

Sat Sep 5 21:54:04 -04 2026 [elapsed=240 sec] SENTRY
  status...OK
  sentry: close=NO open=YES drop=YES IDLE

Sat Sep 5 21:54:04 -04 2026 [elapsed=240 sec] DFM (SHUTTERS)
  initializing and homing shutters...
mount          329.22 -12.93, az/alt=59.88 +60.07 tracking(w)      IDLE      1s
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
initialized motor A constants
initialized motor B constants
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
A  0.020s     3   0.0%
B  0.020s    -1   0.0%
A     2  0.1mm   15 N F R | B    -2 -0.1mm   15 N F R
finding forward (close) limit for shutter A
...done
backing off limit
....................backing off 4 sec...
at limit
done
finding forward (close) limit for shutter B
...done
backing off limit
................backing off 4 sec...
at limit
done
A     0  0.0mm   15 N F R | B    -1 -0.0mm   15 N F R
  exercising shutters...Using amcam-mezz-s to record
A  0.020s     8   0.1%
A  0.051s   108   1.2%
A  0.081s   386   4.2%
A  0.111s   731   8.0%
A  0.141s  1207  13.2%
A  0.172s  1774  19.4%
A  0.202s  2464  26.9%
A  0.232s  3252  35.5%
A  0.263s  4160  45.4%
A  0.293s  5115  55.9%
A  0.323s  5984  65.4%
A  0.353s  6780  74.1%
A  0.384s  7432  81.2%
A  0.414s  8010  87.5%
A  0.444s  8459  92.4%
A  0.475s  8797  96.1%
A  0.505s  9031  98.7%
A  0.535s  9143  99.9%
A  0.566s  9159 100.0%
B  0.020s     1   0.0%
B  0.050s    97   1.1%
B  0.081s   387   4.2%
B  0.111s   735   8.0%
B  0.141s  1191  13.0%
B  0.171s  1782  19.5%
B  0.202s  2469  27.0%
B  0.232s  3256  35.6%
B  0.262s  4170  45.6%
B  0.292s  5111  55.8%
B  0.323s  5996  65.5%
B  0.353s  6804  74.3%
B  0.383s  7432  81.2%
B  0.414s  8011  87.5%
B  0.444s  8459  92.4%
B  0.474s  8793  96.1%
B  0.504s  9033  98.7%
B  0.535s  9147  99.9%
sleeping 3 sec between shutter moves...
A  0.020s  9151 100.0%
A  0.050s  9056  98.9%
A  0.081s  8775  95.9%
A  0.111s  8427  92.1%
A  0.141s  7965  87.0%
A  0.172s  7374  80.6%
A  0.202s  6692  73.1%
A  0.232s  5899  64.4%
A  0.263s  4983  54.4%
A  0.293s  4048  44.2%
A  0.323s  3164  34.6%
A  0.354s  2380  26.0%
A  0.384s  1717  18.8%
A  0.414s  1140  12.5%
A  0.445s   702   7.7%
A  0.475s   354   3.9%
A  0.505s   128   1.4%
A  0.536s    10   0.1%
A  0.566s    -7   0.0%
B  0.020s  9146  99.9%
B  0.050s  9033  98.7%
B  0.081s  8762  95.7%
B  0.111s  8407  91.8%
B  0.141s  7941  86.7%
B  0.172s  7358  80.4%
B  0.202s  6662  72.8%
B  0.232s  5870  64.1%
B  0.263s  4958  54.2%
B  0.293s  4005  43.8%
B  0.323s  3140  34.3%
B  0.354s  2351  25.7%
B  0.384s  1696  18.5%
B  0.414s  1133  12.4%
B  0.444s   673   7.4%
B  0.475s   348   3.8%
B  0.505s   119   1.3%
B  0.535s     3   0.0%
A     0  0.0mm   15 N F R | B    -5 -0.2mm   15 N F R
---------------------------------------------------
Evaluating shutter behavior:
Shutter A opened to 100.0 percent in 0.566 seconds.
Shutter B opened to 99.9 percent in 0.535 seconds.
Shutter A closed to 0.0 percent in 0.566 seconds.
Shutter B closed to 0.0 percent in 0.535 seconds.
Problems: 0
---------------------------------------------------
Attempting audio conversion ... size=     226kB time=00:00:07.23 bitrate= 256.1kbits/s speed=1.22e+03x    
audio converted to shutter.wav.
Copying shutter audio to dashboards ... done

DFM (FOCUS)
  changing to best focus...  dfm: filter=c[4] foc=9862 IDLE

Sat Sep 5 21:54:38 -04 2026 [elapsed=274 sec] IMAGING (acam+auxcam)
  status...OK
  cam: main=[idle] aux=[off] N=0/0 spi=38.6 IDLE
  taking preflight exposures:
  acam...OK
  acam image:
    156M Sep 5 21:54 /atlas/obs/04a/61289/04a61289e0001c.arch.fz
  AUXCAM: Skipping (noauxcam=1).

Sat Sep 5 21:55:01 -04 2026 [elapsed=297 sec] DEHUMIDIFIER
  OTA humidity exists...OK
  OTA humidity is current... OK (23 seconds old)
  OTA humidity level...WARNING (31%)
WARNING (OTA humidity > 25 (31%); )
  Dome humidity exists...OK
  Dome humidity is current... OK

Sat Sep 5 21:55:01 -04 2026 [elapsed=297 sec] SCHEDULE
  Status...OK
  Checking scheduled filter...correct filter inserted
dfm: OK [bestfocus]
61289.07987789|info|galildriver|using focus model: foc=9830+(3.50)*14.5+(-0.35)*60.2=9859.7
61289.07988291|info|galildriver|c  4 IN  | cass:  9132686  45.66 mm b=23 move=NO       | arm:   409734 477.00 mm b=03 move=OK       | foc: 53278550  9861 um b=8f M     [focus]
61289.07989050|info|galildriver|c  4 IN  | cass:  9132685  45.66 mm b=23 move=NO       | arm:   409734 477.00 mm b=03 move=OK       | foc: 53278768  9860 um b=0f       [cmd]
bestfocus for c...OK


Sat Sep 5 21:55:03 -04 2026 [elapsed=299 sec] Parking the mount.
Parking ... mount: task <-parksouth> accepted
Waiting ... Mount is parked.

Sat Sep 5 21:55:32 -04 2026 [elapsed=328 sec] Disabling mount tracking.
  Waiting on the mount ... done.
  Turning tracking off ... done.
  Waiting on the mount ... done.
  Recheck mount status ... done.
sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Sat Sep 5 21:55:33 -04 2026 [elapsed=329 sec] WARNINGS: OTA humidity > 25 (31%); 


Preflight completed with warnings.  See
http://tinyurl.com/chlpreflight
--
Please reduce summit bandwidth by turning off your webcam viewer.

Sat Sep 5 21:55:33 -04 2026 [elapsed=329 sec] Happy observing!
Sat Sep 5 21:55:33 -04 2026 [elapsed=329 sec] Preflight took 329 seconds to complete.


Sat Sep 5 21:55:33 -04 2026 [elapsed=329 sec] STARTING CLEANUP
Turning off LEDs
sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL

  
Azimuth check

Preflight image

Dome audio


Shutter audio

Shutter acutation data:

A  0.020s     4   0.0%
A  0.051s   120   1.3%
A  0.081s   396   4.3%
A  0.111s   749   8.2%
A  0.141s  1214  13.3%
A  0.172s  1804  19.7%
A  0.202s  2489  27.2%
A  0.232s  3295  36.0%
A  0.262s  4204  45.9%
A  0.293s  5133  56.1%
A  0.323s  6027  65.8%
A  0.353s  6796  74.2%
A  0.383s  7453  81.4%
A  0.414s  8006  87.5%
A  0.444s  8457  92.4%
A  0.474s  8793  96.1%
A  0.504s  9027  98.6%
A  0.535s  9137  99.8%
A  0.565s  9153 100.0%
B  0.020s     1   0.0%
B  0.050s   120   1.3%
B  0.081s   381   4.2%
B  0.111s   728   8.0%
B  0.141s  1201  13.1%
B  0.171s  1773  19.4%
B  0.201s  2468  27.0%
B  0.232s  3268  35.7%
B  0.262s  4166  45.5%
B  0.292s  5102  55.7%
B  0.322s  5988  65.4%
B  0.353s  6773  74.0%
B  0.383s  7439  81.3%
B  0.413s  8000  87.4%
B  0.444s  8456  92.4%
B  0.474s  8796  96.1%
B  0.504s  9023  98.6%
B  0.534s  9139  99.8%
B  0.565s  9156 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9151 100.0%
A  0.050s  9049  98.9%
A  0.081s  8777  95.9%
A  0.111s  8421  92.0%
A  0.141s  7959  86.9%
A  0.171s  7381  80.6%
A  0.201s  6692  73.1%
A  0.232s  5894  64.4%
A  0.262s  4982  54.4%
A  0.292s  4038  44.1%
A  0.322s  3194  34.9%
A  0.353s  2409  26.3%
A  0.383s  1732  18.9%
A  0.413s  1164  12.7%
A  0.443s   705   7.7%
A  0.473s   368   4.0%
A  0.504s   132   1.4%
A  0.534s    15   0.2%
A  0.564s     1   0.0%
B  0.020s  9144  99.9%
B  0.050s  9026  98.6%
B  0.081s  8779  95.9%
B  0.111s  8434  92.1%
B  0.141s  7969  87.1%
B  0.171s  7400  80.8%
B  0.201s  6714  73.3%
B  0.232s  5919  64.7%
B  0.262s  5007  54.7%
B  0.292s  4083  44.6%
B  0.322s  3191  34.9%
B  0.353s  2416  26.4%
B  0.383s  1727  18.9%
B  0.413s  1159  12.7%
B  0.443s   713   7.8%
B  0.474s   364   4.0%
B  0.504s   137   1.5%
B  0.534s    15   0.2%
B  0.564s     0   0.0%
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R