CHL Preflight Night 61116

Executing preflight for 61116 at Mon Mar 16 19:01:03 -03 2026.
Log can be found in /atlas/obs/04/61116/preflight.dat.
Setting donefile '/atlas/obs/04/61116/preflight_complete.20260316220103.24283' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260316220103.24283.
Mon Mar 16 19:01:03 -03 2026 [elapsed=0 sec] DFM (initialization)
  get service string...OK
  service is running...OK
  is initialized...OK

Mon Mar 16 19:01:03 -03 2026 [elapsed=0 sec] Getting TCS lock.

OK TCS lock granted to preflight-CHL [8d67b59b-7b83-463e-bb1f-dfd188799e4c;1800]
Mon Mar 16 19:01:04 -03 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw  3  ON redLED
Mon Mar 16 19:01:04 -03 2026 [elapsed=1 sec] About to start CHL preflight.  Point your web browser at http://localhost:7454.
Mon Mar 16 19:01:05 -03 2026 [elapsed=1 sec]   auxcam is disabled.
Mon Mar 16 19:01:05 -03 2026 [elapsed=1 sec]   Skipping auxcam.
error: unknown module: vent
Mon Mar 16 19:01:05 -03 2026 [elapsed=2 sec] DEADMAN
  Get heartbeat host ... got 'tcs'
  Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1773698464
OK
Mon Mar 16 19:01:05 -03 2026 [elapsed=2 sec] OPSEC
  AUTO mode:  ...OK
Mon Mar 16 19:01:05 -03 2026 [elapsed=2 sec] CLUSTER NFS MOUNTS
  admin proc1:/export/atlas-cal...OK
  admin proc1:/export/atlas-red...OK
  proc1 admin:/export/atlas-obs...OK
  proc2 admin:/export/atlas-obs...OK
  proc2 proc1:/export/atlas-cal...OK
  proc2 proc1:/export/atlas-red...OK
  proc3 admin:/export/atlas-obs...OK
  proc3 proc1:/export/atlas-cal...OK
  proc3 proc1:/export/atlas-red...OK
  proc4 admin:/export/atlas-obs...OK
  proc4 proc1:/export/atlas-cal...OK
  proc4 proc1:/export/atlas-red...OK

Mon Mar 16 19:01:06 -03 2026 [elapsed=3 sec] SCREENS
  admin dash-tcsdata...OK
  admin dash-recent...OK
  admin dash-skycoverage...OK
  admin dash-logstamp...OK
  proc1 redq...OK
  proc1 prochain-redpost-04a...OK
  proc1 prochain-redpost-04x...OK

Mon Mar 16 19:01:07 -03 2026 [elapsed=4 sec] QUEUE
  0 observations queued.

Mon Mar 16 19:01:07 -03 2026 [elapsed=4 sec] CLOCKS
  admin:      Mon Mar 16 22:01:07 UTC 2026
  met:        OK
  proc1:      OK
  proc2:      OK
  proc3:      OK
  proc4:      OK
  archon:     OK

  NTP:
       remote           refid      st t when poll reach   delay   offset  jitter
  ==============================================================================
  +metbox2.chl.atl .PPS.            1 u  204  512  377    0.292   -0.372   0.183
  *10.0.11.4       .GPS.            1 u  291  512  377    0.538   -0.282   0.282
   ntp.ubuntu.com  .POOL.          16 p    -   64    0    0.000    0.000   0.000
  -185.125.190.57  194.121.207.249  2 u  239  512  377  210.083   -2.512   6.098
  +185.125.190.58  145.238.80.80    2 u  285  512  377  212.332   -1.383   3.971
  -alphyn.canonica 132.163.96.1     2 u  306  512  377  157.805   -2.186   1.642
  -185.125.190.56  79.243.60.50     2 u  518 1024  377  225.715   -8.864   1.403

Mon Mar 16 19:01:08 -03 2026 [elapsed=5 sec] DISKS
  200GB available in /atlas/obs...OK (4745GB)
  200GB available in /atlas/red...OK (8376GB)

  Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done

  Filesystem                                Size  Used  Avail  Use%  Mounted_on
  admin:/dev/md0p1                          11T   5.7T  4.6T   56%   /
  admin:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  admin:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  archon:/dev/mapper/ubuntu--vg-ubuntu--lv  58G   20G   35G    37%   /
  archon:/dev/loop0                         105M  105M  0      100%  /snap/core/17272
  archon:/dev/sda2                          974M  321M  586M   36%   /boot
  archon:/dev/sda1                          511M  4.4M  507M   1%    /boot/efi
  archon:/dev/loop2                         106M  106M  0      100%  /snap/core/17284
  proc1:/dev/md0p1                          15T   5.7T  8.0T   42%   /
  proc1:/dev/sda1                           511M  6.7M  505M   2%    /boot/efi
  proc1:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc1:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  proc2:/dev/md0p1                          15T   630G  13T    5%    /
  proc2:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc2:/dev/loop1                          106M  106M  0      100%  /snap/core/17284
  proc3:/dev/md0p1                          15T   902G  13T    7%    /
  proc3:/dev/loop2                          105M  105M  0      100%  /snap/core/17272
  proc3:/dev/loop0                          106M  106M  0      100%  /snap/core/17284
  proc4:/dev/md0p1                          15T   691G  13T    6%    /
  proc4:/dev/loop1                          105M  105M  0      100%  /snap/core/17247
  proc4:/dev/loop2                          105M  105M  0      100%  /snap/core/17272

Mon Mar 16 19:01:08 -03 2026 [elapsed=5 sec] SERVICES1
xcam
  chiller...OK
  dome...OK
  mount...OK
  modo...OK
  cam...OK
  acam...OK
  weather...OK
  met...OK
  sentry...OK
  dfm...OK
  duplicates...OK

Mon Mar 16 19:01:09 -03 2026 [elapsed=6 sec] Disabling mount tracking.
Mon Mar 16 19:01:09 -03 2026 [elapsed=6 sec] SERVICES2

Mon Mar 16 19:01:09 -03 2026 [elapsed=6 sec] CHILLER
  status...OK
  chiller: 3.0/3.0C ? chiller=ON dryer=? IDLE


Mon Mar 16 19:01:13 -03 2026 [elapsed=10 sec] DOME
  status...OK
  audio setup: using amcam-mezz-s to record
  Pointing webcam to azcheck position ... done
  Homing the dome ... waiting ... done
  Attempting audio conversion ... size=     914kB time=00:00:29.24 bitrate= 256.0kbits/s speed=1.57e+03x    
audio converted to domehome.wav.
  Copy dome audio to dashboards ... done
  slewing to azimuth 0 (N)...OK
  Copy azcheck JPEG to dashboards ... done
  parking...OK
  dome: AZ=35.00 CLOSED/CLOSED (0%) IDLE


Mon Mar 16 19:04:03 -03 2026 [elapsed=180 sec] MOUNT
  blinky  status...OK
  motor logs...OK
  slewing to az=70,alt=70...OK
  slewing to az=290,alt=70...OK
  parking...OK
  mount: 72.73 -27.58, az/alt=324.55 +86.48 idle(e) IDLE


Mon Mar 16 19:05:08 -03 2026 [elapsed=245 sec] MODO
  status...OK
  slewing to az=60,alt=60...OK
  modo: dome=stopped mount=tracking IDLE


Mon Mar 16 19:05:33 -03 2026 [elapsed=270 sec] CAM SERVICE
  status...OK
  cam: main=[idle] aux=[off] N=895/0 spi=38.5 IDLE

Mon Mar 16 19:05:33 -03 2026 [elapsed=270 sec] ACAM
  status  Camera tripped exists... OK
  Camera tripped is current... OK (9 seconds old)
  Software failsafe ready... OK (NA)
  CCD on...OK
  ION pump on...OK
  CCD temp...OK (-53.6C)
  Checking CCD plane: Z0=-198.00  DZDX=+461.00  DZDY=-415.00 
  acam: -54C CCD TEC ION e=30.0s d=0.6s N=895 IDLE

Mon Mar 16 19:05:33 -03 2026 [elapsed=270 sec] WEATHER
  status  weather: C 25.3C 24% 10/14kph@296 DP23.0C/40C/d IDLE
...OK

Mon Mar 16 19:05:34 -03 2026 [elapsed=271 sec] MET
  status...OK
  met: c=N o=Y Ro8d Co7d Wo38d Ho38d To38d Do38d  IDLE

Mon Mar 16 19:05:34 -03 2026 [elapsed=271 sec] SENTRY
  status...OK
  sentry: close=YES open=NO drop=NO IDLE

Mon Mar 16 19:05:34 -03 2026 [elapsed=271 sec] DFM (SHUTTERS)
  initializing and homing shutters...
mount          101.40 -12.93, az/alt=59.87 +60.08 tracking(w)      IDLE      1s
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
initialized motor A constants
initialized motor B constants
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
A  0.020s     2   0.0%
B  0.020s    -1   0.0%
A     2  0.1mm   15 N F R | B    -1 -0.0mm   15 N F R
finding forward (close) limit for shutter A
...done
backing off limit
..................backing off 4 sec...
at limit
done
finding forward (close) limit for shutter B
...done
backing off limit
................backing off 4 sec...
at limit
done
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
  exercising shutters...Using amcam-mezz-s to record
A  0.020s     8   0.1%
A  0.051s   107   1.2%
A  0.081s   388   4.2%
A  0.111s   742   8.1%
A  0.141s  1205  13.2%
A  0.172s  1796  19.6%
A  0.203s  2493  27.2%
A  0.233s  3290  35.9%
A  0.263s  4193  45.8%
A  0.294s  5137  56.1%
A  0.324s  6040  66.0%
A  0.354s  6829  74.6%
A  0.385s  7471  81.6%
A  0.415s  8041  87.8%
A  0.446s  8480  92.6%
A  0.476s  8812  96.3%
A  0.506s  9037  98.7%
A  0.536s  9143  99.9%
A  0.567s  9157 100.0%
B  0.020s     2   0.0%
B  0.050s    95   1.0%
B  0.081s   387   4.2%
B  0.111s   748   8.2%
B  0.141s  1206  13.2%
B  0.172s  1803  19.7%
B  0.202s  2494  27.2%
B  0.232s  3281  35.8%
B  0.274s  4544  49.6%
B  0.304s  5460  59.6%
B  0.334s  6317  69.0%
B  0.365s  7042  76.9%
B  0.395s  7663  83.7%
B  0.425s  8202  89.6%
B  0.456s  8598  93.9%
B  0.486s  8896  97.2%
B  0.516s  9090  99.3%
B  0.546s  9158 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9152 100.0%
A  0.051s  9054  98.9%
A  0.081s  8772  95.8%
A  0.111s  8428  92.1%
A  0.142s  7962  87.0%
A  0.172s  7374  80.6%
A  0.202s  6692  73.1%
A  0.233s  5892  64.4%
A  0.263s  4948  54.1%
A  0.293s  4025  44.0%
A  0.324s  3137  34.3%
A  0.354s  2360  25.8%
A  0.384s  1689  18.5%
A  0.415s  1125  12.3%
A  0.445s   691   7.5%
A  0.475s   347   3.8%
A  0.506s   126   1.4%
A  0.536s     9   0.1%
B  0.020s  9147  99.9%
B  0.050s  9034  98.7%
B  0.081s  8762  95.7%
B  0.111s  8404  91.8%
B  0.142s  7942  86.8%
B  0.172s  7357  80.4%
B  0.203s  6663  72.8%
B  0.233s  5845  63.9%
B  0.263s  4929  53.8%
B  0.294s  3975  43.4%
B  0.324s  3113  34.0%
B  0.354s  2329  25.4%
B  0.385s  1678  18.3%
B  0.415s  1119  12.2%
B  0.445s   660   7.2%
B  0.476s   341   3.7%
B  0.506s   117   1.3%
B  0.536s     3   0.0%
A     0  0.0mm   15 N F R | B    -2 -0.1mm   15 N F R
---------------------------------------------------
Evaluating shutter behavior:
Shutter A opened to 100.0 percent in 0.567 seconds.
Shutter B opened to 100.0 percent in 0.546 seconds.
Shutter A closed to 0.1 percent in 0.536 seconds.
Shutter B closed to 0.0 percent in 0.536 seconds.
Problems: 0
---------------------------------------------------
Attempting audio conversion ... size=     226kB time=00:00:07.23 bitrate= 256.1kbits/s speed=1.19e+03x    
audio converted to shutter.wav.
Copying shutter audio to dashboards ... done

DFM (FOCUS)
  changing to best focus...  dfm: filter=c[4] foc=9890 IDLE

Mon Mar 16 19:06:09 -03 2026 [elapsed=306 sec] IMAGING (acam+auxcam)
  status...OK
  cam: main=[idle] aux=[off] N=895/0 spi=38.5 IDLE
  taking preflight exposures:
  acam...OK
  acam image:
    154M Mar 16 19:06 /atlas/obs/04a/61116/04a61116e0001c.arch.fz
  AUXCAM: Skipping (noauxcam=1).

Mon Mar 16 19:06:31 -03 2026 [elapsed=328 sec] DEHUMIDIFIER
  OTA humidity exists...OK
  OTA humidity is current... OK (85 seconds old)
  OTA humidity level...OK (5%)
  Dome humidity exists...OK
  Dome humidity is current... OK

Mon Mar 16 19:06:31 -03 2026 [elapsed=328 sec] SCHEDULE
  Status...OK
  Checking scheduled filter...correct filter inserted
dfm: OK [bestfocus]
61115.92120411|info|galildriver|using focus model: foc=9830+(3.50)*23.4+(-0.35)*60.2=9890.8
61115.92120877|info|galildriver|c  4 IN  | cass:  9136264  45.68 mm b=23 move=NO       | arm:   407051 473.88 mm b=03 move=OK       | foc: 53272747  9890 um b=0f       [cmd]
bestfocus for c...OK


Mon Mar 16 19:06:33 -03 2026 [elapsed=330 sec] Parking the mount.
Parking ... mount: task <-parksouth> accepted
Waiting ... Mount is parked.

Mon Mar 16 19:07:05 -03 2026 [elapsed=362 sec] Disabling mount tracking.
  Waiting on the mount ... done.
  Turning tracking off ... done.
  Waiting on the mount ... done.
  Recheck mount status ... done.
sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED

Preflight completed successfully.  See
http://tinyurl.com/chlpreflight
--
Please reduce summit bandwidth by turning off your webcam viewer.

Mon Mar 16 19:07:07 -03 2026 [elapsed=364 sec] Happy observing!
Mon Mar 16 19:07:07 -03 2026 [elapsed=364 sec] Preflight took 364 seconds to complete.


Mon Mar 16 19:07:07 -03 2026 [elapsed=364 sec] STARTING CLEANUP
Turning off LEDs
sitepsw  3 OFF redLED
sitepsw  4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL

  
Azimuth check

Preflight image

Dome audio


Shutter audio

Shutter acutation data:

A  0.020s     3   0.0%
A  0.050s   116   1.3%
A  0.081s   373   4.1%
A  0.111s   718   7.8%
A  0.141s  1182  12.9%
A  0.171s  1759  19.2%
A  0.202s  2441  26.7%
A  0.232s  3238  35.4%
A  0.262s  4144  45.3%
A  0.292s  5077  55.5%
A  0.322s  5963  65.1%
A  0.353s  6756  73.8%
A  0.383s  7412  81.0%
A  0.413s  7991  87.3%
A  0.444s  8446  92.3%
A  0.474s  8779  95.9%
A  0.504s  9023  98.6%
A  0.534s  9137  99.8%
A  0.565s  9152 100.0%
B  0.020s    -1  -0.0%
B  0.050s   105   1.1%
B  0.081s   378   4.1%
B  0.111s   714   7.8%
B  0.141s  1185  12.9%
B  0.171s  1753  19.2%
B  0.202s  2441  26.7%
B  0.232s  3240  35.4%
B  0.262s  4135  45.2%
B  0.292s  5074  55.4%
B  0.322s  5959  65.1%
B  0.352s  6749  73.7%
B  0.383s  7418  81.0%
B  0.413s  7986  87.2%
B  0.443s  8431  92.1%
B  0.473s  8778  95.9%
B  0.503s  9012  98.4%
B  0.534s  9133  99.8%
B  0.564s  9156 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9155 100.0%
A  0.050s  9050  98.9%
A  0.081s  8783  95.9%
A  0.111s  8430  92.1%
A  0.141s  7965  87.0%
A  0.171s  7385  80.7%
A  0.202s  6694  73.1%
A  0.232s  5903  64.5%
A  0.262s  4982  54.4%
A  0.293s  4045  44.2%
A  0.323s  3172  34.7%
A  0.353s  2381  26.0%
A  0.383s  1714  18.7%
A  0.414s  1146  12.5%
A  0.444s   692   7.6%
A  0.474s   360   3.9%
A  0.504s   125   1.4%
A  0.535s    15   0.2%
A  0.565s     4   0.0%
B  0.020s  9144  99.9%
B  0.050s  9009  98.4%
B  0.081s  8770  95.8%
B  0.111s  8420  92.0%
B  0.141s  7951  86.9%
B  0.171s  7377  80.6%
B  0.202s  6687  73.1%
B  0.232s  5892  64.4%
B  0.262s  4983  54.4%
B  0.292s  4052  44.3%
B  0.322s  3161  34.5%
B  0.353s  2393  26.1%
B  0.383s  1704  18.6%
B  0.413s  1147  12.5%
B  0.443s   700   7.6%
B  0.474s   355   3.9%
B  0.504s   133   1.5%
B  0.534s    13   0.1%
B  0.564s     0   0.0%
A    -1 -0.0mm   15 N F R | B     0  0.0mm   15 N F R