STH Recent Preflight: 61013

Executing preflight for 61013 at Wed Dec  3 18:33:56 SAST 2025.
Log can be found in /atlas/obs/03/61013/preflight.dat.
Setting donefile '/atlas/obs/03/61013/preflight_complete.20251203163356.7063' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20251203163356.7063.
Wed Dec 3 18:33:56 SAST 2025 [elapsed=0 sec] DFM (initialization)
  get service string...OK
  service is running...OK
  is initialized...OK

Wed Dec 3 18:33:56 SAST 2025 [elapsed=0 sec] Getting TCS lock.

OK TCS lock granted to preflight-STH [9dde1cb3-3437-452d-afe9-be14e7353ab2;1800]
Wed Dec 3 18:33:56 SAST 2025 [elapsed=0 sec] Enabling red LEDs for preflight.
doorpsw  3  ON redLED
Wed Dec 3 18:33:57 SAST 2025 [elapsed=1 sec] About to start STH preflight.  Point your web browser at http://localhost:7354.
Wed Dec 3 18:33:57 SAST 2025 [elapsed=1 sec]   auxcam is disabled.
Wed Dec 3 18:33:57 SAST 2025 [elapsed=1 sec]   Skipping auxcam.
error: unknown module: vent
Wed Dec 3 18:33:57 SAST 2025 [elapsed=1 sec] DEADMAN
  Get heartbeat host ... got 'tcs'
  Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1764779627
OK
Wed Dec 3 18:33:57 SAST 2025 [elapsed=1 sec] OPSEC
  AUTO mode:  ...OK
Wed Dec 3 18:33:57 SAST 2025 [elapsed=1 sec] CLUSTER NFS MOUNTS
  admin proc1:/export/atlas-cal...OK
  admin proc1:/export/atlas-red...OK
  proc1 admin:/export/atlas-obs...OK
  proc2 admin:/export/atlas-obs...OK
  proc2 proc1:/export/atlas-cal...OK
  proc2 proc1:/export/atlas-red...OK
  proc3 admin:/export/atlas-obs...OK
  proc3 proc1:/export/atlas-cal...OK
  proc3 proc1:/export/atlas-red...OK
  proc4 admin:/export/atlas-obs...OK
  proc4 proc1:/export/atlas-cal...OK
  proc4 proc1:/export/atlas-red...OK

Wed Dec 3 18:33:58 SAST 2025 [elapsed=2 sec] SCREENS
  admin dash-tcsdata...OK
  admin dash-recent...OK
  admin dash-skycoverage...OK
  admin dash-logstamp...OK
  proc1 redq...OK
  proc1 prochain-redpost-03a...OK
  proc1 prochain-redpost-03x...OK

Wed Dec 3 18:33:59 SAST 2025 [elapsed=3 sec] QUEUE
  0 observations queued.

Wed Dec 3 18:33:59 SAST 2025 [elapsed=3 sec] CLOCKS
  admin:      Wed Dec  3 16:33:59 UTC 2025
  met:        OK
  proc1:      OK
  proc2:      OK
  proc3:      OK
  proc4:      OK
  archon:     OK

  NTP:
       remote           refid      st t when poll reach   delay   offset  jitter
  ==============================================================================
  +192.168.4.5     .GPS.            1 u  302 1024  217    1.025    0.009   0.131
  *metbox2.sth.atl .PPS.            1 u  235 1024  377    0.307   -0.050   0.024
   ntp.ubuntu.com  .POOL.          16 p    -   64    0    0.000    0.000   0.000
  -zibbi.ngei.csir 155.232.19.8     2 u 1002 1024  377   24.951   -0.542   0.185
  -ntp.as3741.net  146.64.8.7       2 u  873 1024  377   23.554   -0.551   4.476
  -ntp2.as3741.net 146.64.8.7       2 u   51 1024  377    7.320    0.146   0.091
  -ntp2.inx.net.za 183.3.52.101     2 u  727 1024  377    7.305    0.037   0.057
  -102.222.100.153 196.21.187.2     2 u  695 1024  377    7.804    0.192   0.803
  -za-jnb-rs01b.dp 183.3.52.101     2 u  931 1024  377   23.780    0.078   1.047
  +tick.sanren.ac. .TC.             1 u   28 1024  377   24.892    0.039   0.022
  #ntp.urbanwave.c 155.232.19.7     2 u  929 1024  377   24.382   -1.159   1.205
  -ntp4.inx.net.za 183.3.52.101     2 u   10 1024  377   24.638    0.010   0.049

Wed Dec 3 18:34:01 SAST 2025 [elapsed=5 sec] DISKS
  200GB available in /atlas/obs...OK (5849GB)
  200GB available in /atlas/red...OK (8819GB)

  Checking disks on admin ... archon ... tcs ... proc1 ... proc2 ... proc3 ... proc4 ... done

  Filesystem                             Size  Used  Avail  Use%  Mounted_on
  admin:/dev/md0p2                       11T   4.7T  5.6T   46%   /
  admin:/dev/loop0                       105M  105M  0      100%  /snap/core/17212
  admin:/dev/loop1                       105M  105M  0      100%  /snap/core/17247
  archon:/dev/sda2                       117G  21G   91G    19%   /
  archon:/dev/sda1                       511M  6.6M  505M   2%    /boot/efi
  archon:/dev/loop1                      105M  105M  0      100%  /snap/core/17212
  archon:/dev/loop0                      105M  105M  0      100%  /snap/core/17247
  tcs:/dev/mapper/ubuntu--vg-ubuntu--lv  98G   34G   60G    37%   /
  tcs:/dev/nvme0n1p2                     2.0G  131M  1.7G   8%    /boot
  tcs:/dev/nvme0n1p1                     1.1G  6.1M  1.1G   1%    /boot/efi
  proc1:/dev/md0p1                       15T   5.0T  8.5T   38%   /
  proc1:/dev/loop0                       105M  105M  0      100%  /snap/core/17212
  proc1:/dev/loop1                       105M  105M  0      100%  /snap/core/17247
  proc2:/dev/md0p1                       15T   1.7T  12T    13%   /
  proc2:/dev/loop1                       105M  105M  0      100%  /snap/core/17212
  proc2:/dev/loop0                       105M  105M  0      100%  /snap/core/17247
  proc3:/dev/md0p1                       15T   732G  13T    6%    /
  proc3:/dev/loop0                       105M  105M  0      100%  /snap/core/17212
  proc3:/dev/loop1                       105M  105M  0      100%  /snap/core/17247
  proc4:/dev/md0p1                       15T   1.1T  13T    8%    /
  proc4:/dev/loop0                       105M  105M  0      100%  /snap/core/17212
  proc4:/dev/loop1                       105M  105M  0      100%  /snap/core/17247

Wed Dec 3 18:34:02 SAST 2025 [elapsed=6 sec] SERVICES1
qcam
  chiller...OK
  dome...OK
  mount...OK
  modo...OK
  cam...OK
  acam...OK
  weather...OK
  met...OK
  sentry...OK
  dfm...OK
  duplicates...OK

Wed Dec 3 18:34:02 SAST 2025 [elapsed=6 sec] Disabling mount tracking.
Wed Dec 3 18:34:02 SAST 2025 [elapsed=6 sec] SERVICES2

Wed Dec 3 18:34:02 SAST 2025 [elapsed=6 sec] CHILLER
  status...OK
  chiller: 3.0/3.0C ? chiller=ON dryer=? IDLE


Wed Dec 3 18:34:06 SAST 2025 [elapsed=10 sec] DOME
  status...OK
  audio setup: using amcam-mezz-s to record
  Pointing webcam to azcheck position ... done
  Homing the dome ... waiting ... done
  Attempting audio conversion ... size=     930kB time=00:00:29.76 bitrate= 256.0kbits/s speed=1.4e+03x    
audio converted to domehome.wav.
  Copy dome audio to dashboards ... done
  slewing to azimuth 0 (N)...OK
  Copy azcheck JPEG to dashboards ... done
  parking...OK
  dome: AZ=90.00 CLOSED/CLOSED (0%) IDLE


Wed Dec 3 18:36:40 SAST 2025 [elapsed=164 sec] MOUNT
  blinky  status...OK
  motor logs...OK
  slewing to az=70,alt=70...OK
  slewing to az=290,alt=70...OK
  parking...OK
  mount: 340.64 -29.49, az/alt=324.67 +86.49 idle(e) IDLE


Wed Dec 3 18:37:37 SAST 2025 [elapsed=221 sec] MODO
  status...OK
  slewing to az=60,alt=60...OK
  modo: dome=stopped mount=tracking IDLE


Wed Dec 3 18:37:58 SAST 2025 [elapsed=242 sec] CAM SERVICE
  status...OK
  cam: main=[idle] aux=[off] N=0/0 spi=152.2 IDLE

Wed Dec 3 18:37:58 SAST 2025 [elapsed=242 sec] ACAM
  status  Camera tripped exists... OK
  Camera tripped is current... OK (2 seconds old)
  Software failsafe ready... OK (NA)
  CCD on...OK
  ION pump on...OK
  CCD temp...OK (-54.2C)
  Checking CCD plane: Z0=+1766.00 DZDX=-895.00  DZDY=+3663.00
  acam: -54C CCD TEC ION e=30.0s d=0.6s N=0 IDLE

Wed Dec 3 18:37:58 SAST 2025 [elapsed=242 sec] WEATHER
  status  weather: clear 19.4C 29% 17/23kph@147 DP18.0C/-16C/d IDLE
...OK

Wed Dec 3 18:37:58 SAST 2025 [elapsed=242 sec] MET
  status...OK
  met: c=N o=Y Ro4d Co10h Wo4d Ho10h To4d Do4d  IDLE

Wed Dec 3 18:37:58 SAST 2025 [elapsed=242 sec] SENTRY
  status...OK
  sentry: close=YES open=NO drop=NO IDLE

Wed Dec 3 18:37:58 SAST 2025 [elapsed=242 sec] DFM (SHUTTERS)
  initializing and homing shutters...
mount            9.57 -14.63, az/alt=59.90 +60.06 tracking(w)      IDLE      1s
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
initialized motor A constants
initialized motor B constants
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
A  0.020s     3   0.0%
B  0.020s    -1   0.0%
A     2  0.1mm   15 N F R | B    -2 -0.1mm   15 N F R
finding forward (close) limit for shutter A
....done
backing off limit
.......................backing off 4 sec...
at limit
done
finding forward (close) limit for shutter B
...done
backing off limit
..............backing off 4 sec...
at limit
done
A     0  0.0mm   15 N F R | B     0  0.0mm   15 N F R
  exercising shutters...Using amcam-mezz-s to record
A  0.020s     9   0.1%
A  0.051s   108   1.2%
A  0.081s   393   4.3%
A  0.111s   734   8.0%
A  0.142s  1191  13.0%
A  0.172s  1783  19.5%
A  0.202s  2466  26.9%
A  0.233s  3260  35.6%
A  0.263s  4165  45.5%
A  0.293s  5113  55.9%
A  0.323s  5990  65.4%
A  0.354s  6782  74.1%
A  0.384s  7437  81.2%
A  0.414s  7999  87.4%
A  0.445s  8468  92.5%
A  0.475s  8790  96.0%
A  0.505s  9021  98.5%
A  0.535s  9152 100.0%
B  0.020s     1   0.0%
B  0.050s    92   1.0%
B  0.081s   373   4.1%
B  0.111s   715   7.8%
B  0.142s  1198  13.1%
B  0.172s  1777  19.4%
B  0.202s  2467  26.9%
B  0.232s  3258  35.6%
B  0.263s  4168  45.5%
B  0.293s  5105  55.8%
B  0.323s  5989  65.4%
B  0.353s  6776  74.0%
B  0.384s  7435  81.2%
B  0.414s  8009  87.5%
B  0.444s  8456  92.4%
B  0.475s  8796  96.1%
B  0.505s  9027  98.6%
B  0.535s  9141  99.9%
B  0.565s  9160 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9150 100.0%
A  0.050s  9062  99.0%
A  0.081s  8769  95.8%
A  0.111s  8414  91.9%
A  0.141s  7969  87.1%
A  0.172s  7372  80.5%
A  0.202s  6693  73.1%
A  0.232s  5897  64.4%
A  0.263s  4982  54.4%
A  0.293s  4046  44.2%
A  0.323s  3164  34.6%
A  0.354s  2376  26.0%
A  0.384s  1712  18.7%
A  0.414s  1148  12.5%
A  0.444s   696   7.6%
A  0.475s   355   3.9%
A  0.505s   124   1.4%
A  0.536s    10   0.1%
A  0.566s    -7   0.0%
B  0.020s  9146  99.9%
B  0.051s  9040  98.8%
B  0.081s  8781  95.9%
B  0.111s  8438  92.2%
B  0.142s  7972  87.1%
B  0.172s  7379  80.6%
B  0.202s  6695  73.1%
B  0.233s  5896  64.4%
B  0.263s  4982  54.4%
B  0.293s  4056  44.3%
B  0.323s  3161  34.5%
B  0.354s  2384  26.0%
B  0.384s  1715  18.7%
B  0.414s  1138  12.4%
B  0.445s   698   7.6%
B  0.475s   358   3.9%
B  0.505s   130   1.4%
B  0.536s    11   0.1%
B  0.566s    -6   0.0%
A     1  0.0mm   15 N F R | B    -5 -0.2mm   15 N F R
---------------------------------------------------
Evaluating shutter behavior:
Shutter A opened to 100.0 percent in 0.535 seconds.
Shutter B opened to 100.0 percent in 0.565 seconds.
Shutter A closed to 0.0 percent in 0.566 seconds.
Shutter B closed to 0.0 percent in 0.566 seconds.
Problems: 0
---------------------------------------------------
Attempting audio conversion ... conversion FAILED!  Bogus AAC file?
Copying shutter audio to dashboards ... done

DFM (FOCUS)
  changing to best focus...  dfm: filter=o[2] foc=9254 IDLE

Wed Dec 3 18:38:46 SAST 2025 [elapsed=290 sec] IMAGING (acam+auxcam)
  status...OK
  cam: main=[idle] aux=[off] N=0/0 spi=152.2 IDLE
  taking preflight exposures:
  acam...OK
  acam image:
    126M Dec 3 18:39 /atlas/obs/03a/61013/03a61013e0001o.arch.fz
  AUXCAM: Skipping (noauxcam=1).

Wed Dec 3 18:39:09 SAST 2025 [elapsed=313 sec] DEHUMIDIFIER
  OTA humidity exists...OK
  OTA humidity is current... OK (73 seconds old)
  OTA humidity level...OK (4%)
  Dome humidity exists...OK
  Dome humidity is current... OK

Wed Dec 3 18:39:09 SAST 2025 [elapsed=313 sec] SCHEDULE
  Status...OK
  Checking scheduled filter...correct filter inserted
dfm: OK [bestfocus]
61012.69386231|info|galildriver|using focus model: foc=9187+(4.30)*20.4+(-0.40)*60.2=9250.6
61012.69386756|info|galildriver|o  2 IN  | cass:  3045845  15.23 mm b=23 move=NO       | arm:   409734 477.00 mm b=03 move=OK       | foc: 54010121  9254 um b=8f M     [focus]
61012.69387817|info|galildriver|o  2 IN  | cass:  3045846  15.23 mm b=23 move=NO       | arm:   409734 477.00 mm b=03 move=OK       | foc: 54010112  9254 um b=2f       [cmd]
bestfocus for o...OK


Wed Dec 3 18:39:12 SAST 2025 [elapsed=316 sec] Parking the mount.
Parking ... mount: task <-parksouth> accepted
Waiting ... Mount is parked.

Wed Dec 3 18:39:41 SAST 2025 [elapsed=345 sec] Disabling mount tracking.
  Waiting on the mount ... done.
  Turning tracking off ... done.
  Waiting on the mount ... done.
  Recheck mount status ... done.
doorpsw  3 OFF redLED
doorpsw  2 OFF whiteLED
Wed Dec 3 18:39:42 SAST 2025 [elapsed=346 sec] NOTICES: det_dzdx=-895 is outside range +-250 from -558; det_dzdy=3663 is outside range +-250 from -1915; 

Wed Dec 3 18:39:42 SAST 2025 [elapsed=346 sec] WARNINGS: DFM shutter audio conversion to WAV failed (bad AAC file?); 


Preflight completed with warnings.  See
http://tinyurl.com/sthpreflight
--
Please reduce summit bandwidth by turning off your webcam viewer.

Wed Dec 3 18:39:42 SAST 2025 [elapsed=346 sec] Happy observing!
Wed Dec 3 18:39:42 SAST 2025 [elapsed=346 sec] Preflight took 346 seconds to complete.


Wed Dec 3 18:39:42 SAST 2025 [elapsed=346 sec] STARTING CLEANUP
Turning off LEDs
doorpsw  3 OFF redLED
doorpsw  2 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-STH

  
Azimuth check

Preflight image

Dome audio


Shutter audio

Shutter acutation data:

A  0.020s     3   0.0%
A  0.051s   109   1.2%
A  0.081s   374   4.1%
A  0.111s   717   7.8%
A  0.141s  1180  12.9%
A  0.171s  1760  19.2%
A  0.202s  2441  26.7%
A  0.232s  3237  35.4%
A  0.262s  4143  45.3%
A  0.292s  5107  55.8%
A  0.322s  5963  65.1%
A  0.353s  6756  73.8%
A  0.383s  7412  81.0%
A  0.413s  8059  88.0%
A  0.443s  8445  92.3%
A  0.474s  8768  95.8%
A  0.504s  9016  98.5%
A  0.534s  9135  99.8%
A  0.564s  9152 100.0%
B  0.020s     2   0.0%
B  0.050s   110   1.2%
B  0.080s   389   4.2%
B  0.111s   729   8.0%
B  0.141s  1201  13.1%
B  0.171s  1773  19.4%
B  0.202s  2466  26.9%
B  0.232s  3270  35.7%
B  0.262s  4167  45.5%
B  0.292s  5220  57.0%
B  0.323s  5987  65.4%
B  0.353s  6795  74.2%
B  0.383s  7440  81.3%
B  0.413s  8081  88.3%
B  0.444s  8455  92.4%
B  0.474s  8794  96.1%
B  0.504s  9023  98.6%
B  0.534s  9138  99.8%
B  0.565s  9156 100.0%
sleeping 3 sec between shutter moves...
A  0.020s  9154 100.0%
A  0.050s  9049  98.9%
A  0.081s  8781  95.9%
A  0.111s  8428  92.1%
A  0.141s  7966  87.0%
A  0.171s  7301  79.8%
A  0.202s  6693  73.1%
A  0.232s  5902  64.5%
A  0.262s  4981  54.4%
A  0.292s  4072  44.5%
A  0.322s  3172  34.7%
A  0.353s  2380  26.0%
A  0.383s  1733  18.9%
A  0.413s  1145  12.5%
A  0.444s   692   7.6%
A  0.474s   369   4.0%
A  0.504s   130   1.4%
A  0.534s    15   0.2%
A  0.565s     3   0.0%
B  0.020s  9144  99.9%
B  0.051s  8995  98.3%
B  0.081s  8770  95.8%
B  0.111s  8420  92.0%
B  0.141s  7952  86.9%
B  0.172s  7316  79.9%
B  0.202s  6689  73.1%
B  0.232s  5890  64.3%
B  0.262s  4978  54.4%
B  0.293s  4052  44.3%
B  0.323s  3163  34.6%
B  0.353s  2392  26.1%
B  0.383s  1702  18.6%
B  0.414s  1147  12.5%
B  0.444s   699   7.6%
B  0.474s   356   3.9%
B  0.505s   132   1.4%
B  0.535s    14   0.2%
B  0.565s     1   0.0%
A    -1 -0.0mm   15 N F R | B     1  0.0mm   15 N F R