STH Recent Preflight: 61344
Executing preflight for 61344 at Fri Oct 30 21:04:46 SAST 2026.
Log can be found in /atlas/obs/03/61344/preflight.dat.
Setting donefile '/atlas/obs/03/61344/preflight_complete.20261030190446.19047' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20261030190446.19047.
Fri Oct 30 21:04:46 SAST 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Fri Oct 30 21:04:46 SAST 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-STH [3aaaf862-00f3-48b5-9dc1-6cb4f4a5fbbb;1800]
Fri Oct 30 21:04:46 SAST 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
doorpsw 3 ON redLED
Fri Oct 30 21:04:47 SAST 2026 [elapsed=1 sec] About to start STH preflight. Point your web browser at http://localhost:7354.
Fri Oct 30 21:04:47 SAST 2026 [elapsed=1 sec] auxcam is disabled.
Fri Oct 30 21:04:47 SAST 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Fri Oct 30 21:04:47 SAST 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1793387079
OK
Fri Oct 30 21:04:47 SAST 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Fri Oct 30 21:04:47 SAST 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Fri Oct 30 21:04:48 SAST 2026 [elapsed=2 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-03a...OK
proc1 prochain-redpost-03x...OK
Fri Oct 30 21:04:49 SAST 2026 [elapsed=3 sec] QUEUE
0 observations queued.
Fri Oct 30 21:04:49 SAST 2026 [elapsed=3 sec] CLOCKS
admin: Fri Oct 30 19:04:49 UTC 2026
metbox: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
*192.168.4.5 .GPS. 1 u 931 1024 377 0.957 0.044 0.037
-metbox2.sth.atl .PPS. 1 u 655 1024 377 0.321 -0.029 0.049
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
-zibbi.ngei.csir 155.232.19.7 2 u 339 1024 377 23.348 -0.022 1.070
-ntp.as3741.net 210.182.58.253 2 u 284 1024 377 22.855 -0.025 0.189
+ntp2.as3741.net 146.64.58.41 2 u 262 1024 377 7.269 0.118 0.129
-ntp2.inx.net.za 183.3.52.101 2 u 765 1024 377 7.294 0.075 0.073
+ntp2.nog.net.za 80.72.67.48 3 u 246 1024 377 7.456 0.138 0.068
-139.84.231.68 ( 196.21.187.2 2 u 129 1024 377 22.848 0.219 0.388
-ntp7.inx.net.za 210.182.58.253 2 u 87 1024 377 16.485 0.245 0.541
-tick.sanren.ac. .TC. 1 u 842 1024 377 23.197 0.034 0.059
Fri Oct 30 21:04:50 SAST 2026 [elapsed=4 sec] DISKS
200GB available in /atlas/obs...OK (6366GB)
200GB available in /atlas/red...OK (9391GB)
Checking disks on admin ... archon ... tcs ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p2 11T 4.2T 6.1T 41% /
admin:/dev/loop0 106M 106M 0 100% /snap/core/17292
admin:/dev/loop1 106M 106M 0 100% /snap/core/17284
archon:/dev/sda2 117G 22G 89G 20% /
archon:/dev/loop0 106M 106M 0 100% /snap/core/17292
archon:/dev/loop1 106M 106M 0 100% /snap/core/17284
archon:/dev/sda1 511M 6.6M 505M 2% /boot/efi
tcs:/dev/mapper/ubuntu--vg-ubuntu--lv 98G 38G 56G 41% /
tcs:/dev/nvme0n1p2 2.0G 131M 1.7G 8% /boot
tcs:/dev/nvme0n1p1 1.1G 6.1M 1.1G 1% /boot/efi
proc1:/dev/md0p1 15T 4.4T 9.0T 33% /
proc1:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc2:/dev/md0p1 15T 1.8T 12T 13% /
proc2:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc3:/dev/md0p1 15T 739G 13T 6% /
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc3:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc4:/dev/md0p1 15T 1.1T 13T 8% /
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc4:/dev/loop1 106M 106M 0 100% /snap/core/17292
Fri Oct 30 21:04:50 SAST 2026 [elapsed=4 sec] SERVICES1
qcam
chiller...OK
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
Fri Oct 30 21:04:50 SAST 2026 [elapsed=4 sec] Disabling mount tracking.
Fri Oct 30 21:04:50 SAST 2026 [elapsed=4 sec] SERVICES2
Fri Oct 30 21:04:50 SAST 2026 [elapsed=4 sec] CHILLER
status...OK
chiller: 3.0/3.0C ? chiller=ON dryer=? IDLE
Fri Oct 30 21:04:54 SAST 2026 [elapsed=8 sec] DOME
status...OK
audio setup: using amcam-mezz-s to record
Pointing webcam to azcheck position ... done
Homing the dome ... waiting ... done
Attempting audio conversion ... size= 912kB time=00:00:29.18 bitrate= 256.0kbits/s speed=1.51e+03x
audio converted to domehome.wav.
Copy dome audio to dashboards ... done
slewing to azimuth 0 (N)...OK
Copy azcheck JPEG to dashboards ... done
parking...OK
dome: AZ=90.00 CLOSED/CLOSED (0%) IDLE
Fri Oct 30 21:07:17 SAST 2026 [elapsed=151 sec] MOUNT
blinky status...OK
motor logs...OK
slewing to az=70,alt=70...OK
slewing to az=290,alt=70...OK
parking...OK
mount: 344.63 -29.49, az/alt=324.74 +86.49 idle(e) IDLE
Fri Oct 30 21:08:08 SAST 2026 [elapsed=202 sec] MODO
status...OK
slewing to az=60,alt=60...OK
modo: dome=stopped mount=tracking IDLE
Fri Oct 30 21:08:28 SAST 2026 [elapsed=222 sec] CAM SERVICE
status...OK
cam: main=[idle] aux=[off] N=0/0 spi=155.7 IDLE
Fri Oct 30 21:08:28 SAST 2026 [elapsed=222 sec] ACAM
status Camera tripped exists... OK
Camera tripped is current... OK (11 seconds old)
Software failsafe ready... OK (NA)
CCD on...OK
ION pump on...OK
CCD temp...OK (-51.3C)
Checking CCD plane: Z0=+1779.00 DZDX=-922.00 DZDY=+3967.00
acam: -51C CCD TEC ION e=30.0s d=0.6s N=0 IDLE
Fri Oct 30 21:08:28 SAST 2026 [elapsed=222 sec] WEATHER
status weather: C W 19.3C 52% 30/35kph@301 DP8.6C/-60C/d IDLE
...OK
Fri Oct 30 21:08:28 SAST 2026 [elapsed=222 sec] MET
status...OK
met: c=N o=Y Ro24d Co2d Wo8d Ho3d To37d Do2d IDLE
Fri Oct 30 21:08:28 SAST 2026 [elapsed=222 sec] SENTRY
status...OK
sentry: close=NO open=YES drop=NO IDLE
Fri Oct 30 21:08:28 SAST 2026 [elapsed=222 sec] DFM (SHUTTERS)
initializing and homing shutters...
mount 13.55 -14.64, az/alt=59.90 +60.06 tracking(w) IDLE 1s
A 0 0.0mm 15 N F R | B 0 0.0mm 15 N F R
initialized motor A constants
initialized motor B constants
A 0 0.0mm 15 N F R | B 0 0.0mm 15 N F R
A 0.020s 2 0.0%
B 0.020s -3 0.0%
A 1 0.0mm 15 N F R | B -2 -0.1mm 15 N F R
finding forward (close) limit for shutter A
....done
backing off limit
.........................backing off 4 sec...
at limit
done
finding forward (close) limit for shutter B
...done
backing off limit
...............backing off 4 sec...
at limit
done
A 0 0.0mm 15 N F R | B 0 0.0mm 15 N F R
exercising shutters...Using amcam-mezz-s to record
A 0.020s 12 0.1%
A 0.051s 103 1.1%
A 0.081s 402 4.4%
A 0.111s 736 8.0%
A 0.141s 1189 13.0%
A 0.172s 1787 19.5%
A 0.202s 2465 26.9%
A 0.232s 3258 35.6%
A 0.262s 4167 45.5%
A 0.293s 5113 55.9%
A 0.323s 5984 65.4%
A 0.353s 6785 74.1%
A 0.383s 7443 81.3%
A 0.413s 7995 87.3%
A 0.444s 8468 92.5%
A 0.474s 8794 96.1%
A 0.504s 9018 98.5%
A 0.534s 9153 100.0%
B 0.020s 0 0.0%
B 0.050s 93 1.0%
B 0.081s 374 4.1%
B 0.111s 715 7.8%
B 0.141s 1182 12.9%
B 0.172s 1759 19.2%
B 0.202s 2443 26.7%
B 0.232s 3232 35.3%
B 0.262s 4137 45.2%
B 0.293s 5075 55.4%
B 0.323s 5964 65.2%
B 0.353s 6752 73.8%
B 0.384s 7436 81.2%
B 0.414s 8011 87.5%
B 0.444s 8455 92.4%
B 0.475s 8797 96.1%
B 0.505s 9023 98.6%
B 0.535s 9144 99.9%
B 0.565s 9160 100.0%
sleeping 3 sec between shutter moves...
A 0.020s 9150 100.0%
A 0.050s 9064 99.0%
A 0.081s 8771 95.8%
A 0.111s 8413 91.9%
A 0.141s 7969 87.1%
A 0.172s 7372 80.5%
A 0.202s 6692 73.1%
A 0.232s 5896 64.4%
A 0.262s 4982 54.4%
A 0.293s 4043 44.2%
A 0.323s 3165 34.6%
A 0.353s 2377 26.0%
A 0.383s 1731 18.9%
A 0.414s 1164 12.7%
A 0.444s 711 7.8%
A 0.474s 357 3.9%
A 0.504s 128 1.4%
A 0.535s 13 0.1%
A 0.565s -5 0.0%
B 0.020s 9146 99.9%
B 0.050s 9033 98.7%
B 0.081s 8770 95.8%
B 0.111s 8423 92.0%
B 0.141s 7957 86.9%
B 0.171s 7381 80.6%
B 0.202s 6708 73.3%
B 0.232s 5899 64.4%
B 0.262s 4977 54.4%
B 0.292s 4066 44.4%
B 0.323s 3151 34.4%
B 0.353s 2384 26.0%
B 0.383s 1722 18.8%
B 0.413s 1136 12.4%
B 0.444s 705 7.7%
B 0.474s 367 4.0%
B 0.504s 130 1.4%
B 0.534s 11 0.1%
B 0.564s -9 0.0%
A -1 -0.0mm 15 N F R | B -8 -0.2mm 15 N F R
---------------------------------------------------
Evaluating shutter behavior:
Shutter A opened to 100.0 percent in 0.534 seconds.
Shutter B opened to 100.0 percent in 0.565 seconds.
Shutter A closed to 0.0 percent in 0.565 seconds.
Shutter B closed to 0.0 percent in 0.564 seconds.
Problems: 0
---------------------------------------------------
Attempting audio conversion ... size= 226kB time=00:00:07.23 bitrate= 256.1kbits/s speed=1.14e+03x
audio converted to shutter.wav.
Copying shutter audio to dashboards ... done
DFM (FOCUS)
changing to best focus... dfm: filter=o[2] foc=9214 IDLE
Fri Oct 30 21:09:06 SAST 2026 [elapsed=260 sec] IMAGING (acam+auxcam)
status...OK
cam: main=[idle] aux=[off] N=0/0 spi=155.7 IDLE
taking preflight exposures:
acam...OK
acam image:
124M Oct 30 21:09 /atlas/obs/03a/61344/03a61344e0001o.arch.fz
AUXCAM: Skipping (noauxcam=1).
Fri Oct 30 21:09:28 SAST 2026 [elapsed=282 sec] DEHUMIDIFIER
OTA humidity exists...OK
OTA humidity is current... OK (31 seconds old)
OTA humidity level...OK (2%)
Dome humidity exists...OK
Dome humidity is current... OK
Fri Oct 30 21:09:29 SAST 2026 [elapsed=283 sec] SCHEDULE
Status...OK
Checking scheduled filter...FAIL
Fri Oct 30 21:09:29 SAST 2026 [elapsed=283 sec] Parking the mount.
Parking ... mount: task <-parksouth> accepted
Waiting ... Mount is parked.
Fri Oct 30 21:09:55 SAST 2026 [elapsed=309 sec] Disabling mount tracking.
Waiting on the mount ... done.
Turning tracking off ... done.
Waiting on the mount ... done.
Recheck mount status ... done.
doorpsw 3 OFF redLED
doorpsw 2 OFF whiteLED
Fri Oct 30 21:09:57 SAST 2026 [elapsed=311 sec] NOTICES: det_dzdx=-922 is outside range +-250 from -558; det_dzdy=3967 is outside range +-250 from -1915;
Preflight failed:
Filter changer insert/withdraw axis is reporting OUT;
Fri Oct 30 21:09:57 SAST 2026 [elapsed=311 sec] Preflight took 311 seconds to complete.
Fri Oct 30 21:09:57 SAST 2026 [elapsed=311 sec] STARTING CLEANUP
Turning off LEDs
doorpsw 3 OFF redLED
doorpsw 2 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-STH
Preflight image
Shutter acutation data:
A 0.020s 4 0.0% A 0.050s 114 1.2% A 0.081s 385 4.2% A 0.111s 736 8.0% A 0.141s 1197 13.1% A 0.171s 1782 19.5% A 0.202s 2465 26.9% A 0.232s 3266 35.7% A 0.262s 4174 45.6% A 0.292s 5104 55.8% A 0.323s 5998 65.5% A 0.353s 6775 74.0% A 0.383s 7432 81.2% A 0.413s 8005 87.4% A 0.444s 8458 92.4% A 0.474s 8793 96.1% A 0.504s 9021 98.5% A 0.534s 9136 99.8% A 0.564s 9153 100.0% B 0.020s 2 0.0% B 0.051s 113 1.2% B 0.081s 379 4.1% B 0.111s 728 8.0% B 0.142s 1201 13.1% B 0.172s 1773 19.4% B 0.202s 2467 26.9% B 0.232s 3268 35.7% B 0.263s 4166 45.5% B 0.293s 5103 55.7% B 0.323s 5988 65.4% B 0.353s 6773 74.0% B 0.384s 7439 81.3% B 0.414s 8002 87.4% B 0.444s 8456 92.4% B 0.474s 8794 96.1% B 0.504s 9024 98.6% B 0.535s 9139 99.8% B 0.565s 9156 100.0% sleeping 3 sec between shutter moves... A 0.020s 9151 100.0% A 0.050s 9049 98.9% A 0.081s 8777 95.9% A 0.111s 8422 92.0% A 0.141s 7958 86.9% A 0.172s 7381 80.6% A 0.202s 6692 73.1% A 0.232s 5895 64.4% A 0.262s 4982 54.4% A 0.293s 4037 44.1% A 0.323s 3166 34.6% A 0.353s 2387 26.1% A 0.384s 1711 18.7% A 0.414s 1147 12.5% A 0.444s 706 7.7% A 0.474s 359 3.9% A 0.504s 130 1.4% A 0.535s 15 0.2% A 0.565s 1 0.0% B 0.020s 9143 99.9% B 0.050s 9018 98.5% B 0.081s 8771 95.8% B 0.111s 8421 92.0% B 0.141s 7953 86.9% B 0.171s 7400 80.8% B 0.202s 6714 73.3% B 0.232s 5893 64.4% B 0.262s 5009 54.7% B 0.292s 4083 44.6% B 0.322s 3192 34.9% B 0.353s 2418 26.4% B 0.383s 1725 18.8% B 0.413s 1160 12.7% B 0.443s 713 7.8% B 0.474s 364 4.0% B 0.504s 138 1.5% B 0.534s 17 0.2% B 0.565s 0 0.0% A 0 0.0mm 15 N F R | B 0 0.0mm 15 N F R