STH Recent Preflight: 61307
Executing preflight for 61307 at Wed Sep 23 21:08:05 SAST 2026.
Log can be found in /atlas/obs/03/61307/preflight.dat.
Setting donefile '/atlas/obs/03/61307/preflight_complete.20260923190805.2584' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260923190805.2584.
Wed Sep 23 21:08:05 SAST 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Wed Sep 23 21:08:05 SAST 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-STH [feb4518e-ba23-49b6-a428-bb78eb7e5ca0;1800]
Wed Sep 23 21:08:06 SAST 2026 [elapsed=1 sec] Enabling red LEDs for preflight.
doorpsw 3 ON redLED
Wed Sep 23 21:08:06 SAST 2026 [elapsed=1 sec] About to start STH preflight. Point your web browser at http://localhost:7354.
Wed Sep 23 21:08:06 SAST 2026 [elapsed=1 sec] auxcam is disabled.
Wed Sep 23 21:08:06 SAST 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Wed Sep 23 21:08:06 SAST 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1790190486
OK
Wed Sep 23 21:08:06 SAST 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Wed Sep 23 21:08:06 SAST 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Wed Sep 23 21:08:08 SAST 2026 [elapsed=3 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-03a...OK
proc1 prochain-redpost-03x...OK
Wed Sep 23 21:08:08 SAST 2026 [elapsed=3 sec] QUEUE
0 observations queued.
Wed Sep 23 21:08:08 SAST 2026 [elapsed=3 sec] CLOCKS
admin: Wed Sep 23 19:08:08 UTC 2026
metbox: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
+192.168.4.5 .GPS. 1 u 350 512 7 0.810 -0.592 0.128
metbox2.sth.atl .PPS. 1 u 109 512 377 0.242 -0.693 1690.30
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
+zibbi.ngei.csir 155.232.19.6 2 u 524 512 377 23.258 -0.637 0.313
-ntp.as3741.net 155.232.19.6 2 u 26 512 377 22.633 -0.712 0.174
-ntp2.as3741.net 155.232.19.6 2 u 34 512 377 7.255 -0.378 0.187
-196.10.54.57 183.3.52.101 2 u 65 512 377 7.252 -0.570 0.899
-ntp2.nog.net.za 80.72.67.48 3 u 39 512 377 7.422 -0.482 0.189
-139.84.231.68 ( 196.21.187.2 2 u 397 512 377 22.762 -0.815 0.452
-ntp7.inx.net.za 210.182.58.253 2 u 102 512 377 16.466 -0.603 0.116
*tick.sanren.ac. .TC. 1 u 140 512 377 23.144 -0.570 0.162
Wed Sep 23 21:08:19 SAST 2026 [elapsed=14 sec] DISKS
200GB available in /atlas/obs...OK (5812GB)
200GB available in /atlas/red...OK (9117GB)
Checking disks on admin ... archon ... tcs ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p2 11T 4.7T 5.6T 46% /
admin:/dev/loop0 106M 106M 0 100% /snap/core/17292
admin:/dev/loop1 106M 106M 0 100% /snap/core/17284
archon:/dev/sda2 117G 22G 89G 20% /
archon:/dev/loop0 106M 106M 0 100% /snap/core/17284
archon:/dev/loop1 106M 106M 0 100% /snap/core/17292
archon:/dev/sda1 511M 6.6M 505M 2% /boot/efi
tcs:/dev/mapper/ubuntu--vg-ubuntu--lv 98G 38G 56G 41% /
tcs:/dev/nvme0n1p2 2.0G 131M 1.7G 8% /boot
tcs:/dev/nvme0n1p1 1.1G 6.1M 1.1G 1% /boot/efi
proc1:/dev/md0p1 15T 4.7T 8.7T 35% /
proc1:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc2:/dev/md0p1 15T 1.8T 12T 13% /
proc2:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc3:/dev/md0p1 15T 737G 13T 6% /
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc3:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc4:/dev/md0p1 15T 1.1T 13T 8% /
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc4:/dev/loop1 106M 106M 0 100% /snap/core/17292
Wed Sep 23 21:08:19 SAST 2026 [elapsed=14 sec] SERVICES1
qcam
chiller...OK
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
Wed Sep 23 21:08:19 SAST 2026 [elapsed=14 sec] Disabling mount tracking.
Wed Sep 23 21:08:19 SAST 2026 [elapsed=14 sec] SERVICES2
Wed Sep 23 21:08:19 SAST 2026 [elapsed=14 sec] CHILLER
status...OK
chiller: 2.9/3.0C ? chiller=ON dryer=? IDLE
Wed Sep 23 21:08:24 SAST 2026 [elapsed=19 sec] DOME
status...OK
audio setup: using amcam-mezz-s to record
Pointing webcam to azcheck position ... done
Homing the dome ... waiting ... done
Attempting audio conversion ... size= 918kB time=00:00:29.37 bitrate= 256.0kbits/s speed=1.48e+03x
audio converted to domehome.wav.
Copy dome audio to dashboards ... done
slewing to azimuth 0 (N)...OK
Copy azcheck JPEG to dashboards ... done
parking...OK
dome: AZ=56.90 CLOSED/RESET (0%) IDLE
Wed Sep 23 21:11:02 SAST 2026 [elapsed=177 sec] MOUNT
blinky status...OK
motor logs...OK
slewing to az=70,alt=70...OK
slewing to az=290,alt=70...OK
parking...OK
mount: 309.10 -29.49, az/alt=324.74 +86.49 idle(e) IDLE
Wed Sep 23 21:11:52 SAST 2026 [elapsed=227 sec] MODO
status...OK
slewing to az=60,alt=60...OK
modo: dome=stopped mount=tracking IDLE
Wed Sep 23 21:12:11 SAST 2026 [elapsed=246 sec] CAM SERVICE
status...OK
cam: main=[idle] aux=[off] N=1/0 spi=38.9 IDLE
Wed Sep 23 21:12:11 SAST 2026 [elapsed=246 sec] ACAM
status Camera tripped exists... OK
Camera tripped is current... OK (2 seconds old)
Software failsafe ready... OK (NA)
CCD on...OK
ION pump on...OK
CCD temp...OK (-52.2C)
Checking CCD plane: Z0=+1727.00 DZDX=-956.00 DZDY=+2741.00
acam: -52C CCD TEC ION e=30.0s d=0.6s N=1 IDLE
Wed Sep 23 21:12:11 SAST 2026 [elapsed=246 sec] WEATHER
status weather: clear H 13.6C 79% 19/22kph@62 DP1.9C/-157C/d IDLE
...OK
Wed Sep 23 21:12:12 SAST 2026 [elapsed=247 sec] MET
status...OK
met: c=N o=Y Ro33 Co31 Wo33 Ho33 To33 Do43 IDLE
Wed Sep 23 21:12:12 SAST 2026 [elapsed=247 sec] SENTRY
status...OK
sentry: close=NO open=YES drop=YES IDLE
Wed Sep 23 21:12:12 SAST 2026 [elapsed=247 sec] DFM (SHUTTERS)
initializing and homing shutters...
mount 338.02 -14.63, az/alt=59.90 +60.06 tracking(w) IDLE 1s
A 10177 310.6mm 39 N - R | B -253 -7.7mm 47 N F R
initialized motor A constants
initialized motor B constants
A 10177 310.6mm 39 N - R | B -253 -7.7mm 47 N F R
A 0.020s 10170 111.1%
A 0.051s 10090 110.2%
A 0.081s 9789 106.9%
A 0.111s 9440 103.1%
A 0.141s 8998 98.3%
A 0.172s 8393 91.7%
A 0.202s 7716 84.3%
A 0.232s 6924 75.6%
A 0.263s 6004 65.6%
A 0.293s 5066 55.3%
A 0.323s 4169 45.5%
A 0.353s 3249 35.5%
A 0.384s 2438 26.6%
A 0.414s 1781 19.5%
A 0.444s 1195 13.1%
A 0.474s 745 8.1%
A 0.504s 401 4.4%
A 0.535s 150 1.6%
A 0.565s 19 0.2%
A 0.595s -4 0.0%
B 0.020s -246 0.0%
A -3 -0.1mm 15 N F R | B 16 0.5mm 15 N F R
finding forward (close) limit for shutter A
....done
backing off limit
...........................backing off 4 sec...
at limit
done
finding forward (close) limit for shutter B
...done
backing off limit
..............backing off 4 sec...
at limit
done
A 0 0.0mm 15 N F R | B 0 0.0mm 15 N F R
exercising shutters...Using amcam-mezz-s to record
A 0.020s 9 0.1%
A 0.051s 114 1.2%
A 0.081s 401 4.4%
A 0.111s 748 8.2%
A 0.142s 1207 13.2%
A 0.172s 1803 19.7%
A 0.202s 2489 27.2%
A 0.233s 3285 35.9%
A 0.263s 4193 45.8%
A 0.293s 5175 56.5%
A 0.323s 6046 66.0%
A 0.354s 6826 74.6%
A 0.384s 7478 81.7%
A 0.414s 8033 87.8%
A 0.445s 8489 92.7%
A 0.475s 8813 96.3%
A 0.505s 9034 98.7%
A 0.535s 9154 100.0%
B 0.020s 2 0.0%
B 0.050s 104 1.1%
B 0.081s 393 4.3%
B 0.111s 738 8.1%
B 0.141s 1214 13.3%
B 0.172s 1798 19.6%
B 0.202s 2487 27.2%
B 0.232s 3282 35.9%
B 0.262s 4197 45.8%
B 0.293s 5131 56.1%
B 0.323s 6021 65.8%
B 0.353s 6795 74.2%
B 0.383s 7457 81.5%
B 0.414s 8026 87.7%
B 0.444s 8468 92.5%
B 0.474s 8809 96.2%
B 0.505s 9035 98.7%
B 0.535s 9149 99.9%
sleeping 3 sec between shutter moves...
A 0.020s 9150 100.0%
A 0.051s 9065 99.0%
A 0.081s 8774 95.8%
A 0.111s 8414 91.9%
A 0.141s 7970 87.1%
A 0.172s 7372 80.5%
A 0.202s 6691 73.1%
A 0.232s 5899 64.4%
A 0.262s 4984 54.4%
A 0.293s 4044 44.2%
A 0.323s 3166 34.6%
A 0.353s 2376 26.0%
A 0.384s 1707 18.6%
A 0.414s 1147 12.5%
A 0.444s 697 7.6%
A 0.475s 355 3.9%
A 0.505s 130 1.4%
A 0.535s 12 0.1%
A 0.565s -8 0.0%
B 0.020s 9144 99.9%
B 0.050s 9025 98.6%
B 0.081s 8764 95.7%
B 0.111s 8411 91.9%
B 0.141s 7942 86.8%
B 0.172s 7360 80.4%
B 0.202s 6671 72.9%
B 0.232s 5871 64.1%
B 0.262s 4953 54.1%
B 0.293s 4023 43.9%
B 0.323s 3135 34.2%
B 0.353s 2361 25.8%
B 0.384s 1692 18.5%
B 0.414s 1124 12.3%
B 0.444s 684 7.5%
B 0.474s 345 3.8%
B 0.505s 122 1.3%
B 0.535s 10 0.1%
B 0.565s -5 0.0%
A 0 0.0mm 15 N F R | B -5 -0.2mm 15 N F R
---------------------------------------------------
Evaluating shutter behavior:
Shutter A opened to 100.0 percent in 0.535 seconds.
Shutter B opened to 99.9 percent in 0.535 seconds.
Shutter A closed to 0.0 percent in 0.565 seconds.
Shutter B closed to 0.0 percent in 0.565 seconds.
Problems: 0
---------------------------------------------------
Attempting audio conversion ... size= 226kB time=00:00:07.23 bitrate= 256.1kbits/s speed=1.07e+03x
audio converted to shutter.wav.
Copying shutter audio to dashboards ... done
DFM (FOCUS)
changing to best focus... dfm: filter=o[2] foc=9227 IDLE
Wed Sep 23 21:12:49 SAST 2026 [elapsed=284 sec] IMAGING (acam+auxcam)
status...OK
cam: main=[idle] aux=[off] N=1/0 spi=38.9 IDLE
taking preflight exposures:
acam...OK
acam image:
132M Sep 23 21:13 /atlas/obs/03a/61307/03a61307e0002o.arch.fz
AUXCAM: Skipping (noauxcam=1).
Wed Sep 23 21:13:12 SAST 2026 [elapsed=307 sec] DEHUMIDIFIER
OTA humidity exists...OK
OTA humidity is current... OK (74 seconds old)
OTA humidity level...OK (7%)
Dome humidity exists...OK
Dome humidity is current... OK
Wed Sep 23 21:13:12 SAST 2026 [elapsed=307 sec] SCHEDULE
Status...OK
Checking scheduled filter...FAIL
Wed Sep 23 21:13:12 SAST 2026 [elapsed=307 sec] Parking the mount.
Parking ... mount: task <-parksouth> accepted
Waiting ... Mount is parked.
Wed Sep 23 21:13:38 SAST 2026 [elapsed=333 sec] Disabling mount tracking.
Waiting on the mount ... done.
Turning tracking off ... done.
Waiting on the mount ... done.
Recheck mount status ... done.
doorpsw 3 OFF redLED
doorpsw 2 OFF whiteLED
Wed Sep 23 21:13:39 SAST 2026 [elapsed=334 sec] NOTICES: det_dzdx=-956 is outside range +-250 from -558; det_dzdy=2741 is outside range +-250 from -1915;
Preflight failed:
Filter changer insert/withdraw axis is reporting OUT;
Wed Sep 23 21:13:39 SAST 2026 [elapsed=334 sec] Preflight took 334 seconds to complete.
Wed Sep 23 21:13:39 SAST 2026 [elapsed=334 sec] STARTING CLEANUP
Turning off LEDs
doorpsw 3 OFF redLED
doorpsw 2 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-STH
Preflight image
Shutter acutation data:
A 0.020s 3 0.0% A 0.050s 115 1.3% A 0.081s 385 4.2% A 0.111s 724 7.9% A 0.141s 1180 12.9% A 0.171s 1762 19.2% A 0.201s 2441 26.7% A 0.232s 3239 35.4% A 0.262s 4144 45.3% A 0.292s 5073 55.4% A 0.322s 5971 65.2% A 0.353s 6751 73.7% A 0.383s 7413 81.0% A 0.413s 7990 87.3% A 0.443s 8445 92.3% A 0.474s 8784 96.0% A 0.504s 9021 98.5% A 0.534s 9136 99.8% A 0.564s 9154 100.0% B 0.020s 1 0.0% B 0.050s 106 1.2% B 0.081s 370 4.0% B 0.111s 713 7.8% B 0.141s 1186 13.0% B 0.171s 1751 19.1% B 0.201s 2442 26.7% B 0.232s 3242 35.4% B 0.262s 4135 45.2% B 0.292s 5073 55.4% B 0.322s 5933 64.8% B 0.352s 6726 73.5% B 0.383s 7401 80.8% B 0.413s 7968 87.0% B 0.443s 8430 92.1% B 0.474s 8776 95.9% B 0.504s 9012 98.4% B 0.534s 9134 99.8% B 0.564s 9156 100.0% sleeping 3 sec between shutter moves... A 0.020s 9151 100.0% A 0.050s 9050 98.9% A 0.081s 8778 95.9% A 0.111s 8420 92.0% A 0.141s 7959 86.9% A 0.171s 7380 80.6% A 0.202s 6692 73.1% A 0.232s 5894 64.4% A 0.262s 4982 54.4% A 0.293s 4038 44.1% A 0.323s 3167 34.6% A 0.353s 2386 26.1% A 0.383s 1711 18.7% A 0.414s 1147 12.5% A 0.444s 692 7.6% A 0.474s 359 3.9% A 0.504s 125 1.4% A 0.535s 14 0.2% A 0.565s 1 0.0% B 0.020s 9144 99.9% B 0.050s 9020 98.5% B 0.081s 8772 95.8% B 0.111s 8423 92.0% B 0.141s 7954 86.9% B 0.171s 7381 80.6% B 0.201s 6691 73.1% B 0.232s 5892 64.4% B 0.262s 4980 54.4% B 0.292s 4056 44.3% B 0.322s 3166 34.6% B 0.353s 2393 26.1% B 0.383s 1701 18.6% B 0.413s 1146 12.5% B 0.443s 699 7.6% B 0.474s 357 3.9% B 0.504s 132 1.4% B 0.534s 14 0.2% B 0.564s 0 0.0% A 0 0.0mm 15 N F R | B 0 0.0mm 15 N F R