STH Recent Preflight: 61208
Executing preflight for 61208 at Wed Jun 17 00:51:19 SAST 2026.
Log can be found in /atlas/obs/03/61208/preflight.dat.
Setting donefile '/atlas/obs/03/61208/preflight_complete.20260616225119.28886' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260616225119.28886.
Wed Jun 17 00:51:19 SAST 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Wed Jun 17 00:51:19 SAST 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-STH [499b7c27-bf85-43dd-9a7c-7f01c4f8e9bb;1800]
Wed Jun 17 00:51:19 SAST 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
doorpsw 3 ON redLED
Wed Jun 17 00:51:20 SAST 2026 [elapsed=1 sec] About to start STH preflight. Point your web browser at http://localhost:7354.
Wed Jun 17 00:51:20 SAST 2026 [elapsed=1 sec] auxcam is disabled.
Wed Jun 17 00:51:20 SAST 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Wed Jun 17 00:51:20 SAST 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1781650273
OK
Wed Jun 17 00:51:20 SAST 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Wed Jun 17 00:51:20 SAST 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Wed Jun 17 00:51:22 SAST 2026 [elapsed=3 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...FAIL
proc1 prochain-redpost-03a...FAIL
proc1 prochain-redpost-03x...FAIL
Wed Jun 17 00:51:23 SAST 2026 [elapsed=4 sec] QUEUE
0 observations queued.
Wed Jun 17 00:51:23 SAST 2026 [elapsed=4 sec] CLOCKS
admin: Tue Jun 16 22:51:23 UTC 2026
met: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
+192.168.4.5 .GPS. 1 u 560 1024 377 1.085 -0.044 0.444
*metbox2.sth.atl .PPS. 1 u 264 1024 377 0.267 -0.063 0.094
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
+zibbi.ngei.csir 155.232.19.7 2 u 284 1024 377 23.353 0.051 0.111
-ntp.as3741.net 210.182.58.253 2 u 587 1024 377 22.801 -0.137 0.248
-ntp2.as3741.net 155.232.19.7 2 u 502 1024 377 7.271 -0.132 0.147
-ntp2.inx.net.za 210.182.58.253 2 u 337 1024 377 7.239 0.030 0.404
-ntp5.inx.net.za 183.3.52.101 2 u 662 1024 377 7.553 -0.124 0.128
-102.222.156.151 196.21.187.2 2 u 233 1024 377 23.376 -0.221 0.210
+102.222.103.99 80.72.67.48 3 u 565 1024 377 7.657 -0.037 0.315
+139.84.231.68 ( 196.21.187.2 2 u 319 1024 377 22.762 0.028 0.111
#ntp8.inx.net.za 210.182.58.253 2 u 139 1024 377 16.774 0.122 0.239
Wed Jun 17 00:51:25 SAST 2026 [elapsed=6 sec] DISKS
200GB available in /atlas/obs...OK (6251GB)
200GB available in /atlas/red...OK (9098GB)
Checking disks on admin ... archon ... tcs ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p2 11T 4.3T 6.0T 42% /
admin:/dev/loop0 106M 106M 0 100% /snap/core/17284
admin:/dev/loop1 106M 106M 0 100% /snap/core/17292
archon:/dev/sda2 117G 22G 89G 20% /
archon:/dev/loop1 106M 106M 0 100% /snap/core/17284
archon:/dev/loop0 106M 106M 0 100% /snap/core/17292
archon:/dev/sda1 511M 6.6M 505M 2% /boot/efi
tcs:/dev/mapper/ubuntu--vg-ubuntu--lv 98G 37G 57G 40% /
tcs:/dev/nvme0n1p2 2.0G 131M 1.7G 8% /boot
tcs:/dev/nvme0n1p1 1.1G 6.1M 1.1G 1% /boot/efi
proc1:/dev/md0p1 15T 4.7T 8.7T 36% /
proc1:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc2:/dev/md0p1 15T 1.7T 12T 13% /
proc2:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc3:/dev/md0p1 15T 736G 13T 6% /
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc3:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc4:/dev/md0p1 15T 1.1T 13T 8% /
proc4:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17292
Wed Jun 17 00:51:25 SAST 2026 [elapsed=6 sec] SERVICES1
qcam
chiller...OK
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
doorpsw 3 OFF redLED
doorpsw 2 OFF whiteLED
Preflight failed:
redq not running on proc1; prochain-redpost-03a not running on proc1; prochain-redpost-03x not running on proc1;
Wed Jun 17 00:51:26 SAST 2026 [elapsed=7 sec] Preflight took 7 seconds to complete.
Wed Jun 17 00:51:26 SAST 2026 [elapsed=7 sec] STARTING CLEANUP
Turning off LEDs
doorpsw 3 OFF redLED
doorpsw 2 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-STH
Preflight image
Shutter acutation data:
A 0.020s 3 0.0% A 0.051s 107 1.2% A 0.081s 376 4.1% A 0.111s 724 7.9% A 0.141s 1180 12.9% A 0.172s 1762 19.2% A 0.202s 2443 26.7% A 0.232s 3238 35.4% A 0.262s 4144 45.3% A 0.293s 5074 55.4% A 0.323s 5970 65.2% A 0.353s 6753 73.8% A 0.383s 7413 81.0% A 0.413s 7990 87.3% A 0.451s 8443 92.2% A 0.481s 8846 96.6% A 0.511s 9058 99.0% A 0.541s 9146 99.9% B 0.020s -1 -0.0% B 0.050s 104 1.1% B 0.081s 368 4.0% B 0.111s 712 7.8% B 0.141s 1183 12.9% B 0.172s 1751 19.1% B 0.202s 2438 26.6% B 0.232s 3241 35.4% B 0.262s 4136 45.2% B 0.292s 5071 55.4% B 0.323s 5958 65.1% B 0.353s 6748 73.7% B 0.383s 7420 81.1% B 0.413s 7985 87.2% B 0.443s 8443 92.2% B 0.474s 8785 96.0% B 0.504s 9015 98.5% B 0.534s 9135 99.8% B 0.564s 9154 100.0% sleeping 3 sec between shutter moves... A 0.020s 9154 100.0% A 0.050s 9044 98.8% A 0.081s 8771 95.8% A 0.111s 8410 91.9% A 0.141s 7944 86.8% A 0.171s 7363 80.4% A 0.202s 6695 73.1% A 0.232s 5898 64.4% A 0.262s 4985 54.5% A 0.292s 4042 44.2% A 0.323s 3169 34.6% A 0.353s 2385 26.1% A 0.383s 1709 18.7% A 0.413s 1149 12.6% A 0.444s 693 7.6% A 0.474s 357 3.9% A 0.504s 126 1.4% A 0.535s 13 0.1% A 0.565s 2 0.0% B 0.020s 9142 99.9% B 0.050s 9011 98.4% B 0.081s 8761 95.7% B 0.111s 8408 91.9% B 0.141s 7936 86.7% B 0.171s 7358 80.4% B 0.201s 6665 72.8% B 0.232s 5891 64.4% B 0.262s 4981 54.4% B 0.292s 4054 44.3% B 0.322s 3164 34.6% B 0.352s 2391 26.1% B 0.383s 1703 18.6% B 0.413s 1147 12.5% B 0.443s 700 7.6% B 0.473s 357 3.9% B 0.503s 138 1.5% B 0.534s 15 0.2% B 0.564s 0 0.0% A 1 0.0mm 15 N F R | B 0 0.0mm 15 N F R