CHL Preflight Night 61194
Executing preflight for 61194 at Tue Jun 2 17:24:55 -04 2026.
Log can be found in /atlas/obs/04/61194/preflight.dat.
Setting donefile '/atlas/obs/04/61194/preflight_complete.20260602212455.11991' on successful script completion.
Sitech host is tcs.
Disabling voice.exe countdown.
Disabling chiller checks.
Disabling dehumidifier power check.
Logging errors to /tmp/preflight.20260602212455.11991.
Tue Jun 2 17:24:55 -04 2026 [elapsed=0 sec] DFM (initialization)
get service string...OK
service is running...OK
is initialized...OK
Tue Jun 2 17:24:55 -04 2026 [elapsed=0 sec] Getting TCS lock.
OK TCS lock granted to preflight-CHL [4ef51688-8c9f-4222-88d1-ecbabeb4b035;1800]
Tue Jun 2 17:24:55 -04 2026 [elapsed=0 sec] Enabling red LEDs for preflight.
sitepsw 3 ON redLED
Tue Jun 2 17:24:56 -04 2026 [elapsed=1 sec] About to start CHL preflight. Point your web browser at http://localhost:7454.
Tue Jun 2 17:24:56 -04 2026 [elapsed=1 sec] auxcam is disabled.
Tue Jun 2 17:24:56 -04 2026 [elapsed=1 sec] Skipping auxcam.
error: unknown module: vent
Tue Jun 2 17:24:56 -04 2026 [elapsed=1 sec] DEADMAN
Get heartbeat host ... got 'tcs'
Fetching timestamp (redis-cli -h tcs) ... done. Got response: 1780435494
OK
Tue Jun 2 17:24:56 -04 2026 [elapsed=1 sec] OPSEC
AUTO mode: ...OK
Tue Jun 2 17:24:56 -04 2026 [elapsed=1 sec] CLUSTER NFS MOUNTS
admin proc1:/export/atlas-cal...OK
admin proc1:/export/atlas-red...OK
proc1 admin:/export/atlas-obs...OK
proc2 admin:/export/atlas-obs...OK
proc2 proc1:/export/atlas-cal...OK
proc2 proc1:/export/atlas-red...OK
proc3 admin:/export/atlas-obs...OK
proc3 proc1:/export/atlas-cal...OK
proc3 proc1:/export/atlas-red...OK
proc4 admin:/export/atlas-obs...OK
proc4 proc1:/export/atlas-cal...OK
proc4 proc1:/export/atlas-red...OK
Tue Jun 2 17:24:58 -04 2026 [elapsed=3 sec] SCREENS
admin dash-tcsdata...OK
admin dash-recent...OK
admin dash-skycoverage...OK
admin dash-logstamp...OK
proc1 redq...OK
proc1 prochain-redpost-04a...OK
proc1 prochain-redpost-04x...OK
Tue Jun 2 17:24:58 -04 2026 [elapsed=3 sec] QUEUE
0 observations queued.
Tue Jun 2 17:24:58 -04 2026 [elapsed=3 sec] CLOCKS
admin: Tue Jun 2 21:24:58 UTC 2026
met: OK
proc1: OK
proc2: OK
proc3: OK
proc4: OK
archon: OK
NTP:
remote refid st t when poll reach delay offset jitter
==============================================================================
metbox2.chl.atl .INIT. 16 u - 1024 0 0.000 0.000 0.000
*10.0.11.4 .GPS. 1 u 101 256 377 0.403 1.795 0.629
ntp.ubuntu.com .POOL. 16 p - 64 0 0.000 0.000 0.000
+185.125.190.56 99.220.8.133 2 u 80 256 377 238.110 2.738 0.808
-185.125.190.58 146.131.121.246 2 u 75 256 377 237.416 4.179 0.812
-alphyn.canonica 132.163.96.1 2 u 465 512 377 169.052 5.983 1.034
+185.125.190.57 99.220.8.133 2 u 86 256 377 237.119 2.749 0.689
Tue Jun 2 17:24:58 -04 2026 [elapsed=3 sec] DISKS
200GB available in /atlas/obs...OK (3716GB)
200GB available in /atlas/red...OK (7950GB)
Checking disks on admin ... archon ... proc1 ... proc2 ... proc3 ... proc4 ... done
Filesystem Size Used Avail Use% Mounted_on
admin:/dev/md0p1 11T 6.7T 3.6T 66% /
admin:/dev/loop0 106M 106M 0 100% /snap/core/17284
admin:/dev/loop1 106M 106M 0 100% /snap/core/17292
archon:/dev/mapper/ubuntu--vg-ubuntu--lv 58G 20G 36G 36% /
archon:/dev/loop0 106M 106M 0 100% /snap/core/17292
archon:/dev/loop1 106M 106M 0 100% /snap/core/17284
archon:/dev/sda2 974M 321M 586M 36% /boot
archon:/dev/sda1 511M 4.4M 507M 1% /boot/efi
proc1:/dev/md0p1 15T 6.1T 7.6T 45% /
proc1:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc1:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc1:/dev/sda1 511M 6.7M 505M 2% /boot/efi
proc2:/dev/md0p1 15T 452G 13T 4% /
proc2:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc2:/dev/loop1 106M 106M 0 100% /snap/core/17292
proc3:/dev/md0p1 15T 907G 13T 7% /
proc3:/dev/loop0 106M 106M 0 100% /snap/core/17292
proc3:/dev/loop1 106M 106M 0 100% /snap/core/17284
proc4:/dev/md0p1 15T 696G 13T 6% /
proc4:/dev/loop0 106M 106M 0 100% /snap/core/17284
proc4:/dev/loop1 106M 106M 0 100% /snap/core/17292
Tue Jun 2 17:24:59 -04 2026 [elapsed=4 sec] SERVICES1
xcam
chiller...OK
dome...OK
mount...OK
modo...OK
cam...OK
acam...OK
weather...OK
met...OK
sentry...OK
dfm...OK
duplicates...OK
Tue Jun 2 17:24:59 -04 2026 [elapsed=4 sec] Disabling mount tracking.
Tue Jun 2 17:24:59 -04 2026 [elapsed=4 sec] SERVICES2
Tue Jun 2 17:24:59 -04 2026 [elapsed=4 sec] CHILLER
status...OK
chiller: 3.2/3.0C ? chiller=ON dryer=? IDLE
Tue Jun 2 17:25:03 -04 2026 [elapsed=8 sec] DOME
status...OK
audio setup: using amcam-mezz-s to record
Pointing webcam to azcheck position ... done
Homing the dome ... waiting ... done
Attempting audio conversion ... size= 914kB time=00:00:29.24 bitrate= 256.0kbits/s speed=1.6e+03x
audio converted to domehome.wav.
Copy dome audio to dashboards ... done
slewing to azimuth 0 (N)...OK
Copy azcheck JPEG to dashboards ... done
parking...OK
dome: AZ=35.00 CLOSED/CLOSED (0%) IDLE
Tue Jun 2 17:28:20 -04 2026 [elapsed=205 sec] MOUNT
blinky status...OK
motor logs...OK
slewing to az=70,alt=70...OK
slewing to az=290,alt=70...OK
parking...OK
mount: 140.66 -27.58, az/alt=324.55 +86.48 idle(e) IDLE
Tue Jun 2 17:29:26 -04 2026 [elapsed=271 sec] MODO
status...OK
slewing to az=60,alt=60...OK
modo: dome=stopped mount=tracking IDLE
Tue Jun 2 17:29:50 -04 2026 [elapsed=295 sec] CAM SERVICE
status...OK
cam: main=[idle] aux=[off] N=0/0 spi=42.3 IDLE
Tue Jun 2 17:29:50 -04 2026 [elapsed=295 sec] ACAM
status Camera tripped exists... OK
Camera tripped is current... OK (5 seconds old)
Software failsafe ready... OK (NA)
CCD on...OK
ION pump on...OK
CCD temp...TOO WARM
Checking CCD plane: Z0=-194.00 DZDX=+488.00 DZDY=-362.00
acam: -28C CCD TEC ION e=30.0s d=0.6s N=0 IDLE
Tue Jun 2 17:29:50 -04 2026 [elapsed=295 sec] WEATHER
status weather: C 23.3C 9% -2/-2kph DP34.3C/-24C/d IDLE
...OK
Tue Jun 2 17:29:51 -04 2026 [elapsed=296 sec] MET
status...OK
met: c=N o=N Rc0 Cx0 Wc0 Hc0 Tc0 Dc0 wait RCWHTD IDLE
Tue Jun 2 17:29:51 -04 2026 [elapsed=296 sec] SENTRY
status...OK
sentry: close=YES open=NO drop=NO IDLE
Tue Jun 2 17:29:51 -04 2026 [elapsed=296 sec] DFM (SHUTTERS)
initializing and homing shutters...
mount 169.33 -12.93, az/alt=59.87 +60.08 tracking(w) IDLE 1s
A 46 1.4mm 47 N F R | B -40 -1.2mm 47 N F R
initialized motor A constants
initialized motor B constants
A 46 1.4mm 47 N F R | B -40 -1.2mm 47 N F R
A 0.020s 41 0.4%
A 0.051s 30 0.3%
A 0.081s 8 0.1%
B 0.020s -35 0.0%
A -3 -0.1mm 15 N F R | B -4 -0.1mm 15 N F R
finding forward (close) limit for shutter A
...done
backing off limit
...................backing off 4 sec...
at limit
done
finding forward (close) limit for shutter B
...done
backing off limit
................backing off 4 sec...
at limit
done
A 0 0.0mm 15 N F R | B -1 -0.0mm 15 N F R
exercising shutters...Using amcam-mezz-s to record
A 0.020s 5 0.1%
A 0.051s 122 1.3%
A 0.081s 400 4.4%
A 0.111s 743 8.1%
A 0.142s 1221 13.3%
A 0.172s 1794 19.6%
A 0.202s 2490 27.2%
A 0.232s 3288 35.9%
A 0.263s 4194 45.8%
A 0.293s 5141 56.2%
A 0.323s 6013 65.7%
A 0.354s 6800 74.3%
A 0.384s 7452 81.4%
A 0.414s 8026 87.7%
A 0.445s 8470 92.5%
A 0.475s 8805 96.2%
A 0.505s 9036 98.7%
A 0.535s 9140 99.8%
A 0.566s 9155 100.0%
B 0.020s 1 0.0%
B 0.050s 90 1.0%
B 0.081s 378 4.1%
B 0.111s 736 8.0%
B 0.141s 1192 13.0%
B 0.172s 1782 19.5%
B 0.202s 2470 27.0%
B 0.232s 3256 35.6%
B 0.263s 4172 45.6%
B 0.293s 5114 55.9%
B 0.323s 5995 65.5%
B 0.353s 6782 74.1%
B 0.384s 7431 81.2%
B 0.414s 8011 87.5%
B 0.444s 8460 92.4%
B 0.475s 8792 96.0%
B 0.505s 9032 98.7%
B 0.535s 9146 99.9%
sleeping 3 sec between shutter moves...
A 0.020s 9152 100.0%
A 0.051s 9059 99.0%
A 0.081s 8768 95.8%
A 0.111s 8426 92.0%
A 0.142s 7956 86.9%
A 0.172s 7378 80.6%
A 0.202s 6691 73.1%
A 0.233s 5898 64.4%
A 0.263s 4981 54.4%
A 0.293s 4051 44.3%
A 0.324s 3166 34.6%
A 0.354s 2379 26.0%
A 0.384s 1715 18.7%
A 0.415s 1125 12.3%
A 0.445s 703 7.7%
A 0.475s 356 3.9%
A 0.506s 128 1.4%
A 0.536s 10 0.1%
A 0.566s -3 0.0%
B 0.020s 9149 99.9%
B 0.050s 9050 98.9%
B 0.081s 8782 95.9%
B 0.111s 8432 92.1%
B 0.142s 7962 87.0%
B 0.172s 7379 80.6%
B 0.202s 6711 73.3%
B 0.232s 5926 64.7%
B 0.263s 5021 54.9%
B 0.293s 4065 44.4%
B 0.323s 3195 34.9%
B 0.354s 2374 25.9%
B 0.384s 1717 18.8%
B 0.414s 1150 12.6%
B 0.444s 686 7.5%
B 0.475s 360 3.9%
B 0.505s 133 1.5%
B 0.535s 8 0.1%
A 0 0.0mm 15 N F R | B -2 -0.1mm 15 N F R
---------------------------------------------------
Evaluating shutter behavior:
Shutter A opened to 100.0 percent in 0.566 seconds.
Shutter B opened to 99.9 percent in 0.535 seconds.
Shutter A closed to 0.0 percent in 0.566 seconds.
Shutter B closed to 0.1 percent in 0.535 seconds.
Problems: 0
---------------------------------------------------
Attempting audio conversion ... size= 228kB time=00:00:07.29 bitrate= 256.1kbits/s speed=1.17e+03x
audio converted to shutter.wav.
Copying shutter audio to dashboards ... done
DFM (FOCUS)
changing to best focus... dfm: filter=o[3] foc=9880 IDLE
Tue Jun 2 17:30:25 -04 2026 [elapsed=330 sec] Disabling mount tracking.
Waiting on the mount ... done.
Turning tracking off ... done.
Waiting on the mount ... done.
Recheck mount status ... done.
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Preflight failed:
ACAM CCD is substantially warmer than expected (-27.6C);
Tue Jun 2 17:30:26 -04 2026 [elapsed=331 sec] Preflight took 331 seconds to complete.
Tue Jun 2 17:30:26 -04 2026 [elapsed=331 sec] STARTING CLEANUP
Turning off LEDs
sitepsw 3 OFF redLED
sitepsw 4 OFF whiteLED
Releasing TCS lock [preflight]
OK TCS lock released by preflight-CHL
Preflight image
Shutter acutation data:
A 0.020s 3 0.0% A 0.051s 115 1.3% A 0.081s 385 4.2% A 0.111s 735 8.0% A 0.141s 1197 13.1% A 0.172s 1782 19.5% A 0.202s 2466 26.9% A 0.232s 3266 35.7% A 0.262s 4174 45.6% A 0.293s 5104 55.8% A 0.323s 5997 65.5% A 0.353s 6775 74.0% A 0.383s 7433 81.2% A 0.413s 8006 87.5% A 0.444s 8458 92.4% A 0.474s 8793 96.1% A 0.504s 9021 98.5% A 0.534s 9137 99.8% A 0.564s 9154 100.0% B 0.020s 2 0.0% B 0.050s 112 1.2% B 0.081s 379 4.1% B 0.111s 728 8.0% B 0.141s 1186 13.0% B 0.171s 1753 19.2% B 0.201s 2442 26.7% B 0.231s 3241 35.4% B 0.262s 4136 45.2% B 0.292s 5074 55.4% B 0.322s 5960 65.1% B 0.352s 6749 73.7% B 0.382s 7419 81.0% B 0.412s 7968 87.0% B 0.443s 8430 92.1% B 0.473s 8776 95.9% B 0.503s 9012 98.4% B 0.533s 9134 99.8% B 0.563s 9156 100.0% sleeping 3 sec between shutter moves... A 0.020s 9151 100.0% A 0.050s 9051 98.9% A 0.081s 8777 95.9% A 0.111s 8420 92.0% A 0.141s 7959 86.9% A 0.171s 7381 80.6% A 0.202s 6692 73.1% A 0.232s 5894 64.4% A 0.262s 4981 54.4% A 0.292s 4069 44.5% A 0.322s 3193 34.9% A 0.353s 2409 26.3% A 0.383s 1731 18.9% A 0.413s 1164 12.7% A 0.443s 706 7.7% A 0.474s 367 4.0% A 0.504s 131 1.4% A 0.534s 15 0.2% A 0.564s 1 0.0% B 0.020s 9143 99.9% B 0.050s 9026 98.6% B 0.081s 8780 95.9% B 0.111s 8435 92.1% B 0.141s 7969 87.1% B 0.171s 7400 80.8% B 0.201s 6714 73.3% B 0.232s 5920 64.7% B 0.262s 5011 54.7% B 0.292s 4082 44.6% B 0.323s 3192 34.9% B 0.353s 2417 26.4% B 0.383s 1724 18.8% B 0.413s 1161 12.7% B 0.444s 713 7.8% B 0.474s 365 4.0% B 0.504s 139 1.5% B 0.534s 16 0.2% B 0.564s 0 0.0% A 1 0.0mm 15 N F R | B 0 0.0mm 15 N F R