sumjulyevent
This is an old revision of the document!
Report of July 5th, 2025 events resulting in critical failure
General Timeline
- At ~1am July 5th, 2025 SSP TA Yujean reached out to Zach concerning and issue with the dome and weather station not talking / connecting to ACP. After restarting TMO's desktop and turning on/off the USB port controlling both of these devices, Zach was able to remotely recover. Everything was working and connected at the start of the night when Zach did their usually pre-SSP use checks. Zach monitored the entire shift to ensure the connection held. Zach instructed the SSP team to *not* start the Scheduler. There were no other issues through the rest of the shift.
- At 3am July 5th, 2025 the SSP accidently started the scheduler despite prior instructions. Zach took over at this point to wait for a safe place to stop the scheduler.
- At 3:15 July 5th, 2025 Zach closed the dome. As the dome was closing, it stopped ~mid way, prompted a “SHUTTER ERROR” in ACP, and using TMOCAM a wire was visibly hanging down from the pulley system. The weather for the rest of the night was supposed to be fine, so Zach left it as is. Zach called the NMSU after hours desk. Since weather outlook was only ~1% for the weekend it was left till Monday.
- At ~8am July 5th, 2025 Zach checked in on the telescope remotely using TMOCAM it was noticed that the shutters have moved. As viewed from TMOCAM, the left shutter was in a “closed” position, but was crooked (bottom was more closed than the top). The right shutter was fully open
sumjulyevent.1752065587.txt.gz · Last modified: 2025/07/09 12:53 by astroadmin