User Tools

Site Tools


sumjulyevent

This is an old revision of the document!


Report of July 5th, 2025 events resulting in critical failure

General Timeline

  1. At ~1am July 5th, 2025 SSP TA Yujean reached out to Zach concerning and issue with the dome and weather station not talking / connecting to ACP. After restarting TMO's desktop and turning on/off the USB port controlling both of these devices, Zach was able to remotely recover. Everything was working and connected at the start of the night when Zach did their usually pre-SSP use checks. Zach monitored the entire shift to ensure the connection held. Zach instructed the SSP team to *not* start the Scheduler. There were no other issues through the rest of the shift.
  2. At 3am July 5th, 2025 the SSP accidently started the scheduler despite prior instructions. Zach took over at this point to wait for a safe place to stop the scheduler.
  3. At 3:15 July 5th, 2025 Zach closed the dome. As the dome was closing, it stopped ~mid way, prompted a “SHUTTER ERROR” in ACP, and using TMOCAM a wire was visibly hanging down from the pulley system. The weather for the rest of the night was supposed to be fine, so Zach left it as is. Zach called the NMSU after hours desk. Since weather outlook was only ~1% for the weekend it was left till Monday.
  4. At ~8am July 5th, 2025 Zach checked in on the telescope remotely using TMOCAM it was noticed that the shutters have moved. As viewed from TMOCAM, the left shutter was in a “closed” position, but was crooked (bottom was more closed than the top). The right shutter was fully opened. Zach went up to TMO to physically inspect. The chain was completely wrapped around the motor gear. Zach called the afterhours Work Order desk again to follow up and update to this new concerning situation.
  5. At ~4pm July 6th, Zach noticed that the local weather's rain chance went from ~1% to 40-60% chance. With the dome in an opened / critical state, Zach hiked up to TMO with tarps and cords to cover the telescope to mitigate any potential chance of weather related damage.
sumjulyevent.1752066527.txt.gz · Last modified: 2025/07/09 13:08 by astroadmin

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki