MtKent
Home Obs Webcams
Weather Temp's Motors
Tenerife
Home Status OR Ins.
Weather Temp's Sat Im
Motors Obs Webcams
Find -tasks- here

SONG technical logbook page

Choose site
Logbook entries for all SONG sites are shown
Project
Logbook entries for all projects are shown
Add to tasks?
Should someone look more into this or is it fixed?
Date of event
Description
Who are you?
Hardware group
Action performed
Attachment
[Maximum size = 20MB]
Notify
Send out notification e-mail? Messages will always be send to slack -> SONG-operations.

The latest 50 events are displayed!
Search the log:
DateDescriptionPerson(s)Hardware GroupAction performedAttachmentEditSiteTask(?)
2025-06-06 Telescope reported not ready in web control and on slack and email there was a message that PWI4 was not running Karsten Telescope On remote desktop PWI4 was running, but PWI3 and ASCOM server were not. I started PWI3 and ASCOM server and the checked that the web controls were running again None Edit MtKent
2025-06-06 T2 did not find targets Mads Telescope 2 Did a homing sequence of T2 again and it would then find targets. None Edit MtKent
2025-06-05 The observer page for Mt. Kent shows that all is good - but no signal from T2 - guiding is active, but no star in image and no spectrum from T2 Frank Slit-guider - T2 None, this can wait until next working day. None Edit MtKent 255
2025-06-03 Because of clouds and the Boltwood cloud detector not working the telescope was going crazy Mads Weather station I closed down the site None Edit Tenerife
2025-06-02 user reported telescope had stopped responding to control panel commands. When investigated the following morning the telescope was pointing strangely - see attachement for both. Karsten All Telescope computer was in blue screen revealing that it had rebooted. I logged in, enabled alt-az motors, homed and parked the telescope. Restart of the monitor envoked a message saying that the CMOS controller was not running. The camera was then rebooted and the camera controler restarted. After that everything seems to work in the web control panel. Show Edit MtKent
2025-05-30 Problem with the FITS headers of the RAW files: the slit is listed as -1 and the Camfocus as 1 .... This makes songpipe crash -- something must be wrong with the camera software. Frank Spectrograph this task.... None Edit Tenerife 254
2025-05-30 There are no calibrations after 20250526 - perhaps script is not running. Frank 2000 None Edit Tenerife 253
2025-05-15 There appears to be no calibrations for the nights of 20250515 and 20250516 Frank Spectrograph Only this log insert :-) None Edit Tenerife 252
2025-05-13 No observations during high wind speed Mads None The old weather station database table was disabled a while ago and the conductor was using information on wind from that... corrected to the new table now. None Edit Tenerife
2025-05-12 An error ocurres when the telescope is shutting down "The Error message was: [CONN-ID: 87271] "DRIVES|2:DOME[0]|2;DOME[1]|2;DOME[2]|2:ERR_DeviceError|timeout reading status|2|DOME[0];ERR_DeviceError|timeout reading status|2|DOME[1];ERR_DeviceError|timeout reading status|2|DOME[2],SYSTEM|7:CABINET|7:ERR_PhaseWatcher|Wrong 3-phase seq./undervoltage|5|CABINET;ERR_UPS|Power failure. system running on UPS battery|1|CABINET;ERR_DeviceError|timeout reading status|2|CABINET,AUXILIARY|0::,UNKNOWN|0::"" . This message is repeated and sen via email to the watchmen (Dennis Stello noticed that he received lots of email pr. minute. Neither me or Stello are watchman for tonight). Looking at the observer page the dome state is still open, this is problematic, since the humidity is high. I tried to activate the shutdown, but it didn't help. Jonatan Rudrasingam All Trired to activate shutdown. Didn't work. Added urgently to task. None Edit Tenerife 251
2025-04-29 Telescope was shut down during the night using 'Total Shutdown', but in the morning at 08:14 dk time the mirror covers and dome where completely open and pointing at low altitude to the east. Frank Grundahl Telescope Used Astelos to close mirror covers and then the dome. None Edit Tenerife 250
2025-04-28 Previously, I activated the shutdown for the telescope because connection to software and I couldn't acces the observer page. Now the observer page is backup and I can see that the telescope has not shutdown. Since morning is approaching someone needs to shutdown the telescope as soon as possible. Jonatan Rudrasingam All Tasked this as critical. None Edit Tenerife 249
2025-04-28 Connection to software (Monitor, Telescope, Scheduler) was lost around 19:25 UTC. Cannot acces the observer page to check status. Jonatan Rudrasingam Servers? Activated shutdown to be safe. Added to task. None Edit Tenerife 248
2025-04-22 Mail from system indicating problem with QHY detector Frank Spectrograph Detector stopped detector daemon, power-cycled the QHY, started qhy-daemon and set temperature to -5 - seem to be running again. None Edit MtKent
2025-04-17 No update of preview images, and no new data on disk, even though we followed alpha Cen A nicely Frank Spectrograph Detector Logged in to detector HP-PC. Stopped the camera-server. Power-cycled the camera from hw as obs (pdu_control spec-room 20 2/1) - Restarted camera server. Remember to set the cooler temperature !! Observations now seem to be going on. It seems we had the same problem yesterday (20250416) so no spectra here. None Edit MtKent
2025-04-14 No observations entire night Mads Spectrograph Problem is a stuck motor for the slit motion. Tried to power cycle the motor, controller and software with no effect. We will stay closed until on site assistance. None Edit Tenerife
2025-04-14 Clar weather throughout the night... but no data obtained although we were tracking. probably a software issue with data storage. Hans Kjeldsen IT, software, computers Nothing.. None Edit Tenerife 247
2025-04-14 Clar wether for a number of hours... but no data obtained although we were tracking. probably a software issue with data storage. Hans Kjeldsen IT, software, computers Nothing.. None Edit MtKent 246
2025-04-08 Adjust the Fabry-Perot illumination of the science fibers Frank Spectrograph Duncan helped to correct the misalignment of the FabryPerot light source, such that calibrations now work again for FP. The exposure time should be 2s. None Edit MtKent
2025-04-06 No observations at the end of the night from 4:30 UTC Mads Spectrograph The slit motor is stuck and needs on-site manual actions. Actions needed by Antonio: The spectrograph box needs to be opened and the motor should me manually moved and the spindle greased. None Edit Tenerife 245
2025-03-31 There seem to be a problem with the referencing of M2 - there are entries in the monitor log, and they can be seen in Astelos.This problem may possibly have been there the last few days causing no observations. Frank Telescope I tried to acknowledge the errors, and then things began the startup process, but the error returned. Then wrote this report. Show Edit Tenerife 244
2025-03-25 Dome closing failure due to 'under voltage' - errors in Astelos Frank Dome Cleared errors 2-3 times - the everything closed correctly. None Edit Tenerife
2025-03-17 No connection to anything in the FUT dome! Likely because of no power so perhaps breaker switch needs a turn again?! Please investigate. Karsten None Edit MtKent 242
2025-03-14 No observations carried out Mads, Pere None A problem with slony ment no observing requests were send to Tenerife. A restart of the database in Tenerife and restarting slony made it replicate again None Edit Tenerife
2025-03-12 No observations despite good weather. Mads and Pere None A bug in the software that handles the side ports when weather turns good from bad made the code fail. This is now corrected. None Edit Tenerife
2025-03-03 Server running out of disk space for /scratch Mads, Jakob Servers Checked that all files up to 2025 were transfered to Aarhus and deleted old data - up to 2024-01-01. Capacity went from 2% (400 GB) left to 62% (11000 GB) None Edit Tenerife
2025-03-03 Spectre did not contain data Mads Detector Noticed that the preview images did not get updated and found out that the QHY detector did not work as it should and did not readout data. After a power cycle and restart of software it seems to have recovered. None Edit MtKent
2025-02-23 No connection to anything in the FUT dome (again). Breaker switch or something else? You can wait until daytime to fix. Karsten None Edit MtKent 243
2025-02-03 IThe monitor hangs after errors in Astelco that cannot be cleared. This is possibly due to a bad switch, as reported by Pere on Saturday ... I have labeled the importance level to 'Important' since Mads is also contacted via mail.... :-) Frank Grundahl Telescope Checked that the dome and mirror covers are closed. The dome is not in the correct parking position, but that is acceptable. None Edit Tenerife 241
2025-01-27 Weather data has not updated since yesterday Karsten None Edit MtKent 240
2025-01-18 Reset Astelco Gabinete Antonio, Mantenamse grup Telescope Show Edit Tenerife
2025-01-15 Pointing model was getting bad with offsets above 15 arcseconds Mads Telescope Made a new pointing model with 83 measurements and an RMS of 1.53 arcseconds None Edit Tenerife
2025-01-14 Telescope is open, but nothing seens to be observed... pointing model problen...? Frank Grundahl Telescope None None Edit Tenerife 238
2025-01-09 Power failure - Circuit breaker flips (labeled UPS in). See attached image. Mads, Rosa (support ast) All Power failure happened while I was checking for light through the whole system; dome open, telescope tracking. When Rosa flipped power on it started powering on things but after a while it flipped again. A propper check of the electrical system is needed. Something is not well on the power grid. Show Edit Tenerife 237
2024-12-28 Dif UPS OFF Antonio P. Dome UPS input differential tripped, disconnecting control panel, dome does not trip, (they share UPS.) after cleaning the contacts it is holding up (dust, spider webs and humidity.... possible cause). None Edit Tenerife
2024-11-21 Weather data not updated since about 00:10 local Mount Kent time (15:10 DK time) Karsten None Edit MtKent 236
2024-11-12 No connection to T1 guide camera Mads T1 fibre guider The camera is not seen from the controlling computer in the spectrogragh room. The PC was rebooted which did not help. Maybe the USB cable has come loose somewhere? None Edit MtKent 234
2024-11-12 Connection to the T1 Monitor was lost around 23 local time. Got an error message about "T1 monitor deamon is hanging somewhere". Activated shutdown. Jonatan Rudrasingam T1 monitor Activated shutdown. Added to task None Edit MtKent 235
2024-10-30 There appears to be a problem with observation of beta Hyi where star seems to be defocused (see attached image). The overview plot of the observation also lacks flux. Jonatan Rudrasingam Telescope Added it to the task. Contacted Frank and Mads Show Edit MtKent 232
2024-10-30 There appears to be a problem with observation of beta Hyi where star seems to be defocused (see attached image). The overview plot of the observation also lacks flux. Jonatan Rudrasingam Telescope Added it to the task. Contacted Frank and Mads Show Edit MtKent 233
2024-10-23 T1 monitor crashed. This happen after an observed star came under the telescope altitude limit (low object). This appear to be the same problem which happen on 18th October. Update: Connection to the T1 monitor is established, but the connection to the Scheduler is lost (according to the SODA webpage) Update 2: Connection to Scheduler is reestablsihed. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Added it to the task None Edit MtKent 231
2024-10-18 Connection to the T1 Monitor was lost around 5:00 local time. Encoder set is no. Overall obs state is 174. Global state is 0. Woke up (around 45 minutes later) and noticed this. Took the watchman shift and activated shutdown. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Added it to the task None Edit MtKent 229
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter Show Edit MtKent 228
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter Show Edit MtKent 226
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter None Edit MtKent 225
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter Show Edit MtKent 227
2024-10-01 Regular electrical power check Mads All Powered off critical systems yesterday and restarted things today (2024-10-02) None Edit MtKent
2024-10-01 Telescope communication error at 1 UTC. No observations afterwards. Mads Telescope and dome Restarted the telescope control software wrapper which brought back the connection - when I noticed in the morning. None Edit Tenerife
2024-09-29 Very few observations during the night - despite good weather - No errors reported. It seems that only one target was observed, with flux. Frank Grundahl All ?? None - I am wondering whether this is a pointing model problem,but do not know. There was flux on the guider for one target, so probably not the guider ? None Edit Tenerife 224
2024-01-15 Weather data is not being updated (for days now) Karsten All None Edit MtKent 239