MtKent
Home Obs Webcams
Weather Temp's Motors
Tenerife
Home Status OR Ins.
Weather Temp's Sat Im
Motors Obs Webcams
Find -tasks- here

SONG technical logbook page
Choose site
Logbook entries for all SONG sites are shown
Project
Logbook entries for all projects are shown
Add to tasks?
Should someone look more into this or is it fixed?
Date of event
Description
Who are you?
Hardware group
Action performed
Attachment
[Maximum size = 20MB]
Notify
Send out notification e-mail? Messages will always be send to slack -> SONG-operations.
The latest 50 events are displayed!
Search the log:
DateDescriptionPerson(s)Hardware GroupAction performedAttachmentEditSiteTask(?)
2024-11-12 No connection to T1 guide camera Mads T1 fibre guider The camera is not seen from the controlling computer in the spectrogragh room. The PC was rebooted which did not help. Maybe the USB cable has come loose somewhere? None Edit MtKent 234
2024-11-12 Connection to the T1 Monitor was lost around 23 local time. Got an error message about "T1 monitor deamon is hanging somewhere". Activated shutdown. Jonatan Rudrasingam T1 monitor Activated shutdown. Added to task None Edit MtKent 235
2024-10-30 There appears to be a problem with observation of beta Hyi where star seems to be defocused (see attached image). The overview plot of the observation also lacks flux. Jonatan Rudrasingam Telescope Added it to the task. Contacted Frank and Mads Show Edit MtKent 232
2024-10-30 There appears to be a problem with observation of beta Hyi where star seems to be defocused (see attached image). The overview plot of the observation also lacks flux. Jonatan Rudrasingam Telescope Added it to the task. Contacted Frank and Mads Show Edit MtKent 233
2024-10-23 T1 monitor crashed. This happen after an observed star came under the telescope altitude limit (low object). This appear to be the same problem which happen on 18th October. Update: Connection to the T1 monitor is established, but the connection to the Scheduler is lost (according to the SODA webpage) Update 2: Connection to Scheduler is reestablsihed. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Added it to the task None Edit MtKent 231
2024-10-18 Connection to the T1 Monitor was lost around 5:00 local time. Encoder set is no. Overall obs state is 174. Global state is 0. Woke up (around 45 minutes later) and noticed this. Took the watchman shift and activated shutdown. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Added it to the task None Edit MtKent 229
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter Show Edit MtKent 227
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter Show Edit MtKent 228
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter None Edit MtKent 225
2024-10-11 This morning before observation a T1 monitor daemon is hanging warning occured. Shortly afterwards a homing warning occured. Looking at obs page AZ motors are not enabled, Encoders set is no, Ready state is not ready. Overall obs state is 64. Motion state is on homing. I don't know if it is a software problem or a hardware problem. Update: when writing this logbook and after activating shutdown the software on T1 Monitor and the Scheduler is not up to date on the soda webpage. Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Tasked the problem to Jack Soutter Show Edit MtKent 226
2024-10-01 Telescope communication error at 1 UTC. No observations afterwards. Mads Telescope and dome Restarted the telescope control software wrapper which brought back the connection - when I noticed in the morning. None Edit Tenerife
2024-10-01 Regular electrical power check Mads All Powered off critical systems yesterday and restarted things today (2024-10-02) None Edit MtKent
2024-09-29 Very few observations during the night - despite good weather - No errors reported. It seems that only one target was observed, with flux. Frank Grundahl All ?? None - I am wondering whether this is a pointing model problem,but do not know. There was flux on the guider for one target, so probably not the guider ? None Edit Tenerife 224
2024-09-25 Connection to telescope( Tel-com?) is lost around 12:30 UTC/22:30 local time. Last data was taken around the time. No further data were taken or shown in the obs page. On the SODA webpage the status on the Telescope Power and Telescope Motion are shown as "Error" Jonatan Rudrasingam Telescope Shutdown initiated until problem can be solved. Contacted Mads and Frank via. email. None Edit MtKent
2024-09-10 Looking at the slit-guider image, betaAql was way off the slit and appears de-focused. Watching for several minutes the image seem to update, but without any pointing or focus corrections. Frank Grundahl Slit-guider Tried to just change focus in Astelos (-0.1mm) ... this made the guide image appear very sharply focused. Applied manually offsets in Astelos to move the star to the correct guide spots. This put light to the slit, but still no active guiding. Then tried to stop/start the slit-guider from 10.8.0.80, but seemingly this had no effect, and there was no output to the log file. Not quite sure what the problem is. None Edit Tenerife 223
2024-09-07 Iodine cell not heated for about two hours from 16:10 to 18 UTC Mads Iodine cell Heater was re-enabled and started heating again None Edit MtKent
2024-09-03 Pointing had been quite bad for some time Mads Telescope Made a new pointing model with 76 stars and an RMS of 1.46 arcseconds None Edit Tenerife
2024-09-02 No observations from around 3 UTC caused by no new ORs send to site Mads Servers A database machine (db_backup) in Aarhus was hanging and causing problems for the main user access database (db_aadc on trinity). This made the Conductor not able to fetch new information for sending ORs. After reboot of the db_backup machine it seems to run fine again. None Edit Tenerife
2024-09-01 Observations did not start after sunset - no ORs received on site - 'connection to server at "10.28.0.127", port 5432 failed: FATAL: sorry, too many clients already' Mads None Restarted postgres on trinity as root - 'systemctl restart postgresql' - made things run again None Edit Tenerife
2024-08-24 During the observation of beta Aql the connection to the telecope (Astelco) was lost (around 2 UTC). However, I was asleep so the problem has stewed until 6 UTC. Attempted in the morning to activate shotdown but did not work. Jonatan Rudrasingam Telescope Contacted Mads None Edit Tenerife
2024-08-22 Observation of beta Aql was stopped due to bad weather (clouds). Dome closed but a T1 shutdown error message occurred even through the dome closed properly. Jonatan Rudrasingam Dome None Edit MtKent
2024-08-09 Check and grease dome slit ger and general check at the dome mechanisms Antonio P and Pere (remote) Dome Grease the slit gear of the dome and check the rest of the motors (rotation and flap) None Edit Tenerife
2024-08-08 Dome error alert Pere Dome As I was "watchman that night, execute full shutdown None Edit Tenerife
2024-07-29 No connection to SONG Tel-Com 1. The telescope control computer is not reachable on the network Mads Tel-com Tried to power cycled the computer which did not help. On site assistance is needed to investigate the issue. None Edit MtKent 222
2024-07-23 No connection to FUT CMOS detector. I get the error "Could not connect to the camera." for any attempted operation with the camera. Have tried to turn off, wait, and the on again without any effect. Could you try to de- and re-attach the usb connectors and test the usb connection? Let me know when if you need me at the other end for troubleshooting. Thanks Karsten FUT CMOS detector None Edit MtKent 221
2024-07-10 I observed two things as watcher... 1. the telescope did not observe any targets for a period of time near the end of the night, although dome was open and weather was OK. 2. 15 minutes later I lost contact to the webpage and could not even see the Watchman-site and in case of emergency therefore no close the telescope (or call.. since info. on actions is on the webside). The webside was active again 15 minutes later and nothing went wrong and I did not needed to perform any actions. Hans Kjeldsen, AU Telescope nothing - I informed Frank and Mads via SMS None Edit MtKent 220
2024-07-01 The shutter for T2 is not working - probably not in remote mode. If there is still power connected to the nasmyth unit on T2, please put the shutter in remote mode, next time you are at Mt. Kent - in this way we can run calibs in the normal way, which makes life, and data reduction, easier :-) Frank Grundahl Spectrograph 2000 None Edit MtKent 219
2024-06-23 Aquistion gone 'rampage' --- two first targets ok - then a lot of inserts of HD185144 ... apparently not acquired, although it was just observed ... I saw it on the guider... then keeps inserting more ORs of HD185144.... Frank Grundahl All Tried to 'change_or_status' for the extra ORs .... not effect - the system still thinks that 185144 should be observed, but cannot find it .... None Edit Tenerife 218
2024-06-17 At the start of the night the acquisition of the first target (HD109358) failed ~10 times, resulting in many inserted ORs. There seem to be a problem with the pointing model or focus guess. Frank Grundahl Telescope None, after the target was acquired. None Edit Tenerife 216
2024-06-17 The shutter on T1 does not seem to work - probably not in remote mode. Please go to T1 and press the button to activate remote mode for the shutter. T2 shutter is ok. Frank Grundahl Telescope 2000 None Edit MtKent 217
2024-06-16 T1 dome did not close automatically (at high humidity) and I therefore initiated a full shot down via activating shutdown overwrite. This had no effect and I therefore contacted Frank Grundahl and asked him to check this. Frank managed to close dome 1 such that the telescope is safe. Hans Kjeldsen, AU Telescope I called Frank Grundahl. He will havbe the details and he managed to close down the whole facility. None Edit MtKent
2024-06-15 Observations did not start after sunset, and the weather is fine. The Or_scheduler log says the monitor has not prepared the telescopes for observations. Frank Grundahl T1 and T2 Tried stop/start monitor(s) - did not seem to help. I will keep and eye out and close domes manually if needed. The monitors 'runs as it should' according to the log. None Edit MtKent 215
2024-06-09 T2 seems off target… several degrees Hans Kjeldsen Telescope When time allows it should be checked Show Edit all 213
2024-06-09 The telescope stopped and is now idle. Will email before I close down Hans Kjeldsen Telescope T1 and T2 Email to Frank and Mads. Will close down later. No risk at present. Show Edit MtKent 214
2024-06-05 T1 is not tracking well and drifts off during tracking. Offset is significant and light is not entering the fibre. Hans Kjeldsen, AU Telescope No actions .. weather turned bad after some time. None Edit MtKent
2024-06-03 No observations before 2024-06-04 04:40 UTC. Mads None The issue was that the conductor could not connect to the database where observing info is located. The issue resolved it self at 04:40. None Edit Tenerife
2024-05-27 No connection to anything in the FUT dome including the dome webcamera. Previous events like this were due to no power to the FUT dome. Karsten likely no power to FUT dome None Edit MtKent 211
2024-05-26 Dome 1 did not close (despite clouds) Hans Kjeldsen, AU Dome I contacted Frank and he closed the dome None Edit MtKent 212
2024-05-01 The following error messages were sent out: "The monitor daemon is hanging somewhere and a restart is most likely needed. Please check if things looks fine!” and "Slony is not replicating data from tenerife to central!!!” When trying to access the webcams and SODA page, i found both offline. After about 15min both came live again and the problem seems to have dissapeared. Paul All waiting None Edit Tenerife
2024-04-18 After coming home for dinner, no one on watch, so took it. Monitor was not running, so started it .... after ~10min things started, but monitor stopped itself, tried to restart, but it stopped again. The 'client_abort_acq' did not work, so stopped or_scheduler. Then tried to close the hatch and dome ... the hatch closed, but when the upper hatch closed I could see the lower hatch was not closed properly, despite Astelos reporting it closed ... so opened the uper/lower hatces agin... then the telescope slewed to a new objece (despite the monitor was not running!): ... then I closed the lower and uppper hatch, parked the telescope ... during which the 'both-limits-active' ocurred.. and then the telescope powered off.... Not sure what all the reasons for this are, but guessing perhaps the new(?) monitor. Frank Grundahl All see description above. None Edit Tenerife 210
2024-04-05 Expected sudden rain at OT tonight and tomorrrow (only) Pere All Watchman will look closely None Edit Tenerife
2024-04-02 Power failures continued - last part of night lost Mads Telescope Short power failures continued during night and prevented reopening after weather improved. None Edit Tenerife
2024-04-02 A number of short power failures Mads All Cleared the error in Astelos (telescope control software) when errors occurred. Power cuts from 1 to around 10 seconds. Show Edit Tenerife
2024-04-02 The dome did not close correctly in the morning Mads Dome Telescope and dome control system reported an error which after acknowledged the dome closed correctly. Next time Antonio on duty he could check the dome slit gear. Maybe it needs to be replaced? None Edit Tenerife 209
2024-03-26 Half yearly regular RCD electrical testing Mads Electrical Stopped software and powered off tel-coms (t1, t2, fut), motors, detectors and main server. None Edit MtKent
2024-03-20 washed M1 miorror with distilled water and dried with microfiber cloth Antonio, Maintanense grup Telescope washed M1 miorror None Edit Tenerife
2024-03-12 T1 guider with new USB extender reports error (ASI_ERROR_TIMEOUT) Mads T1 guider The camera is detected on the server but will not acquire images. I suggest a hard reset (power cycle). Is the USB extender power connected to the PDU outlet number 6? None Edit MtKent 208
1970-01-01 revision and cleaning of dust in container None Edit Tenerife
1970-01-01 washed M1 miorror with distilled water and dried with microfiber cloth Antonio, Mantenamse grup Telescope washed M1 miorror Show Edit Tenerife
1970-01-01 washed M1 miorror with distilled water and dried with microfiber cloth Antonio, Mantenamse grup Telescope washed M1 miorror Show Edit Tenerife