MtKent
Home Obs Webcams
Weather Temp's Motors
Tenerife
Home Status OR Ins.
Weather Temp's Sat Im
Motors Obs Webcams
Find -tasks- here

SONG technical logbook page

Choose site
Logbook entries for all SONG sites are shown
Project
Logbook entries for all projects are shown
Add to tasks?
Should someone look more into this or is it fixed?
Date of event
Description
Who are you?
Hardware group
Action performed
Attachment
[Maximum size = 20MB]
Notify
Send out notification e-mail? Messages will always be send to slack -> SONG-operations.

The latest 50 events are displayed!
Search the log:
DateDescriptionPerson(s)Hardware GroupAction performedAttachmentEditSiteTask(?)
2024-04-18 After coming home for dinner, no one on watch, so took it. Monitor was not running, so started it .... after ~10min things started, but monitor stopped itself, tried to restart, but it stopped again. The 'client_abort_acq' did not work, so stopped or_scheduler. Then tried to close the hatch and dome ... the hatch closed, but when the upper hatch closed I could see the lower hatch was not closed properly, despite Astelos reporting it closed ... so opened the uper/lower hatces agin... then the telescope slewed to a new objece (despite the monitor was not running!): ... then I closed the lower and uppper hatch, parked the telescope ... during which the 'both-limits-active' ocurred.. and then the telescope powered off.... Not sure what all the reasons for this are, but guessing perhaps the new(?) monitor. Frank Grundahl All see description above. None Edit Tenerife 210
2024-04-05 Expected sudden rain at OT tonight and tomorrrow (only) Pere All Watchman will look closely None Edit Tenerife
2024-04-02 A number of short power failures Mads All Cleared the error in Astelos (telescope control software) when errors occurred. Power cuts from 1 to around 10 seconds. Show Edit Tenerife
2024-04-02 Power failures continued - last part of night lost Mads Telescope Short power failures continued during night and prevented reopening after weather improved. None Edit Tenerife
2024-04-02 The dome did not close correctly in the morning Mads Dome Telescope and dome control system reported an error which after acknowledged the dome closed correctly. Next time Antonio on duty he could check the dome slit gear. Maybe it needs to be replaced? None Edit Tenerife 209
2024-03-26 Half yearly regular RCD electrical testing Mads Electrical Stopped software and powered off tel-coms (t1, t2, fut), motors, detectors and main server. None Edit MtKent
2024-03-20 washed M1 miorror with distilled water and dried with microfiber cloth Antonio, Maintanense grup Telescope washed M1 miorror None Edit Tenerife
2024-03-12 T1 guider with new USB extender reports error (ASI_ERROR_TIMEOUT) Mads T1 guider The camera is detected on the server but will not acquire images. I suggest a hard reset (power cycle). Is the USB extender power connected to the PDU outlet number 6? None Edit MtKent 208
2024-03-04 Filterwheel was not placed correctly in front of slit guider - perhaps causing flux loss Mads Spectrograph Homed the filterwheel which fixed the issue. None Edit Tenerife
2024-02-09 No connection to anything in FUT Dome. Perhaps no power? Seem to recall something about a breaker switch separate for the FUT Dome in previous similar situation. I send this on behalf of Mads, who is going on vacation. Karsten All None Edit MtKent 207
2024-02-07 Thorium Argon lamp change Antonio P. Spectrograph Thorium Argon lamp change Show Edit Tenerife
2024-02-06 Most of the night lost because of hanging QHY600 CMOS detector Mads Detector Restared the daemon of the detector as a one time fix. Long term solution is being investigated. None Edit Tenerife 206
2024-02-05 Guide camera on telescope 1 is not responding correctly. Mads Guiders Tried to power cycle outlet 6 on the T1 PDU in the dome. This should be the USB booster for the ZWO camera. It did not help. Perhaps a physical unplug - wait 30 seconds - and replug will work. None Edit MtKent 205
2024-02-03 Blowing M1/M3 mirrors Antonio P. Telescope spots not removed. I'll contac Maintenace OT for aproper washing (TBC) None Edit Tenerife
2024-02-03 CHECKED IN SITU THE THRAR CONTROLLER UNIT Antonio P. and Pere (remotely) Spectrograph Confirm that unit itself OK but always red led ON, "Faulty". Power cycle and other actions but no changes at all Show Edit Tenerife
2024-02-01 No connection to FUT CMOS detector Mads Detector The USB connection does not show up on the machine on which the software is running. Maybe a loose USB connector? None Edit MtKent 204
2024-02-01 Thorium Argon lamp controller reporting faults Mads Lamp controller Tried to power cycle the controller but the issue is still persistant. Local investigations of the unit is needed. Bottom unit on the shelf at the back of the container. None Edit Tenerife 203
2024-01-29 Header entries for slit 6 calibration files was set to 0 ... so pipeline fails. Frank Spectrograph Detector None, just something to keep an eye on. The slit id was correct for the rest of the night. None Edit Tenerife
2024-01-29 There seem to be a problem with the slit-guider. Frank Grundahl Slit-guider Tried to stop/start the slit guider on 192.168.67.1 ... looking in the log resulted in error message - see attachment. Activate full shutdown as we cannot observe more tonight. Show Edit Tenerife 202
2024-01-12 Moved the control of the slit guider to the new detector PC in stead of the old kvmtenerife Mads Guider Installed the guide software on the new PC and moved the USB cable to connect to this machine. None Edit Tenerife
2024-01-11 The spectrograph detector was changed from Andor Ikon-L CCD to QHY600 Pro CMOS Mads Spectrograph Change them None Edit Tenerife
2024-01-10 Greased PST motor spindles Mads Motors Used grease from the Pyramid and added this gently to the spindle rods and afterwards moved the moving part back and forth a number of times. None Edit Tenerife
2023-12-12 Observations did not start after sunset, and the weather is fine. Fran Servers ? PROBLEM is gone/solved -- PERHAPS there were no objects available for the first ~30min ... seem ok now. Tried to abort or_req 93185 ... as that was in the queue, but only for execution after midnight. Other time critical ORs are inserted for after 22:00 UT, perhaps that is affecting something ? Comment fom Mads: The conductor had crashed eariler that day. None Edit Tenerife 201
2023-12-12 Temperature in spec. room too high Frank Grundahl Spectrograph room Emailed Jack who will contact building services. None Edit MtKent 200
2023-12-11 Powered off tel-coms, detector, motors and server Mads All Preventive due to power cut tomorrow for UPS work None Edit MtKent
2023-12-09 No weather station data since 07:51 UTC Mads Weather station Both data streams from the Boltwood and the Davis sensor stopped at 07:51 UTC. Guess is that the MINERVA/USQ script fails? None Edit MtKent 199
2023-12-05 Boltwood sensor not reporting correct sky temperatures (cloud condition) Mads Weather station Changed limits in the software to accomodate for the bad readings - readings seemed to be offset. Maybe dirty sensor head? None Edit MtKent
2023-12-04 No connection to the FUT dome and everything inside Mads Electrical / power Checked fibre connection but looks very similar to the issue last week with a flipped circuit breaker. Is something getting wet inside the FUT dome? None Edit MtKent 198
2023-12-02 Observations does not seem to be carried out - telescope can point, but does not seem to start observations Frank Grundahl Telescope Tried stop/start monitor and tcs_comm demon - nothing seem to change. Cancelled a lot of ORs in 'wait' state. No effect. Stopped the monitor, closed dome, parked telescope and povered off. Closed the side-ports. None Edit Tenerife 197
2023-11-28 Replacement of the ThAr lamp Frank Grundahl Spectrograph Duncan and Jack exchanged the SONG ThAr lamp which was throughly 'worn' ... see attached image. Flux checked and is fine after replacement. A lamp from MINERVA was used, as the spare SONG lamp does not seem to fit the mount. Show Edit MtKent
2023-11-23 No connection to the FUT dome, telescope, computers etc Mads All Checked if the fiber connection needed to be reactivated but that did not help. Looks like a power loss or some other kind of bad network connection. It is only affecting the FUT. None Edit MtKent 196
2023-11-18 The pointing model was not so great and targets were some times not acquired. Mads Telescope Made a new pointing model for coude: RMS = 1.03" with 76 stars None Edit Tenerife
2023-11-13 Changed batteries on main SONG UPS Antonio, Pere, Mads Servers While servers were powered off due to planned power cut the battery for the UPS was changed and tested (12 minutes). None Edit Tenerife
2023-11-09 No connection to dome 2 and the FUT dome Mads Network Since we have connection to SONG dome 1 this is again most likely an issue with the fibre connectors for Dome 2 and the FUT dome. Unplugging and replugging could be the fix. None Edit MtKent 195
2023-10-26 Observations stopped due to 'some' critical condition. It seems that the status from PWI for alt and az does not match the OBS pages, not the web cameras. Frank Grundahl Telescope Tried to stop/start the monitor this morning (could not locate problems in the logs). It is cloudy, so perhaps related to guiders not being able to find the guide stars. I have put this under 'important', but it can wait til tomorrow. None Edit MtKent 194
2023-10-25 The aircondition in the spectrograph room seem to go 'bananas' resulting in a dramatic temperature increase in the room Frank Grundahl Spectrograph None - created this post -- is this perhaps the annual adjustment of the system when switching to 'summer-mode' ? (done by USQ building services..?). Show Edit MtKent 193
2023-10-18 Observations stopped due to 'some' critical condition Frank Grundahl ? Total shutdown, no reason to stay open - I cannot find the cause for this in the logs - guessing it might be the guide camera for T1 .... None Edit MtKent 192
2023-10-06 Pupil guider seems broken Mads Pupil guider Tried to restart and power cycle it but the software reports an error on the readout from the camera. It has been disabled in the observing scripts. It was not actively used for anything else than checking. None Edit Tenerife
2023-10-06 Network issue after electrical tests Mads, Jack Many Rebooted several things, replugged many things. Nothing worked or works! None Edit MtKent 191
2023-10-05 Reoccurring electrical instalations check - scheduled power failures Mads Many different Powered off computers and other vulnerable electical hardware - will restart all tomorrow (UTC) / later (local time). Jack checks fibre connectors and sets shutters to remote in domes. None Edit MtKent 190
2023-10-04 Power failure from 16:50 UTC and the whole night Mads, Pere, Antonio All The power cable from Cielo Nocturno was bad. Antonio switched back to old power cable. None Edit Tenerife
2023-10-04 Power failure in FUT dome - now back online Mads FUT electronics The components had power cycled in the FUT dome. So a temporary power failure apparently happened. All seems to be working again. None Edit MtKent
2023-10-02 There seem to be no connection to the site - sstenerife and the 'obs' pages cannot be contacted. When trying to get the 'Observer' page up an error messageConnection timed out Is the server running on host "dbhub.sstenerife.prv" occurs which says: Frank Grundahl Servers -- sonnection None - I do not know how to fix the problem. None Edit Tenerife 189
2023-10-01 No connection to SONG and FUT domes (tel-coms, dome, telescope, webcams etc) Mads Dome connection Could not connect to anything in the domes. Indicates issue with network connection - the fibres. Suggested on site action: Unplug/replug fibre connectors at server side. If not working reset (power cycle) fibre unit in the domes. None Edit MtKent 188
2023-09-14 Weather data not updated for about 2 hours now Mads Weather station It seems the weather data from MINERVA is not being updated None Edit MtKent 187
2023-09-10 Slit guide camera not detectable (usb) Mads Slit guider Does not show up at all on server. Cables and plugs needs to be checked None Edit Tenerife 186
2003-02-24 Checks ThrAr Antonio P., Pere Spectrograph Check the Controller Unit.. "Fault" red led always on.. power recycle, etc... No changes None Edit Tenerife
1970-01-01 washed M1 miorror with distilled water and dried with microfiber cloth Antonio, Mantenamse grup Telescope washed M1 miorror Show Edit Tenerife
1970-01-01 revision and cleaning of dust in container None Edit Tenerife
1970-01-01 washed M1 miorror with distilled water and dried with microfiber cloth Antonio, Mantenamse grup Telescope washed M1 miorror Show Edit Tenerife