Mycodo daemon terminated

Hi collegues,

i have an issue with the Mycodo daemon terminating itself after some random period of time. Happening like every two days now after 3 months of no-problems run. After i have to manually turn off and on the Raspberry to restart the system.

This is my Daemon Log before shutdown:

2023-01-16 06:16:40,596 - ERROR - mycodo.controllers.controller_input_cb7a1007 - StopIteration raised 3 times. Possibly could not read input. Ensure it’s connected properly and detected.
2023-01-16 06:16:55,070 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:16:55,581 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:09,904 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:10,410 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:25,186 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:25,692 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:25,704 - ERROR - mycodo.controllers.controller_input_cb7a1007 - StopIteration raised 3 times. Possibly could not read input. Ensure it’s connected properly and detected.
2023-01-16 06:17:39,985 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:40,486 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:55,234 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:17:55,743 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:09,898 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:10,400 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:10,401 - ERROR - mycodo.controllers.controller_input_cb7a1007 - StopIteration raised 3 times. Possibly could not read input. Ensure it’s connected properly and detected.
2023-01-16 06:18:25,172 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:25,682 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:39,873 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:40,374 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:55,171 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:55,682 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:18:55,683 - ERROR - mycodo.controllers.controller_input_cb7a1007 - StopIteration raised 3 times. Possibly could not read input. Ensure it’s connected properly and detected.
2023-01-16 06:19:09,901 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:19:10,403 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 121] Remote I/O error
2023-01-16 06:19:23,963 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_111 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:23,974 - ERROR - mycodo.controllers.controller_input_0ddd5c7d - StopIteration raised 3 times. Possibly could not read input. Ensure it’s connected properly and detected.
2023-01-16 06:19:26,439 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:27,477 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_99 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:28,517 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_100 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:29,557 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_99 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:30,597 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_105 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:32,997 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_102 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:33,828 - INFO - mycodo.daemon - Received command to terminate daemon
2023-01-16 06:19:34,037 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_108 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:34,708 - INFO - mycodo.controllers.controller_input_ba5fdf02 - Deactivated in 0.3 ms
2023-01-16 06:19:34,730 - INFO - mycodo.controllers.controller_input_be86c402 - Deactivated in 22.3 ms
2023-01-16 06:19:34,737 - INFO - mycodo.controllers.controller_function_e80ebcd8 - Deactivated in 30.3 ms
2023-01-16 06:19:34,743 - INFO - mycodo.controllers.controller_input_d9998ef4 - Deactivated in 35.4 ms
2023-01-16 06:19:34,748 - INFO - mycodo.controllers.controller_input_5a119ef9 - Deactivated in 40.5 ms
2023-01-16 06:19:34,749 - INFO - mycodo.controllers.controller_input_cb7a1007 - Deactivated in 42.0 ms
2023-01-16 06:19:34,753 - INFO - mycodo.controllers.controller_input_73ad3055 - Deactivated in 46.0 ms
2023-01-16 06:19:34,762 - INFO - mycodo.controllers.controller_input_7eacddf7 - Deactivated in 54.8 ms
2023-01-16 06:19:34,781 - INFO - mycodo.controllers.controller_input_817e28f5 - Deactivated in 73.4 ms
2023-01-16 06:19:34,796 - INFO - mycodo.controllers.controller_input_401a54ef - Deactivated in 88.3 ms
2023-01-16 06:19:34,796 - INFO - mycodo.controllers.controller_input_ee075a73 - Deactivated in 89.1 ms
2023-01-16 06:19:34,883 - INFO - mycodo.controllers.controller_pid_72e025a3 - Deactivated in 175.4 ms
2023-01-16 06:19:34,899 - INFO - mycodo.controllers.controller_trigger_21d79c19 - Deactivated in 191.7 ms
2023-01-16 06:19:34,913 - INFO - mycodo.controllers.controller_trigger_9264b39d - Deactivated in 205.9 ms
2023-01-16 06:19:34,932 - INFO - mycodo.controllers.controller_trigger_ad799a4c - Deactivated in 224.2 ms
2023-01-16 06:19:34,945 - INFO - mycodo.controllers.controller_function_3dfeb19d - Deactivated in 238.0 ms
2023-01-16 06:19:34,946 - INFO - mycodo.controllers.controller_trigger_7e4c9ca5 - Deactivated in 238.2 ms
2023-01-16 06:19:34,946 - INFO - mycodo.daemon - All Function controllers stopped
2023-01-16 06:19:34,947 - INFO - mycodo.daemon - All PID controllers stopped
2023-01-16 06:19:35,077 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_111 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:35,178 - INFO - mycodo.controllers.controller_input_0ddd5c7d - Deactivated in 470.9 ms
2023-01-16 06:19:35,512 - INFO - mycodo.controllers.controller_input_cd8010c8 - Deactivated in 804.7 ms
2023-01-16 06:19:36,117 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_102 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:36,219 - INFO - mycodo.controllers.controller_input_3de2d3bd - Deactivated in 1511.3 ms
2023-01-16 06:19:37,157 - DEBUG - mycodo.devices.atlas_scientific_i2c_1_108 - AtlasScientificI2C raised an exception when taking a reading: [Errno 110] Connection timed out
2023-01-16 06:19:37,259 - INFO - mycodo.controllers.controller_input_4782a807 - Deactivated in 2551.6 ms
2023-01-16 06:19:37,260 - INFO - mycodo.daemon - All Input controllers stopped
2023-01-16 06:19:37,261 - INFO - mycodo.daemon - All Trigger controllers stopped
2023-01-16 06:19:37,262 - INFO - mycodo.daemon - All Conditional controllers stopped
2023-01-16 06:19:37,306 - INFO - mycodo.outputs.on_off_gpio_7624daa3 - Stopped in 0.1 ms
2023-01-16 06:19:37,307 - INFO - mycodo.outputs.on_off_gpio_1f048571 - Stopped in 0.1 ms
2023-01-16 06:19:37,308 - INFO - mycodo.outputs.on_off_gpio_256ea838 - Stopped in 0.1 ms
2023-01-16 06:19:37,308 - INFO - mycodo.outputs.on_off_gpio_c84921aa - Stopped in 0.1 ms
2023-01-16 06:19:37,309 - INFO - mycodo.outputs.on_off_gpio_d25c7e06 - Stopped in 0.1 ms
2023-01-16 06:19:37,309 - INFO - mycodo.outputs.on_off_gpio_c01c386a - Stopped in 0.1 ms
2023-01-16 06:19:37,310 - INFO - mycodo.outputs.on_off_gpio_1d71afd8 - Stopped in 0.0 ms
2023-01-16 06:19:37,310 - INFO - mycodo.outputs.on_off_gpio_5c4a8b79 - Stopped in 0.1 ms
2023-01-16 06:19:37,311 - INFO - mycodo.outputs.pump_gpio_8a84593c - Stopped in 0.0 ms
2023-01-16 06:19:37,311 - INFO - mycodo.outputs.pump_gpio_2fc65727 - Stopped in 0.0 ms
2023-01-16 06:19:37,312 - INFO - mycodo.outputs.pump_gpio_c7a96a41 - Stopped in 0.0 ms
2023-01-16 06:19:37,312 - INFO - mycodo.outputs.pump_gpio_5b90cd64 - Stopped in 0.0 ms
2023-01-16 06:19:37,312 - INFO - mycodo.outputs.pump_atlas_ezo_pmp_951f9737 - Stopped in 0.0 ms
2023-01-16 06:19:37,313 - INFO - mycodo.controllers.controller_output - Deactivated in 50.7 ms
2023-01-16 06:19:37,449 - INFO - mycodo.controllers.controller_widget - Deactivated in 135.4 ms
2023-01-16 06:19:37,450 - INFO - mycodo.daemon - Mycodo daemon terminated in 3.623 seconds

The I2C exeptions follows back to 15th of january @ 14:50. This one is exeptionaly long, as before the log showed only few of these lines before termination.

I turned on the logs for each input so will update as soon as this will happen again.

I found mentions pointing to
adding delay after bus = smbus.SMBus(1), but this is where i got stuck.

Wondering if some of you already faced this issue.

Thank you for any tips.

This error indicates an issue being able to communicate with the device. Do any of your devices have the following?

  • insecure connection
  • long wire
  • insufficient power

If any do, then this can potentially be the cause of the symptoms you’re seeing with all devices on your I2C bus.

Thanks for quick answer,

the network the pi is running on is super secure,
all probes runs on original cables without extension, interfaced via Whitebox T3 with Atlas circuits.
Everything without issues for almost half year in prototyping mode, but suddenly this starts to occur.

I will double check the power efficiency and just one more time revise the connections on the boards. Will be back with info. Blessings