---

Subject:	have you recently added a
Author:	Andrew Kirch
Posted:	2015-02-02 10:17

have you recently added a python datasource, or have a custom python datasource I'm suspecting it's not exiting, or is leaking memory.

Andrew Kirch

akirch@gvit.com

Need Zenoss support, consulting or custom development Look no further. Email or PM me!

Ready for Distributed Topology (collectors) for Zenoss 5 Coming May 1st from GoVanguard

---

Subject:	No new Python data soure has been added.
Author:	[Not Specified]
Posted:	2015-02-03 02:42

Hi Andrew

It been rather static over the last months. The only things I've added are some extra snmp graphs and a kiosk display and user.

I haven't even updated the rhel6 environment. So I'm at a loss what cause this problem.
I have to recycle Zenoss every night. And I would prefer not to.

Walther

---

Subject:	WaltB: would you please reply
Author:	Andrew Kirch
Posted:	2015-02-04 11:33

WaltB: would you please reply with a list of installed zenpacks and zenpython.log

There is also an update to ZenPython on the wiki that may help.

Andrew Kirch

akirch@gvit.com

Need Zenoss support, consulting or custom development Look no further. Email or PM me!

Ready for Distributed Topology (collectors) for Zenoss 5 Coming May 1st from GoVanguard

---

Subject:	Hi Andrew
Author:	[Not Specified]
Posted:	2015-02-05 02:04

Hi Andrew

Thanks, I'll try with the wiki ZenPython update. And here's the ZenPacks and Log file:

Rgds

Walt

Loaded ZenPacks

ZenPacks.HP.Proliant.MIBs HP Michael C. Hoffman 1.0
ZenPacks.MMMonitor.mateam MMMonitor Walt 1.0
ZenPacks.Nova.Windows.SNMPPerfMonitor Nova Ryan Matte, Kevin Brebanov 1.7
ZenPacks.SCC.ShowGraphPortlet SCC Anton Menshutin may@chg.ru 0.2
ZenPacks.community.HPMon community Egor Puzanov 2.3.0
ZenPacks.community.LinuxMonitorAddOn community Eric Edgar 1.0
ZenPacks.community.SQLDataSource community Egor Puzanov 2.5.0
ZenPacks.community.WBEMDataSource community Egor Puzanov 3.0
ZenPacks.community.WMIDataSource community Egor Puzanov 3.0
ZenPacks.community.WMIPerf_Windows community Egor Puzanov 2.5.83
ZenPacks.community.deviceAdvDetail community Egor Puzanov 2.9.0
ZenPacks.fdeckert.myeventviews fdeckert fdeckert@sopragroup.com 2.0
ZenPacks.lattus.monitor lattus walt 1.0.0
ZenPacks.skills1st.deviceReports skills1st Jane Curry 2.1
ZenPacks.zenoss.ActiveDirectory zenoss Zenoss 2.1.0
ZenPacks.zenoss.ApacheMonitor zenoss Zenoss 2.1.4
ZenPacks.zenoss.DellMonitor zenoss Zenoss 2.2.0
ZenPacks.zenoss.DeviceSearch zenoss Zenoss 1.2.0
ZenPacks.zenoss.DigMonitor zenoss Zenoss 1.1.0
ZenPacks.zenoss.DnsMonitor zenoss Zenoss 2.1.0
ZenPacks.zenoss.EsxTop zenoss Zenoss 1.1.0
ZenPacks.zenoss.FtpMonitor zenoss Zenoss 1.1.0
ZenPacks.zenoss.HPMonitor zenoss Zenoss 2.1.0
ZenPacks.zenoss.HttpMonitor zenoss Zenoss 2.1.0
ZenPacks.zenoss.IISMonitor zenoss Zenoss 2.0.2
ZenPacks.zenoss.IRCDMonitor zenoss Zenoss 1.1.0
ZenPacks.zenoss.JabberMonitor zenoss Zenoss 1.1.0
ZenPacks.zenoss.LDAPMonitor zenoss Zenoss 1.4.0
ZenPacks.zenoss.LinuxMonitor zenoss Zenoss 1.2.1
ZenPacks.zenoss.MSExchange zenoss Zenoss 2.0.4
ZenPacks.zenoss.MSMQMonitor zenoss Zenoss 1.2.1
ZenPacks.zenoss.MSSQLServer zenoss Zenoss 2.0.3
ZenPacks.zenoss.Microsoft.Windows zenoss Zenoss 2.1.2
ZenPacks.zenoss.MySqlMonitor zenoss Zenoss 3.0.1
ZenPacks.zenoss.NNTPMonitor zenoss Zenoss 1.1.0
ZenPacks.zenoss.NtpMonitor zenoss Zenoss 2.2.0
ZenPacks.zenoss.PySamba zenoss Zenoss 1.0.2
ZenPacks.zenoss.PythonCollector zenoss Zenoss 1.6.2
ZenPacks.zenoss.WBEM zenoss Zenoss 1.0.0
ZenPacks.zenoss.WindowsMonitor zenoss Zenoss 1.1.0
ZenPacks.zenoss.XenMonitor zenoss Zenoss 1.1.0
ZenPacks.zenoss.ZenJMX zenoss Zenoss 3.9.6
ZenPacks.zenoss.ZenossVirtualHostMonitor zenoss Zenoss 2.4.0
ZenPacks.zenoss.oVirt zenoss Zenoss Labs 1.2.0

The ZenPython.log

This is that last part of todays log (and yes I know I'v got a MySql Server down :-) )

2015-02-05 08:43:08,555 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122188.000000 when last update time is 1423122188.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:43:08,556 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122188.000000 when last update time is 1423122188.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_size
2015-02-05 08:45:53,997 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122353.000000 when last update time is 1423122353.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:45:53,998 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122353.000000 when last update time is 1423122353.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:45:53,999 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122353.000000 when last update time is 1423122353.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_size
2015-02-05 08:47:46,496 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122466.000000 when last update time is 1423122466.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:47:46,497 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122466.000000 when last update time is 1423122466.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:47:46,498 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122466.000000 when last update time is 1423122466.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_size
2015-02-05 08:48:08,482 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122488.000000 when last update time is 1423122488.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:48:08,483 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122488.000000 when last update time is 1423122488.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:48:08,484 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122488.000000 when last update time is 1423122488.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_size
2015-02-05 08:50:54,076 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122654.000000 when last update time is 1423122654.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:50:54,077 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122654.000000 when last update time is 1423122654.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:50:54,078 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122654.000000 when last update time is 1423122654.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_size
2015-02-05 08:52:46,495 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122766.000000 when last update time is 1423122766.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:52:46,496 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122766.000000 when last update time is 1423122766.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:52:46,497 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122766.000000 when last update time is 1423122766.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_size
2015-02-05 08:53:08,526 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122788.000000 when last update time is 1423122788.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:53:08,528 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122788.000000 when last update time is 1423122788.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:53:08,529 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122788.000000 when last update time is 1423122788.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_size
2015-02-05 08:55:53,981 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122953.000000 when last update time is 1423122953.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:55:53,983 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122953.000000 when last update time is 1423122953.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:55:53,984 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423122953.000000 when last update time is 1423122953.000000 (minimum one second step) Devices/mdc01a/mysql_servers/root_3307/DbStats_size
2015-02-05 08:57:46,498 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423123066.000000 when last update time is 1423123066.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:57:46,500 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423123066.000000 when last update time is 1423123066.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:57:46,501 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423123066.000000 when last update time is 1423123066.000000 (minimum one second step) Devices/mdctst01/mysql_servers/root_3307/DbStats_size
2015-02-05 08:58:08,565 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423123088.000000 when last update time is 1423123088.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_index_size
2015-02-05 08:58:08,566 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423123088.000000 when last update time is 1423123088.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_data_size
2015-02-05 08:58:08,567 ERROR zen.RRDUtil: rrdtool reported error rrdcached: illegal attempt to update using time 1423123088.000000 when last update time is 1423123088.000000 (minimum one second step) Devices/mdc02a/mysql_servers/root_3307/DbStats_size

---

Subject:	Please reply here if
Author:	Andrew Kirch
Posted:	2015-02-05 10:00

Please reply here if ZenPython continues to break on you.

Andrew Kirch

akirch@gvit.com

Need Zenoss support, consulting or custom development Look no further. Email or PM me!

Ready for Distributed Topology (collectors) for Zenoss 5 Coming May 1st from GoVanguard

---

Subject:	I've installed the zenpython
Author:	[Not Specified]
Posted:	2015-02-06 02:18

I've installed the zenpython 1.7dev. and a process monitor for zenpython.
I'm still restarting the server every night as I'll be off-grid all of next week.

I'll report back week 8.

Rgds

Walt

---

Subject:	Same issue here - Zenpython
Author:	[Not Specified]
Posted:	2015-02-10 09:30

Same issue here - Zenpython has been using tons of swap and eventually crashing (happens about every ~5 days). Logs look identical to mine.

I've been restarting the zenpython daemon every couple of days to avoid it. Nothing has changed on the Zenoss host other than upgrade to WinRM 2.1.3 and zenpython 1.6.2.

---

Subject:	Did you happen to find a solution?
Author:	[Not Specified]
Posted:	2015-07-14 14:51

Did you happen to find a resolution for this I am still experiencing this problem with Zenoss 5.0.3. I made a crontab script to monitor ZenPython service and restart it if memory reaches the limit..

#!/bin/bash

# Stop ZenPython from killing the server!
maxmem="30" # percent
zenpymem=`ps aux | grep -e PythonCollector | grep -v 'grep' | awk '{ print $4 }'`
if [ "$zenpymem" != "" ]; then
memleak=`echo "$zenpymem > $maxmem" | bc -l`
if [ "$memleak" == "1" ]; then
echo "ZenPython consuming >$maxmem% ($zenpymem%) of available memory. Restarting ZenPython service."
serviced service restart zenpython
else
echo "ZenPython operating normally ($zenpymem% memory used)."
fi
fi