TECHZEN Zenoss User Community ARCHIVE  

zenmodeler crash!

Subject: zenmodeler crash!
Author: [Not Specified]
Posted: 2014-06-30 07:13

Hi Guys,

We have a distribuited installation of zenoss with 1 master and 2 collector. On the collector we have several problem to leave the process zenmodeler up&running. We are trying several way but without any lucky so far.

Below an extract from zenmodler.log ( in debug mode ):
2014-06-30 12:35:53,948 INFO zen.ZenModeler: Running 10 clients
2014-06-30 12:35:53,950 DEBUG zen.SnmpClient: Using a max of 40 OIDs per request
2014-06-30 12:35:53,950 DEBUG zen.SnmpClient: running
2014-06-30 12:35:53,950 DEBUG zen.SnmpClient: sending queries for plugin zenoss.snmp.NewDeviceMap
2014-06-30 12:35:53,955 DEBUG zen.SnmpClient: running
2014-06-30 12:35:53,956 DEBUG zen.SnmpClient: sending queries for plugin zenoss.snmp.DeviceMap
2014-06-30 12:35:53,968 DEBUG zen.SnmpClient: running
2014-06-30 12:35:53,968 DEBUG zen.SnmpClient: sending queries for plugin zenoss.snmp.InterfaceMap
2014-06-30 12:35:53,989 DEBUG zen.SQLClient: create pool -4468796280054044029

Above the last lines writted: no information about error or other... simply process crash.

We have tryed to change parameter in zenmodeler.conf but is not working yet.

Any suggestions



Subject: no one? please help me! :-)
Author: [Not Specified]
Posted: 2014-07-02 10:26

no one

please help me! :-)



Subject: no one? please help me! :-)
Author: Roman Bakaleyko
Posted: 2014-07-04 04:25

Hi,
Could you please share somehow with a full log



Subject: Hi Roman and thanks for reply
Author: [Not Specified]
Posted: 2014-07-04 05:24

Hi Roman and thanks for reply.

Unfortunately there isn't any useful information on log. The only thing I saw It's just related to perfsql modelling.
I noted after modelling node with Oracle and zenperf command it crash.

Anyway below an extract of zenmodeler.log:
2014-07-04 12:19:34,951 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXBase
2014-07-04 12:19:34,971 DEBUG zen.SnmpClient: running
2014-07-04 12:19:34,971 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXDeviceMap
2014-07-04 12:19:34,972 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2.6.191.1.3.7 type SNMP_MSG_INTERNAL_OBJECT_LOOKUP - returning None
2014-07-04 12:19:34,974 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2.6.191.1.3.6 type SNMP_MSG_INTERNAL_OBJECT_LOOKUP - returning None
2014-07-04 12:19:34,974 DEBUG zen.SnmpClient: running
2014-07-04 12:19:34,974 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXInterfaceMap
2014-07-04 12:19:35,083 DEBUG zen.SnmpClient: running
2014-07-04 12:19:35,083 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXCPUMap
2014-07-04 12:19:35,153 DEBUG zen.SnmpClient: running
2014-07-04 12:19:35,153 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXPCIMap
2014-07-04 12:19:35,208 DEBUG zen.ZenModeler: Running 2 clients
2014-07-04 12:19:35,259 DEBUG zen.SnmpClient: running
2014-07-04 12:19:35,259 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXVolumeGroupMap
2014-07-04 12:19:36,154 DEBUG zen.SnmpClient: running
2014-07-04 12:19:36,154 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXhdiskMap
2014-07-04 12:19:36,208 DEBUG zen.ZenModeler: Running 2 clients
2014-07-04 12:19:36,234 DEBUG zen.SnmpClient: running
2014-07-04 12:19:36,234 DEBUG zen.SnmpClient: sending queries for plugin community.snmp.AIXmemory
2014-07-04 12:19:36,259 DEBUG zen.SnmpClient: running
2014-07-04 12:19:36,259 DEBUG zen.SnmpClient: sending queries for plugin zenoss.snmp.HRFileSystemMap
2014-07-04 12:19:36,282 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2021.10.1.6.1 type ASN_OPAQUE_FLOAT - returning None
2014-07-04 12:19:36,283 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2021.10.1.6.2 type ASN_OPAQUE_FLOAT - returning None
2014-07-04 12:19:36,283 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2021.10.1.6.3 type ASN_OPAQUE_FLOAT - returning None
2014-07-04 12:19:36,285 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2021.10.1.6.1 type ASN_OPAQUE_FLOAT - returning None
2014-07-04 12:19:36,285 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2021.10.1.6.2 type ASN_OPAQUE_FLOAT - returning None
2014-07-04 12:19:36,285 DEBUG zen.netsnmp: No decoder for oid 1.3.6.1.4.1.2021.10.1.6.3 type ASN_OPAQUE_FLOAT - returning None
2014-07-04 12:19:36,286 DEBUG zen.SnmpClient: running
2014-07-04 12:19:36,286 DEBUG zen.SnmpClient: sending queries for plugin zenoss.snmp.HRSWInstalledMap
2014-07-04 12:19:36,910 DEBUG zen.SQLClient: create pool -4468796280054044029

I leaved conf file with default value and then tryed to change some parameter to fix situation without any luck.

Please give me a suggestion

thanks and regards



Subject: Hi Roman and everybody
Author: [Not Specified]
Posted: 2014-07-21 09:13

Hi Roman and everybody

below the "interesting part" of zenmodelere on DB device:

2014-07-21 16:10:20,544 INFO zen.ZenModeler: Skipping Physical memory (ram) as it matches zFileSystemMapIgnoreTypes.
2014-07-21 16:10:20,544 INFO zen.ZenModeler: Skipping Real memory (ram) as it matches zFileSystemMapIgnoreTypes.
2014-07-21 16:10:20,544 INFO zen.ZenModeler: Skipping Swap space (virtualMemory) as it matches zFileSystemMapIgnoreTypes.
2014-07-21 16:10:20,545 DEBUG zen.Classifier: No classifier defined
2014-07-21 16:10:20,571 DEBUG zen.ZenModeler: Running 1 clients
2014-07-21 16:10:21,058 INFO zen.ZenModeler: Changes in configuration applied
2014-07-21 16:10:21,059 DEBUG zen.ZenModeler: Client 10.8.155.12 finished
2014-07-21 16:10:21,059 DEBUG zen.ZenModeler: Running 0 clients
2014-07-21 16:10:21,059 INFO zen.ZenModeler: Scan time: 8.99 seconds
2014-07-21 16:10:21,059 DEBUG zen.thresholds: Checking value 8.99242019653 on Daemons/OMP-PMN-A-01/zenmodeler_cycleTime
2014-07-21 16:10:21,060 DEBUG zen.MinMaxCheck: Checking zenmodeler_cycleTime 8.99242019653 against min None and max 34560.0
2014-07-21 16:10:21,060 DEBUG zen.ZenModeler: Queued event (total of 1) {'zenoss.device.url': 'zport/dmd/Monitors/Performance/OMP-PMN-A-01/viewDaemonPerformance', 'zenoss.device.path': 'Monitors/Performance/OMP-PMN-A-01', 'severity': 0, 'min': None, 'max': 34560.0, 'component': '', 'agent': 'zenmodeler', 'summary': 'threshold of zenmodeler cycle time restored: current value 8.992420', 'current': 8.992420196533203, 'manager': 'OMP-PMN-A-01.wind.root.it', 'eventKey': 'zenmodeler cycle time', 'rcvtime': 1405951821.060661, 'device': 'OMP-PMN-A-01 collector', 'eventClass': '/Perf', 'monitor': 'OMP-PMN-A-01'}
2014-07-21 16:10:21,061 DEBUG zen.collector.scheduler: In shutdown stage before
2014-07-21 16:10:21,061 DEBUG zen.ZenModeler: Tried to stop reactor that was stopped
2014-07-21 16:10:21,061 INFO zen.ZenModeler: Daemon ZenModeler shutting down
2014-07-21 16:10:21,061 DEBUG zen.ZenModeler: Sending 1 events, 0 perf events, 0 heartbeats
2014-07-21 16:10:21,072 DEBUG zen.ZenModeler: Removing service EventService
2014-07-21 16:10:21,072 DEBUG zen.ZenModeler: Removing service ModelerService
2014-07-21 16:10:21,072 DEBUG zen.pbclientfactory: Lost connection to 10.55.146.160:8789 - [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion: Connection lost.
]
2014-07-21 16:10:21,072 DEBUG zen.collector.scheduler: In shutdown stage during
2014-07-21 16:10:21,243 DEBUG zen.collector.scheduler: In shutdown stage after
Exception TypeError: 'isinstance() arg 2 must be a class, type, or tuple of classes and types' in > ignored
Exception TypeError: 'isinstance() arg 2 must be a class, type, or tuple of classes and types' in > ignored
Exception TypeError: 'isinstance() arg 2 must be a class, type, or tuple of classes and types' in > ignored
Exception TypeError: 'isinstance() arg 2 must be a class, type, or tuple of classes and types' in > ignored
Exception TypeError: 'isinstance() arg 2 must be a class, type, or tuple of classes and types' in > ignored

--------------

The strange thing is that we have 1 Zenoss Master and 2 Zenoss Collector and Zenoss crash on both collector. Note we dont use manager as collecting station.

Suggestions

thanks in advance for any help



Subject: Another bit
Author: [Not Specified]
Posted: 2014-07-22 04:39

Comparing crash of zenmodeler with zenmodeler log shown a direct relation from running oracle plugin and crashing of zenmodeler... issue seems to be related to below exeption:

Exception TypeError: 'isinstance() arg 2 must be a class, type, or tuple of classes and types' in > ignored

Someone know how to fix it



< Previous
4.2.5 and winrm not working
  Next
New to Zenoss and need help with email alert
>