TECHZEN Zenoss User Community ARCHIVE  

Adding more of the same Daemons

Subject: Adding more of the same Daemons
Author: [Not Specified]
Posted: 2014-11-07 07:01

Hi,

I am looking for a way to add more daemons to my Zenoss 4.2.5 installation to distribute the load between them.

For instance, if I have 3000 ping devices. I want to give each Zenping daemon 1500 devices to handle so that one doesn't become overloaded and potentially crash.

I have already added another collector, just not sure where to go from here as I couldn't find any documentation surrounding this.

Any help would be appreciate :)



Subject: you're going to have to
Author: Andrew Kirch
Posted: 2014-11-07 09:14

you're going to have to assign 1500 devices per collector. Workers are a Zenoss Resource Manager feature and require a commercial license.

Andrew Kirch

akirch@gvit.com

Need Zenoss support, consulting or custom development Look no further. Email or PM me!

Ready for Distributed Topology (collectors) for Zenoss 5 Coming May 1st from GoVanguard



Subject: So basically, another
Author: [Not Specified]
Posted: 2014-11-10 00:32

So basically, another collector would only truly help if I have a commercial license

Otherwise I don't see much benefit for it as it doesn't duplicate daemons.



Subject: Diabolix: each collector has
Author: Andrew Kirch
Posted: 2014-11-11 13:32

Each collector has it's own set of Daemons, so yes additional collectors will help spread the load. The commercial software load-balances between daemons using workers, so that the zenping load can be spread across several running processes.
My apologies if I wasn't clear.

Andrew Kirch

akirch@gvit.com

Need Zenoss support, consulting or custom development Look no further. Email or PM me!

Ready for Distributed Topology (collectors) for Zenoss 5 Coming May 1st from GoVanguard



Subject: Is there any guide on how to
Author: [Not Specified]
Posted: 2014-11-14 05:39

Is there any guide on how to setup another local collector on 4.2.5 Meaning two collectors on the same box.

I added the collector, and changed the device to use the second collector, but I don't get any graphs so I am obviously missing something.



Subject: you can't run two collectors
Author: Andrew Kirch
Posted: 2014-11-18 09:09

you can't run two collectors on one os instance, you'll have to spin up a vm

Andrew Kirch

akirch@gvit.com

Need Zenoss support, consulting or custom development Look no further. Email or PM me!

Ready for Distributed Topology (collectors) for Zenoss 5 Coming May 1st from GoVanguard



Subject: Thanks Trelane, will start
Author: [Not Specified]
Posted: 2014-11-20 07:38

Thanks Trelane, will start playing around with adding another collector through a VM.

Any link to maybe an updated guide to doing this

UPDATE: Did the following guide, http://community.zenoss.org/docs/DOC-5861

Now when I go to the remote collector through the master UI to view the performance of the remote collector. Then all the graphs give error type icons, like it can't load. Also added a device to the remote collector, but can't see it being monitored. Not sure if that guide is a bit out of date for 4.2.5 or what I am doing wrong.



Subject: Getting the following when
Author: [Not Specified]
Posted: 2014-11-24 06:56

Getting the following when trying to add the remote collector.

014-11-24 14:51:21,000 INFO zen.updateCollector: Add Remote Collector 10.16.100.84
2014-11-24 14:51:21,000 INFO zen.updateCollector: Stopping zenoss daemons
2014-11-24 14:51:23,000 INFO zen.updateCollector: bash: zenoss: command not found
2014-11-24 14:51:23,000 INFO zen.updateCollector: Remove ZenPacks files from Remote Collector
2014-11-24 14:51:24,000 INFO zen.updateCollector: Copy ZenPacks files to Remote Collector
2014-11-24 14:51:30,000 INFO zen.updateCollector: 117240 blocks
2014-11-24 14:51:30,000 INFO zen.updateCollector: Update Remote Collector configuration
2014-11-24 14:51:31,000 INFO zen.updateCollector: Starting zenoss daemons
2014-11-24 14:51:32,000 INFO zen.updateCollector: bash: zenoss: command not found
2014-11-24 14:51:32,000 INFO zen.updateCollector: All Tasks Finished

I guess the command not found part is causing the collector to not functioning properly.

Has anyone got this working on a 4.2.5 installation

Also been following this doc: http://community.zenoss.org/docs/DOC-2496

But it seems a bit outdated, as I can't seem to find where to remove MySQL.



Subject: Okay the daemons from the
Author: [Not Specified]
Posted: 2014-11-25 05:45

Okay the daemons from the remote collector (10.16.100.84) are now connecting to the main hub (10.16.100.85).

Also changed global.conf, zope.conf,zodb_db_main.conf and zodb_db_session.conf on the remote collector to use the main MySQL database (10.16.100.85).

Now when I add a device to the local connector everything works like it should, but when I add a device to the remote collector it gets added onto the webpage, but I am not seeing any RRD files for the device on the remote or local collector (Guess it will be populated on the remote collector). The graphs for remote collector performance is also just displaying -nan. So I am not sure if its a permission issue or what.

Any suggestions and will V5 makes this process smoother



Subject: Zenoss produces and supports
Author: Andrew Kirch
Posted: 2014-11-25 12:21

Zenoss produces and supports a distributed collector plugin which is a commercial feature of Resource Manager. The community plugin is community supported only. It will be up to the community to continue to update and maintain this plugin in the future.

Andrew Kirch

akirch@gvit.com

Need Zenoss support, consulting or custom development Look no further. Email or PM me!

Ready for Distributed Topology (collectors) for Zenoss 5 Coming May 1st from GoVanguard



Subject: Diabolix, what daemons are
Author: [Not Specified]
Posted: 2014-12-04 16:49

Diabolix, what daemons are running on both hubs I recently configured a similar setup on 4.2.5 in a small lab. I don't believe I had the same issue that you are having, but I did have plenty trying to get it to work.

Trelane, is there a reason you cannot run multiple logical collectors on the same hub I have a box doing just that and, so far, have not seen any adverse affects.



Subject: Here:
Author: Brad
Posted: 2014-12-10 16:49

Here:

https://github.com/epuzanov/ZenPacks.community.DistributedCollectors

Follow his docs. Read the comments for a couple minor fixes. Works perfectly. And yes you can have a single server with a bunch of VM's do this. Use ramdisks for the RRD files. Which is the most active part of the pollers.



< Previous
Device list not rendering/displaying
  Next
MIssing Dependency Repository
>