Zenoss ZenTech Community

I stood up a dev instance and have some base device monitoring in place. Can you point me to documentation / examples as to how I forward KPI data to an external OpenTSDB

Subject:	No, you can't stream OpenTSDB
Author:	Jan Garaj
Posted:	2015-11-04 19:42

No, you can't stream OpenTSDB data. However OpenTSDB uses HBase and HBase is the right candidate for replication. Actually there is HBase cluster (3xHBase container) - do you really need replication

Devops Monitoring Expert advice: Dockerize/automate/monitor all the things.

DevOps stack: Docker / Kubernetes / Mesos / Zabbix / Zenoss / Grafana / Puppet / Ansible / Vagrant / Terraform / Elasticsearch

Subject:	See: hbase\|apache\|org/book
Author:	Jan Garaj
Posted:	2015-11-04 19:44

See: hbase|apache|org/book.html#_cluster_replication

Subject:	Clarification on my request
Author:	Ken Jenkins
Posted:	2015-11-06 15:13

As we collect KPI data in Zenoss, we need to forward that data to an external instance of OpenTSDB. Is there an API or sample code or documentation that will allow me to do this

Subject:	Updated my question
Author:	Ken Jenkins
Posted:	2015-11-06 15:18

Thanks for the response. I revised my request for help.

Subject:	Another spin on my request
Author:	Ken Jenkins
Posted:	2015-11-06 15:39

Can I reconfigure Zenoss Core 5 to use another external OpenTSDB from the default version installed Are there any restriction as to what version Zenoss Core 5 can point to

Subject:	Looking for options
Author:	Ken Jenkins
Posted:	2015-11-06 16:59

I looked through the install documentation and I do not see a way to reconfigure Zenoss Core 5 to point to another OpenTSDB. Is it possible to create a ZenPack to forward data to an OpenTSDB similar to the core 4 OpenTSDB zenpack used with RRD's

We are pressed to get something working with Core 5 ... else we may have to consider using Core 4 and the above community ZenPack. http://wiki.zenoss.org/ZenPack:OpenTSDB

Advice is appreciated.

Subject:	Zenpacklib.py is not available with Zenoss Core 5
Author:	Ken Jenkins
Posted:	2015-11-06 17:00

Since Zenpacklib.py is not available with Zenoss Core 5, what is the best practice we should use with creating ZenPacks in Core 5

Subject:	Yes, you should to be able to
Author:	Jan Garaj
Posted:	2015-11-06 17:38

Yes, you should to be able to use external OpenTSDB, however no official documentation is provided. You should to dig into the setting/code of MetricConsumer service.

Subject:	Docker container: serviced
Author:	Jan Garaj
Posted:	2015-11-09 13:36

Docker container: serviced service status | grep MetricConsumer | awk '{print $7}'
Used Docker image: docker ps | grep "$(serviced service status | grep MetricConsumer | awk '{print $7}')" | awk '{print $2}'

Subject:	Configuration file found ... Need help with what to change ...
Author:	Ken Jenkins
Posted:	2015-11-09 18:36

The below config file might be all I need to change but want to check to see if this is the right approach ... Should I change local host to the external host IP of my OpenTSDB

If I change it, how do I commit the docker change

clients:
- {host: localhost, port: 4242}

::::::::::::::
configuration.yaml
::::::::::::::
authEnabled: true

logging:
level: INFO

http:
port: 8443
adminPort: 58443
connectorType: nonblocking
ssl:
keyStore: etc/metric-consumer-app/cert/ssl.pfx
keyStorePassword: zapp_pass
keyStoreType: pkcs12
requestLog:
console:
enabled: false

webSocketConfiguration:
maxTextMessageSize: 10485760

metricService:
jobSize: 1000
highCollisionMark: 2000000
maxClientWaitTime: 60000
minTimeBetweenBroadcast: 200
tsdbWriterThreads: 1
maxIdleTime: 10000
maxConnectionBackOff: 5000
minConnectionBackOff: 100
openTsdbClientPool:
maxKeepAliveTime: 300000
minTestTime: 60000
clientBufferSize: 65536
clients:
- {host: localhost, port: 4242}

clientFactory:
keepAlive: true
connectTimeout: 1000
soTimeout: 1000

managedReporter:
metricReporters:
- {posterType: http, username: "$env[CONTROLPLANE_CONSUMER_USERNAME]", password: "$env[CONTROLPLANE_CONSUMER_PASSWORD]", urlEnvironment: "CONTROLPLANE_CONSUMER_URL"}
- {posterType: bean, beanName: metric-service-poster}
::::::::::::::

Subject:	Follow Up
Author:	Ken Jenkins
Posted:	2015-11-10 19:39

If I update this config file, do I disable HBASE from Zenoss since an external OpenTSDB will be used or is the not the correct approach to configuring an external OpenTSDB

I still need help updating the configuration files, changing them and committing the changes. Help!

Subject:	Still having issues with updating the opentsdb container
Author:	Ken Jenkins
Posted:	2015-11-11 19:21

I need to update the opentsdb.conf file to allow Grafana to display available metrics. I can connect Grafana to Zenoss Core 5 but cannot add tags.

Please let me know how I can update the opentsdb container and save / commit my changes.

Help is appreciated since I am on a critical timeline to get this done. We may have to resort to using core 4 and the OpenTSDB Zenpack to forward metrics if I cannot update Zenoss Core 5.

Thank you,
Ken

Subject:	Metric Consumer Re-pointed to another OpenTSDB
Author:	Ken Jenkins
Posted:	2015-11-12 13:46

MetricConsumer -> /opt/zenoss/etc/metric-consumer-app/configuration.yaml updated and MetricConsumer was restarted.

- I changed localhost to the new IP for the external OpenTSDB saved the configuration and restarted the service.
- I restarted MetricConsumer and reviewed Zenoss graphs and as I thought, data and collections stopped graphing.

For Zenoss to start graphing again, I assume I need to perform the following:

- Verify metrics are sent in the new OpenTSDB.

Once I validate the above is working, I need to know if I need to update the configuration for Zenoss Core 5 HBASE service and / or do I need to update the Metric Shipper container for graphing to function once more.

Please provide some advice on this.

Thanks,
Ken

Subject:	I was able to update the
Author:	Ken Jenkins
Posted:	2015-11-13 09:46

I was able to update the Metric Consumer to send to multiple OpenTSDB servers localhost and a remote host. I restarted the Metric Consumer Service an all works.

Subject:	Zenoss Core 5 - How do I forward KPI data to an external OpenTSDB? (Resolved)
Author:	Ken Jenkins
Posted:	2015-11-04 18:53

Zenoss Core 5 - How do I forward KPI data to an external OpenTSDB? (Resolved)