TECHZEN Zenoss User Community ARCHIVE  

Zenoss Core 5 event console no longer displaying new events in the event archive

Subject: Zenoss Core 5 event console no longer displaying new events in the event archive
Author: Larry Virden
Posted: 2016-06-08 08:42

Has anyone encountered this situation

This morning around 9am we began noticing that the newest events in our event archive were from 8:30 this morning. New events are appearing in the event console - they just are not appearing in the archive after being closed.

I looked in /opt/zenoss/log but the only log showing any updates is the zenhub.log which says nothing about issues with the event console.

Thank you for your help.



Subject: Events don't immediately go
Author: Jane Curry
Posted: 2016-06-08 09:58

Events don't immediately go to to the archive. They sit in your Event Console, possibly with a Closed or Cleared status for the time configured in ADVANCED -> Settings -> Events -> "Event Archive Threshold (minutes)". This is 4320 by default, or 3 days.

Are there events in Closed, Cleared or Aged status in the Event Console, that are older than this Archive Threshold

Cheers,

Jane

Email: jane.curry@skills-1st.co.uk    Web: https://www.skills-1st.co.uk



Subject: More on our event situation1
Author: Larry Virden
Posted: 2016-06-08 10:07

1. Our Event Archive Threshold (minutes) is set to 1.

2. Before today, events were showing up in the archive rather quickly, once closed or aged out.

3. We just discovered a few minutes ago thatno events are showing up in the console or the archive since 8:30am today. I restarted the event service and that didn't help, so we have rebooted the entire machine. It just became available so we are testing now.



Subject: I have a vague feeling that
Author: Jane Curry
Posted: 2016-06-08 10:19

I have a vague feeling that the process that moves events from Console to Archive will not cope with a 1 minute interval. An hour rings very faint bells for me. Why do you want to get them to archive so quickly

zeneventserver is the daemon that does this so check his log files.

Cheers,

Jane

Email: jane.curry@skills-1st.co.uk    Web: https://www.skills-1st.co.uk



Subject: Could this have impacted things?
Author: Larry Virden
Posted: 2016-06-08 10:20

So after the machine was rebooted, new events are once again appearing in the event console and archive.

Early this morning, around 8am, I had taken the following steps:

serviced service shell -s json_one zenhub

cd /home/zenoss/bin

vi script

made some changes to a bash script that uses JSON to retrieve event information and formats it

exit

serviced snapshot commit json_one

serviced service restart zenhub

The above finished between 8:30 and 9am this morning.

A bit after 9am was when we noticed not seeing new events - however, we didn't touch anything to do with events coming into the software.

We spent a couple of hours trying to figure out what was going on. As I mentioned a moment ago, I went into command center, looked at logs, and eventually did a restart on the event service. Still no events appeared.

Only after we rebooted the machine did we see resumption of the events - and of course all the intervening alerts were lost.

Could there be some connection between editing the shell command and committing that change and the loss of events



Subject: zenoss core 5 zeneventserver log
Author: Larry Virden
Posted: 2016-06-08 11:20

Okay, so now that the machine rebooted, all I see in the event server log is what has happened since the reboot.

During the reboot some things turn up with warnings - and most of the health checks fail with an exit status of 1.

Are older versions of the logs stored somewhere on disk



Subject: I've the similar issue
Author: [Not Specified]
Posted: 2016-08-03 20:20

my issue is even worse,new events are not showing in event console, although I created it successfully.
can you give me some guide on how to solve it



Subject: Troubleshooting
Author: Larry Virden
Posted: 2016-08-04 05:59

The only thing that we did that helped was rebooting the machine - and I suspect that was simplybecause some process had hung or crashed and Zenoss Core 5 couldn't get it restarted.



Subject: Get it resolved
Author: [Not Specified]
Posted: 2016-08-04 23:04

Finally fixed it.

Reason isthe mariaDB "zenoss_zep" crashed, manually drop this db and manually recreate the schema, reboot machines,then events show up.



< Previous
startat parameter for zenmodeler daemon
  Next
JSON interface returning unexpected results
>