Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[dev.icinga.com #6810] High Availablity does not synchronise the data like expected #1834

Closed
icinga-migration opened this issue Jul 30, 2014 · 11 comments
Labels
area/distributed Distributed monitoring (master, satellites, clients) bug Something isn't working
Milestone

Comments

@icinga-migration
Copy link

This issue has been migrated from Redmine: https://dev.icinga.com/issues/6810

Created by dgoetz on 2014-07-30 08:12:20 +00:00

Assignee: (none)
Status: Closed (closed on 2014-08-06 07:57:31 +00:00)
Target Version: 2.0.2
Last Update: 2014-08-06 07:57:31 +00:00 (in Redmine)

Icinga Version: 2.0.1-1

High Availablity does not synchronise the data like expected.

I created a setup with a ha zone based on sles 11 sp3 and the release packages of icinga2 (r2.0.1-1), which synchronized the configuration fine but is not syncing the check results. also it seems to execute mysql statements on both nodes destroying the master-master-replication off the locally installed mysql servers. On this setup I have seen TLS/SSL problems so this could be a split brain situation which it is not recovering also network connections seems fine.

Because of this problems I tried to recreate the setup in some virtual machines based on centos6, first with the same release packages then with the snapshot packages. It is telling me on both nodes that they are connected to each other. But the data in the classic ui are only from its own check results. During a restart I also see the TLS problem on the other node (like expected api is shutdown during restart, so I think this is fine) and both nodes are executing mysql statements until I see the pausing message again, but replication is already broken.

Seems to work fine but no synchronisation of the data:
icinga2c1:

[2014-07-30 07:26:03 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:03 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:03 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:03 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:03 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:04 +0000] notice/ThreadPool: Pool #1: Pending tasks: 0; Average latency: 0ms; Threads: 4; Pool utilization: 0.00920878%
[2014-07-30 07:26:08 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:08 +0000] notice/WorkQueue: #4 items: 0
[2014-07-30 07:26:08 +0000] notice/WorkQueue: #2 items: 0
[2014-07-30 07:26:08 +0000] notice/WorkQueue: #3 items: 0
[2014-07-30 07:26:08 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:08 +0000] debug/CheckerComponent: Executing check for "localhost!load"
[2014-07-30 07:26:08 +0000] notice/ApiListener: Relaying "event::SetNextCheck" message
[2014-07-30 07:26:08 +0000] notice/ApiListener: Sending message to "icinga2c2"
[2014-07-30 07:26:08 +0000] notice/Process: Running command "/usr/lib64/nagios/plugins/check_load", "-c", "10,6,4", "-w", "5,4,3": PID 2416
[2014-07-30 07:26:08 +0000] debug/CheckerComponent: Check finished for object "localhost!load"
[2014-07-30 07:26:08 +0000] notice/Process: PID 2416 terminated with exit code 0
[2014-07-30 07:26:08 +0000] debug/DbEvents: add service check history for "localhost!load"
[2014-07-30 07:26:08 +0000] debug/DbObject: Updating object vars for "localhost!load"
[2014-07-30 07:26:08 +0000] debug/DbObject: object customvar key: "sla" value: "24x7" overridden: 0
[2014-07-30 07:26:08 +0000] debug/DbObject: Endpoint node: "icinga2c1" status update for "localhost!load"
[2014-07-30 07:26:08 +0000] notice/ApiListener: Relaying "event::CheckResult" message
[2014-07-30 07:26:08 +0000] notice/ApiListener: Sending message to "icinga2c2"
[2014-07-30 07:26:08 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:08 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:08 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:09 +0000] notice/WorkQueue: #15 items: 0
[2014-07-30 07:26:13 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:13 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:13 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:13 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:13 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:14 +0000] notice/StatusDataWriter: Writing status.dat file took less than 1 millisecond
[2014-07-30 07:26:18 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:18 +0000] notice/WorkQueue: #4 items: 0
[2014-07-30 07:26:18 +0000] notice/WorkQueue: #2 items: 0
[2014-07-30 07:26:18 +0000] notice/WorkQueue: #3 items: 0
[2014-07-30 07:26:18 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:18 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:18 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:18 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:19 +0000] notice/WorkQueue: #15 items: 0
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::SetNextCheck" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::CheckResult" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::SetNextCheck" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::CheckResult" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ThreadPool: Pool #1: Pending tasks: 0; Average latency: 0ms; Threads: 4; Pool utilization: 0.00672153%
[2014-07-30 07:26:19 +0000] debug/CheckerComponent: Executing check for "localhost!ping4"
[2014-07-30 07:26:19 +0000] notice/ApiListener: Relaying "event::SetNextCheck" message
[2014-07-30 07:26:19 +0000] notice/ApiListener: Sending message to "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/Process: Running command "/usr/lib64/nagios/plugins/check_ping", "-4", "-H", "127.0.0.1", "-c", "200,15%", "-w", "100,5%": PID 2417

icinga2c2:

[2014-07-30 07:26:03 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:03 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:03 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:03 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:03 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:04 +0000] notice/ThreadPool: Pool #1: Pending tasks: 0; Average latency: 0ms; Threads: 4; Pool utilization: 0.00920878%
[2014-07-30 07:26:08 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:08 +0000] notice/WorkQueue: #4 items: 0
[2014-07-30 07:26:08 +0000] notice/WorkQueue: #2 items: 0
[2014-07-30 07:26:08 +0000] notice/WorkQueue: #3 items: 0
[2014-07-30 07:26:08 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:08 +0000] debug/CheckerComponent: Executing check for "localhost!load"
[2014-07-30 07:26:08 +0000] notice/ApiListener: Relaying "event::SetNextCheck" message
[2014-07-30 07:26:08 +0000] notice/ApiListener: Sending message to "icinga2c2"
[2014-07-30 07:26:08 +0000] notice/Process: Running command "/usr/lib64/nagios/plugins/check_load", "-c", "10,6,4", "-w", "5,4,3": PID 2416
[2014-07-30 07:26:08 +0000] debug/CheckerComponent: Check finished for object "localhost!load"
[2014-07-30 07:26:08 +0000] notice/Process: PID 2416 terminated with exit code 0
[2014-07-30 07:26:08 +0000] debug/DbEvents: add service check history for "localhost!load"
[2014-07-30 07:26:08 +0000] debug/DbObject: Updating object vars for "localhost!load"
[2014-07-30 07:26:08 +0000] debug/DbObject: object customvar key: "sla" value: "24x7" overridden: 0
[2014-07-30 07:26:08 +0000] debug/DbObject: Endpoint node: "icinga2c1" status update for "localhost!load"
[2014-07-30 07:26:08 +0000] notice/ApiListener: Relaying "event::CheckResult" message
[2014-07-30 07:26:08 +0000] notice/ApiListener: Sending message to "icinga2c2"
[2014-07-30 07:26:08 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:08 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:08 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:09 +0000] notice/WorkQueue: #15 items: 0
[2014-07-30 07:26:13 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:13 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:13 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:13 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:13 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:14 +0000] notice/StatusDataWriter: Writing status.dat file took less than 1 millisecond
[2014-07-30 07:26:18 +0000] notice/ApiClient: Received "log::SetLogPosition" message from "icinga2c2"
[2014-07-30 07:26:18 +0000] notice/WorkQueue: #4 items: 0
[2014-07-30 07:26:18 +0000] notice/WorkQueue: #2 items: 0
[2014-07-30 07:26:18 +0000] notice/WorkQueue: #3 items: 0
[2014-07-30 07:26:18 +0000] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 6; Checks/s: 0.4
[2014-07-30 07:26:18 +0000] notice/ApiListener: Setting log position for identity "icinga2c2": 2014/07/30 07:25:57
[2014-07-30 07:26:18 +0000] notice/ApiListener: Current zone master: icinga2c1
[2014-07-30 07:26:18 +0000] notice/ApiListener: Connected endpoints: icinga2c2 (1)
[2014-07-30 07:26:19 +0000] notice/WorkQueue: #15 items: 0
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::SetNextCheck" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::CheckResult" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::SetNextCheck" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ApiClient: Received "event::CheckResult" message from "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/ThreadPool: Pool #1: Pending tasks: 0; Average latency: 0ms; Threads: 4; Pool utilization: 0.00672153%
[2014-07-30 07:26:19 +0000] debug/CheckerComponent: Executing check for "localhost!ping4"
[2014-07-30 07:26:19 +0000] notice/ApiListener: Relaying "event::SetNextCheck" message
[2014-07-30 07:26:19 +0000] notice/ApiListener: Sending message to "icinga2c2"
[2014-07-30 07:26:19 +0000] notice/Process: Running command "/usr/lib64/nagios/plugins/check_ping", "-4", "-H", "127.0.0.1", "-c", "200,15%", "-w", "100,5%": PID 2417

IDO problem:

icinga2c1 ~]#  grep -Ri -e resuming -e pausing -e shut /var/log/icinga2/debug*
/var/log/icinga2/debug.log-20140730:[2014-07-29 13:52:42 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 13:53:12 +0000] information/DbConnection: Pausing IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:06:34 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:10:48 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:11:18 +0000] information/DbConnection: Pausing IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:14:17 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:14:20 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:14:50 +0000] information/DbConnection: Pausing IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:32:10 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:32:14 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:32:43 +0000] information/DbConnection: Pausing IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:43:11 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-30 06:58:28 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-30 06:58:58 +0000] information/DbConnection: Pausing IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-30 07:27:33 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-30 07:27:36 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-30 07:28:06 +0000] information/DbConnection: Pausing IDO connection: ido-mysql

icinga2c2 ~]# grep -Ri -e resuming -e pausing -e shut /var/log/icinga2/debug*
/var/log/icinga2/debug.log:[2014-07-30 07:27:35 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log:[2014-07-30 07:27:39 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 13:53:26 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:07:10 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:08:59 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:11:10 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:11:16 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:14:11 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:14:14 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:32:14 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:32:17 +0000] information/DbConnection: Resuming IDO connection: ido-mysql
/var/log/icinga2/debug.log-20140730:[2014-07-29 14:43:17 +0000] information/Application: Shutting down Icinga...
/var/log/icinga2/debug.log-20140730:[2014-07-30 06:58:27 +0000] information/DbConnection: Resuming IDO connection: ido-mysql

Attachments

  • master.png ccesario - 2014-08-01 15:12:56 +00:00
  • slave.png ccesario - 2014-08-01 15:13:03 +00:00

Changesets

2014-07-31 10:00:52 +00:00 by (unknown) 76ba6a3

Fix permission problem with cluster messages

fixes #6810

2014-07-31 10:11:43 +00:00 by (unknown) 8f2af1a

Fix permission problem with cluster messages

fixes #6810

Relations:

@icinga-migration
Copy link
Author

Updated by mfriedrich on 2014-07-30 08:14:51 +00:00

  • Description updated
  • Assigned to deleted mfriedrich

@icinga-migration
Copy link
Author

Updated by mfriedrich on 2014-07-30 14:53:09 +00:00

  • Target Version set to 2.0.2
  • Estimated Hours set to 4

Required Changes

  • Reproduce the issue
  • Estimate time to fix (current estimate is only for tests)

@icinga-migration
Copy link
Author

Updated by Anonymous on 2014-07-31 10:05:03 +00:00

  • Status changed from New to Resolved
  • Done % changed from 0 to 100

Applied in changeset 76ba6a3.

@icinga-migration
Copy link
Author

Updated by gbeutner on 2014-08-01 07:04:26 +00:00

  • Assigned to set to mfriedrich

@icinga-migration
Copy link
Author

Updated by ccesario on 2014-08-01 13:50:04 +00:00

Not fixed for me.

I"m getting the same problem above reported.

Tested with version

Version: v2.0.1-55-g72d66e4

@icinga-migration
Copy link
Author

Updated by ccesario on 2014-08-01 15:13:16 +00:00

  • File added master.png
  • File added slave.png

@icinga-migration
Copy link
Author

Updated by ccesario on 2014-08-01 19:16:15 +00:00

One bit more information.

After some tests, the synchronization occur when the slave service is stopped and started.
If I got further info, I"ll post here.

@icinga-migration
Copy link
Author

Updated by ccesario on 2014-08-05 13:40:01 +00:00

After upgrade to Version v2.0.1-85-g53d3a4a the problem still happen, but when I restart the icinga2 service in host not synchronized, it appear to force the synchronism.

@icinga-migration
Copy link
Author

Updated by mfriedrich on 2014-08-05 15:17:17 +00:00

  • Status changed from Resolved to Feedback
  • Assigned to deleted mfriedrich

Re-opening for further feedback/tests.

@icinga-migration
Copy link
Author

Updated by ccesario on 2014-08-05 16:22:31 +00:00

The file /var/lib/icinga 2/api/log/current shows me that sync it is occurring

When I see this log in slave host

[2014-08-05 13:14:03 -0300] notice/ApiListener: Sending message to "icinga-master"
[2014-08-05 13:14:03 -0300] notice/ApiListener: Sending message to "icinga-master"
[2014-08-05 13:14:03 -0300] notice/ApiListener: Sending message to "icinga-master"
[2014-08-05 13:14:04 -0300] notice/ApiListener: Sending message to "icinga-master"
[2014-08-05 13:14:06 -0300] notice/ApiListener: Sending message to "icinga-master"
[2014-08-05 13:14:13 -0300] notice/ApiListener: Sending message to "icinga-master"
[2014-08-05 13:14:17 -0300] notice/ApiListener: Sending message to "icinga-master"
[2014-08-05 13:14:17 -0300] notice/ApiListener: Sending message to "icinga-master"

I receive this (part of log) into /var/lib/icinga 2/api/log/current on master host

\"},\"ts\":1.407254454280539e+09}","timestamp":1.407254454280539e+09},241:{"message":"{\"jsonrpc\":\"2.0\",\"method\":\"event::SetNextCheck\",\"params\":{\"host\":\"tecnomega-linux002\",\"next_check\":1.407254514330000e+09,\"service\":\"snmp-load\"},\"ts\":1.407254454330229e+09}","timestamp":1.407254454330229e+09},232:{"message":"{\"jsonrpc\":\"2.0\",\"method\":\"event::SetNextCheck\",\"params\":{\"host\":\"icinga-master\",\"next_check\":1.407254514330000e+09,\"service\":\"ping4\"},\"ts\":1.407254454330285e+09}","timestamp":1.407254454330285e+09},1107:{"message":"{\"jsonrpc\":\"2.0\",\"method\":\"event::CheckResult\",\"params\":{\"cr\":{\"active\":1,\"check_source\":\"icinga-master\",\"command\":[\"/usr/lib/nagios/plugins/check_snmp_storage.pl\",\"-H\",\"192.168.15.232\",\"-L\",\"md5,des\",\"-X\",\"p@ssword\",\"-c\",\"90\",\"-f\",\"-l\",\"usermd5\",\"-m\",\"^/$\",\"-w\",\"80\",\"-x\",\"p@ssword\"],\"execution_end\":1.407254454431127e+09,\"execution_start\":1.407254454280457e+09,\"exit_status\":0,\"output\":\"/: 27%used(14672MB/54306MB) (<80%) : OK \",\"performance_data\":{\"/\":{\"counter\":0,\"crit\":51249152000,\"max\":56943968256,\"min\":0,\"type\":\"PerfdataValue\",\"unit\":\"bytes\",\"value\":1.5384457196339199e+10,\"warn\":45555384320}},\"schedule_end\":1.407254454431234e+09,\"schedule_start\":1.407254514280000e+09,\"state\":0,\"type\":\"CheckResult\",\"vars_after\":{\"attempt\":1,\"reachable\":1,\"state\":0,\"state_type\":1},\"vars_before\":{\"attempt\":1,\"reachable\":1,\"state\":0,\"state_type\":1}},\"host\":\"tecnomega-linux002\",\"service\":\"snmp-diskspace /\"},\"ts\":1.407254454431674e+09}","timestamp":1.407254454431674e+09},1076:{"message":"{\"jsonrpc\":\"2.0\",\"method\":\"event::CheckResult\",\"params\":{\"cr\":{\"active\":1,\"check_source\":\"icinga-master\",\"command\":[\"/usr/lib/nagios/plugins/check_snmp_load.pl\",\"-H\",\"192.168.15.232\",\"-L\",\"md5,des\",\"-T\",\"stand\",\"-X\",\"p@ssword\",\"-c\",\"95\",\"-f\",\"-l\",\"usermd5\",\"-w\",\"85\",\"-x\",\"p@ssword\"],\"execution_end\":1.407254454613875e+09,\"execution_start\":1.407254454330743e+09,\"exit_status\":2,\"output\":\"2 CPU, average load 100.0% > 95% : CRITICAL \",\"performance_data\":{\"cpu_prct_used\":{\"counter\":0,\"crit\":95,\"max\":null,\"min\":null,\"type\":\"PerfdataValue\",\"unit\":\"percent\",\"value\":100,\"warn\":85}},\"schedule_end\":1.407254454614001e+09,\"schedule_start\":1.407254514330000e+09,\"state\":2,\"type\":\"CheckResult\",\"vars_after\":{\"attempt\":2,\"reachable\":1,\"state\":2,\"state_type\":0},\"vars_before\":{\"attempt\":1,\"reachable\":1,\"state\":0,\"state_type\":1}},\"host\":\"tecnomega-linux002\",\"service\":\"snmp-load\"},\"ts\":1.407254454614653e+09}","timestamp":1.407254454614653e+09},260:{"message":"{\"jsonrpc\":\"2.0\",\"method\":\"event::SetNextNotification\",\"params\":{\"next_notification\":1.407254455784800e+09,\"notification\":\"tecnomega-linux002!mail-suporte-tecnomega\"},\"ts\":1.407254455784859e+09}","timestamp":1.407254455784859e+09},270:{"message":"{\"jsonrpc\":\"2.0\",\"method\":\"event::SetNextNotification\",\"params\":{\"next_notification\":1.407254455784865e+09,\"notification\":\"tecnomega-linux002!snmp-load!mail-suporte-tecnomega\"}

Note that the service snmp-load it is in CRITICAL state : CPU, average load 100.0% > 95% : CRITICAL

But web interface show me that this service is is OK (icingaweb1 and icingaweb2).

@icinga-migration
Copy link
Author

Updated by gbeutner on 2014-08-06 07:57:32 +00:00

  • Status changed from Feedback to Closed

I"m unable to reproduce that problem in my cluster setup.

@icinga-migration icinga-migration added bug Something isn't working area/distributed Distributed monitoring (master, satellites, clients) labels Jan 17, 2017
@icinga-migration icinga-migration added this to the 2.0.2 milestone Jan 17, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/distributed Distributed monitoring (master, satellites, clients) bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant