categraf 的kafka插件，采集kafka指标没有kafka_up指标 #1539

carry2017123 · 2023-05-19T03:53:47Z

carry2017123
May 19, 2023

cat input.kafka/kafka.toml
[[instances]]
labels = { instance = "10.98.33.9:8103",business_name = "carry_kafka1",ip = "10.98.33.9" }
kafka_uris = [ "10.98.33.9:8103" ]
kafka_version = "1.1.0"
interval_times = 1

categraf v0.3.4

carry2017123 · 2023-05-19T03:54:53Z

carry2017123
May 19, 2023
Author

kafka_brokers
kafka_topic_partition_current_offset
kafka_topic_partition_in_sync_replica
kafka_topic_partitions
kafka_topic_partition_under_replicated_partition
只有这几个指标被采集到

0 replies

carry2017123 · 2023-05-19T03:59:38Z

carry2017123
May 19, 2023
Author

-rw-r--r-- 1 kafka kafka 4.3M Mar 24 2018 kafka_2.12-1.1.0.jar
-rw-r--r-- 1 kafka kafka 821 Mar 24 2018 kafka_2.12-1.1.0.jar.asc
-rw-r--r-- 1 kafka kafka 57K Mar 24 2018 kafka_2.12-1.1.0-javadoc.jar
-rw-r--r-- 1 kafka kafka 821 Mar 24 2018 kafka_2.12-1.1.0-javadoc.jar.asc
-rw-r--r-- 1 kafka kafka 9.4K Mar 24 2018 kafka_2.12-1.1.0-scaladoc.jar
-rw-r--r-- 1 kafka kafka 821 Mar 24 2018 kafka_2.12-1.1.0-scaladoc.jar.asc
-rw-r--r-- 1 kafka kafka 859K Mar 24 2018 kafka_2.12-1.1.0-sources.jar
-rw-r--r-- 1 kafka kafka 821 Mar 24 2018 kafka_2.12-1.1.0-sources.jar.asc
-rw-r--r-- 1 kafka kafka 2.7M Mar 24 2018 kafka_2.12-1.1.0-test.jar
-rw-r--r-- 1 kafka kafka 821 Mar 24 2018 kafka_2.12-1.1.0-test.jar.asc
-rw-r--r-- 1 kafka kafka 688K Mar 24 2018 kafka_2.12-1.1.0-test-sources.jar
-rw-r--r-- 1 kafka kafka 821 Mar 24 2018 kafka_2.12-1.1.0-test-sources.jar.asc

0 replies

UlricQin · 2023-05-19T10:12:50Z

UlricQin
May 19, 2023
Maintainer

这些信息判断不出来，有报错日志？

2 replies

carry2017123 May 19, 2023
Author

2023/05/19 18:15:17 main.go:129: I! runner.hostname: ubuntu
2023/05/19 18:15:17 main.go:130: I! runner.fd_limits: (soft=262140, hard=262140)
2023/05/19 18:15:17 main.go:131: I! runner.vm_limits: (soft=unlimited, hard=unlimited)
2023/05/19 18:15:17 provider.go:69: I! use input provider: [local]
2023/05/19 18:15:17 prometheus_agent.go:19: I! prometheus scraping disabled!
2023/05/19 18:15:17 ibex_agent.go:19: I! ibex agent disabled!
2023/05/19 18:15:17 agent.go:39: I! agent starting
level=debug msg="Done with kafka client initialization"
level=debug msg="Initializing metrics"
2023/05/19 18:15:17 metrics_agent.go:211: I! input: local.kafka started
2023/05/19 18:15:17 agent.go:47: I! [*agent.MetricsAgent] started
2023/05/19 18:15:17 agent.go:50: I! agent started
level=info msg="Refreshing client metadata"
level=info msg="Generating topic metrics"
level=debug msg="waiting for topic metric generation to complete"
level=debug msg="Fetching topic metrics" topic=test
level=debug msg="Fetching topic metrics" topic=topic1
level=debug msg="Fetching topic metrics" topic=AVA-VAV
level=info msg="Generating consumergroup metrics"
level=debug msg="waiting for consumergroup metric generation to complete"
level=debug msg="Fetching consumer group metrics for broker" broker=3 broker_addr=10.98.33.19:8103
level=debug msg="Fetching consumer group metrics for broker" broker=2 broker_addr=10.98.33.8:8103
level=debug msg="listing consumergroups for broker" broker=3 broker_addr=10.98.33.19:8103
level=debug msg="listing consumergroups for broker" broker=2 broker_addr=10.98.33.8:8103
level=debug msg="Fetching consumer group metrics for broker" broker=1 broker_addr=10.98.33.9:8103
level=debug msg="listing consumergroups for broker" broker=1 broker_addr=10.98.33.9:8103
level=debug msg="describing consumergroups for broker" broker=3
level=debug msg="describing consumergroups for broker" broker=2
level=debug msg="describing consumergroups for broker" broker=1
level=info msg="Calculating consumergroup lag"

UlricQin May 22, 2023
Maintainer

看起来没啥异常日志，神奇

kongfei605 · 2023-05-19T11:03:54Z

kongfei605
May 19, 2023
Maintainer

./categraf --test --inputs kafka --debug

1 reply

carry2017123 May 22, 2023
Author

./categraf --test --inputs kafka --debug
2023/05/22 11:41:43 main.go:128: I! runner.binarydir: /home/dspeak/yyms/sl_agent/categraf
2023/05/22 11:41:43 main.go:129: I! runner.hostname: ubuntu
2023/05/22 11:41:43 main.go:130: I! runner.fd_limits: (soft=262140, hard=262140)
2023/05/22 11:41:43 main.go:131: I! runner.vm_limits: (soft=unlimited, hard=unlimited)
2023/05/22 11:41:43 provider.go:69: I! use input provider: [local]
2023/05/22 11:41:43 prometheus_agent.go:19: I! prometheus scraping disabled!
2023/05/22 11:41:43 ibex_agent.go:19: I! ibex agent disabled!
2023/05/22 11:41:43 agent.go:39: I! agent starting
level=debug msg="Done with kafka client initialization"
level=debug msg="Initializing metrics"
2023/05/22 11:41:43 metrics_agent.go:211: I! input: local.kafka started
2023/05/22 11:41:43 agent.go:47: I! [*agent.MetricsAgent] started
2023/05/22 11:41:43 agent.go:50: I! agent started
2023/05/22 11:41:43 metrics_reader.go:54: D! local.kafka : before gather once
2023/05/22 11:41:43 metrics_reader.go:60: D! local.kafka : after gather once, duration: 73.224µs
2023/05/22 11:41:58 metrics_reader.go:54: D! local.kafka : before gather once
2023/05/22 11:41:58 metrics_reader.go:60: D! local.kafka : after gather once, duration: 76.545µs
2023/05/22 11:42:13 metrics_reader.go:54: D! local.kafka : before gather once
level=info msg="Refreshing client metadata"
level=debug msg="pruning iMap data" maxOffsets=1000
level=info msg="Interpolation map is nil, nothing to prune"
level=info msg="Generating topic metrics"
level=debug msg="waiting for topic metric generation to complete"
level=debug msg="Fetching topic metrics" topic=test
level=debug msg="Fetching topic metrics" topic=AVA-VAV
level=debug msg="Fetching topic metrics" topic=topic1
level=info msg="Generating consumergroup metrics"
level=debug msg="waiting for consumergroup metric generation to complete"
level=debug msg="Fetching consumer group metrics for broker" broker=3 broker_addr=10.98.33.19:8103
level=debug msg="listing consumergroups for broker" broker=3 broker_addr=10.98.33.19:8103
level=debug msg="Fetching consumer group metrics for broker" broker=1 broker_addr=10.98.33.9:8103
level=debug msg="listing consumergroups for broker" broker=1 broker_addr=10.98.33.9:8103
level=debug msg="Fetching consumer group metrics for broker" broker=2 broker_addr=10.98.33.8:8103
level=debug msg="listing consumergroups for broker" broker=2 broker_addr=10.98.33.8:8103
level=debug msg="describing consumergroups for broker" broker=3
level=debug msg="describing consumergroups for broker" broker=2
level=debug msg="describing consumergroups for broker" broker=1
level=info msg="Calculating consumergroup lag"
level=debug msg="waiting for consumergroup lag estimation metric generation to complete"
11:42:13 kafka_brokers agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 3
11:42:13 kafka_broker_info address=10.98.33.8:8103 agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= id=2 instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 1
11:42:13 kafka_broker_info address=10.98.33.9:8103 agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= id=1 instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 1
11:42:13 kafka_broker_info address=10.98.33.19:8103 agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= id=3 instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 1
11:42:13 kafka_topic_partitions agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 topic=test 8
11:42:13 kafka_topic_partitions agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=test 1
11:42:13 kafka_topic_partitions agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 topic=topic1 6
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=AVA-VAV 1
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=test 0
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=AVA-VAV 7.483605e 06
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=test 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=test 2
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=AVA-VAV 6.047844e 06
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=AVA-VAV 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=0 port=8103 topic=AVA-VAV 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=AVA-VAV 2
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=topic1 2
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=test 0
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=AVA-VAV 7.484252e 06
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=test 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=test 3
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=AVA-VAV 6.048347e 06
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=AVA-VAV 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=1 port=8103 topic=AVA-VAV 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=test 0
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=AVA-VAV 7.484143e 06
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=test 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=test 1
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=AVA-VAV 6.048109e 06
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=AVA-VAV 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=AVA-VAV 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=2 port=8103 topic=AVA-VAV 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=test 0
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=3 port=8103 topic=test 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=test 2
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=test 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=topic1 2
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=4 port=8103 topic=test 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=test 3
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=test 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=topic1 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=topic1 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=topic1 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=5 port=8103 topic=test 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=6 port=8103 topic=test 1
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=6 port=8103 topic=test 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=6 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=6 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=6 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=6 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=6 port=8103 topic=test 0
11:42:13 kafka_topic_partition_leader agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=7 port=8103 topic=test 2
11:42:13 kafka_topic_partition_current_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=7 port=8103 topic=test 0
11:42:13 kafka_topic_partition_oldest_offset agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=7 port=8103 topic=test 0
11:42:13 kafka_topic_partition_replicas agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=7 port=8103 topic=test 3
11:42:13 kafka_topic_partition_in_sync_replica agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=7 port=8103 topic=test 3
11:42:13 kafka_topic_partition_leader_is_preferred agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=7 port=8103 topic=test 1
11:42:13 kafka_topic_partition_under_replicated_partition agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 partition=7 port=8103 topic=test 0
11:42:13 kafka_scrape_use_seconds agent_hostname=10.98.33.19 agent_type=categraf business_name=carry_kafka1 group_name= instance=10.98.33.19:8103 ip=10.98.33.19 port=8103 0.005140157
2023/05/22 11:42:13 metrics_reader.go:60: D! local.kafka : after gather once, duration: 6.483846ms
2023/05/22 11:42:28 metrics_reader.go:54: D! local.kafka : before gather once
2023/05/22 11:42:28 metrics_reader.go:60: D! local.kafka : after gather once, duration: 60.244µs
^C2023/05/22 11:42:37 main.go:110: I! received signal: interrupt
2023/05/22 11:42:37 agent.go:54: I! agent stopping
2023/05/22 11:42:37 agent.go:62: I! [*agent.MetricsAgent] stopped
2023/05/22 11:42:37 agent.go:65: I! agent stopped
2023/05/22 11:42:37 main.go:123: I! exited

syq1990228 · 2023-06-19T09:19:21Z

syq1990228
Jun 19, 2023

1 reply

syq1990228 Jun 19, 2023

ho

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

categraf 的kafka插件，采集kafka指标没有kafka_up指标 #1539

{{title}}

Replies: 5 comments 4 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

categraf 的kafka插件，采集kafka指标没有kafka_up指标 #1539

carry2017123 May 19, 2023

Replies: 5 comments · 4 replies

carry2017123 May 19, 2023 Author

carry2017123 May 19, 2023 Author

UlricQin May 19, 2023 Maintainer

carry2017123 May 19, 2023 Author

UlricQin May 22, 2023 Maintainer

kongfei605 May 19, 2023 Maintainer

carry2017123 May 22, 2023 Author

syq1990228 Jun 19, 2023

syq1990228 Jun 19, 2023

carry2017123
May 19, 2023

Replies: 5 comments 4 replies

carry2017123
May 19, 2023
Author

carry2017123
May 19, 2023
Author

UlricQin
May 19, 2023
Maintainer

carry2017123 May 19, 2023
Author

UlricQin May 22, 2023
Maintainer

kongfei605
May 19, 2023
Maintainer

carry2017123 May 22, 2023
Author

syq1990228
Jun 19, 2023