Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve][broker][monitoring] metrics data flow control #16452

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

tjiuming
Copy link
Contributor

@tjiuming tjiuming commented Jul 7, 2022

Motivation

add metrics data flow control when Prometheus scrape metrics, to prevent high network usage.

Modifications

  1. add MetricsDataFlowController class
  2. add metricsDataFlowPermitPerSecond configuration

Documentation

Check the box below or label this PR directly.

Need to update docs?

  • doc-required
    (Your PR needs to update docs and you will update later)

  • doc-not-needed
    (Please explain why)

  • doc
    (Your PR contains doc changes)

  • doc-complete
    (Docs have been already added)

@github-actions github-actions bot added the doc-required Your PR changes impact docs and you will update later. label Jul 7, 2022
@tjiuming
Copy link
Contributor Author

tjiuming commented Jul 8, 2022

/pulsarbot run-failure-checks

Copy link
Contributor

@liangyuanpeng liangyuanpeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's case we need this? IMO, it should be working on some proxy.

@tjiuming
Copy link
Contributor Author

tjiuming commented Jul 11, 2022

What's case we need this? IMO, it should be working on some proxy.

if there is a big metrics response, say, 500MB, without flow control, it will comes high network usage and high messaging latency

@codelipenghui
Copy link
Contributor

@tjiuming It's better to start a discussion in the mailing list since it's a new feature for the Prometheus endpoint.

@github-actions
Copy link

The pr had no activity for 30 days, mark with Stale label.

@github-actions github-actions bot added the Stale label Aug 20, 2022
@Technoboy- Technoboy- added this to the 3.2.0 milestone Jul 31, 2023
@Technoboy- Technoboy- modified the milestones: 3.2.0, 3.3.0 Dec 22, 2023
@coderzc coderzc modified the milestones: 3.3.0, 3.4.0 May 8, 2024
@lhotari lhotari modified the milestones: 4.0.0, 4.1.0 Oct 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
doc-required Your PR changes impact docs and you will update later. Stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants