Before you start please confirm the following.

• Yes, I've searched similar issues on GitHub.
• Yes, I've checked whether this issue is covered in the Portainer documentation or knowledge base.

Problem Description

This problem is intermittent. I have 5 manager nodes. All of them run portainer agent and in the same stack a have a portainer application itself float between the first 3 nodes. Every now and again when doing a reboot to my proxmox, for something like a kernel update the portainer web application throws this error.

Unable to find an agent on any manager node

I have the replication set to global for manager nodes for portainer agent. All the services show they are up but the error still happens.

The only way i can fix it is to do a reboot and hope they work or do a docker service update -f for the service portainer_agent.

Expected Behavior

When portainer and agents start there should be no errors and i can view and edit the swarm.

Actual Behavior

When this happens the portainer web gui works but i can not see any information from any node in the swarm. no volumes, images, containers. Nothing I must reboot or force the agent service to update.

Steps to Reproduce

Just start all the manager nodes. Sometimes the error happens sometimes it doesn't.

Portainer logs or screenshots

No response

Portainer version

2.19.5

Portainer Edition

Community Edition (CE)

Platform and Version

Docker Swarm

OS and Architecture

Debian Bookworm

Browser

Firefox

What command did you use to deploy Portainer?

docker stack deploy

Additional Information

I monitor 40 stacks. I know its alot but it works instantly sometimes and instantly if i do a docker service update -f