Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

server status message #48

Open
mgriffininprs opened this issue Jun 9, 2023 · 28 comments
Open

server status message #48

mgriffininprs opened this issue Jun 9, 2023 · 28 comments

Comments

@mgriffininprs
Copy link

mgriffininprs commented Jun 9, 2023

image

Even though my managed server ERMDEV01_ManagedServer1 is running verified in Weblogic console and Enterprise Manager console, it shows status of not running under the Weblogic Remote console ->Monitoring -> servers window

image
Yet if you click on the managed server Weblogic Remote console ->Monitoring ->ERMDEV01_ManagedServer1, the status shows running

BTW for entirely different server i have in my kiosk panel the functionality works as expected

@lfeigen
Copy link
Member

lfeigen commented Jun 9, 2023

Hmmm. What version are you running of (A) the Remote Console and (B) WebLogic?

@mgriffininprs
Copy link
Author

weblogic 12.2.1.4.
image

@moreaut
Copy link
Member

moreaut commented Jun 9, 2023

Can you try some curl commands to get more info from WLS?

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:wlsadminserverport/management/weblogic/latest/domainRuntime/serverRuntimes

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:/management/weblogic/latest/serverRuntime

curl -v -k --user {username}:{password} http://{ERMDEV01_ManagedServer1 host}:{ERMDEV01_ManagedServer1 port}:/management/weblogic/latest/serverRuntime

curl -v -k --user {username}:{password} http://{ERMDEV01_ManagedServer2 host}:{ERMDEV01_ManagedServer2 port}:/management/weblogic/latest/serverRuntime

@moreaut
Copy link
Member

moreaut commented Jun 9, 2023

Also, how are you starting the manged servers? e.g. are you using the node manager?

@moreaut
Copy link
Member

moreaut commented Jun 12, 2023

Also, what happens if you go to the admin console (not the remote console), and navigate to Servers then click the Control tab?

And then click ERMDEV01_ManagedServer1 in the table then click the Monitoring tab? And click the Control tab?

Also, do you have access to WLST? If so, I'll send some WLST commands I'd like you to try.

@mgriffininprs
Copy link
Author

Also, what happens if you go to the admin console (not the remote console), and navigate to Servers then click the Control tab?

And then click ERMDEV01_ManagedServer1 in the table then click the Monitoring tab? And click the Control tab?

Also, do you have access to WLST? If so, I'll send some WLST commands I'd like you to try.

All of this works correctly. Also yes I have access to WLST.

@mgriffininprs
Copy link
Author

mgriffininprs commented Jun 12, 2023

Can you try some curl commands to get more info from WLS?

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:wlsadminserverport/management/weblogic/latest/domainRuntime/serverRuntimes

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:/management/weblogic/latest/serverRuntime

curl -v -k --user {username}:{password} http://{ERMDEV01_ManagedServer1 host}:{ERMDEV01_ManagedServer1 port}:/management/weblogic/latest/serverRuntime

curl -v -k --user {username}:{password} http://{ERMDEV01_ManagedServer2 host}:{ERMDEV01_ManagedServer2 port}:/management/weblogic/latest/serverRuntime

< HTTP/1.1 200 OK
< Date: Mon, 12 Jun 2023 17:10:52 GMT
< Content-Length: 4358
< Content-Type: application/json
< Vary: Accept-Encoding
< X-ORACLE-DMS-RID: 0
< X-ORACLE-DMS-ECID: b1f151a4-e4af-4e19-9bea-13de84a96760-00001b00
< X-Content-Type-Options: nosniff
<
{
"links": [
{
"rel": "parent",
"href": "http:// /management/weblogic/latest/domainRuntime"
},
{
"rel": "self",
"href": "http:// /management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes"
},
{
"rel": "canonical",
"href": "http:/\ //management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes"
}
],
"items": [
{
"links": [
{
"rel": "self",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer1"
},
{
"rel": "canonical",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer1"
}
],
"identity": [
"serverLifeCycleRuntimes",
"ERMDEV01_ManagedServer1"
],
"nodeManagerRestartCount": 0,
"middlewareHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01",
"name": "ERMDEV01_ManagedServer1",
"weblogicHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01/wlserver",
"state": "RUNNING",
"type": "ServerLifeCycleRuntime"
},
{
"links": [
{
"rel": "self",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer2"
},
{
"rel": "canonical",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer2"
}
],
"identity": [
"serverLifeCycleRuntimes",
"ERMDEV01_ManagedServer2"
],
"nodeManagerRestartCount": 0,
"middlewareHome": null,
"name": "ERMDEV01_ManagedServer2",
"weblogicHome": null,
"state": "SHUTDOWN",
"type": "ServerLifeCycleRuntime"
},
{
"links": [
{
"rel": "self",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV02_AdminServer(admin)"
},
{
"rel": "canonical",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV02_AdminServer(admin)"
}
],
"identity": [
"serverLifeCycleRuntimes",
"ERMDEV02_AdminServer(admin)"
],
"nodeManagerRestartCount": 1,
"middlewareHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01",
"name": "ERMDEV02_AdminServer(admin)",
"weblogicHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01/wlserver",
"state": "RUNNING",
"type": "ServerLifeCycleRuntime"
},
{
"links": [
{
"rel": "self",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_AdminServer"
},
{
"rel": "canonical",
"href": "http:///management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_AdminServer"
}
],
"identity": [
"serverLifeCycleRuntimes",
"ERMDEV01_AdminServer"
],
"nodeManagerRestartCount": 0,
"middlewareHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01",
"name": "ERMDEV01_AdminServer",
"weblogicHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01/wlserver",
"state": "RUNNING",
"type": "ServerLifeCycleRuntime"
}
]

@mgriffininprs
Copy link
Author

Also, how are you starting the manged servers? e.g. are you using the node manager?

Well its not possible to restart them from the remote control console...So they are started through scripting via node manager by executing ./startNodeManger.sh and ./startWeblogic.sh

@moreaut
Copy link
Member

moreaut commented Jun 13, 2023

Thanks for the data. At this point, the curl command indicates that the servers are properly running, so we don't
need to use WLST yet (WLST is just an alternative way to view the underlying server runtime mbeans).

I've been trying to reproduce the problem and have not been able to.
I'm wondering if this is a transient problem while the server is starting up.

Now that everything has stabilized and should be running, what happens if you
navigate to the Servers table again and then to ManagedServer1? Do the pages
look OK now or are you still seeing the same problem?

@moreaut
Copy link
Member

moreaut commented Jun 13, 2023

Also, if you've configured the node manager, you should be able to start the managed servers from the remote console via the 'Start' button on the Servers table under monitoring (it worked for me). Give it a try?

Also, does the 'Start' button in the admin console work for your servers?

@moreaut
Copy link
Member

moreaut commented Jun 14, 2023

Can you try this curl command?

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:wlsadminserverport/management/weblogic/latest/domainRuntime/serverRuntimes

Thanks!

@moreaut
Copy link
Member

moreaut commented Jun 14, 2023

Also, does your domain's security realm have a DefaultIdentityAsserter configured?
(go to the edit tree then Security -> Realms -> <your realm, e.g. myrealm> -> Authentication Providers)

@moreaut
Copy link
Member

moreaut commented Jun 14, 2023

And would you be available for zoom debugging session?

@mgriffininprs
Copy link
Author

Also, does your domain's security realm have a DefaultIdentityAsserter configured? (go to the edit tree then Security -> Realms -> <your realm, e.g. myrealm> -> Authentication Providers)

Yes the out of the box DefaultIdentityAsserter is has been created during domain creation

@mgriffininprs
Copy link
Author

mgriffininprs commented Jun 15, 2023

Also, if you've configured the node manager, you should be able to start the managed servers from the remote console via the 'Start' button on the Servers table under monitoring (it worked for me). Give it a try?

Also, does the 'Start' button in the admin console work for your servers?

If the Weblogic console for a domain is shutdown, it doesnt appear to me there is anyway through the remote control panel -> kiosk panel to connect to much less start/restart any managed server.

You receive message
image

@mgriffininprs
Copy link
Author

wlsadminserverport

So it appears when there is more than one Domain and/or Weblogic console defined in the KIOSK panel like in my case is where it causes this issue.
image

However, when I click on the managed server that is supposedly not running, I see this
image

@mgriffininprs
Copy link
Author

mgriffininprs commented Jun 15, 2023

Also no it isnt a mistake that I have two ADMIN servers running under one Weblogic console. From a management/monitoring point of view(s) this is the next best thing to do outside of having a clustered environment which in our case we are running non-clustered. Eventually I will have one DOMAIN ERMDEV that will contain ERMDEV01 domain and ERMDEV02 domain both of these Admin console(s) for these domains and then their respective managed servers under each

@moreaut
Copy link
Member

moreaut commented Jun 15, 2023

Thanks for the data. I'll discuss it with the rest of the remote console team then get back to you.

@moreaut
Copy link
Member

moreaut commented Jun 15, 2023

I'm a little unclear about your configuration.

Can you attach your domains' config.xmls and screen shots of:

  1. the kiosk (that lists all your providers)
  2. go to each provider in the kiosk and click its settings gear

Also, would you be available for a zoom debugging session?

Thanks!

@mgriffininprs
Copy link
Author

mgriffininprs commented Jun 15, 2023

Which ports numbers are ERMDEV01_AdminServer and ERMDEV02_AdminServer running on, and which one did you pick when you created the Admin Server Provider Connection in the remote console?

Also, can you attach your config.xml?

I'm a little unclear about your configuration.

Can you attach your domains' config.xmls and screen shots of:

  1. the kiosk (that lists all your providers)
  2. go to each provider in the kiosk and click its settings gear

Also, would you be available for a zoom debugging session?

Thanks!

image

@mgriffininprs
Copy link
Author

mgriffininprs commented Jun 15, 2023

Which ports numbers are ERMDEV01_AdminServer and ERMDEV02_AdminServer running on, and which one did you pick when you created the Admin Server Provider Connection in the remote console?
Also, can you attach your config.xml?

AdminServerdev01 8002, 8502,

I'm a little unclear about your configuration.
Can you attach your domains' config.xmls and screen shots of:

  1. the kiosk (that lists all your providers)
  2. go to each provider in the kiosk and click its settings gear

Also, would you be available for a zoom debugging session?
Thanks!

image

@mgriffininprs
Copy link
Author

mgriffininprs commented Jun 15, 2023

Which ports numbers are ERMDEV01_AdminServer and ERMDEV02_AdminServer running on, and which one did you pick when you created the Admin Server Provider Connection in the remote console?
Also, can you attach your config.xml?

AdminServerdev01 8002, 8502,

I'm a little unclear about your configuration.
Can you attach your domains' config.xmls and screen shots of:

  1. the kiosk (that lists all your providers)
  2. go to each provider in the kiosk and click its settings gear

Also, would you be available for a zoom debugging session?
Thanks!

image
image

@moreaut
Copy link
Member

moreaut commented Jun 15, 2023

Thanks for the screen shots.

Unfortunately, I'm not able to debug what's going on from just the screen shots. I need lower level data.

Can you attach your domains' config.xmls and the curl output from:

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:wlsadminserverport/management/weblogic/latest/domainRuntime/serverRuntimes

and

curl -v -k --user {username}:{password} http://{ERMSIT02_AdminServer host}:{ERMSIT02_AdminServer port}:wlsadminserverport/management/weblogic/latest/domainRuntime/serverRuntimes

@moreaut
Copy link
Member

moreaut commented Jun 15, 2023

Also, can we do a zoom debugging session? I probably need to run a number of curl commands to get to the bottom of the issue. I'm a developer on Oracle's remote console team. I'm available this afternoon (EST). I'm also available most of Friday.

@mgriffininprs
Copy link
Author

mgriffininprs commented Jun 15, 2023

Thanks for the screen shots.

Unfortunately, I'm not able to debug what's going on from just the screen shots. I need lower level data.

Can you attach your domains' config.xmls and the curl output from:

curl -v -k --user {username}:{password} http://{ERMDEV01_AdminServer host}:{ERMDEV01_AdminServer port}:wlsadminserverport/management/weblogic/latest/domainRuntime/serverRuntimes

and

curl -v -k --user {username}:{password} http://{ERMSIT02_AdminServer host}:{ERMSIT02_AdminServer port}:wlsadminserverport/management/weblogic/latest/domainRuntime/serverRuntimes

$ curl -v -k --user
/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes | more

  • Trying .
  • TCP_NODELAY set
    % Total % Received % Xferd Average Speed Time Time Time Current
    Dload Upload Total Spent Left Speed
    0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Connected to port 8002 (#0)
  • Server auth using Basic with user 'weblogic'

GET /management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes HTTP/1.1

User-Agent: curl/7.61.1
Accept: /

< HTTP/1.1 200 OK
< Date: Thu, 15 Jun 2023 15:02:14 GMT
< Content-Length: 4358
< Content-Type: application/json
< Vary: Accept-Encoding
< X-ORACLE-DMS-RID: 0
< X-ORACLE-DMS-ECID: ad1125b9-1a0f-4963-913d-de75115e0e54-0000025f
< X-Content-Type-Options: nosniff
<
{ [4072 bytes data]
100 4358 100 4358 0 0 13246 0 --:--:-- --:--:-- --:--:-- 13246

  • Connection #0 to host left intact
    {
    "links": [
    {
    "rel": "parent",
    "href": "http://server name/management/weblogic/latest/domainRuntime"
    },
    {
    "rel": "self",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes"
    },
    {
    "rel": "canonical",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes"
    }
    ],
    "items": [
    {
    "links": [
    {
    "rel": "self",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer1"
    },
    {
    "rel": "canonical",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer1"
    }
    ],
    "identity": [
    "serverLifeCycleRuntimes",
    "ERMDEV01_ManagedServer1"
    ],
    "nodeManagerRestartCount": 0,
    "middlewareHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01",
    "name": "ERMDEV01_ManagedServer1",
    "weblogicHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01/wlserver",
    "state": "RUNNING",
    "type": "ServerLifeCycleRuntime"
    },
    {
    "links": [
    {
    "rel": "self",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer2"
    },
    {
    "rel": "canonical",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_ManagedServer2"
    }
    ],
    "identity": [
    "serverLifeCycleRuntimes",
    "ERMDEV01_ManagedServer2"
    ],
    "nodeManagerRestartCount": 0,
    "middlewareHome": null,
    "name": "ERMDEV01_ManagedServer2",
    "weblogicHome": null,
    "state": "SHUTDOWN",
    "type": "ServerLifeCycleRuntime"
    },
    {
    "links": [
    {
    "rel": "self",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV02_AdminServer(admin)"
    },
    {
    "rel": "canonical",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV02_AdminServer(admin)"
    }
    ],
    "identity": [
    "serverLifeCycleRuntimes",
    "ERMDEV02_AdminServer(admin)"
    ],
    "nodeManagerRestartCount": 0,
    "middlewareHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01",
    "name": "ERMDEV02_AdminServer(admin)",
    "weblogicHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01/wlserver",
    "state": "RUNNING",
    "type": "ServerLifeCycleRuntime"
    },
    {
    "links": [
    {
    "rel": "self",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_AdminServer"
    },
    {
    "rel": "canonical",
    "href": "http://server name/management/weblogic/latest/domainRuntime/serverLifeCycleRuntimes/ERMDEV01_AdminServer"
    }
    ],
    "identity": [
    "serverLifeCycleRuntimes",
    "ERMDEV01_AdminServer"
    ],
    "nodeManagerRestartCount": 0,
    "middlewareHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01",
    "name": "ERMDEV01_AdminServer",
    "weblogicHome": "/u01/app/oracle/Middleware/WL_12214_ermdev01/wlserver",
    "state": "RUNNING",
    "type": "ServerLifeCycleRuntime"
    }
    ]
    }

@moreaut
Copy link
Member

moreaut commented Jun 15, 2023

Thanks for the curl output.

Could you get me the output for curl -H X-RequestedBy:myclient --user:.. .../domainRuntime/serverRuntimes ?

(v.s. you gave me the output for .../domainRuntimes/serverLifeCycleRuntimes)

(I need to see this to help figure out why the admin server isn't able to see the running managed servers)

@mriccell
Copy link
Member

Hello @mgriffininprs it would be easier to help you if you could register to our public weblogic workspace. Use the following link https://join.slack.com/t/oracle-weblogic/shared_invite/zt-1ni1gtjv6-PGC6CQ4uIte3KBdm_67~aQ to register your self and once in, please go to #remote-console and lets continue the thread there.

@mgriffininprs
Copy link
Author

Hello @mgriffininprs it would be easier to help you if you could register to our public weblogic workspace. Use the following link https://join.slack.com/t/oracle-weblogic/shared_invite/zt-1ni1gtjv6-PGC6CQ4uIte3KBdm_67~aQ to register your self and once in, please go to #remote-console and lets continue the thread there.

I mean no offense nor is it my intent to be uncooperative when I say this but Im going to respectfully to decline to register for yet another messaging type of application regardless of how technically beneficial it could be or provide

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants