Change Details

Parsoid is exposing a number of public endpoints through RESTbase. With the sunsetting of RESTbase and the integration of parsoid into MediaWiki core, these endpoints should be decomissioned. However, they are still in use by external clients. A deprecation plan is needed. Relevant endpoints and usage: * `/api/rest_v1/page/html/`: about 100 req/s https://w.wiki/6YSL ** main user is WikiMedia enterprise ** about 8 req/s from `REST-API-Crawler-Google/1.0` ** about 14 req/s without user agent, the vast majority originating from just four IP addresses * `/api/rest_v1/transform/wikitext/to/html` about 6 req/s https://w.wiki/6YSK ** about 2.5 req/s from `REST-API-Crawler-Google/1.0` ** about 2.5 req/s from a fake user agent that starts with "User-Agent", originating from a single IP address. ** another 0.2 req/s from `ServiceChecker-WMF/0.1.2` * `/api/rest_v1/transform/wikitext/to/pb` * `/api/rest_v1/transform/html/to/wikitext` * `/api/rest_v1/transform/pb/to/wikitext`

Parsoid is exposing a number of public endpoints through RESTbase. With the sunsetting of RESTbase and the integration of parsoid into MediaWiki core, these endpoints should be decomissioned. However, they are still in use by external clients. A deprecation plan is needed. Usage analysis: * `/api/rest_v1/page/html/`: about 100 req/s https://w.wiki/6YSL ** main user is WikiMedia enterprise ** about 8 req/s from `REST-API-Crawler-Google/1.0` ** about 14 req/s without user agent, the vast majority originating from just four IP addresses * `/api/rest_v1/transform/wikitext/to/html` about 6 req/s https://w.wiki/6YSK ** about 2.5 req/s from `REST-API-Crawler-Google/1.0` ** about 2.5 req/s from a fake user agent that starts with "User-Agent", originating from a single IP address. ** another 0.2 req/s from `ServiceChecker-WMF/0.1.2` * `/api/rest_v1/transform/wikitext/to/lint` about 21 req/min https://w.wiki/6YSR ** about 19 req/min from a fake user agent that starts with "User-Agent", originating from a single IP address. ** some 0.6 req/min from `sigprobs signatures` on toolforge * `/api/rest_v1/transform/html/to/wikitext` about 18 req/min https://w.wiki/6YSS ** nearly all from a fake user agent that starts with "User-Agent", originating from a single IP address.

Parsoid is exposing a number of public endpoints through RESTbase. With the sunsetting of RESTbase and the integration of parsoid into MediaWiki core, these endpoints should be decomissioned. However, they are still in use by external clients. A deprecation plan is needed. Relevant endpoints and usage:Usage analysis: * `/api/rest_v1/page/html/`: about 100 req/s https://w.wiki/6YSL ** main user is WikiMedia enterprise ** about 8 req/s from `REST-API-Crawler-Google/1.0` ** about 14 req/s without user agent, the vast majority originating from just four IP addresses * `/api/rest_v1/transform/wikitext/to/html` about 6 req/s https://w.wiki/6YSK ** about 2.5 req/s from `REST-API-Crawler-Google/1.0` ** about 2.5 req/s from a fake user agent that starts with "User-Agent", originating from a single IP address. ** another 0.2 req/s from `ServiceChecker-WMF/0.1.2` * `/api/rest_v1/transform/wikitext/to/pb`lint` about 21 req/min https://w.wiki/6YSR * `/api/rest_v1/transform/html/to/wikitext`** about 19 req/min from a fake user agent that starts with "User-Agent", originating from a single IP address. * `/api/rest_v1/transform/pb/to/wikitext`* some 0.6 req/min from `sigprobs signatures` on toolforge * `/api/rest_v1/transform/html/to/wikitext` about 18 req/min https://w.wiki/6YSS ** nearly all from a fake user agent that starts with "User-Agent", originating from a single IP address.