Page MenuHomePhabricator
Create Task
Maniphest T344944

Move Parsoid endpoints out of RESTBase
Open, HighPublic
Actions

Description

Currently, the Parsoid API is defiend in RESTBase. Equivalent endpoints implemented in PHP exist in the Parsoid extension under /{domain}/v3/page/html/{title}. Alternative endpoints for retrieving page HTML are exposed by MediaWiki core under /v1/page/{title}/html.

Instead of exposing the parsoid endpoints through RESTBase, we want to expose them through Envoy (REST Gateway or API Gateway)

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolveddanielT386326 REST: endpoints that return rendered page content should support all content models
 ResolvedPginer-WMFT338432 Prepare the cxserver for usage without RESTbase
 StalledNoneT324931 Clean up open RESTBase related tickets
 In ProgressNoneT262315 <CORE TECHNOLOGY> API Migration & RESTBase Sunset
 OpenNoneT344944 Move Parsoid endpoints out of RESTBase
 ResolvedJgiannelosT344945 Disable storage of Parsoid content in RESTbase
 DeclinedNoneT344946 Create a mechanism for purging output from (parsoid) HTML endpoints from edge caches (without RESTbase)
 ResolvedhnowlanT357504 Prepare amount of workers to handle enwiki traffic for parsoid endpoints
 In ProgressNoneT328559 Replace usage of RESTbase parsoid endpoints
 ResolveddanielT320529 Configure VE backend to use Parsoid directly, instead of calling RESTbase
 ResolvedNoneT310376 Make VE Action API use Parsoid directly
 ResolvedNoneT310377 Make parsoid transformation API available internally
 ResolvedmatmarexT314565 ApiVisualEditor: Convert ApiParsoidTrait into a helper object.
 ResolvedPRODUCTION ERRORdanielT320703 VisualEditor can't save pages on de.wikipedia.beta
 ResolveddanielT320704 When VisualEditor saves an edit, it should use the same backend that the HTML was originally loaded from
 DuplicatexSavitarT320532 Create dual backend mode for VE API
 ResolveddanielT320534 Put Parsoid output into the ParserCache on every edit
 ResolveddanielT322427 Job for pre-emptive population of the ParserCache with Parsoid output
 ResolvedNoneT322672 Make ParsoidHandler::wt2html write to parser cache
 ResolvedovasilevaT326147 Stop fragmenting ParserCache entries for mobile frontend
Declined• nrayT328802 Devise Test cases for functional fallout of ParserCache fix
 ResolvedDAlangi_WMFT327164 Trigger ParsoidCachePrewarmJob on page views
 ResolvedssastryT328034 ParsoidCachePrewarmJob should set the useParsoid ParserOption
 ResolveddanielT341123 High insertion rate of ParsoidCachePrewarmJob causes substantial backlog
 ResolveddanielT329366 Enable WarmParsoidParserCache on all wikis
 ResolvedClement_GoubertT333528 Increase memory_limit for jobrunners to $wmgMemoryLimitParsoid
 ResolveddanielT333684 VE load latency degraded on hewiki
 ResolvedKrinkleT327162 RefreshLinksJob should update ParserCache
 ResolveddanielT320536 Ensure that stashing backend for the VE API has sufficient capacity
 ResolveddanielT309016 Determine storage requirements for stashing parsoid output for VE edits
 ResolveddanielT320531 Configure VE backend to use Parsoid directly on the beta cluster and testwiki
 ResolveddanielT320535 Put Parsoid output into the ParserCache on the beta cluster and testwiki
 ResolvedKCVelaga_WMFT338634 Calculate edit session length by platform and editing interface
 ResolveddanielT338638 [SPIKE] What – if any – user-facing regressions might RESTbase deprecation have caused
 ResolvedMSantosT333536 Survey RESTBase services and find which ones accesses Parsoid via RESTBase
 ResolvedDAlangi_WMFT339228 Remove VRS code from ContentTranslation
 ResolvedDAlangi_WMFT339227 Remove VRS code from VisualEditor
 Resolved• R_RanaT338922 Introduce maintenance script for warming cache with Parsoid Outputs
 ResolvedJgiannelosT339865 PCS should use parsoid endpoints in MediaWiki, not RESTbase
 ResolvedPRODUCTION ERRORcscottT356368 Revision endpoint: InvalidArgumentException: ParserOutput does not have a render ID
 ResolvedPRODUCTION ERRORJgiannelosT356369 Missing content-language header on PCS responses
 ResolvedClement_GoubertT356497 Raise mw-api-int replicas for increased load from mobileapps
 ResolvedKartikMistryT344982 Make cxserver call parsoid endpoints on MediaWiki, instead of going through RESTbase
 ResolvedBUG REPORTngkountasT357769 cxserver "fetch segmented page content" API endpoint doesn't work for space-separated multi-word titles
 OpenMSantosT334238 Create deprecation plan for public parsoid endpoints
 ResolvedMSantosT335511 Talk to Google about transitioning REST-API-Crawler-Google from RESTBase endpoints
 ResolvedMSantosT335512 Transition Enterprise MediaWiki from RESTBase to core page HTML endpoints
 ResolvedROdonnell-WMFT353286 Test structured-contents parsing with the new WMF update in T335512
 ResolvedBUG REPORTMSantosT353689 REST HTML endpoint returning 500 for JSON page
 ResolvedBUG REPORTdanielT353688 REST: Trying to load the content "magic" image description pages leads to redirect loop
 ResolvedBUG REPORTdanielT353687 REST: page content endpoints fail on page "0"
 OpenBUG REPORTNoneT362187 REST HTML endpoint returning 500 for the first 3 - 5 calls for several pages
 InvalidNoneT335513 Selective outage of `/wikitext/to/lint` and `/html/to/wikitext` RESTBase endpoints
 ResolveddanielT350661 Expose parsoid transformation API from MediaWiki core.
 ResolvedBPirkleT370430 REST: define the content.v1 module that will replace Parsoid endpoints.
 In ProgressdanielT366835 REST: API modularization and versioning (tracking)
 DuplicateNoneT366838 Allow extensions to define REST modules
 StalleddanielT364400 map the /api/ prefix to /w/rest.php
 ResolveddanielT365754 REST: Allow extensions to define REST modules
 ResolveddanielT366837 REST: Introduce module definition files
 ResolveddanielT362480 Introduces support for modules into the REST API framework
 In ProgressdanielT365753 REST: expose a machine readable directory of available API modules
 ResolveddanielT365755 REST: make module definition files compatible with OpenAPI specs
 OpendanielT365752 REST: Introduce support for private modules
 OpenNoneT366567 REST: introduce audience designations (proposal)
 ResolveddanielT359964 Move page lint job outside of restbase request/response cycle to allow completely disabling cassandra writes
 ResolveddanielT361013 Update lint tables independently of changeprop/restbase
 ResolveddanielT361413 Parsoid should perhaps use LinkUpdate job for lints instead of special Linter API/Hook
 DeclinedNoneT361411 Parsoid lints should be added to ParserOutput
 OpenNoneT367416 Route requests to parsoid endpoints to MediaWiki directly instead of RESTbase
 OpenJgiannelosT367418 ChangeProp: stop making no-cache requests to parsoid endpoints in RESTBase
 ResolvedBPirkleT365630 Remove long term caching and active purging for Parsoid endpoints in RESTBase
 ResolvedJgiannelosT367417 Enable LinterParseOnDerivedDataUpdate in production
 OpenNoneT373716 Reroute RESTbase Parsoid endpoints to core's REST endpoints
 OpenakosiarisT374683 Switchover plan from RESTbase to REST Gateway for rest_v1/page/html and rest_v1/page/title endpoints

Event Timeline

daniel created this task.Aug 24 2023, 5:29 PM
daniel updated the task description. (Show Details)Aug 24 2023, 5:44 PM
daniel added a subtask: T328559: Replace usage of RESTbase parsoid endpoints.Aug 25 2023, 8:32 AM
daniel added a subtask: T334238: Create deprecation plan for public parsoid endpoints.Aug 25 2023, 8:39 AM
Physikerwelt unsubscribed.Aug 25 2023, 8:41 AM
MSantos added a project: Content-Transform-Team.Aug 31 2023, 2:26 PM
MSantos moved this task from Needs Triage to Tech Debt / Big changes on the Parsoid board.
MSantos moved this task from Backlog to Later on the Content-Transform-Team board.
MSantos moved this task from Unsorted to Parsoid pile on the RESTBase Sunsetting board.Sep 13 2023, 12:01 PM
MSantos triaged this task as High priority.Sep 13 2023, 12:46 PM
MSantos added a project: Content-Transform-Team-WIP.Oct 2 2023, 2:47 PM
MSantos moved this task from Backlog to Blocked on the Content-Transform-Team-WIP board.Oct 16 2023, 2:26 PM
MSantos moved this task from Blocked to Current Epics on the Content-Transform-Team-WIP board.
Jgiannelos closed subtask T344945: Disable storage of Parsoid content in RESTbase as Resolved.Feb 28 2024, 1:52 PM
daniel closed subtask T359964: Move page lint job outside of restbase request/response cycle to allow completely disabling cassandra writes as Resolved.Jun 13 2024, 2:52 PM
Reedy renamed this task from Move Parsoid endpoints out of RESTbase to Move Parsoid endpoints out of RESTBase.Jun 13 2024, 9:29 PM
Reedy updated the task description. (Show Details)
Jgiannelos closed subtask T367417: Enable LinterParseOnDerivedDataUpdate in production as Resolved.Jul 11 2024, 7:32 AM
Jgiannelos closed subtask T367418: ChangeProp: stop making no-cache requests to parsoid endpoints in RESTBase as Resolved.Jul 11 2024, 11:52 AM
MSantos reopened subtask T367418: ChangeProp: stop making no-cache requests to parsoid endpoints in RESTBase as Open.Jul 22 2024, 1:14 PM
Jdforrester-WMF subscribed.Aug 21 2024, 1:10 PM
BPirkle added a subtask: T373716: Reroute RESTbase Parsoid endpoints to core's REST endpoints.Aug 30 2024, 8:57 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits