Interface customization baseline instrumentation
Closed, ResolvedPublic5 Estimated Story Points
Actions

Assigned To

Authored By

	ovasileva
	Sep 11 2023, 10:05 PM

Description

Background

The WE2.1 KR states: Ensure a quality reading experience for all users by adapting the default experience for 15% of pageviews, based on the individual needs and constraints of the user. We would like to establish a baseline for this metric by looking at at the frequency of how the interface currently adapts

Acceptance criteria

Build out instrumentation for the following metrics, as per the spec in https://docs.google.com/spreadsheets/d/1MrnLq5ZefmGl2YEko5SznpHrUaye2mXutr8MN7lisbo/edit#gid=0
page preview status
interface width
pin status
media viewer status

QA

Note: https://grafana.wikimedia.org/d/000000566/overview?orgId=1 may be helpful

This will impact the live schema so make sure DesktopWebUIClickTracking volume is not impacted
This will impact the live schema so make sure MobileWebUIClickTracking volume is not impacted
All events should contain the new accessibility fields

QA Results - Beta

AC	Status	Details
1	✅	T346106#9244756
2	✅	T346106#9244756
3	✅	T346106#9244756
4	✅	T346106#9244756

QA Results - Prod

AC	Status	Details
1	✅	T346106#9264900
2	✅	T346106#9264900
3	✅	T346106#9264900
4	✅	T346106#9264900

Details

Other Assignee: KSarabia-WMF

Subject	Repo	Branch	Lines /-
Fix Typo in OS Dark Mode field	mediawiki/extensions/WikimediaEvents	wmf/1.42.0-wmf.1	1 -1
Fix Typo in OS Dark Mode field	mediawiki/extensions/WikimediaEvents	master	1 -1
Introduce Web Accessibility Features and Submodule (attempt 2)	mediawiki/extensions/WikimediaEvents	master	171 -22
Schema bump desktop and mobile web ui	schemas/event/secondary	master	519 -6
mw.popups.isEnabled should always return boolean	mediawiki/extensions/Popups	master	3 -3
Introduce Web Accessibility Features and Submodule	mediawiki/extensions/WikimediaEvents	master	171 -22
Refactor schema structure	schemas/event/secondary	master	90 -78
Beta cluster: mobile web click tracking schema at 100%	operations/mediawiki-config	master	1 -0
Add new utility function for detecting pinned elements	mediawiki/skins/Vector	master	22 -0
Adds new web fragment	schemas/event/secondary	master	619 -12

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	ovasileva	T341631 [EPIC] Q1 Main hypothesis: Typographical and palette customizations
Resolved	ovasileva	T341632 [EPIC] Palette customizations and dark mode
Resolved	jwang	T345001 Create instrumentation spec for establishing baseline for interface customization
Resolved	Jdlrobson	T346106 Interface customization baseline instrumentation

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 11 2023, 10:05 PM

ovasileva triaged this task as High priority.Sep 11 2023, 10:05 PM

ovasileva added a parent task: T345001: Create instrumentation spec for establishing baseline for interface customization.

ovasileva edited projects, added Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6); removed Web-Team-Backlog.

Jdrewniak set the point value for this task to 5.Sep 12 2023, 4:42 PM

Jdlrobson moved this task from Incoming to Ready for Development on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6) board.Sep 12 2023, 4:42 PM

KSarabia-WMF claimed this task.Sep 14 2023, 5:16 PM

KSarabia-WMF moved this task from Ready for Development to Doing on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6) board.

Change 958863 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@master] Add fields to web common

https://gerrit.wikimedia.org/r/958863

gerritbot added a project: Patch-For-Review.Sep 19 2023, 2:55 AM

Jdlrobson updated Other Assignee, added: Jdlrobson.Sep 19 2023, 5:08 PM

ovasileva mentioned this in T346978: QA instrumentation for baseline for interface customization.Sep 20 2023, 8:37 PM

Jdlrobson edited projects, added Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)); removed Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6).Sep 21 2023, 4:56 PM

KSarabia-WMF edited projects, added Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 1); removed Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)).Sep 21 2023, 4:56 PM

KSarabia-WMF edited projects, added Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)); removed Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 1).

ovasileva updated the task description. (Show Details)Sep 21 2023, 5:12 PM

ovasileva merged a task: T346977: Interface customization baseline instrumentation pt 2.

ovasileva added subscribers: KSarabia-WMF, jwang, Masumrezarock100, mpopov.

Jdlrobson updated the task description. (Show Details)Sep 21 2023, 5:21 PM

Change 960136 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/skins/Vector@master] Add client-side preference classes

https://gerrit.wikimedia.org/r/960136

Change 960141 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[schemas/event/secondary@master] Adds new web fragment

https://gerrit.wikimedia.org/r/960141

ovasileva moved this task from Incoming to Ready for Development on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)) board.Sep 25 2023, 5:26 PM

Jdlrobson moved this task from Ready for Development to Needs More Work on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)) board.Sep 25 2023, 6:53 PM

Change 958863 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@master] Adds fields webAccessibilitySettings js

https://gerrit.wikimedia.org/r/958863

Jdlrobson moved this task from Needs More Work to Doing on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)) board.Sep 27 2023, 9:30 PM

Change 960141 merged by jenkins-bot:

[schemas/event/secondary@master] Adds new web fragment

https://gerrit.wikimedia.org/r/960141

Jdlrobson moved this task from Doing to Needs More Work on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)) board.Sep 29 2023, 8:36 PM

Change 960136 merged by jenkins-bot:

[mediawiki/skins/Vector@master] Add new utility function for detecting pinned elements

https://gerrit.wikimedia.org/r/960136

ReleaseTaggerBot added a project: MW-1.41-notes (1.41.0-wmf.29; 2023-10-03).Sep 30 2023, 2:00 AM

Jdlrobson moved this task from Needs More Work to Doing on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)) board.Oct 2 2023, 5:11 PM

Jdlrobson moved this task from Doing to Code Review on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)) board.Oct 3 2023, 5:13 PM

Jdlrobson mentioned this in T348033: Provide a recent analysis on usage of width toggle.Oct 3 2023, 5:29 PM

Change 958863 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Introduce Web Accessibility Features and Submodule

https://gerrit.wikimedia.org/r/958863

ReleaseTaggerBot edited projects, added MW-1.41-notes (1.41.0-wmf.30; 2023-10-10); removed MW-1.41-notes (1.41.0-wmf.29; 2023-10-03).Oct 3 2023, 9:01 PM

QA Instructions

Validate the event tracking and data collection as outlined in the following tables.
Test both logged-in and logged-out states.
Mobile has additional new fields because it now shares a new fragment with desktop, so it will also have is_pinned, is_media_viewer_enabled, etc. This is expected behavior.

Minerva (Mobile)

Description	Schema	Fields	Expected Results	Logged In Status
Number of pageviews	MobileWebUIActionsTracking	event.action="init"	On load, the init event should always fire.	Check both logged in and logged out
Session ID	MobileWebUIActionsTracking	event.token	Token field must always be included	Check both logged in and logged out
Skin name	MobileWebUIActionsTracking	event.skin='minerva'	Skin field must always be included	Check both logged in and logged out
Font size	MobileWebUIActionsTracking	event.font	For now, should always return false	Check both logged in and logged out

Vector 2022 (Desktop)

Description	Schema	Fields	Expected Results	Logged In Status
Number of pageviews	desktopwebuiactionstracking	event.action="init"	On load, the init event should always fire.	Check both logged in and logged out
Session ID	desktopwebuiactionstracking	event.token	Token field must always be included	Check both logged in and logged out
Skin name	desktopwebuiactionstracking	event.skin='vector-2022'	Skin field must always be included	Check both logged in and logged out
Previews status	desktopwebuiactionstracking	event.is_page_preview_on (Boolean)	If page preview is enabled, returns true, otherwise false	Check both logged in and logged out
interface width status	desktopwebuiactionstracking	event.is_full_width (Boolean)	If full width, return true, otherwise false	Check both logged in and logged out
pinned	desktopwebuiactionstracking	event.is_pinned (Boolean)	If at least one pinnable component is pinned, return true, otherwise false	Check both logged in and logged out
media viewer status	desktopwebuiactionstracking	event.is_media_viewer_enabled (Boolean)	If media viewer is enabled via the console or the thumbnail, return true, otherwise false	Check both logged in and logged out
OS Dark Mode Setting	desktopwebuiactionstracking	event.is_dark_mode_preferred_by_os	Toggling OS settings for dark mode returns true or false (Instructions)	Check both logged in and logged out
Dark Mode	desktopwebuiactionstracking	event.is_dark_mode_on	For now, should always return false	Check both logged in and logged out

KSarabia-WMF reassigned this task from KSarabia-WMF to Edtadros.Oct 3 2023, 9:30 PM

KSarabia-WMF moved this task from Code Review to QA on the Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)) board.

Jdlrobson edited projects, added Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 1); removed Web-Team-Backlog (Web Team FY2023-24 Q1 Sprint 6.5 (Quarter wrap up)).Oct 10 2023, 4:57 PM

Jdlrobson moved this task from Incoming to QA on the Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 1) board.

Change 965246 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[operations/mediawiki-config@master] Beta cluster: mobile web click tracking schema at 100%

https://gerrit.wikimedia.org/r/965246

Change 965258 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[schemas/event/secondary@master] Refactor schema structure

https://gerrit.wikimedia.org/r/965258

Test Result - Beta

Status: ✅ PASS
Environment: beta
OS: macOS Sonoma
Browser: Chrome
Device: MBA
Emulated Device:NA

Test Artifact(s):

QA Steps

QA Instructions

Validate the event tracking and data collection as outlined in the following tables.
Test both logged-in and logged-out states.
Mobile has additional new fields because it now shares a new fragment with desktop, so it will also have is_pinned, is_media_viewer_enabled, etc. This is expected behavior.

Minerva (Mobile)

✅ AC1: Minerva logged in
✅ AC2: Minerva logged out

Description	Schema	Fields	Expected Results	Logged In	Logged Out
Number of pageviews	MobileWebUIActionsTracking	event.action="init"	On load, the init event should always fire.	✅	✅
Session ID	MobileWebUIActionsTracking	event.token	Token field must always be included	✅	✅
Skin name	MobileWebUIActionsTracking	event.skin='minerva'	Skin field must always be included	✅	✅
Font size	MobileWebUIActionsTracking	event.font	For now, should always return false	✅	✅

Logged In	Logged Out

Vector 2022 (Desktop)

✅ AC3: Vector 2022 logged in
✅ AC4: Vector 2022 logged out

Description	Schema	Fields	Expected Results	Logged In	Logged Out
Number of pageviews	desktopwebuiactionstracking	event.action="init"	On load, the init event should always fire.	✅	✅
Session ID	desktopwebuiactionstracking	event.token	Token field must always be included	✅	✅
Skin name	desktopwebuiactionstracking	event.skin='vector-2022'	Skin field must always be included	✅	✅
Previews status	desktopwebuiactionstracking	event.is_page_preview_on (Boolean)	If page preview is enabled, returns true, otherwise false	✅	✅
interface width status	desktopwebuiactionstracking	event.is_full_width (Boolean)	If full width, return true, otherwise false	✅	✅
pinned	desktopwebuiactionstracking	event.is_pinned (Boolean)	If at least one pinnable component is pinned, return true, otherwise false	✅	✅
media viewer status	desktopwebuiactionstracking	event.is_media_viewer_enabled (Boolean)	If media viewer is enabled via the console or the thumbnail, return true, otherwise false	✅	✅
OS Dark Mode Setting	desktopwebuiactionstracking	event.is_dark_mode_preferred_by_os	Toggling OS settings for dark mode returns true or false (Instructions)	✅	✅
Dark Mode	desktopwebuiactionstracking	event.is_dark_mode_on	For now, should always return false	✅	✅

Logged In	Logged Out

Jdlrobson claimed this task.Oct 12 2023, 4:38 PM

Jdlrobson moved this task from Ready for Signoff to Code Review on the Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 1) board.

Production QA will be done in T346978: QA instrumentation for baseline for interface customization

Change 965258 merged by jenkins-bot:

[schemas/event/secondary@master] Refactor schema structure

https://gerrit.wikimedia.org/r/965258

Change 965246 merged by jenkins-bot:

[operations/mediawiki-config@master] Beta cluster: mobile web click tracking schema at 100%

https://gerrit.wikimedia.org/r/965246

Jdlrobson reassigned this task from Jdlrobson to KSarabia-WMF.Oct 12 2023, 11:16 PM

Jdlrobson moved this task from Code Review to Doing on the Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 1) board.

Jdlrobson subscribed.

Hi folks! After an unrelated deployment of EventGate analytics-external a lot of validation errors appeared:

https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&var-service=eventgate-analytics-external&var-stream=All&var-kafka_broker=All&var-kafka_producer_type=All&var-dc=thanos&from=now-3h&to=now&refresh=1m&viewPanel=75

DesktopWebUIActionsTracking -> "message": "'.event.font' should be string",
MobileWebUIActionsTracking -> "message":"'.event.font' should be string"

In both cases the schema seems to be the one created with https://gerrit.wikimedia.org/r/c/schemas/event/secondary/ /960141. The change has been merged before the MediaWiki deployment, and our (unrelated) restart of the Eventgate service forced a refresh. Should we revert the change before the MW Deployment to stop the errors?

phuedx mentioned this in T348957: '.event.font' should be a string.Oct 16 2023, 9:56 AM

I've left two comments on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaEvents/ /95a8863, one of which caused the "'.event.font' should be string" validation error and another that caused a relatively small number of events to be sent with is_page_previews_enabled=null.

Edit

Sorry… I reverted that patch and scap backported it. The validation errors very quickly tailed off:

https://logstash.wikimedia.org/goto/3ed5d68762e7f907df25993e02c48c54

Change 966262 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/extensions/Popups@master] mw.popups.isEnabled should always return boolean

https://gerrit.wikimedia.org/r/966262

Edtadros mentioned this in T346851: Verify 1.41.0-wmf.30 deployment.Oct 16 2023, 5:15 PM

Jdlrobson removed a project: MW-1.41-notes (1.41.0-wmf.30; 2023-10-10).Oct 16 2023, 5:22 PM

Change 966262 merged by jenkins-bot:

[mediawiki/extensions/Popups@master] mw.popups.isEnabled should always return boolean

https://gerrit.wikimedia.org/r/966262

Change 966278 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[schemas/event/secondary@master] Schema bump desktop and mobile web ui

https://gerrit.wikimedia.org/r/966278

ReleaseTaggerBot added a project: MW-1.42-notes (1.42.0-wmf.1; 2023-10-17).Oct 16 2023, 7:00 PM

Change 966278 merged by jenkins-bot:

[schemas/event/secondary@master] Schema bump desktop and mobile web ui

https://gerrit.wikimedia.org/r/966278

Change 966229 had a related patch set uploaded (by Jdlrobson; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@master] Introduce Web Accessibility Features and Submodule (attempt 2)

https://gerrit.wikimedia.org/r/966229

Change 966229 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Introduce Web Accessibility Features and Submodule (attempt 2)

https://gerrit.wikimedia.org/r/966229

KSarabia-WMF moved this task from Doing to QA on the Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 1) board.Oct 16 2023, 9:30 PM

@jwang The latest revert we made should be testable in test.wikipedia.org tomorrow. Sampling there is at 100% so we should see some entries in the database starting tomorrow as part of QA.
@Edtadros You should be able to QA that events are firing in the network tab again just to make sure we didn't accidentally undo anything in test wiki.

• Mabualruz removed KSarabia-WMF as the assignee of this task.Oct 17 2023, 4:41 PM

• Mabualruz assigned this task to Edtadros.

• Mabualruz updated Other Assignee, added: KSarabia-WMF; removed: Jdlrobson.

Change 966630 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@master] Fix Typo in OS Dark Mode field

https://gerrit.wikimedia.org/r/966630

Change 966630 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Fix Typo in OS Dark Mode field

https://gerrit.wikimedia.org/r/966630

ReleaseTaggerBot edited projects, added MW-1.42-notes (1.42.0-wmf.2; 2023-10-24); removed MW-1.42-notes (1.42.0-wmf.1; 2023-10-17).Oct 17 2023, 9:00 PM

Change 966615 had a related patch set uploaded (by Jdlrobson; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@wmf/1.42.0-wmf.1] Fix Typo in OS Dark Mode field

https://gerrit.wikimedia.org/r/966615

Change 966615 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.42.0-wmf.1] Fix Typo in OS Dark Mode field

https://gerrit.wikimedia.org/r/966615

ReleaseTaggerBot edited projects, added MW-1.42-notes (1.42.0-wmf.1; 2023-10-17); removed MW-1.42-notes (1.42.0-wmf.2; 2023-10-24).Oct 18 2023, 6:00 PM

Mentioned in SAL (#wikimedia-operations) [2023-10-18T18:03:45Z] <brennen@deploy2002> Started scap: Backport for [[gerrit:966615|Fix Typo in OS Dark Mode field (T346106)]]

Mentioned in SAL (#wikimedia-operations) [2023-10-18T18:05:08Z] <brennen@deploy2002> brennen and jdlrobson: Backport for [[gerrit:966615|Fix Typo in OS Dark Mode field (T346106)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2023-10-18T18:17:31Z] <brennen@deploy2002> Finished scap: Backport for [[gerrit:966615|Fix Typo in OS Dark Mode field (T346106)]] (duration: 13m 46s)

Test Result - Prod

Status: ✅ PASS
Environment: testwiki
OS: macOS Sonoma
Browser: Chrome
Device: MBA
Emulated Device:NA

Test Artifact(s):

QA Steps

QA Instructions

Validate the event tracking and data collection as outlined in the following tables.
Test both logged-in and logged-out states.
Mobile has additional new fields because it now shares a new fragment with desktop, so it will also have is_pinned, is_media_viewer_enabled, etc. This is expected behavior.

Minerva (Mobile)

✅ AC1: Minerva logged in
✅ AC2: Minerva logged out

Description	Schema	Fields	Expected Results	Logged In	Logged Out
Number of pageviews	MobileWebUIActionsTracking	event.action="init"	On load, the init event should always fire.	✅	✅
Session ID	MobileWebUIActionsTracking	event.token	Token field must always be included	✅	✅
Skin name	MobileWebUIActionsTracking	event.skin='minerva'	Skin field must always be included	✅	✅
Font size	MobileWebUIActionsTracking	event.font	For now, should always return false	✅	✅

Logged In	Logged Out

Vector 2022 (Desktop)

✅ AC3: Vector 2022 logged in
✅ AC4: Vector 2022 logged out

Description	Schema	Fields	Expected Results	Logged In	Logged Out
Number of pageviews	desktopwebuiactionstracking	event.action="init"	On load, the init event should always fire.	✅	✅
Session ID	desktopwebuiactionstracking	event.token	Token field must always be included	✅	✅
Skin name	desktopwebuiactionstracking	event.skin='vector-2022'	Skin field must always be included	✅	✅
Previews status	desktopwebuiactionstracking	event.is_page_preview_on (Boolean)	If page preview is enabled, returns true, otherwise false	✅	✅
interface width status	desktopwebuiactionstracking	event.is_full_width (Boolean)	If full width, return true, otherwise false	✅	✅
pinned	desktopwebuiactionstracking	event.is_pinned (Boolean)	If at least one pinnable component is pinned, return true, otherwise false	✅	✅
media viewer status	desktopwebuiactionstracking	event.is_media_viewer_enabled (Boolean)	If media viewer is enabled via the console or the thumbnail, return true, otherwise false	✅	✅
OS Dark Mode Setting	desktopwebuiactionstracking	event.is_dark_mode_preferred_by_os	Toggling OS settings for dark mode returns true or false (Instructions)	✅	✅
Dark Mode	desktopwebuiactionstracking	event.is_dark_mode_on	For now, should always return false	✅	✅

Logged In	Logged Out

Edtadros updated the task description. (Show Details)Oct 19 2023, 1:37 PM

Jdrewniak assigned this task to Jdlrobson.Oct 19 2023, 4:42 PM

Edtadros mentioned this in T348357: Verify 1.42.0-wmf.1 deployment.Oct 22 2023, 8:18 PM

Ran some queries and their responses seemed reasonable so I think this looks good enough to pass to Jennifer. Thanks for all the work here! Interestingly 20% of all users have the dark mode operating system setting enabled.

Jdlrobson added a project: Verified.Oct 23 2023, 5:16 PM

Change 968674 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[schemas/event/secondary@master] Adds skin field in mobilewebuiactions

https://gerrit.wikimedia.org/r/968674

Change 968675 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@master] Updates schema version for mobilewebuiactions

https://gerrit.wikimedia.org/r/968675

jwang mentioned this in T346979: Report on baseline for interface customization.Oct 26 2023, 5:51 PM

Jdlrobson mentioned this in T284781: Add type hinting to WikimediaEvents to protect against errors in instrumentation.Oct 30 2023, 4:31 PM

	F38816867: screenshot 130da.png
	Oct 19 2023, 1:35 PM

	F38816864: screenshot 132dl.png
	Oct 19 2023, 1:35 PM

	F38816862: screenshot 129ma.png
	Oct 19 2023, 1:35 PM

	F38816860: screenshot 133ml.png
	Oct 19 2023, 1:35 PM

Interface customization baseline instrumentation Closed, ResolvedPublic5 Estimated Story PointsActions

Description

Background

Acceptance criteria

QA

QA Results - Beta

QA Results - Prod

Details

Related ObjectsSearch...

Event Timeline

QA Instructions

Minerva (Mobile)

Vector 2022 (Desktop)

Test Result - Beta

QA Steps

QA Instructions

Minerva (Mobile)

Vector 2022 (Desktop)

Test Result - Prod

QA Steps

QA Instructions

Minerva (Mobile)

Vector 2022 (Desktop)

Interface customization baseline instrumentation
Closed, ResolvedPublic5 Estimated Story Points
Actions

Related Objects
Search...