Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: remove pinned SelfDM for new users #53193

Merged
merged 3 commits into from
Dec 2, 2024

Conversation

nkdengineer
Copy link
Contributor

@nkdengineer nkdengineer commented Nov 27, 2024

Explanation of Change

Fixed Issues

$ #52830
PROPOSAL: #52830 (comment)

Tests

  1. Login with the new user
  2. Choose 'manage my team's expenses'
  3. Complete onboarding flow
  4. Verify that: SelfDM isn't pinned
  • Verify that no errors appear in the JS console

Offline tests

same as above

QA Steps

// TODO: These must be filled out, or the issue title must include "[No QA]."
same as above

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
android.mov
Android: mWeb Chrome
android-mweb.mov
iOS: Native
ios.mov
iOS: mWeb Safari
ios-mweb.mov
MacOS: Chrome / Safari
web.mov
MacOS: Desktop
desktop.mov

@nkdengineer nkdengineer marked this pull request as ready for review November 27, 2024 09:27
@nkdengineer nkdengineer requested a review from a team as a code owner November 27, 2024 09:27
@melvin-bot melvin-bot bot requested review from suneox and removed request for a team November 27, 2024 09:27
Copy link

melvin-bot bot commented Nov 27, 2024

@suneox Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@suneox
Copy link
Contributor

suneox commented Nov 27, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Screen.Recording.2024-11-27.at.22.11.04.mp4
Android: mWeb Chrome
Screen.Recording.2024-11-27.at.22.09.33.mp4
iOS: Native
Screen.Recording.2024-11-27.at.22.08.36.mp4
iOS: mWeb Safari
Screen.Recording.2024-11-27.at.22.06.55.mp4
MacOS: Chrome / Safari
Screen.Recording.2024-11-27.at.22.12.16.mp4
MacOS: Desktop
Screen.Recording.2024-11-27.at.22.03.56.mp4

Copy link
Contributor

@suneox suneox left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@melvin-bot melvin-bot bot requested a review from MonilBhavsar November 27, 2024 15:16
@MonilBhavsar
Copy link
Contributor

I wonder if it works without backend change 🤔 Is pinned state persisted after signing out or signing in?

@nkdengineer
Copy link
Contributor Author

@MonilBhavsar Yes, we also need to retest after the backend change is complete.

@MonilBhavsar
Copy link
Contributor

I have sent PR for backend. Will notify once it can be tested

@MonilBhavsar
Copy link
Contributor

We can test with backend change now

@nkdengineer
Copy link
Contributor Author

I'll test today

@nkdengineer
Copy link
Contributor Author

@MonilBhavsar i merged and tested well

@MonilBhavsar
Copy link
Contributor

Thanks for confirming! Let's ship it 🚀

@MonilBhavsar MonilBhavsar merged commit 7d15aac into Expensify:main Dec 2, 2024
16 checks passed
@OSBotify
Copy link
Contributor

OSBotify commented Dec 2, 2024

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Dec 2, 2024
Copy link
Contributor

github-actions bot commented Dec 2, 2024

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 810.902 ms → 922.627 ms ( 111.726 ms, 13.8%) 🔴
Show details
Name Duration
Linking Baseline
Mean: 810.902 ms
Stdev: 258.531 ms (31.9%)
Runs: 496.4077550005168 496.5262460000813 513.9870609994978 524.7130939997733 525.6640629991889 529.9212650004774 533.1278079990298 533.8364670015872 534.1292320005596 535.1038410011679 540.0303140003234 541.9134109988809 550.5201009996235 552.2480469997972 553.2856850009412 554.0190030001104 554.5111079998314 559.2312819994986 559.4007580000907 560.7179769985378 569.4938149992377 571.9137779995799 585.8822019994259 588.718913000077 615.516235999763 781.1230880003422 812.2484539989382 812.6929940003902 815.4539395001446 824.191487999633 831.2207440007478 835.598022999242 837.9192710015923 844.2959809992462 845.444825001061 849.9207760002464 852.73091599904 857.0107429996133 858.1949879992753 865.4791270010173 867.6771649997681 877.5303549990058 883.8428959995508 887.1679280009121 890.0271809995174 892.7428390011191 893.0852869991213 903.7514650002122 911.8759359996766 920.5585129987448 922.0135099999607 923.859864000231 926.6185309998691 928.988851999864 929.1467289999127 933.4006350003183 944.2246509995311 946.9530849996954 948.6577969994396 957.8383389990777 1354.4464940000325 1390.4530040007085 1391.168904999271 1392.3439549989998 1415.528036000207 1435.2288419995457 1456.9252129998058

Current
Mean: 922.627 ms
Stdev: 407.953 ms (44.2%)
Runs: 505.8308520000428 507.6809080000967 514.3504230007529 520.5874029994011 521.6097829993814 522.3391530010849 524.0596110001206 529.0944420006126 536.9846195009266 545.9066160004586 548.532104998827 549.8635249994695 553.8602300006896 555.9540200009942 557.2146819997579 558.3879799991846 562.625489500231 563.1554370000958 563.6619879994541 564.5960699990392 564.8824060000479 572.6919759996235 572.8932700008154 573.1447349991649 573.6885170005262 574.4013270009309 578.3803310003132 581.9554439987987 582.07881699875 583.6376140005887 583.7020270004869 589.8272709995508 969.3306889999658 977.0764570012689 981.4501149989665 987.2326250001788 995.6087650004774 1004.0729170013219 1005.7427989989519 1005.9205729998648 1007.8997399993241 1019.8530680015683 1027.9051520004869 1028.9210609998554 1042.6673180013895 1045.5328369997442 1056.794026998803 1066.3102219998837 1066.3364669997245 1068.9471029993147 1075.9333500005305 1083.6944989990443 1087.793741999194 1090.7437350004911 1106.668456999585 1107.6873380001634 1122.5968019999564 1129.6781419999897 1132.8422860000283 1171.1615410000086 1595.49536200054 1628.0450849998742 1651.8155930005014 1680.5917980000377 1735.5123700015247 1738.584106998518 1807.8616140000522 1810.1212980002165 1812.3419190011919 1919.563517998904

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 33.383 ms → 32.712 ms (-0.671 ms, -2.0%)
App start time nativeLaunchEnd_To_appCreationStart 64.914 ms → 66.967 ms ( 2.053 ms, 3.2%)
App start time appCreation 82.300 ms → 82.339 ms ( 0.039 ms, ±0.0%)
App start time appCreationEnd_To_contentAppeared 588.644 ms → 591.140 ms ( 2.496 ms, ±0.0%)
App start time contentAppeared_To_screenTTI 590.184 ms → 601.895 ms ( 11.711 ms, 2.0%)
App start time runJsBundle 423.150 ms → 422.550 ms (-0.600 ms, ±0.0%)
App start time TTI 1369.924 ms → 1376.989 ms ( 7.066 ms, 0.5%)
App start time regularAppStart 0.023 ms → 0.023 ms (-0.000 ms, -1.4%)
App start time (CPU) 125.781 % → 125.739 % (-0.042 %, ±0.0%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 371.274 MB → 370.691 MB (-0.582 MB, ±0.0%)
App start time (CPU/JS) 75.738 % → 75.900 % ( 0.162 %, ±0.0%)
App start time (CPU/UI) 20.656 % → 20.490 % (-0.166 %, -0.8%)
Open search router TTI Load Search Options 95.016 ms → 94.660 ms (-0.356 ms, ±0.0%)
Open search router TTI Open Search Router TTI 760.801 ms → 769.654 ms ( 8.852 ms, 1.2%)
Open search router TTI (CPU) 148.380 % → 149.824 % ( 1.445 %, 1.0%)
Open search router TTI (FPS) 59.895 FPS → 59.858 FPS (-0.037 FPS, ±0.0%)
Open search router TTI (RAM) 387.253 MB → 388.512 MB ( 1.260 MB, ±0.0%)
Open search router TTI (CPU/JS) 77.819 % → 78.273 % ( 0.455 %, 0.6%)
Open search router TTI (CPU/UI) 29.032 % → 28.937 % (-0.095 %, ±0.0%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 427.400 ms → 434.616 ms ( 7.217 ms, 1.7%)
Report typing (CPU) 101.843 % → 103.145 % ( 1.302 %, 1.3%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 472.440 MB → 472.658 MB ( 0.218 MB, ±0.0%)
Report typing (CPU/JS) 46.903 % → 47.619 % ( 0.716 %, 1.5%)
Report typing (CPU/UI) 26.234 % → 26.191 % (-0.043 %, ±0.0%)
Chat opening Chat TTI 561.622 ms → 580.117 ms ( 18.495 ms, 3.3%)
Chat opening (CPU) 156.688 % → 158.335 % ( 1.647 %, 1.1%)
Chat opening (FPS) 59.729 FPS → 59.139 FPS (-0.589 FPS, 1.0%)
Chat opening (RAM) 376.502 MB → 379.472 MB ( 2.970 MB, 0.8%)
Chat opening (CPU/JS) 77.878 % → 77.555 % (-0.323 %, ±0.0%)
Chat opening (CPU/UI) 34.725 % → 34.070 % (-0.655 %, -1.9%)
Linking (CPU) 161.521 % → 161.751 % ( 0.230 %, ±0.0%)
Linking (FPS) 59.950 FPS → 59.875 FPS (-0.076 FPS, ±0.0%)
Linking (RAM) 413.747 MB → 422.117 MB ( 8.370 MB, 2.0%)
Linking (CPU/JS) 83.726 % → 84.763 % ( 1.037 %, 1.2%)
Linking (CPU/UI) 35.200 % → 34.678 % (-0.522 %, -1.5%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 33.383 ms
Stdev: 5.742 ms (17.2%)
Runs: 27 27 27 27 27 27 27 28 28 28 28 28 28 28 29 29 29 29 29 30 30 30 30 30 30 31 31 31 31 31 31 32 32 33 33 34 34 34 34 35 35 36 36 37 37 37 37 37 39 39 40 41 41 41 41 44 45 47 47 49

Current
Mean: 32.712 ms
Stdev: 4.954 ms (15.1%)
Runs: 26 27 27 27 27 27 27 27 28 28 28 28 28 28 29 29 29 29 29 29 30 30 30 30 30 31 31 31 31 31 32 32 33 33 33 33 33 33 33 34 35 36 36 36 36 37 37 38 38 38 39 39 39 39 40 41 44 45 46
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 64.914 ms
Stdev: 12.749 ms (19.6%)
Runs: 43 46 46 47 48 48 48 48 50 52 54 54 54 55 55 56 56 56 57 58 59 62 62 62 62 63 63 63 63 64 64 65 66 66 67 69 69 69 70 70 70 70 71 72 72 72 75 75 76 78 78 85 86 88 88 90 92 98

Current
Mean: 66.967 ms
Stdev: 13.231 ms (19.8%)
Runs: 47 48 49 49 50 50 50 51 53 53 53 53 53 54 54 56 57 57 59 59 60 61 62 63 63 63 64 65 65 66 66 67 67 68 68 70 70 70 70 70 71 71 75 76 76 76 77 78 80 80 82 82 84 85 85 88 89 92 92 106
App start time appCreation Baseline
Mean: 82.300 ms
Stdev: 10.758 ms (13.1%)
Runs: 60 62 63 65 65 67 68 70 70 73 73 74 75 75 76 76 77 77 77 78 78 79 79 79 79 80 80 80 81 82 82 82 83 84 84 84 85 85 85 85 85 86 87 87 87 89 90 92 93 93 94 94 95 95 95 97 101 105 108 108

Current
Mean: 82.339 ms
Stdev: 10.241 ms (12.4%)
Runs: 63 64 66 67 68 69 69 70 70 71 72 72 73 76 76 76 77 78 78 78 78 78 79 79 79 79 79 80 80 81 82 82 82 83 83 83 84 85 86 86 88 89 89 89 91 91 92 92 93 94 94 95 96 97 98 99 100 102 108
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 588.644 ms
Stdev: 40.479 ms (6.9%)
Runs: 495 495 501 522 527 528 531 532 535 535 543 549 554 562 565 565 574 578 579 583 583 584 585 586 587 587 587 587 589 590 863 863 596 596 597 597 598 603 609 612 619 619 621 621 625 625 628 629 630 630 632 634 635 637 638 641 643 649 660

Current
Mean: 591.140 ms
Stdev: 41.733 ms (7.1%)
Runs: 499 508 510 523 529 531 534 536 539 541 553 558 558 558 560 562 571 573 573 575 575 581 588 588 588 590 591 592 595 600 602 603 604 605 606 607 609 609 611 614 616 619 620 622 631 632 634 635 635 636 641 643 644 645 645 652 696
App start time contentAppeared_To_screenTTI Baseline
Mean: 590.184 ms
Stdev: 39.287 ms (6.7%)
Runs: 490.4033469995484 515.0515750003979 531.2288229996338 531.2400150001049 535.4770280001685 535.6021170001477 546.3685995003869 547.9716889997944 549.1799959996715 555.551072999835 556.230237999931 557.4903859999031 559.622452000156 565.0080150002614 565.3692410001531 570.5462130000815 571.4278769996017 574.4634950002655 576.1931699998677 576.4196410002187 576.6129580000415 577.9870530003682 582.8968895001997 583.4856939995661 586.4173149997368 587.3703519999981 588.7508659996092 589.2474729996175 593.9796409998089 595.8224240001291 598.0959559995681 598.5001280000433 599.8606289997697 601.6698920000345 607.5316479997709 608.9949030000716 610.3262529997155 611.3931700000539 611.7184149995446 611.9411629997194 613.7689770003781 614.1184719996527 615.6490599997342 616.1504589999095 621.71991399955 625.0590599998832 635.9212009999901 638.9318059999496 640.6289410004392 644.7428430002183 654.497510000132 661.733946999535 665.6298489999026 687.952948000282

Current
Mean: 601.895 ms
Stdev: 48.306 ms (8.0%)
Runs: 456.464494000189 479.56512199994177 532.0289970003068 537.2765309996903 538.5967070003971 545.838454999961 547.5851609995589 549.1833795000528 552.9451339999214 556.342428999953 557.0301950003105 559.3264269996434 560.2141720000654 564.9850120004267 568.4567379998043 577.7551119998097 579.5221480000764 583.5427529998124 584.1332289995626 584.7599200000986 585.5558329997584 593.7573650004342 863.9041595001434 595.9192270003259 596.4013569997624 597.7256199996918 597.7389219999313 602.2838369999081 604.0840400001034 607.1559149995446 607.2080600000918 610.0560295003195 617.9828519998118 619.5139189995825 619.5298330001533 624.4078869996592 625.9287860002369 629.3602329995483 630.0742100002244 631.3889499995857 632.5486199995503 632.7337779998779 636.7627579998225 637.0180860003456 643.1087239999324 645.4045169996098 648.3298559999093 650.0155619997531 651.273738999851 657.7626200001687 659.502918000333 671.2060909997672 671.7702409997582 676.0146679999307 692.512256000191 693.6335695002888
App start time runJsBundle Baseline
Mean: 423.150 ms
Stdev: 28.691 ms (6.8%)
Runs: 360 365 369 371 372 374 377 377 386 386 395 396 398 406 408 410 411 413 414 414 416 416 420 421 421 423 423 423 424 424 425 427 428 429 431 432 435 436 436 436 436 437 438 441 445 447 447 448 450 453 453 454 455 462 463 464 464 468 468 468

Current
Mean: 422.550 ms
Stdev: 29.894 ms (7.1%)
Runs: 360 360 360 370 376 381 385 386 386 387 389 397 399 400 404 406 407 407 408 409 409 411 411 413 413 414 415 415 420 424 426 427 428 432 433 435 436 437 438 440 440 442 445 446 446 446 447 451 451 451 452 454 454 459 464 464 464 465 479 479
App start time TTI Baseline
Mean: 1369.924 ms
Stdev: 92.702 ms (6.8%)
Runs: 1152.4033469995484 1161.01678000018 1213.4770280001685 1226.6021170001477 1240.368599500387 1243.5462130000815 1246.0515750003979 1258.4634950002655 1264.2288229996338 1279.8606289997697 1280.3692410001531 1281.9716889997944 1290.531647999771 1293.0080150002614 1299.6129580000415 1312.2474729996175 1320.240015000105 1323.1799959996715 1325.4196410002187 1332.551072999835 1334.8968895001997 1340.4856939995661 1352.4173149997368 1353.490385999903 1361.1931699998677 1364.095955999568 1366.622452000156 1366.979640999809 1379.5001280000433 1384.6698920000345 1385.1504589999095 1385.9411629997194 1386.6490599997342 1387.7508659996092 1389.7966250004247 1390.9870530003682 1393.230237999931 1394.92120099999 1398.7184149995446 1408.3262529997155 1412.0590599998832 1413.393170000054 1414.768977000378 1418.4278769996017 1419.370351999998 1425.497510000132 1426.9949030000716 1432.822424000129 1436.7428430002183 1439.6289410004392 1442.9318059999496 1447.71991399955 1458.1184719996527 1462.6298489999026 1495.733946999535 1530.952948000282 1548.0125430002809 1560.3344599995762 1562.5053110001609 1575.7994799995795

Current
Mean: 1376.989 ms
Stdev: 94.426 ms (6.9%)
Runs: 1146.464494000189 1148.5651219999418 1196.0441760001704 1229.0289970003068 1238.9451339999214 1246.4567379998043 1248.838454999961 1251.0301950003105 1258.2141720000654 1268.5851609995589 1274.1833795000528 1281.342428999953 1305.2765309996903 1308.3264269996434 1323.5967070003971 1326.9828519998118 1328.7573650004342 1330.5558329997584 1338.7256199996918 1340.1559149995446 1352.4013569997624 1355.0840400001034 1357.5427529998124 1359.7389219999313 1360.7551119998097 1364.283836999908 1374.422977999784 1374.7599200000986 1381.9850120004267 1384.4078869996592 1387.733777999878 1396.9041595001434 1397.0560295003195 1397.919227000326 1399.9287860002369 1402.233277999796 1414.2080600000918 1419.5221480000764 1421.7627579998225 1422.273738999851 1428.0180860003456 1428.0742100002244 1434.5139189995825 1443.512256000191 1443.7626200001687 1453.1332289995626 1459.1087239999324 1460.0155619997531 1460.7702409997582 1469.6335695002888 1471.5486199995503 1474.3298559999093 1483.0146679999307 1483.502918000333 1485.5298330001533 1486.4045169996098 1502.3889499995857 1506.2060909997672 1511.3602329995483 1619.5374499997124
App start time regularAppStart Baseline
Mean: 0.023 ms
Stdev: 0.002 ms (7.7%)
Runs: 0.01928700041025877 0.019491000100970268 0.019896999932825565 0.020181999541819096 0.020507999695837498 0.020589999854564667 0.020834000781178474 0.0210359999909997 0.02128100022673607 0.021443000063300133 0.021564999595284462 0.0215659998357296 0.0215659998357296 0.021566000767052174 0.021606999449431896 0.021647999994456768 0.021687999367713928 0.021972999908030033 0.022134999744863097 0.022216999903321266 0.022216999903321266 0.0224609998986125 0.022622999735176563 0.022622999735176563 0.022704999893903732 0.022745000198483467 0.02274599950760603 0.02274599950760603 0.022746000438928604 0.022746000438928604 0.022995000434219837 0.02307100035250187 0.023111999966204166 0.02355899941176176 0.023599999956786633 0.023600000888109207 0.023641000501811504 0.023722000420093536 0.023884999565780163 0.02396600041538477 0.024006999097764492 0.024007000029087067 0.024007000029087067 0.024047999642789364 0.0240879999473691 0.02433300018310547 0.024455000646412373 0.024699500641703606 0.024780000559985638 0.024821000173687935 0.024902000091969967 0.025187000632286072 0.025350000709295273 0.025797000154852867 0.02697799913585186 0.0281980000436306

Current
Mean: 0.023 ms
Stdev: 0.002 ms (8.3%)
Runs: 0.018636000342667103 0.019206000491976738 0.019245999865233898 0.019491000100970268 0.020142000168561935 0.02038499992340803 0.020385999232530863 0.020589500545442104 0.0206300001591444 0.020711999386548996 0.02071200031787157 0.02095599938184023 0.0210359999909997 0.021077999845147133 0.021200000308454037 0.021280999295413494 0.021321999840438366 0.021321999840438366 0.0213620001450181 0.021443999372422695 0.02144400030374527 0.021524999290704727 0.02176899928599596 0.021851000376045704 0.021932000294327736 0.022095000371336937 0.022216999903321266 0.022257999517023563 0.0224609998986125 0.022461000829935074 0.02254199981689453 0.022623000666499138 0.022704999893903732 0.022786999121308327 0.02282699942588806 0.02307100035250187 0.023111999966204166 0.023111999966204166 0.023111999966204166 0.023396999575197697 0.02343699987977743 0.02380399964749813 0.023843999952077866 0.024089500187814236 0.024128999561071396 0.02416899986565113 0.02421100065112114 0.0242510000243783 0.0244140001013875 0.024616999551653862 0.024821000173687935 0.024861999787390232 0.02494300063699484 0.02502400055527687 0.0253095001642704 0.025472000241279602 0.0255129998549819 0.025756999850273132 0.026366999372839928 0.026570999994874
App start time (CPU) Baseline
Mean: 125.781 %
Stdev: 10.861 % (8.6%)
Runs: 108 108.75822368421052 111.27933977657838 111.54065079214502 111.85791065231855 112.13779420470728 113.04645218580872 113.75519904931672 113.91922783845571 114.9120290686556 115.71371769383697 116.04348312094791 116.75732417215383 117.26907630522089 117.91212468923315 118.67301254065572 118.79681274900395 118.87193870843078 119.71968190854872 119.80876494023903 119.86597449371907 120.02283487828056 120.78893361749148 120.97302174069253 121.51394422310756 121.713717693837 122.06084513776823 122.24782386072711 122.2679367175159 122.73203485880282 123.62218678008152 124.23038451882343 124.65277777777779 124.69582504970181 124.753475204377 124.81274900398405 125.44691928270696 126.07401718427494 128.4521706134162 128.85213767495227 130.30522088353413 130.78486055776895 131.3725490196078 134.29585798816572 134.8504572009144 134.9022991705172 135.64811133200797 135.73682017500346 136.9185409486623 137.10420841683367 137.42158540062735 137.62280337622803 139.75371377675987 140.40876547038718 142.56349206349205 142.88423153692622 143.81845201337072 145.8882235528943 150.04175614411835 155.99896603833614

Current
Mean: 125.739 %
Stdev: 10.911 % (8.7%)
Runs: 109.01690863714186 109.78043912175646 110.45454545454547 111.55445544554453 113.77245508982034 113.88582333653392 113.98689164691115 115.6809886203688 115.73161033797217 115.80079681274898 115.84999023892719 116.12392803422478 116.2231749518714 117.57111060064794 117.65051188128112 117.65512799102987 117.8207171314741 117.91217564870257 118.29025844930423 118.52808881232656 118.79681274900395 118.81673306772906 119.33727810650888 119.89605204555578 120.7375745526839 121.82071713147407 121.86842608529358 122.06572769953053 122.06911636045498 122.71968190854874 123.37938530852722 123.90219560878242 124.47524752475245 124.9001996007984 125.54612445089943 126.05191841392097 127.06235183682561 127.1199273167777 127.26175878765014 127.52312038381417 128.98810591118283 129.67793240556665 130.93318110324236 131 132.62518787126945 133.08837564420693 134.79282868525902 134.80079681274907 134.94119713530648 137.38373837383742 137.89682539682542 138.4011235602423 140.33734939759037 141.60523574365223 144.71057884231544 145.39137446490616 146.81649581469102 147.07005153655274 148.80360828682825 156.42754426082658
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 371.274 MB
Stdev: 6.838 MB (1.8%)
Runs: 358.1953125 361.078125 361.14453125 361.287109375 361.755859375 362.486328125 364.3828125 364.556640625 364.712890625 364.837890625 364.873046875 364.92578125 365.548828125 366.251953125 366.44921875 366.98828125 367.056640625 367.376953125 367.51171875 367.919921875 368.412109375 368.46875 369.052734375 369.212890625 369.775390625 369.810546875 369.921875 369.994140625 370.048828125 370.0546875 370.111328125 370.279296875 370.6953125 370.88671875 371.16015625 371.458984375 371.564453125 372.294921875 372.595703125 372.896484375 373.373046875 373.408203125 373.755859375 374.33984375 376.482421875 376.693359375 376.8671875 377.83984375 378.615234375 378.896484375 379.10546875 379.267578125 379.861328125 380.453125 380.603515625 381.673828125 387.083984375 389.029296875 389.75390625

Current
Mean: 370.691 MB
Stdev: 6.444 MB (1.7%)
Runs: 361.94921875 362.291015625 362.529296875 362.5703125 362.65234375 362.736328125 362.9140625 363.9296875 363.984375 364.9609375 365.248046875 365.427734375 365.66015625 366.14453125 366.509765625 366.537109375 366.75 367.091796875 367.400390625 367.587890625 367.728515625 367.81640625 368.158203125 368.28515625 368.70703125 368.8984375 369.08984375 369.287109375 369.634765625 369.927734375 370.212890625 370.267578125 370.37109375 370.603515625 370.822265625 370.931640625 370.98828125 371.015625 371.154296875 371.5859375 372.439453125 373.37109375 374.064453125 374.52734375 374.556640625 375.103515625 375.71875 376.072265625 376.244140625 377.759765625 380.767578125 381.068359375 381.640625 382.900390625 386.3671875 388.126953125 388.302734375
App start time (CPU/JS) Baseline
Mean: 75.738 %
Stdev: 2.943 % (3.9%)
Runs: 70.8 71.2 71.8 71.9 71.9 71.9 72 72 72.8 72.8 72.8 72.8 72.8 73.1 73.7 73.7 73.8 73.8 73.9 73.9 74 74 74.1 74.8 74.8 74.8 74.9 74.9 74.9 75.1 75.5 75.6 75.7 75.7 75.8 76 76.1 76.4 76.7 76.9 76.9 77.1 77.8 77.8 77.8 77.9 77.9 78.2 78.2 78.8 78.9 78.9 79.7 79.8 79.9 81 81.1 81.7 82 82.8

Current
Mean: 75.900 %
Stdev: 3.259 % (4.3%)
Runs: 67.9 70.9 70.9 70.9 71 71.6 71.7 71.9 72.5 72.7 72.7 72.9 72.9 73 73.1 73.7 73.9 74 74.7 74.8 74.8 74.8 74.8 74.9 74.9 74.9 74.9 75 75.5 75.5 75.7 75.8 75.8 75.9 75.9 76.4 76.8 76.9 76.9 77 77.8 77.9 77.9 77.9 78 78.1 78.8 78.8 78.9 79.6 79.9 80.2 80.2 80.2 80.4 81 81.4 81.5 81.8 82.9
App start time (CPU/UI) Baseline
Mean: 20.656 %
Stdev: 4.151 % (20.1%)
Runs: 11 12 13 13.9 14.9 15.9 16.8 16.9 16.9 16.9 17 17 17 17 17.8 18 18 18 18 18.9 18.9 18.9 19 19 19.8 19.9 19.9 19.9 19.9 20 20 20 21 21.9 22 22 22 22 22 22 22.9 23 23 23 23 23.9 23.9 24.8 25.1 26 26 26.1 27 27 27.1 27.1 27.9 28 28.9

Current
Mean: 20.490 %
Stdev: 4.917 % (24.0%)
Runs: 10 13 13 14 14.9 15 15 15 15.9 16 16 16.8 16.8 16.9 17 17 17 17 17 17 17.8 17.9 17.9 18 18 18.9 19 19 19.9 19.9 19.9 20 20 20 20.9 21 21 21.8 22 23 23 23.9 24 24.1 24.1 24.1 24.8 24.9 25 25 25 25 25.2 25.9 26.1 26.5 28 29.9 34.1 34.6
Open search router TTI Load Search Options Baseline
Mean: 95.016 ms
Stdev: 6.774 ms (7.1%)
Runs: 79.52710000053048 82.88427700102329 83.43599399924278 83.88517299853265 84.53357000090182 85.21903500147164 85.80546100065112 86.08675099909306 86.10953800007701 87.19409099966288 87.36263000033796 87.44352199882269 87.48722299933434 87.78458699956536 88.04951950057495 88.16044100001454 88.17842600122094 88.2167559992522 88.73384699970484 89.08398499898612 89.13688199967146 89.59118700027466 89.6485195000385 89.77486100047827 89.97623699903488 90.06132000128635 90.09944700077176 90.1191000007093 90.2567139994353 90.38639299944043 90.40002399869263 90.50223799981177 90.60644599981606 90.65812199935317 90.74178000167012 90.76253299973905 90.91609700024128 90.95300299860537 91.1657720003277 91.23681599833071 91.26013199985027 91.46337899938226 91.65547700040042 91.69970699958503 91.73193300142884 91.82539950019765 91.996377998963 92.07397500053048 92.69478400051863 92.81538899987936 92.90873299911618 93.0887460000813 93.11934399977326 93.13065600022674 93.30631499923766 93.54691500030458 93.60640499927104 93.81929500028491 93.9589430000633 94.18225100077689 94.22827100008726 94.35632300004363 94.42785600014031 94.60176599957049 94.65445899963379 94.68701200000942 94.80782099999487 95.13785899989307 95.24715200066566 95.34541800059378 95.77063000015914 95.89575199969113 96.18225100077689 96.18591300025582 96.29972399957478 96.33976300060749 96.52392500080168 96.61393300071359 96.70975699834526 96.71309399977326 96.94466199912131 97.5077309999615 98.11214199848473 98.47241199947894 98.53076200000942 98.64164200052619 99.08727999962866 99.1833910010755 99.80578599870205 100.08996600098908 100.11905950016427 100.15722599998116 100.17272950044918 100.18981950066137 100.34944699890912 100.8343099988997 101.13789950019765 101.30985499918461 101.48177099972963 101.84236600063741 102.15625 102.3163239993155 102.39990199916065 102.8597419988364 103.1262619998306 103.61507199890912 104.63952599838376 104.74861700087786 105.8863560008496 106.82910099998116 107.14860000088811 108.40344299934804 108.83125800080597 109.33215400017798 111.54134099930525 111.93290199898183 112.49650099873543 112.92757100053132

Current
Mean: 94.660 ms
Stdev: 6.144 ms (6.5%)
Runs: 82.01611400023103 83.34497100114822 83.3859870005399 83.62601800076663 83.93339099921286 84.00325500033796 84.68037899956107 86.18465100042522 86.34077899903059 86.42871099896729 86.4921059999615 86.5805670004338 87.21215800009668 87.30916399881244 87.63623099960387 88.56018099933863 88.71053100004792 88.7249349988997 89.02339700050652 89.11734999902546 89.11734999902546 89.27197300083935 89.3981529995799 89.8902589995414 89.902342999354 89.92508899979293 89.99776200018823 90.19665499962866 90.23421199992299 90.34163399972022 90.42456099949777 90.62076799944043 90.86417599953711 90.90104199945927 90.94291199930012 91.21293099969625 91.29146300069988 91.3631179984659 91.48523000068963 91.54972399957478 91.65120500139892 91.88688199967146 92.25252300128341 92.75866699963808 92.77714000083506 92.87150100059807 92.95629899948835 93.00667300075293 93.02380299940705 93.050497001037 93.06127950071442 93.06160500086844 93.11881499923766 93.16145950078118 93.40889499895275 93.61511300131679 93.63623099960387 93.76477099955082 93.84777799993753 93.85205100104213 93.89534500055015 93.90258800052106 93.9460450001061 94.16068500094116 94.16471400111914 94.25740600004792 94.27929699979722 94.43090800009668 94.55546000041068 94.90820300020278 94.96492499858141 95.10168500058353 95.40266899950802 95.68428499996662 95.93375699967146 95.95096899941564 96.0235195000385 96.24365299940109 96.47644099965692 96.59663899987936 97.33858199976385 97.49222800135612 97.57096300087869 97.79707799851894 97.90629100054502 98.37206999957561 98.85367799922824 98.96675600111485 99.19673700071871 99.22037700004876 99.25313300080597 99.32727099955082 99.67061400040984 99.70214799977839 99.9324960000813 100.09045400097966 100.09822499938309 100.25317399948835 100.3269449993968 100.41666699945927 100.44681800156832 100.89632199890912 101.0913899987936 101.66866100020707 102.13260950042951 102.40234399986345 102.47526099905372 102.91963700018823 103.8121339995414 104.3519289996475 104.53918400034308 104.9933679997921 105.3725579995662 105.95324699953198 106.98006200045347 107.9095060005784 108.55501299910247 109.95646199956536 112.4043370001018
Open search router TTI Open Search Router TTI Baseline
Mean: 760.801 ms
Stdev: 109.487 ms (14.4%)
Runs: 553.2199299987406 564.7762860003859 567.5293789990246 572.0135500002652 586.0895589999855 586.2678229995072 608.5758060012013 611.891805998981 629.8435059990734 633.2111410014331 654.2065440006554 655.4082440007478 670.766114000231 673.5821529999375 674.9388030003756 675.3926195007478 676.4278980009258 676.9640709999949 682.3935150001198 683.4451499991119 684.9311939999461 685.87845950096 690.3961180001497 696.2637130003422 698.2557379994541 699.5668949987739 703.8432620000094 704.8024909999222 708.4274095006948 710.3450119998306 710.4137779995799 710.5926920007914 710.6625980008394 711.9836840014905 712.1523850001395 713.0520830005407 713.3174649998546 715.935140999034 716.0658369995654 716.3129070010036 716.7314459998161 718.6456709988415 718.7043459992856 719.3495279997587 719.7478439994156 724.5213619992137 725.6151529997587 726.438395999372 730.9193930011243 736.4171550013125 737.762206999585 739.3185229990631 742.019654000178 745.176147999242 747.397624000907 749.9792480003089 762.1385099999607 763.797607999295 780.0652670003474 841.0322270002216 841.0322270002216 841.9116220008582 841.9116220008582 854.4630130007863 854.4630130007863 870.8928229995072 870.8928229995072 872.0426839999855 872.0426839999855 872.1234140004963 872.1234140004963 874.3476979993284 874.3476979993284 881.4542239997536 881.4542239997536 881.7512619998306 883.0718189999461 883.0718189999461 896.1831870004535 896.1831870004535 896.581095000729 896.581095000729 913.0411789994687 913.0411789994687 927.8917650002986 927.8917650002986 941.6455889996141 941.6455889996141 1051.0585539992899 1051.0585539992899

Current
Mean: 769.654 ms
Stdev: 98.994 ms (12.9%)
Runs: 558.0070800017565 577.3926195007478 585.7402750011533 587.793782999739 593.8077395007675 607.266601998359 618.6358240004629 621.3881430011243 621.612997001037 636.7379959989339 641.5036629997194 642.3333740010858 650.3869630005211 659.4217939991504 668.624673999846 670.9817299991846 686.4018559996039 686.5167650002986 688.1841230001301 694.0449630003422 696.9403479993343 698.8203530013561 699.3058679997921 699.5114339999855 703.0412610005587 703.050904000178 704.2050379998982 704.6808669995517 705.7248949985951 706.0569660011679 709.6767989993095 709.8186849988997 710.4259039983153 711.4936939999461 712.2171229999512 712.3380129989237 713.753866000101 714.5485430005938 714.8851730003953 717.3576669991016 724.9211429990828 725.3472499996424 725.8144940007478 726.2144370004535 728.109822999686 729.2131350003183 730.3942059986293 734.6790769994259 735.0636800006032 740.4275720007718 741.659546000883 742.7269290015101 743.6776940003037 748.6239430010319 749.0362550001591 751.7209069989622 756.8598629999906 757.3667409997433 762.6931970007718 774.812541000545 822.0309660006315 822.0309660006315 824.0148930009454 824.0148930009454 846.016846999526 846.016846999526 863.1674400009215 863.1674400009215 868.9073950002986 868.9073950002986 869.1272795003568 869.1272795003568 869.2329110000283 869.2329110000283 871.3134770002216 871.3134770002216 872.8200695001249 872.8200695001249 873.3103030007333 873.3103030007333 877.6787920016795 877.6787920016795 881.550862999633 881.550862999633 882.1518959999084 882.1518959999084 890.6442469991744 890.6442469991744 894.7049570009112 894.7049570009112 897.1122239995748 897.1122239995748 897.640788000077 897.640788000077 897.7504879999906 897.7504879999906 905.26631699875 905.26631699875 905.3701989986002 905.3701989986002 905.5267340000719 905.5267340000719
Open search router TTI (CPU) Baseline
Mean: 148.380 %
Stdev: 4.548 % (3.1%)
Runs: 139.26427709156613 140.0333141966108 140.81606273038642 141.1876625559752 141.40056783061166 141.816560126106 142.17631512512224 142.76392705691927 143.50662513865637 143.63474432352808 143.68748627537101 143.761784126048 143.88267532498116 144.1455643282435 144.27302959621733 144.82689459179593 144.89773590569084 145.21678157628978 145.60156884725376 145.6122177954846 145.80089483235662 145.86023001418184 146.04452094690745 146.43709175805728 146.72277449898314 147.54368145572516 148.268281777901 148.3513831538337 148.5592588226156 148.79179112788316 148.80861734644492 148.86485464966637 149.2138755741704 149.50687017741694 149.91485486096795 150.05040998772046 150.08293666889355 150.73692052350214 150.74198571148165 150.75769272156495 150.95377535583313 151.35287074251463 151.50478376216202 151.51308351748742 151.80763391224124 151.88822198853154 152.1569625914183 152.36387601002312 152.49666537769528 153.8867598253536 154.02882703777328 154.18525896414354 154.3132645731114 154.57479644332227 155.0742265267874 155.09781560511658 155.1534812077801 155.18367451363073 155.49028613345402 156.2009903897587

Current
Mean: 149.824 %
Stdev: 4.008 % (2.7%)
Runs: 141.22299544466568 142.49008267458274 144.21315817668835 144.307852131807 145.53216719467537 145.53583017876255 145.71162475658278 145.73869392688735 145.77854496312412 145.78903711173692 145.9030873164913 146.1137451519304 146.18811378094148 146.20312669719866 146.44781300479286 146.51032626011005 146.60880780891497 146.90098055267524 147.0601100718967 147.0738069245862 147.22675366398684 147.54039539967687 147.86307147389456 147.89403544729677 147.93275748681185 148.0351444316741 148.20420049981232 148.82324652161432 149.3042643502582 149.3696102904581 150.40979354979783 150.64703414780328 150.9349269588313 150.96067004308733 150.96367689587626 151.0882656118632 151.1998606739328 151.24699375325022 151.34391891352436 151.39567817076855 151.57254754494318 151.76631409020922 151.81161206997774 152.12697784079057 152.7729619740334 152.9408449700205 153.0899943664224 153.45141570481147 153.72602864279642 153.73784303902164 153.90932601996727 154.0709691727656 154.09365879015292 154.23993639123944 154.59768426353358 154.6340508806262 155.44788487967747 158.65491239742738 158.97095410969732 160.40172503867294
Open search router TTI (FPS) Baseline
Mean: 59.895 FPS
Stdev: 0.200 FPS (0.3%)
Runs: 59.20519356119716 59.424475850996515 59.431901596900424 59.44652495219949 59.45780870679923 59.62814183411807 59.636426269288656 59.64053892545216 59.71038815393254 59.753571924297084 59.8479323027648 59.86708923923347 59.876627502441245 59.92726304661516 59.99608944333786 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.858 FPS
Stdev: 0.294 FPS (0.5%)
Runs: 58.81919691521516 58.91510901261251 59.01965866253707 59.31557627201888 59.468453736061434 59.55783455861292 59.568196113967396 59.568479191392136 59.6072212134372 59.65210984149406 59.71056662761909 59.84327104886024 59.99614217610641 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 387.253 MB
Stdev: 5.489 MB (1.4%)
Runs: 376.859375 376.9322916666667 377.28515625 377.3958333333333 377.6783854166667 377.8177083333333 377.9544270833333 379.33203125 380.2825520833333 380.8919270833333 381.0520833333333 381.6328125 384.09375 384.13671875 384.1744791666667 384.2252604166667 384.35546875 385.0087890625 385.3020833333333 385.5107421875 385.5166015625 385.5625 385.6640625 385.7177734375 385.810546875 385.8854166666667 386.1669921875 386.203125 386.5455729166667 387.2802734375 387.4248046875 387.53515625 387.86328125 387.9443359375 387.9794921875 388.8984375 389.0029296875 389.189453125 389.474609375 390.443359375 390.4921875 390.775390625 391.044921875 391.5830078125 391.970703125 392.046875 392.2138671875 392.5087890625 392.6669921875 393.0830078125 393.6982421875 393.9091796875 394.212890625 394.439453125 394.548828125 394.5498046875 394.9931640625 395.9638671875 395.9697265625 396.4541015625

Current
Mean: 388.512 MB
Stdev: 4.648 MB (1.2%)
Runs: 377.7591145833333 378.0911458333333 379.28515625 380.828125 380.9856770833333 382.02734375 382.0533854166667 383.7122395833333 383.9453125 384.1822916666667 384.51171875 384.6536458333333 384.8056640625 385.0322265625 385.197265625 385.2278645833333 385.2607421875 385.6875 385.9765625 386.1484375 386.2864583333333 386.3212890625 386.6494140625 387.2626953125 387.720703125 388.109375 388.1630859375 388.2626953125 388.9501953125 388.9931640625 389.02734375 389.1279296875 389.1416015625 389.18359375 389.546875 389.6630859375 389.8544921875 390.6513671875 390.6728515625 390.794921875 390.8935546875 390.8958333333333 391.1809895833333 391.4775390625 392.6181640625 392.6865234375 392.9345703125 392.9365234375 393.0400390625 393.044921875 393.2447916666667 393.4306640625 393.8505859375 394.2255859375 394.2607421875 394.8671875 395.275390625 395.296875 395.63671875 399.1979166666667
Open search router TTI (CPU/JS) Baseline
Mean: 77.819 %
Stdev: 2.564 % (3.3%)
Runs: 72 73.4 73.8 73.9 74 74 74.2 74.3 74.7 75.2 75.5 75.6 75.9 75.9 76 76.1 76.2 76.3 76.4 76.4 76.5 76.7 76.8 76.8 77.4 77.4 77.5 77.5 77.5 77.5 78 78.2 78.4 78.5 78.7 78.9 78.9 78.9 79.2 79.4 79.5 79.6 79.8 79.8 79.9 79.9 80 80 80 80.3 80.3 80.3 80.4 80.8 81 81.5 82.8 82.9 84

Current
Mean: 78.273 %
Stdev: 2.275 % (2.9%)
Runs: 74.1 74.4 74.7 74.9 75 75.1 75.3 75.4 75.8 75.8 75.9 75.9 75.9 76 76 76.2 76.4 76.5 76.6 76.9 77.1 77.4 77.5 77.8 77.9 78 78.1 78.3 78.4 78.4 78.4 78.5 78.9 78.9 79 79 79 79.1 79.1 79.1 79.3 79.3 79.4 79.4 79.8 79.9 80.1 80.7 80.7 80.7 80.7 81 81.2 81.3 81.4 81.5 81.5 81.7 81.7 84.4
Open search router TTI (CPU/UI) Baseline
Mean: 29.032 %
Stdev: 2.178 % (7.5%)
Runs: 23.6 25 25.5 25.9 26.3 26.5 26.5 26.7 26.7 26.9 27.2 27.3 27.4 27.4 27.7 27.8 27.8 27.9 27.9 27.9 27.9 28.3 28.3 28.3 28.4 28.4 28.4 28.5 28.6 28.6 28.6 28.9 28.9 28.9 28.9 29.1 29.4 29.5 29.8 29.8 29.8 30.3 30.3 30.4 30.5 30.6 30.7 30.9 30.9 31.2 31.4 31.4 31.9 31.9 32.2 32.4 32.8 32.9 33.1 34.9

Current
Mean: 28.937 %
Stdev: 1.763 % (6.1%)
Runs: 25 25.4 25.8 25.9 26 26.9 26.9 26.9 27 27.1 27.2 27.4 27.7 27.7 27.8 27.9 27.9 27.9 28 28 28.2 28.2 28.2 28.2 28.4 28.4 28.4 28.4 28.5 28.8 28.9 29.3 29.3 29.3 29.4 29.4 29.4 29.5 29.8 29.8 29.9 29.9 29.9 29.9 30.2 30.3 30.4 30.6 30.8 30.9 30.9 30.9 30.9 31.2 31.2 31.4 31.7 31.7 32.5 32.8
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 427.400 ms
Stdev: 30.486 ms (7.1%)
Runs: 368.0063070002943 370.2104899995029 373.27652999944985 375.8094069994986 378.7473549991846 379.0135089997202 379.80424000136554 381.5750740002841 385.1755379997194 389.4796959999949 393.91084800101817 396.40905799902976 402.0297039989382 403.15462299995124 403.55432200059295 410.72916699945927 411.36783900111914 411.69925899989903 412.1888020001352 417.51469500056386 419.03389499895275 419.43424499966204 419.496255999431 419.9788010008633 420.16878200136125 420.3509929999709 422.07210299931467 422.8894859999418 425.1286209989339 425.3972169999033 429.5317379999906 430.9225670006126 431.1091719996184 431.672892998904 439.42574100010097 442.58593699894845 442.6156000010669 444.50528999976814 448.3137210011482 450.79317199997604 451.7171219997108 451.76704899966717 451.8374029994011 453.2874759994447 453.93994199857116 454.37902799993753 455.44230199977756 455.6954340003431 456.3641360010952 456.46846499852836 456.6198330000043 456.88252800144255 457.2844650000334 459.172159999609 459.6223150007427 460.1964520011097 461.7897549998015 462.1243079993874 473.0495610013604 507.25809699855745

Current
Mean: 434.616 ms
Stdev: 31.240 ms (7.2%)
Runs: 371.1031499989331 375.6628820002079 378.80989599972963 381.7853189986199 382.22111100144684 385.9226895001446 387.84851099923253 389.10876500047743 391.8186440002173 394.5241290014237 404.72432499937713 406.9121499992907 413.59867399930954 414.02164700068533 415.15295499935746 415.6184080000967 416.8507899995893 417.5712890010327 421.1241859998554 423.3169760014862 423.91625999845564 426.07393399998546 426.8047280013561 427.3261719997972 428.60839950001884 429.1537280008197 429.50427299924195 430.9785980004817 435.0736095000719 435.69336000084877 436.09411700069904 436.9192299991846 440.9755450002849 443.8987629991025 448.5181480012834 449.60140000097454 451.3431809991598 451.74397900141776 453.7992759998888 454.0425630006939 454.07364950037646 455.03466800041497 455.70784500055015 456.13671899986345 456.15564000047743 459.6270759999752 459.62797000072896 459.6702069994062 460.4012040011585 461.0340990014374 462.1590989995748 470.2860509995371 473.08239799924195 476.4767250008881 476.64156199991703 478.61987399868667 483.50968400016427 493.4787600003183 502.8786620013416
Report typing (CPU) Baseline
Mean: 101.843 %
Stdev: 3.029 % (3.0%)
Runs: 95.18845816013149 96.00010602241503 96.32213535491066 98.34484444600761 98.42667620432742 98.48029008201026 98.64092004534389 98.80139033393036 98.91616981290264 99.14702847602132 99.41634652883496 99.5534263979821 99.91848345582837 99.98896051867034 99.99754178903441 100.02725549990869 100.09889031380541 100.17533160482226 100.1920312572339 100.28124370160488 100.29148438125313 100.41573747679185 100.47988342208518 100.53475227995791 100.58853614064748 100.65572994969773 100.90908809020391 101.35222845905133 101.63473324234887 101.687143988972 101.71310959829239 101.72276378322998 102.0956134293859 102.15385145619248 102.41234609433971 102.69766851103553 102.70204183492257 102.74896933577398 102.89018711404515 103.05218307456039 103.22953875556414 103.30756512763092 103.49849310111252 103.51014731108428 103.66131389054019 103.77068839548947 104.51425413566643 105.46052060439906 105.47913034334859 106.06061039166283 106.22366617307388 106.74156471847431 106.91080831513328 107.17784864115201 107.76469307945159 108.29590192304782 108.78441470857712

Current
Mean: 103.145 %
Stdev: 3.218 % (3.1%)
Runs: 97.05456038741012 98.34546556376385 98.7487004459545 98.9812494799662 99.03588589054739 99.13382896274257 99.9790337926538 100.02385026862619 100.17777660699983 100.21002203674362 100.34509931510286 100.36374052557234 100.37923876804378 100.48521298560121 100.55996071380198 100.60078700457984 100.96593265854742 101.06985541624155 101.09775536075381 101.4450291337246 101.48703860246906 101.56428576880305 101.72863329998397 101.79652955310264 101.9072605855172 101.97443356699608 102.02717990864934 102.13628370711382 102.1944910437396 102.38047743151931 102.3976937140945 102.73152402290094 102.93019849282031 103.25978113088314 103.29241163080492 103.33223089691742 103.91224893085973 104.76825634997489 105.04814502450874 105.48219455357605 105.56539553885379 105.60097144944419 105.66656550337932 105.8710896677635 105.93195489566878 106.4064335971927 106.89848239201163 106.89984355752541 106.94691669375794 106.9522359284435 107.13434863733602 107.37810281969948 107.41504967793027 108.44932841001014 109.3724619479009 110.57969225413635 110.84132549296748
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 472.440 MB
Stdev: 5.187 MB (1.1%)
Runs: 463.8515625 464.9420572916667 465.2135416666667 465.71375868055554 465.7298177083333 465.7732204861111 466.0256076388889 466.0349392361111 466.34483506944446 466.6818576388889 466.9197048611111 466.95616319444446 466.9802517361111 467.12847222222223 467.2302517361111 467.2561677631579 467.8990885416667 468.4236111111111 468.4946546052632 468.9845920138889 469.0837673611111 469.57378472222223 470.0138888888889 470.80512152777777 470.82660590277777 471.205078125 472.51996527777777 472.64344618055554 472.8142361111111 473.29578993055554 473.35047743055554 473.4342447916667 474.1985677083333 474.3888888888889 474.42078993055554 474.6091579861111 474.7421875 474.8268229166667 475.07335069444446 475.2109375 475.6204769736842 475.74717881944446 476.01953125 476.23676215277777 476.3346354166667 476.3638980263158 476.72113715277777 476.7892795138889 476.9921875 477.16529605263156 477.1901041666667 477.3190104166667 477.42621527777777 478.0490451388889 478.13389756944446 479.1579861111111 480.99262152777777 482.69835069444446 489.39085477941177

Current
Mean: 472.658 MB
Stdev: 5.737 MB (1.2%)
Runs: 460.958984375 463.9778645833333 464.15386284722223 465.31098090277777 465.74565972222223 466.48631840277777 466.56792534722223 466.7486979166667 466.9353298611111 467.03145559210526 467.1462673611111 467.82899305555554 468.19683159722223 468.48719618055554 468.4919704861111 468.5724826388889 469.00043402777777 469.18446180555554 469.9626736111111 470.3081825657895 470.3125 470.60047743055554 470.75694444444446 470.8318142361111 471.02176339285717 471.1193576388889 471.650390625 472.1627604166667 472.376953125 472.38199013157896 472.93988715277777 472.96723090277777 472.98198784722223 473.1579861111111 473.22960069444446 473.2592516447368 473.37586805555554 473.4513888888889 473.951171875 475.0296052631579 475.2189670138889 475.4934895833333 476.11451480263156 476.240234375 476.9769736842105 477.01583059210526 477.4965049342105 477.5983072916667 478.33289930555554 478.82899305555554 478.8552517361111 480.5095486111111 481.3203125 481.451171875 481.8415798611111 489.74425551470586 489.8431919642857
Report typing (CPU/JS) Baseline
Mean: 46.903 %
Stdev: 3.088 % (6.6%)
Runs: 41 41.4 41.5 41.7 41.9 42 42.3 42.9 43 43.5 43.6 43.8 44.1 44.4 44.5 44.7 45.1 45.4 45.6 45.6 45.6 45.8 45.8 45.9 46.2 46.2 46.3 46.4 46.4 46.6 46.9 47.2 47.4 47.6 47.7 48 48.1 48.2 48.3 48.5 48.8 48.8 48.9 49 49.2 49.2 49.3 49.7 50.2 50.3 50.3 50.6 50.7 51.3 51.3 51.4 51.5 52 52.1 52.5

Current
Mean: 47.619 %
Stdev: 2.878 % (6.0%)
Runs: 42.2 42.7 43.2 43.3 43.5 43.5 43.7 44.1 44.4 44.5 44.5 44.7 44.8 44.9 44.9 45.2 45.5 45.7 45.8 46.5 46.5 46.7 46.7 46.9 46.9 47.2 47.3 47.3 47.3 47.4 47.4 47.5 48 48.4 48.4 48.5 48.8 49.1 49.2 49.2 49.4 49.5 50 50.2 50.6 50.6 50.7 50.8 51.2 51.4 51.4 51.5 51.7 51.7 51.7 52 52.1 53.1
Report typing (CPU/UI) Baseline
Mean: 26.234 %
Stdev: 0.840 % (3.2%)
Runs: 24.6 24.6 24.9 24.9 25 25 25 25.1 25.2 25.3 25.4 25.5 25.6 25.6 25.7 25.8 25.8 25.8 25.8 25.9 25.9 25.9 26 26 26 26 26 26 26.2 26.3 26.3 26.3 26.3 26.4 26.4 26.5 26.5 26.6 26.6 26.7 26.8 26.8 26.8 26.8 26.9 26.9 26.9 26.9 26.9 27 27.1 27.1 27.2 27.3 27.4 27.4 28 28.1 28.1

Current
Mean: 26.191 %
Stdev: 0.729 % (2.8%)
Runs: 24.3 25.1 25.1 25.1 25.2 25.2 25.2 25.3 25.3 25.4 25.5 25.6 25.6 25.6 25.7 25.7 25.8 25.8 25.8 25.8 25.9 26 26 26 26.1 26.1 26.1 26.1 26.1 26.2 26.2 26.3 26.3 26.3 26.3 26.3 26.3 26.4 26.5 26.6 26.6 26.7 26.7 26.7 26.8 26.8 26.8 26.9 26.9 27 27 27.1 27.4 27.4 27.4 27.5 27.5 27.7
Chat opening Chat TTI Baseline
Mean: 561.622 ms
Stdev: 53.364 ms (9.5%)
Runs: 374.38724800013006 381.6739100012928 486.35652700066566 491.5072830002755 494.5188639988663 507.5361729990691 514.527710000053 517.3575439993292 525.3293459992856 533.0418299995363 542.3806560002267 545.9700930006802 552.1396079994738 552.6682540010661 554.2936200015247 555.469197999686 555.481282999739 556.0950119998306 558.0684820003808 559.4455980006605 560.742148000747 560.8640960007906 561.5410970002413 561.840779999271 563.6400970015675 565.1226399987936 566.3400880005211 571.8712569996715 573.8579509984702 573.8867189998634 575.2621670011431 577.0764569994062 582.2152509987354 582.7119960002601 584.6902669984847 591.5302740000188 591.7789709996432 593.6984459999949 863.9330240003765 595.9165449999273 596.6269540004432 598.0307219997048 623.3234860002995 627.8704430013895 629.9125580005348 634.7737220004201 635.035116000101 640.9058030005544 645.2293699998409

Current
Mean: 580.117 ms
Stdev: 39.202 ms (6.8%)
Runs: 492.86120700091124 515.9577230010182 522.4754229988903 528.2123620007187 528.5236409995705 533.3247480001301 535.6427820008248 537.468465000391 541.4060880001634 541.419230999425 545.2300209999084 547.62508200109 553.7889500009745 556.5193680003285 556.847574999556 557.6300050001591 564.1668300013989 569.5430510006845 570.7009280007333 571.4968680012971 572.4390869997442 572.6516110002995 573.2722169999033 574.6399739999324 575.3710939998634 576.8634420006126 584.5311295007085 589.2089440003037 590.7543950006366 863.0047200005502 598.1835529990494 598.8814289998263 603.7169599998742 604.6176360007375 607.8172610010952 613.5884199999273 614.5606699995697 615.0187590010464 618.2633469998837 620.856567999348 623.6219480000436 632.6236570011824 635.1420950002122 647.2863409994781 649.5767010003328 651.296509001404 656.1664630006999
Chat opening (CPU) Baseline
Mean: 156.688 %
Stdev: 5.731 % (3.7%)
Runs: 143.49851587346458 144.7859585280923 145.26651511911268 146.9322709163346 148.1514151373745 148.18734110496493 148.73902053514212 149.1127015557199 149.16567324372062 149.27037981996656 149.50830450449064 149.73676021131703 150.83325412666733 151.67344138714793 151.7417117955325 152.20387429826636 152.4185496157662 154.24701195219112 154.2602921646745 154.81483421493664 155.15724621447586 155.19572409809945 156.10739267737995 156.121979332499 156.17940090510015 156.79064993621495 156.8510395061203 157.11510312707918 157.13437590838636 157.70523160520523 158.30131503261734 158.40948663601236 158.6600207331631 158.6826347305391 158.81921450548626 159.3093279201444 159.4367064852568 159.6336227137051 160.03417436656315 160.22162662569636 160.69322709163347 160.74613992690556 160.96873900107016 161.23894839802475 161.40568454270968 161.43810560894713 161.58823071882554 161.94662851522074 162.12438241327237 162.19322709163356 162.37332600726782 162.45128222469168 162.46409471947484 162.50056116263477 162.69716371112008 162.72510313951716 163.68340608359188 163.8156992169806 166.23133006670253 167.58410737734215

Current
Mean: 158.335 %
Stdev: 5.856 % (3.7%)
Runs: 145.33744969057148 146.16775403030496 146.83047936334614 148.76911716482206 149.43376350406916 149.44659601632964 149.55384751639687 150.12850186555366 150.26029216467455 151.2129699025679 151.72880268679103 151.86873076118985 152.24169986719775 153.63251732473339 153.83993294052073 155.54054028885696 155.5830926945755 156.27853543706482 156.53428914183644 156.57364661805457 156.5923494736815 157.21424301569232 157.22653137854417 157.96169798491138 157.98192159926927 158.0330865982321 158.17760106030494 158.43492604973417 158.67454137327587 158.76780230575733 158.77629951141995 159.14409565548013 159.18241055762743 159.40324627084948 159.50255386591084 159.88867854285655 160.23572377158047 160.55722556223574 160.80185904549543 161.36670281031016 161.59670737875746 161.7922507546605 161.9641552807713 162.68378570609798 162.73553582113254 162.9035073700496 163.201300028166 163.5166255056088 163.6889928542661 164.07722403797993 164.33492513933433 164.48536316570662 164.66808724377765 165.21860722077275 165.69508731935036 166.27741065014717 166.78248522136735 167.43830648562033 169.04100408405696 169.11606054869864
Chat opening (FPS) Baseline
Mean: 59.729 FPS
Stdev: 0.436 FPS (0.7%)
Runs: 58.35431375020039 58.60376868560437 58.708443811239874 58.814246199054864 58.821619535441926 59.05830308011624 59.110760737796205 59.2668968828322 59.26959626258429 59.30523127491555 59.320994051017124 59.36818938511597 59.42284141517056 59.55234392824649 59.558692030150596 59.60684343528019 59.7176786118935 59.838715091018074 59.86557102246959 59.9064248785731 59.941991256021 59.94998958446391 59.99155547037876 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.139 FPS
Stdev: 1.048 FPS (1.8%)
Runs: 55.64005410825207 57.23633719872345 57.25394239077273 57.507726469985386 57.58006486446961 57.61883061926382 57.642859249724495 57.65217109219496 57.71079148087917 57.832768173637795 57.90361433956331 57.96343866313607 57.976452186438685 57.98039516956582 58.145792168636546 58.19347606543606 58.21982150678141 58.56719993124339 58.79393466855885 58.82193820571009 58.84047700463018 58.88664273730862 59.07797247788322 59.15813213344262 59.21483644556821 59.368444698718825 59.55930148197109 59.59018593777046 59.61566533934166 59.751337879376074 59.76283795013161 59.767897642278356 59.79113248929631 59.88322991539251 59.95087407477217 59.95128179384297 59.95604918938457 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 376.502 MB
Stdev: 7.984 MB (2.1%)
Runs: 362.07421875 364.0950520833333 364.5791015625 364.6041666666667 364.8606770833333 365.48828125 365.7161458333333 366.5143229166667 366.7109375 367.26171875 367.8828125 367.8854166666667 368.0403645833333 368.1223958333333 369.0442708333333 369.390625 369.8346354166667 369.8958333333333 370.2552083333333 371.3736979166667 372.0390625 372.0455729166667 372.1080729166667 373.0989583333333 373.796875 374.2890625 374.3151041666667 375.11328125 376.634765625 378.09375 379.107421875 379.2880859375 379.2900390625 379.5400390625 379.740234375 379.91796875 380.2001953125 380.8637265625 381.0556640625 382.01953125 382.2490234375 382.5693359375 382.783203125 383.068359375 383.3701171875 383.765625 384.1552734375 384.189453125 384.1943359375 384.3779296875 384.8388671875 384.90625 384.9609375 385.0673828125 385.0693359375 385.2001953125 385.875 386.3232421875 388.5458984375 398.705078125

Current
Mean: 379.472 MB
Stdev: 7.398 MB (1.9%)
Runs: 366.23828125 368.59375 369.08984375 369.2994791666667 369.44921875 369.8854166666667 369.9309895833333 370.2005208333333 370.5299479166667 370.53125 370.7265625 370.8385416666667 371.1901041666667 372.43359375 372.8528645833333 373.8033854166667 374.1471354166667 374.2838541666667 374.7786458333333 375.08984375 375.93359375 376.0872395833333 377.0546875 377.1640625 377.5338541666667 378.1067708333333 378.5869140625 379.818359375 380.1005859375 380.263671875 380.7939453125 381.4306640625 381.63671875 381.8798828125 382.2373046875 382.712890625 382.830078125 383.103515625 383.115234375 383.3046875 383.3857421875 383.54296875 383.8935546875 384.638671875 384.7216796875 384.9091796875 385.17578125 385.177734375 385.30078125 385.677734375 386.134765625 386.564453125 386.5654296875 387.62109375 387.8916015625 389.845703125 390.2216796875 398.7958984375 401.208984375
Chat opening (CPU/JS) Baseline
Mean: 77.878 %
Stdev: 2.411 % (3.1%)
Runs: 72.6 72.9 74 74.2 74.2 74.3 74.5 74.9 75.3 75.5 75.6 75.8 75.9 75.9 75.9 76.1 76.1 76.3 76.6 76.8 77.2 77.2 77.3 77.3 77.5 77.5 77.6 77.7 77.8 77.8 77.9 78 78 78.1 78.1 78.5 78.5 78.8 78.9 78.9 79.1 79.2 79.3 79.3 79.4 79.6 79.8 79.8 80 80.3 80.4 80.7 80.9 80.9 80.9 81 81.8 81.9 83 83.4

Current
Mean: 77.555 %
Stdev: 2.082 % (2.7%)
Runs: 72.8 73.2 73.7 73.8 74.2 74.3 74.5 74.9 75.1 75.2 75.4 75.4 75.7 75.8 75.9 76.3 76.4 76.5 76.6 76.9 76.9 76.9 77.2 77.3 77.3 77.4 77.4 77.4 77.5 77.9 78 78 78.1 78.1 78.3 78.4 78.4 78.5 78.5 78.5 78.5 78.8 78.8 78.9 78.9 79 79.2 79.2 79.4 79.4 79.7 80.1 80.2 80.2 80.3 80.4 80.5 80.7 80.8 81.7
Chat opening (CPU/UI) Baseline
Mean: 34.725 %
Stdev: 2.900 % (8.4%)
Runs: 26.6 28.6 28.9 29.2 30.9 30.9 31.3 31.8 31.9 31.9 31.9 32.1 32.4 32.5 32.5 32.6 32.9 33 33 33.3 33.6 33.8 33.9 34 34.2 34.6 34.6 34.7 35.1 35.2 35.4 35.4 35.7 35.7 35.7 35.8 35.9 35.9 35.9 35.9 35.9 36.3 36.3 36.4 36.8 36.9 37.2 37.3 37.4 37.4 37.5 37.7 37.9 37.9 38.2 38.2 39.1 39.1 39.4 41.4

Current
Mean: 34.070 %
Stdev: 2.618 % (7.7%)
Runs: 28.6 29.3 29.6 29.7 30.6 30.6 30.8 30.9 31 31.2 31.3 31.3 31.4 31.5 31.5 31.8 31.9 32 32.1 32.3 32.4 32.5 33 33.8 33.8 33.9 34.1 34.4 34.5 34.5 34.6 34.6 34.6 34.8 34.8 34.9 34.9 35 35.4 35.4 35.6 35.8 35.8 35.9 35.9 35.9 36.2 36.3 36.6 36.9 37 37.3 37.4 37.4 37.5 37.5 37.9 38.2 38.9 38.9
Linking (CPU) Baseline
Mean: 161.521 %
Stdev: 2.904 % (1.8%)
Runs: 154.7747713697744 155.5103608441975 155.72131017792643 156.21586507481203 157.7100332711171 157.73356534115337 157.7609266554416 158.01582970348807 158.56524362381515 158.80203242748183 158.89759317899507 159.48522431111155 159.51165822353775 159.51756355266073 159.8281830545736 159.87336604305847 159.9699865328942 159.99280589921486 160.27986790951846 160.32354282235673 160.3728533235887 160.38678129932345 160.4206323297709 160.71332302983072 160.73137568150412 160.8329757515577 161.11480331527972 161.13659137398872 161.4287497180726 161.4805770047219 161.6866680553463 161.7389287930964 161.8335973607272 161.93764162948108 161.98044665502934 162.1304265343443 162.336468860958 162.4635433581325 162.97117318632021 162.97496100331662 163.01503064371636 163.01958570379213 163.28402644302668 163.3354573557843 163.4243026545111 163.6465188699442 163.8224571298158 164.21260357179216 164.22698536322636 164.74243047147593 165.01815556521728 165.05590864656105 165.24968577256647 165.33129426948219 165.47465736944457 165.90374003770822 166.6796603444463 166.89175628956096 168.22261398445076

Current
Mean: 161.751 %
Stdev: 3.013 % (1.9%)
Runs: 154.2116681388049 154.78048473368932 155.070321299658 156.40825885631546 157.1509308197604 158.1028903095069 158.11840666425985 158.40475373056861 158.53178532023523 159.16032750606712 159.22300428023664 159.5327701603348 159.5620460124109 159.79400150102762 159.82331009236358 159.9361864760819 160.03672916761573 160.13944223107572 160.24341017956766 160.37435920530896 160.55584119829317 161.08091386947217 161.32267488304325 161.35241412429303 161.4142575469172 161.63967335681164 161.8621254148184 162.04285452998394 162.12296840117804 162.1758955038633 162.25802527096866 162.41329205423065 162.45455683836886 162.634329374905 162.68276778696892 162.68731317784295 162.83689216953246 162.84774036709123 163.05271413597197 163.0879743758682 163.09351224466474 163.12432617732134 163.6498356660429 163.71020340520786 163.80197322823105 163.82527280085438 164.322457288348 164.9247790326808 165.10959191157218 165.1853017451409 165.2935970481661 165.4335471984832 165.57833381802138 166.23763707462146 166.3836345790172 166.4407908413301 166.5990161811071 167.72091051891377
Linking (FPS) Baseline
Mean: 59.950 FPS
Stdev: 0.099 FPS (0.2%)
Runs: 59.639198076294825 59.64416948689705 59.69582645960984 59.73789456168341 59.78138339727576 59.7920148999709 59.806481498138005 59.85552602439862 59.87292493224027 59.88179884403406 59.88302663725062 59.89506542931468 59.97954179678362 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.875 FPS
Stdev: 0.204 FPS (0.3%)
Runs: 59.2651476785138 59.35118818907737 59.3526159757644 59.42720198256818 59.43986758146881 59.52299438399677 59.62486606067021 59.668447910613494 59.683945967498005 59.68864560221823 59.701038875500444 59.72395314383454 59.73411533017087 59.762664663157246 59.77301196795832 59.858529958893605 59.893835118190964 59.90924709101888 59.91984033009117 59.97250237509201 59.98060557286333 59.981893492767774 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 413.747 MB
Stdev: 2.398 MB (0.6%)
Runs: 408.3567708333333 408.404296875 408.4889322916667 408.6236979166667 408.9720982142857 410.1946614583333 411.3294270833333 411.3372395833333 411.5963541666667 411.6595052083333 411.8131510416667 411.908203125 412.443359375 412.498046875 412.5963541666667 412.681640625 412.841796875 412.9791666666667 413.2141927083333 413.32421875 413.4166666666667 413.423828125 413.578125 413.6516927083333 413.6985677083333 413.7122395833333 413.7578125 413.935546875 413.951171875 413.9609375 414.0364583333333 414.12109375 414.18973214285717 414.419921875 414.4563802083333 414.5286458333333 414.7239583333333 414.7428385416667 414.7526041666667 414.8704427083333 414.9212239583333 415.0416666666667 415.28515625 415.673828125 415.7565104166667 415.841796875 415.9251302083333 416.2747395833333 416.283203125 416.5533854166667 416.6048177083333 416.625 416.6283482142857 418.142578125 418.3502604166667 418.7447916666667

Current
Mean: 422.117 MB
Stdev: 5.641 MB (1.3%)
Runs: 413.1178385416667 413.37890625 414.1875 414.1966145833333 414.3697916666667 414.5201822916667 414.544921875 414.865234375 415.1197916666667 415.44921875 416.2962239583333 416.9928385416667 417.015625 417.25 417.7591145833333 417.7727864583333 417.8899739583333 418.6875 418.8177083333333 419.3307291666667 419.3854166666667 419.8111979166667 420.1022135416667 420.2493489583333 420.2552083333333 420.3483072916667 420.3782552083333 421.0149739583333 421.720703125 423.3776041666667 423.388671875 423.5963541666667 423.7337239583333 424.00892857142856 424.9017857142857 425.08482142857144 425.2578125 425.29966517857144 425.53348214285717 425.81026785714283 426.095703125 426.21707589285717 426.66964285714283 426.95200892857144 427.0546875 427.28515625 427.51060267857144 428.17801339285717 429.29185267857144 429.5078125 429.59542410714283 429.6713169642857 429.8861607142857 430.74386160714283 431.3443080357143 437.7447916666667
Linking (CPU/JS) Baseline
Mean: 83.726 %
Stdev: 1.377 % (1.6%)
Runs: 80.6 80.6 81 81.1 81.3 81.3 81.3 82 82.4 82.5 82.8 82.9 82.9 82.9 82.9 83 83.2 83.2 83.3 83.3 83.3 83.4 83.4 83.6 83.6 83.7 83.7 83.8 83.8 83.9 83.9 84 84.2 84.3 84.4 84.4 84.5 84.5 84.6 84.6 84.6 84.6 84.7 84.7 84.7 84.7 84.9 85 85.2 85.4 85.5 85.5 85.5 85.6 85.7 85.9 86.1

Current
Mean: 84.763 %
Stdev: 1.648 % (1.9%)
Runs: 80.8 80.9 81.1 81.8 82.4 82.4 82.6 82.7 82.9 83.4 83.5 83.6 83.6 83.9 84 84 84 84 84.2 84.3 84.3 84.3 84.3 84.6 84.6 84.6 84.7 84.8 84.9 84.9 84.9 85.1 85.2 85.3 85.3 85.5 85.5 85.6 85.7 85.7 85.9 85.9 85.9 85.9 86 86 86.2 86.3 86.5 86.5 86.6 86.6 86.6 87.1 87.4 88 88.2
Linking (CPU/UI) Baseline
Mean: 35.200 %
Stdev: 1.605 % (4.6%)
Runs: 32.2 32.5 32.6 32.6 33.1 33.2 33.3 33.4 33.5 33.6 33.7 33.8 33.9 33.9 33.9 34.1 34.1 34.2 34.2 34.2 34.2 34.3 34.4 34.5 34.5 34.7 34.7 34.8 34.8 35.1 35.1 35.2 35.3 35.4 35.5 35.5 35.6 35.6 35.7 35.9 36.1 36.1 36.1 36.2 36.3 36.4 36.5 36.6 36.6 36.8 36.8 37.2 37.2 37.2 37.4 37.8 37.9 38.4 38.8 38.8

Current
Mean: 34.678 %
Stdev: 1.892 % (5.5%)
Runs: 30.8 31.2 31.5 31.6 32.1 32.3 32.3 32.5 32.5 33 33.1 33.2 33.3 33.3 33.4 33.4 33.5 33.5 33.7 33.8 33.8 33.8 33.8 33.9 34 34.1 34.3 34.3 34.4 34.4 34.5 34.7 34.9 34.9 34.9 35 35 35.1 35.1 35.3 35.3 35.4 35.4 35.5 35.9 36.1 36.1 36.2 36.5 36.9 36.9 37 37.2 37.2 37.3 37.5 37.8 38.4 38.7 39.2

Copy link
Contributor

github-actions bot commented Dec 2, 2024

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@hannojg
Copy link
Contributor

hannojg commented Dec 2, 2024

Performance regression is a false positive and can be ignored as of:

@MonilBhavsar MonilBhavsar removed the DeployBlockerCash This issue or pull request should block deployment label Dec 2, 2024
Copy link
Contributor

github-actions bot commented Dec 2, 2024

🚀 Deployed to staging by https://github.com/MonilBhavsar in version: 9.0.70-0 🚀

platform result
🤖 android 🤖 false ❌
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

@izarutskaya
Copy link

@nkdengineer QA team encountered with this issue #53284 when checking the PR
#53284

Copy link
Contributor

github-actions bot commented Dec 4, 2024

🚀 Deployed to production by https://github.com/AndrewGable in version: 9.0.70-9 🚀

platform result
🤖 android 🤖 skipped 🚫
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants