Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[No QA] Fullstory small changes #55487

Merged
merged 19 commits into from
Jan 24, 2025
Merged

[No QA] Fullstory small changes #55487

merged 19 commits into from
Jan 24, 2025

Conversation

danieldoglas
Copy link
Contributor

@danieldoglas danieldoglas commented Jan 20, 2025

Explanation of Change

This PR will:

  • Fully stop loading fullstory if we don't want it to be executed (before, we would just return, but FS keeps the configs from the last execution, so we would still run it)
  • Fix the logic to not load fullstory for expensify employees only, we were also including guides.
  • Stop loading FS if this is a supportal session
  • Trigger parseFSAttributes after all components are ready

Fixed Issues

$ https://github.com/Expensify/Expensify/issues/458292
PROPOSAL:

Tests

  • Verify that no errors appear in the JS console

Offline tests

QA Steps

// TODO: These must be filled out, or the issue title must include "[No QA]."

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@danieldoglas danieldoglas self-assigned this Jan 20, 2025
@danieldoglas danieldoglas requested a review from a team as a code owner January 20, 2025 18:35
@melvin-bot melvin-bot bot requested review from sobitneupane and removed request for a team January 20, 2025 18:35
Copy link

melvin-bot bot commented Jan 20, 2025

@sobitneupane Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@danieldoglas danieldoglas changed the title Fullstory small changes [No QA] Fullstory small changes Jan 20, 2025
@danieldoglas danieldoglas requested review from rushatgabhane and removed request for sobitneupane January 23, 2025 15:00
Session.isSupportAuthToken()
) {
// On web, if we started FS at some point in a browser, it will run forever. So let's shut it down if we don't want it to run.
FullStory('shutdown');
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NAB: the command names should probably go in CONST

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@rushatgabhane
Copy link
Member

rushatgabhane commented Jan 23, 2025

Bug: FS error

steps: login to any account on web in an incognito window

I think doing a restart when init hasn't run is causing the problem?

FullStory('restart');
FS.onReady().then(() => {
image

@rushatgabhane
Copy link
Member

rushatgabhane commented Jan 23, 2025

@danieldoglas hmmm same issue on login. i tested the latest code.

this time the issue is shutdown is running even tho init has not.

if ((CONST.ENVIRONMENT.PRODUCTION !== envName && !isTestEmail) ||
                    Str.extractEmailDomain(value.email ?? '') === CONST.EXPENSIFY_PARTNER_NAME ||
                    Session.isSupportAuthToken()
) {
                    FullStory(CONST.FULL_STORY.SHUTDOWN);
                    return;
}
image

@rushatgabhane
Copy link
Member

rushatgabhane commented Jan 24, 2025

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native

WhatsApp Image 2025-01-24 at 17 03 05

Android: mWeb Chrome
iOS: Native image
iOS: mWeb Safari image
MacOS: Chrome / Safari image
MacOS: Desktop

Copy link
Member

@rushatgabhane rushatgabhane left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@melvin-bot melvin-bot bot requested a review from MonilBhavsar January 24, 2025 14:04
Copy link

melvin-bot bot commented Jan 24, 2025

@MonilBhavsar Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

Copy link

melvin-bot bot commented Jan 24, 2025

🎯 @rushatgabhane, thanks for reviewing and testing this PR! 🎉

An E/App issue has been created to issue payment here: #55722.

Copy link
Contributor

@NikkiWines NikkiWines left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@NikkiWines
Copy link
Contributor

NikkiWines commented Jan 24, 2025

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@NikkiWines NikkiWines merged commit 264728f into main Jan 24, 2025
16 checks passed
@NikkiWines NikkiWines deleted the dsilva_fullstory_fixes branch January 24, 2025 16:11
@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

Session.isSupportAuthToken()
) {
// On web, if we started FS at some point in a browser, it will run forever. So let's shut it down if we don't want it to run.
FullStory(CONST.FULL_STORY.SHUTDOWN);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

-FullStory(CONST.FULL_STORY.SHUTDOWN);
+ if (isInitialized()) {
+         FullStory(CONST.FULL_STORY.SHUTDOWN);
+  }

@danieldoglas

I got this error @rushatgabhane reported on latest main.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you need to update your .env file

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

USE_THIRD_PARTY_SCRIPTS=true

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm good suggestion. Let me put up a PR

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Checking if it is initialized is a good way to prevent this from happening on dev.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Jan 24, 2025
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
App start time contentAppeared_To_screenTTI 776.326 ms → 547.602 ms (-228.724 ms, -29.5%) 🟢
App start time appCreationEnd_To_contentAppeared 623.830 ms → 825.850 ms (+202.020 ms, +32.4%) 🔴
Show details
Name Duration
App start time contentAppeared_To_screenTTI Baseline
Mean: 776.326 ms
Stdev: 49.094 ms (6.3%)
Runs: 634.9663929999806 639.6046620002016 650.4912970000878 714.5830219998024 717.8564209998585 722.7660110001452 726.8113150000572 735.757677000016 738.963667999953 747.2379789999686 747.9749090000987 752.4371770001017 754.2857169997878 755.0818059998564 755.3425560002215 756.2665610001422 758.5814220001921 761.0456409999169 762.0143109997734 762.887316999957 762.9076419998892 769.6214220002294 771.0103659997694 771.5034960000776 772.957762000151 775.5853030001745 777.6832650001161 780.9951479998417 783.8635590001941 784.432976000011 787.4956510001794 791.9616419998929 792.6946820002049 799.0770660000853 801.9232100001536 804.2261500000022 805.838310000021 806.5323330000974 808.3749660002068 812.0312669998966 815.2509880000725 819.0649379999377 821.1930929999799 821.9133120002225 826.0495270001702 829.2920960001647 835.1969490000047 836.3278239998035 842.3930409997702 843.4419300002046 860.281473999843 862.8846539999358

Current
Mean: 547.602 ms
Stdev: 122.645 ms (22.4%)
Runs: 399.4616390001029 406.97579400008544 415.22409600019455 415.73284200020134 439.41188899986446 442.999778999947 447.4621199998073 450.19358900003135 451.75807600002736 453.92674299981445 456.6588659998961 456.8076229998842 458.3860579999164 466.0777580002323 472.29626200022176 474.3206489998847 476.2849809997715 476.6856849999167 478.20495899999514 479.4322759998031 485.77467900002375 487.13239900022745 487.42485299985856 488.1986549999565 489.19119200017303 491.8608110002242 493.5099070002325 493.5611379998736 495.8396069998853 496.1942070000805 497.32365899998695 500.2703390000388 500.97423900011927 502.7939769998193 503.4642739999108 513.4762920001522 514.1053709997796 514.9748100000434 516.4848910002038 517.2653210000135 519.5132789998315 524.0685910000466 526.226011000108 531.7113740001805 543.5797910001129 563.3906100001186 661.3826170000248 715.8071050001308 719.3431310001761 747.7380829998292 751.2757080001757 754.4775000000373 762.865009999834 766.0223019998521 773.2060560001992 776.9704539999366 784.0581820001826 805.1537779998034 806.2530700000934 814.9504959997721
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 623.830 ms
Stdev: 39.061 ms (6.3%)
Runs: 530 532 551 566 571 572 574 586 587 590 596 597 599 601 603 604 604 606 609 613 615 616 617 623 625 627 629 629 629 632 635 635 637 638 640 643 643 643 644 645 647 648 649 656 657 659 661 674 679 687 695 696 719

Current
Mean: 825.850 ms
Stdev: 119.372 ms (14.5%)
Runs: 546 579 593 600 622 630 638 639 644 647 652 653 687 701 705 758 764 784 814 833 844 844 847 847 851 857 860 861 871 876 884 885 885 887 887 887 894 901 901 903 903 904 911 911 911 911 913 919 923 926 927 934 942 943 944 944 946 955 960 963

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 25.768 ms → 25.625 ms (-0.143 ms, -0.6%)
App start time nativeLaunchEnd_To_appCreationStart 84.533 ms → 87.424 ms (+2.890 ms, +3.4%)
App start time appCreation 79.567 ms → 77.000 ms (-2.567 ms, -3.2%)
App start time runJsBundle 357.517 ms → 368.018 ms (+10.501 ms, +2.9%)
App start time TTI 1585.236 ms → 1569.799 ms (-15.437 ms, -1.0%)
App start time regularAppStart 0.024 ms → 0.024 ms (-0.000 ms, -1.4%)
App start time (CPU) 142.148 % → 142.412 % (+0.264 %, ±0.0%)
App start time (FPS) 59.217 FPS → 58.154 FPS (-1.063 FPS, +1.8%)
App start time (RAM) 349.025 MB → 350.301 MB (+1.276 MB, ±0.0%)
App start time (CPU/JS) 0.000 % → 0.000 %
App start time (CPU/UI) 23.830 % → 23.115 % (-0.715 %, -3.0%)
Open search router TTI Load Search Options 198.855 ms → 197.445 ms (-1.409 ms, -0.7%)
Open search router TTI Open Search Router TTI 1348.853 ms → 1349.151 ms (+0.298 ms, ±0.0%)
Open search router TTI (CPU) 148.222 % → 147.244 % (-0.978 %, -0.7%)
Open search router TTI (FPS) 57.064 FPS → 59.282 FPS (+2.219 FPS, -3.9%)
Open search router TTI (RAM) 382.448 MB → 381.278 MB (-1.169 MB, ±0.0%)
Open search router TTI (CPU/JS) 0.000 % → 0.000 %
Open search router TTI (CPU/UI) 23.487 % → 24.460 % (+0.973 %, +4.1%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 463.732 ms → 467.982 ms (+4.250 ms, +0.9%)
Report typing (CPU) 105.789 % → 105.636 % (-0.153 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 454.496 MB → 455.255 MB (+0.759 MB, ±0.0%)
Report typing (CPU/JS) 0.000 % → 0.000 %
Report typing (CPU/UI) 25.884 % → 25.660 % (-0.224 %, -0.9%)
Chat opening Chat TTI 371.980 ms → 368.299 ms (-3.681 ms, -1.0%)
Chat opening (CPU) 167.979 % → 166.068 % (-1.911 %, -1.1%)
Chat opening (FPS) 56.016 FPS → 59.835 FPS (+3.820 FPS, -6.8%)
Chat opening (RAM) 373.649 MB → 370.419 MB (-3.230 MB, -0.9%)
Chat opening (CPU/JS) 0.000 % → 0.000 %
Chat opening (CPU/UI) 34.469 % → 36.475 % (+2.006 %, +5.8%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 25.768 ms
Stdev: 3.746 ms (14.5%)
Runs: 21 21 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 24 25 25 25 25 26 26 26 26 26 27 27 27 27 27 27 27 27 28 29 29 31 31 32 34 34 35 35 36

Current
Mean: 25.625 ms
Stdev: 3.553 ms (13.9%)
Runs: 21 21 21 21 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 25 25 25 25 26 26 26 26 26 26 26 27 27 27 27 28 28 28 28 28 29 30 31 32 32 33 34 34 35
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 84.533 ms
Stdev: 10.996 ms (13.0%)
Runs: 61 67 69 70 71 71 71 71 72 73 74 74 75 75 76 76 76 77 78 78 80 81 82 82 82 82 82 82 82 83 84 84 85 85 85 86 86 88 88 89 89 90 90 90 90 90 93 93 94 96 97 97 97 98 101 102 104 104 112 112

Current
Mean: 87.424 ms
Stdev: 11.359 ms (13.0%)
Runs: 67 69 70 73 73 74 74 75 75 75 75 76 76 77 78 79 81 81 81 82 82 83 83 83 83 83 84 84 84 84 86 88 88 90 90 90 91 91 92 93 93 93 94 95 95 95 96 96 98 99 102 102 104 104 105 109 109 111 115
App start time appCreation Baseline
Mean: 79.567 ms
Stdev: 10.322 ms (13.0%)
Runs: 58 60 63 66 66 67 68 68 69 69 69 71 71 72 72 72 72 73 73 73 74 74 75 76 76 76 77 77 78 78 79 79 80 81 81 81 82 82 83 84 84 85 85 85 86 87 88 90 90 90 91 92 93 93 95 96 96 97 100 106

Current
Mean: 77.000 ms
Stdev: 11.456 ms (14.9%)
Runs: 58 59 59 61 62 63 63 63 64 64 65 65 66 66 67 67 68 68 70 70 71 71 71 73 73 73 75 75 76 76 78 78 79 79 80 80 80 81 81 82 83 83 83 84 84 85 86 87 87 89 90 90 90 91 92 93 97 99 99 108
App start time runJsBundle Baseline
Mean: 357.517 ms
Stdev: 28.306 ms (7.9%)
Runs: 275 275 296 296 308 308 315 315 320 320 322 322 322 322 325 325 328 328 329 329 331 331 332 332 332 332 333 333 334 334 338 338 342 342 343 343 344 344 345 345 345 345 350 350 351 351 351 351 353 353 353 353 354 354 354 354 355 355 355 355 357 357 357 357 358 358 358 358 365 365 366 366 366 366 370 370 370 370 374 374 375 375 378 378 379 379 379 379 382 382 382 382 383 383 383 383 384 384 389 389 389 389 392 392 394 394 394 394 394 394 394 394 395 395 397 397 401 401 411 411

Current
Mean: 368.018 ms
Stdev: 19.219 ms (5.2%)
Runs: 319 319 324 324 330 330 332 332 340 340 341 341 345 345 345 345 349 349 351 351 354 354 355 355 355 355 356 356 356 356 357 357 357 357 360 360 361 361 362 362 363 363 364 364 364 364 365 365 366 366 366 366 367 367 369 369 370 370 370 370 370 370 371 371 371 371 371 371 373 373 375 375 376 376 376 376 378 378 379 379 380 380 381 381 381 381 382 382 382 382 384 384 385 385 387 387 387 387 390 390 392 392 394 394 396 396 398 398 398 398 400 400 407 407
App start time TTI Baseline
Mean: 1585.236 ms
Stdev: 78.574 ms (5.0%)
Runs: 1382.9663929999806 1412.9255900001153 1421.6509710000828 1428.9562349999323 1449.7660110001452 1484.6393849998713 1484.8113150000572 1488.3600559998304 1492.5830219998024 1507.8564209998585 1508.045640999917 1530.2857169997878 1536.581422000192 1537.757677000016 1538.2379789999686 1546.963667999953 1554.863559000194 1560.2665610001422 1562.5853030001745 1567.5034960000776 1574.4371770001017 1578.887316999957 1581.6214220002294 1583.9749090000987 1586.957762000151 1588.0143109997734 1589.0103659997694 1589.9076419998892 1593.3425560002215 1604.683265000116 1605.9133120002225 1606.8410490001552 1610.9951479998417 1617.5323330000974 1619.961641999893 1621.694682000205 1628.4956510001794 1629.9232100001536 1631.432976000011 1634.1930929999799 1635.3278239998035 1638.2509880000725 1639.0770660000853 1642.3749660002068 1648.838310000021 1651.2920960001647 1652.1969490000047 1655.0649379999377 1655.2261500000022 1661.0818059998564 1675.0495270001702 1680.3930409997702 1692.0312669998966 1699.281473999843 1718.8846539999358 1753.4419300002046

Current
Mean: 1569.799 ms
Stdev: 76.924 ms (4.9%)
Runs: 1393.4616390001029 1396.8076229998842 1406.3826170000248 1433.3206489998847 1435.8071050001308 1440.4621199998073 1468.7328420002013 1475.999778999947 1488.2240960001945 1493.7746790000238 1503.6856849999167 1512.2703390000388 1514.658865999896 1516.432275999803 1517.3860579999164 1517.7580760000274 1529.0777580002323 1530.1935890000314 1538.4775000000373 1558.2049589999951 1561.2653210000135 1562.0685910000466 1566.5099070002325 1568.9267429998145 1570.1986549999565 1570.2757080001757 1573.343131000176 1574.5611379998736 1575.2060560001992 1579.9742390001193 1584.7939769998193 1586.1323990002275 1589.4118889998645 1592.323658999987 1592.4248529998586 1593.2962620002218 1597.4762920001522 1599.1053709997796 1599.7380829998292 1599.865009999834 1600.2530700000934 1606.2849809997715 1612.022301999852 1622.4642739999108 1623.5132789998315 1623.8396069998853 1628.0581820001826 1628.226011000108 1628.7113740001805 1633.191192000173 1638.9704539999366 1647.579791000113 1650.4848910002038 1655.9748100000434 1658.8608110002242 1677.1942070000805 1695.950495999772 1703.3906100001186 1775.1537779998034
App start time regularAppStart Baseline
Mean: 0.024 ms
Stdev: 0.003 ms (11.5%)
Runs: 0.01733400020748377 0.01920600002631545 0.019532000180333853 0.020060000009834766 0.02038600016385317 0.020507999695837498 0.02066999999806285 0.02083300007507205 0.020834000315517187 0.021158999763429165 0.02148399967700243 0.02164700021967292 0.022297999821603298 0.0224609998986125 0.0224609998986125 0.0224609998986125 0.0226239999756217 0.0226239999756217 0.022663999814540148 0.022704999893903732 0.02270600013434887 0.02307200012728572 0.02307200012728572 0.023111999966204166 0.023316000122576952 0.0235190000385046 0.02363999979570508 0.023723000194877386 0.023845000192523003 0.024007000029087067 0.024007000029087067 0.024088000413030386 0.024170000106096268 0.024170000106096268 0.02425199979916215 0.02433300018310547 0.0244140001013875 0.024658000096678734 0.02478000009432435 0.02494300017133355 0.025145999621599913 0.02514699986204505 0.02514699986204505 0.025186999700963497 0.025716000236570835 0.02632599975913763 0.026448000222444534 0.02677399991080165 0.0273029999807477 0.0273029999807477 0.028238999657332897 0.028239000122994184 0.02848299965262413 0.028726999647915363 0.029581000097095966 0.029703999869525433 0.030192000325769186

Current
Mean: 0.024 ms
Stdev: 0.002 ms (10.5%)
Runs: 0.01798499980941415 0.0194089999422431 0.019570999778807163 0.019694000016897917 0.02030499977990985 0.020466999616473913 0.020507999695837498 0.02075199969112873 0.020874000154435635 0.02099600015208125 0.02099600015208125 0.021157999988645315 0.021158999763429165 0.02128099976107478 0.021606000140309334 0.022134999744594097 0.022379000205546618 0.022379000205546618 0.02307100035250187 0.023111999966204166 0.023151999805122614 0.02315300004556775 0.023316000122576952 0.0233559999614954 0.0235190000385046 0.023845000192523003 0.02388500003144145 0.02388500003144145 0.02388500003144145 0.02408899972215295 0.024129000026732683 0.024209999945014715 0.02433199994266033 0.0244140001013875 0.024536999873816967 0.024658000096678734 0.02469899971038103 0.02469899971038103 0.025024000089615583 0.025065000168979168 0.025065000168979168 0.025105999782681465 0.025106000248342752 0.02522799978032708 0.025349999777972698 0.025431000161916018 0.025553999934345484 0.026082000229507685 0.026448999997228384 0.026732999831438065 0.027222000062465668 0.027588000055402517 0.02766899997368455 0.028767999727278948 0.030110999941825867
App start time (CPU) Baseline
Mean: 142.148 %
Stdev: 10.836 % (7.6%)
Runs: 122.1182364729459 124.85953842164407 125.92695388392208 126.1635079062465 126.85628742514969 127.08174970630917 128.26148610323315 128.80650238062032 129.06700633737478 129.7690763052209 129.81320923116155 131.01638504864314 131.73985547526402 131.75224279442642 132.53174603174602 132.62425447316105 132.79414422555578 133.89909771126761 133.90259627934773 134.7605748275876 135.0527785666951 135.12072724940683 135.34602953292352 135.57188568560406 136.27710843373495 137.33641232017243 138.01655206620828 139.64436810128194 140.73306772908373 142.92929292929298 144.32189303577206 146.26268125315408 146.46420884096236 147.15002085057256 147.51568766689385 148.9411615016978 149.41966246314072 149.94792440605042 150.11455890667466 150.3426530762516 150.38706186570778 150.56638435861566 150.78969453831613 150.86312932162022 151.37739639731655 151.8871075484302 152.19228210246175 152.36625818747632 152.40486888109564 152.43447809404077 152.72769953051642 152.95403437593373 154.80056920644174 154.86954360671 155.48875949838052 155.5139750417427 156.25395806512174 156.47702380371052 156.53666548438 167.7431687391847

Current
Mean: 142.412 %
Stdev: 11.665 % (8.2%)
Runs: 121.67787956866113 122.64202440831286 123.38231854681528 124.24849699398796 124.26219935610126 124.87924055281877 126.9048797931452 127.75298804780874 127.76248321693089 128.40071494100152 128.44983285540013 128.8682634730539 128.93654406772893 129.7319613821138 130.4766213100638 130.74501992031875 130.83451202263086 131.67680865449626 132.07368545619505 132.32287939212122 132.64214711729625 132.8124388353467 133.8702221938857 139.06490015360984 139.40129254492922 144.5946268371827 145.78176533139853 145.87823439878238 147.63882876496373 148.34563462662237 148.4245638096072 149.35505958375853 149.48118633360133 149.57867595300013 149.63839072024945 149.72111553784862 150.7266984271102 150.98178460838423 151.22676745436624 151.36890908564956 151.56941897915632 151.704914208767 151.899724578962 152.08216619981337 152.12193835161509 152.20700152207 152.26456827894913 152.4811498491586 152.85023152745808 153.30518993994895 153.51657061001 153.7714261571287 154.0508605725997 154.43242666377435 154.52626648221263 156.23107569721108 156.28229181907122 156.76466095152438 157.84350098807928 158.26381765022407
App start time (FPS) Baseline
Mean: 59.217 FPS
Stdev: 0.999 FPS (1.7%)
Runs: 56.948087289435165 56.991312691009284 57.326840955251896 57.469025506115315 57.54801592696274 57.615297763160676 57.67355953543578 57.730716831468975 57.81840432671928 57.843292279181696 57.93970976226672 58.158012913145264 58.20200031951769 58.394425551620515 58.46368100504451 58.51443240242418 58.53302600693627 58.65341241819586 58.76705734008956 58.808357823144654 58.828474936619976 59.166744541126064 59.19543786316626 59.31213218153693 59.63041088424439 59.856584978641 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 58.154 FPS
Stdev: 1.977 FPS (3.4%)
Runs: 52.236997178605016 54.261377527236085 54.826134993759354 55.36523231165515 55.449919990401234 55.664439613910595 55.806416295575644 55.84104523361484 55.90452681414893 55.944652588958014 55.95811251762424 56.05511960667886 56.11573880503693 56.2179973335551 56.38365708530711 56.477067031675894 56.503037028186206 56.52178415968071 56.825608437024044 56.87294085001107 56.876334783698944 57.06863726447427 57.3809591558717 57.59728362004946 57.9469066715016 58.11634194679931 58.177650863838466 58.29563033347068 58.490217929737746 58.49606638114511 59.02413078686166 59.204460011310545 59.28933351643809 59.91683214367184 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 349.025 MB
Stdev: 8.814 MB (2.5%)
Runs: 331.955078125 336.92578125 337.033203125 337.05078125 337.169921875 337.30078125 337.435546875 337.517578125 337.935546875 337.994140625 338.333984375 338.67578125 338.798828125 339.08984375 339.11328125 339.3359375 339.37890625 339.431640625 340.4453125 341.189453125 342.091796875 343.388671875 343.63671875 344.078125 351.466796875 351.50390625 351.62109375 351.6223958333333 352.5247395833333 353.12890625 353.1302083333333 353.5065104166667 353.7005208333333 353.712890625 353.73828125 353.8125 353.890625 355.2473958333333 355.45703125 355.4921875 355.6263020833333 355.87109375 355.91015625 356.03515625 356.0807291666667 356.12890625 356.5013020833333 356.5442708333333 357.2330729166667 357.3294270833333 357.40234375 357.53515625 358.0013020833333 359.4934895833333 360.0364583333333 360.0520833333333 360.4205729166667 363.560546875 363.85546875

Current
Mean: 350.301 MB
Stdev: 8.923 MB (2.5%)
Runs: 335.193359375 335.84765625 337.279296875 337.30078125 337.595703125 337.68359375 337.99609375 338.15234375 338.16015625 338.26171875 339.095703125 339.115234375 339.677734375 339.861328125 340.634765625 340.904296875 341.41796875 341.716796875 341.748046875 342.248046875 342.392578125 345.25390625 345.9609375 347.12109375 350.0677083333333 351.1080729166667 352.4778645833333 352.7057291666667 353.2838541666667 354.1158854166667 354.8359375 355.0638020833333 355.3776041666667 355.6067708333333 355.8645833333333 356.43359375 356.7994791666667 356.9453125 357.0846354166667 357.1223958333333 357.2565104166667 357.30859375 357.4375 357.640625 357.83203125 358.0143229166667 358.2734375 358.3072916666667 358.36328125 358.3828125 358.6432291666667 358.65234375 358.83984375 359.1822916666667 359.2083333333333 359.25390625 359.4153645833333 360.38671875 364.392578125 365.732421875
App start time (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
App start time (CPU/UI) Baseline
Mean: 23.830 %
Stdev: 8.154 % (34.2%)
Runs: 9.9 12 13.1 13.1 14 14 14.9 14.9 15 15 15 15 15 15.3 15.9 15.9 16 16 16 16.9 17 17 17 18 18 18 20 21.7 22.1 24 26 29 29.6 29.8 29.9 29.9 30 30 30.1 30.3 30.5 30.6 30.6 30.7 30.7 30.9 31.1 31.2 31.3 31.3 31.9 31.9 31.9 32 32.8 33.2 33.2 34.5 35.9 43.3

Current
Mean: 23.115 %
Stdev: 7.715 % (33.4%)
Runs: 10 11.9 12 12 12.8 12.9 12.9 13 13 13 13 13 14 14 14 15 15 15 16 16.1 17 18 18 18.1 19 23.1 25 26 26.3 27.9 27.9 28.3 28.4 28.6 28.6 28.6 28.6 28.7 29.2 29.3 29.3 29.3 29.4 29.4 29.8 29.9 29.9 29.9 30.1 30.6 30.6 30.7 30.7 31.3 31.3 31.7 31.8 32.4 32.4 33.2
Open search router TTI Load Search Options Baseline
Mean: 198.855 ms
Stdev: 17.113 ms (8.6%)
Runs: 173.4537760000676 176.0062250001356 176.28894100012258 179.76123100006953 180.84171599987894 181.31490099988878 181.43819200014696 181.74125200044364 181.924885999877 182.49812899995595 184.13582399999723 184.51078299991786 184.93074500001967 186.66792799998075 187.03885899996385 187.42386900028214 188.00541199976578 188.36185700027272 189.28633700031787 189.72534200036898 190.20752000017092 190.7384440000169 190.82393399998546 190.8285320000723 191.36649500019848 191.51997900009155 191.67915900005028 192.05578599963337 192.3310960000381 193.67793800029904 194.14929200010374 194.7536210003309 194.83304800000042 195.06734199961647 195.47029699990526 195.98608399927616 196.42846699990332 196.7596839996986 197.79955999925733 200.02697699982673 200.846760999877 201.15250599989668 201.78999900026247 205.16239400021732 207.54427099972963 207.71964600030333 211.61612999998033 211.89790799980983 212.31925399973989 223.50032599968836 223.86800199979916 224.93570900009945 225.32446299958974 226.55049600079656 229.65987099986523 229.828125 235.6138510000892 236.4330239999108 236.6028650002554 237.04614199977368

Current
Mean: 197.445 ms
Stdev: 14.018 ms (7.1%)
Runs: 175.83756500016898 177.3454990000464 178.82340500038117 180.7403569999151 182.64668799983338 183.20113100018352 183.30704700015485 183.40360599989071 183.86031099967659 184.25484200008214 184.4201259999536 184.56669100001454 184.5832919999957 184.89758299989626 185.47501699998975 185.5091960001737 186.3805749998428 187.60225500026718 187.63085900014266 188.19856799999252 188.5937909996137 188.66215000022203 188.80822800006717 190.09012900013477 190.947714000009 191.07588700018823 191.26041699992493 191.29386399965733 191.4899899996817 192.23791499994695 192.43770299991593 192.6027020001784 192.85648600012064 193.16202799975872 193.6903070001863 195.02530900016427 196.59419800015166 197.77754699997604 203.18989999964833 204.38578299991786 206.18510000035167 206.63659700006247 207.8736170004122 208.05074100010097 209.68180399993435 211.4606119999662 211.94722600001842 214.06860399991274 214.67875199997798 215.6157639999874 216.23457900015637 216.58024100027978 217.63997400039807 219.0091559998691 219.54012000001967 220.4304609997198 222.35620100004598 222.73905400000513 223.2435710001737 223.88069699984044
Open search router TTI Open Search Router TTI Baseline
Mean: 1348.853 ms
Stdev: 142.029 ms (10.5%)
Runs: 1144.0081390002742 1145.7631029998884 1147.5786129999906 1148.385050999932 1158.5055749998428 1159.5799160003662 1163.8942060000263 1164.023194000125 1168.5814210004173 1171.8734140000306 1173.278442999348 1175.034668999724 1175.0681560002267 1175.7169199995697 1180.0560300000943 1182.8879399998114 1184.4226480000652 1186.7166349999607 1190.5364999999292 1195.3164880000986 1195.645183000248 1197.1484380001202 1199.8647469999269 1201.4535730006173 1202.019654000178 1202.131184999831 1205.6410730001517 1206.2732750000432 1207.900839000009 1208.9294849997386 1212.208333000075 1218.613199999556 1220.77502500033 1222.3777270000428 1231.1272390000522 1232.2375500001945 1239.6927899997681 1245.7032070001587 1251.9180919998325 1255.3041590000503 1257.9792889999226 1259.8758140001446 1263.0201829997823 1264.1901859999634 1271.0536710000597 1274.4993500001729 1277.5379239995964 1291.7253829999827 1293.482869999949 1293.8990489998832 1295.1098639992997 1296.4485270003788 1298.3660079999827 1308.4001879999414 1310.0120040001348 1311.4627689998597 1314.0263669998385 1324.9493410000578 1327.6855069999583 1334.3430590000935 1394.4995120000094 1407.4805099992082 1410.2592779998668 1413.2324629998766 1414.4985360000283 1414.6063649998978 1418.316529000178 1418.6018890002742 1418.6194660002366 1418.9486499996856 1420.1516929999925 1425.1012369999662 1428.6655280003324 1430.477458999958 1433.4349779998884 1434.7754319999367 1436.1515709999949 1445.096884000115 1458.9501550002024 1460.7462570001371 1462.2065030001104 1462.466512999963 1463.4761970001273 1464.1546640000306 1468.5227059996687 1469.9061289997771 1473.6924650003202 1475.5122889997438 1478.1771249999292 1485.4399020001292 1497.2720550000668 1503.9313559997827 1504.708822000306 1509.65364699997 1510.641317000147 1511.474731999915 1514.342855999712 1521.1055920002982 1521.8389489999972 1521.9798990003765 1533.145346000325 1549.787434999831 1558.644938999787 1560.558147000149 1561.0406499998644 1566.794840999879 1570.9403900001198 1576.890706999693 1587.400512999855 1591.5566000002436 1596.0965179996565 1607.3306889999658 1620.8087570001371

Current
Mean: 1349.151 ms
Stdev: 140.479 ms (10.4%)
Runs: 1150.508992999792 1151.4580089999363 1154.4592289999127 1160.2852789997123 1160.447387999855 1163.8557950002141 1165.276897000149 1169.0143229998648 1169.6913259997964 1171.7151690004393 1171.8828940000385 1175.208822000306 1177.5831710002385 1181.456788000185 1182.0489509999752 1183.619955000002 1184.0277920002118 1184.925456999801 1185.1440440001898 1188.2388510000892 1188.4369309996255 1197.0478929998353 1197.380005999934 1198.9788420000114 1201.5807299995795 1202.3824880002066 1205.4480389999226 1207.9040129994974 1212.3426109999418 1212.5476079997607 1214.241944000125 1215.9370940001681 1216.0978610003367 1219.2647299999371 1220.569663000293 1223.0865079998039 1229.1149089997634 1237.4050300000235 1240.296061000321 1244.8854580000043 1257.8550209999084 1259.7291259998456 1266.5240079998039 1267.245647000149 1270.2560229999945 1277.2358400002122 1284.616617999971 1286.1127940001898 1287.9277349999174 1296.007040000055 1298.872355000116 1301.397135999985 1307.164795000106 1311.8725189999677 1313.1319990004413 1313.9440520000644 1320.2943940004334 1321.031168999616 1328.4333510003053 1341.3566090003587 1381.9744480000809 1382.1365570002235 1390.6434740000404 1396.4814049997367 1399.2308360002935 1400.4147140001878 1402.1381839998066 1403.2242029998451 1416.0996099999174 1420.415934999939 1421.5884210001677 1423.3308520000428 1428.9221200002357 1429.2839770000428 1431.0379650001414 1436.3050139998086 1436.852987000253 1438.185223000124 1438.895141999703 1447.1816819999367 1453.1988129997626 1453.6051440006122 1456.211507000029 1457.9684250000864 1459.6045739995316 1459.9523120000958 1460.382366000209 1465.6225189999677 1469.397299000062 1474.9861250002868 1477.938192000147 1493.62239699997 1494.3233650000766 1508.3304039998911 1509.2466639997438 1513.39168300014 1516.1617040000856 1516.4016519999132 1526.8412689999677 1526.8701989999972 1527.7237959997728 1527.864380999934 1544.117107000202 1555.072753999848 1556.184936999809 1562.0475269998424 1562.6499850000255 1567.21643100027 1572.134563000407 1576.687663000077 1582.0214450000785 1587.1176759996451 1590.76302199997 1594.1121020000428 1601.4278570003808
Open search router TTI (CPU) Baseline
Mean: 148.222 %
Stdev: 3.537 % (2.4%)
Runs: 139.87080838616882 140.65086566650592 141.73508977455307 143.9425740656982 143.97394251837804 144.1052668690027 144.39455909004735 144.7564533781044 144.99677638125922 145.14357919114457 145.27033138937057 145.32787644432415 145.33462772010304 145.40860365256904 145.98263428872426 146.0202378252622 146.06245074700402 146.29876005106198 146.3040999316276 146.33954307949156 146.45026416792996 146.5589038095049 146.57684906478332 146.7622215804736 147.15981712989634 147.20008454977986 147.35318355632486 147.41684291934666 147.4177653409531 147.60877351703843 147.77889907770196 147.87580510468905 148.1837992821734 148.25081470360143 148.56959926548907 148.60170190014352 148.8401495233279 149.14072970058234 149.20580445488324 149.29263495436862 149.39767052878372 149.57303176560657 150.3309058272149 150.59975979072388 150.6854631884615 150.769036304581 150.78011101859414 150.88877907129378 151.21307232161067 151.21604217639273 151.78606716054205 152.05585696568093 153.07646893648436 153.5945130015469 154.09928364232098 154.28571243752205 154.94105239325734 154.98659035983837 155.4092873392639 155.46428664612242

Current
Mean: 147.244 %
Stdev: 2.394 % (1.6%)
Runs: 142.72511251315632 143.3616776419642 143.7144844911902 143.90573696796787 144.2231694431109 144.3324602583394 144.62860689077252 144.74071743588956 144.88806758239926 144.90891479027883 145.03338359861527 145.16448119276396 145.1984640139727 145.33077374346385 145.36050135612084 145.50421500374966 145.5889344472388 145.64169853755433 145.95143401065548 146.0671988690891 146.07700156788601 146.18174123373794 146.224238269491 146.32894241950692 146.4534815190497 146.56268390534697 146.6228362336946 146.7780245046442 147.35826855663223 147.37307617222524 147.42152369848483 147.46043758128704 147.62960356291643 147.63568502969494 147.67858849773143 147.834193546067 147.86937029885792 147.88973059797567 148.00936650979503 148.1415110928058 148.29450750586454 148.40796660818597 148.45235899146502 148.48092661340948 148.6936477326258 148.82800287513317 149.6319001604701 150.0834410079587 150.1889747194166 150.2797463976068 150.88056567300993 150.92102104215215 151.00093007078988 151.28941801436505 151.8528645927044 152.39603030805608 153.40400746625093
Open search router TTI (FPS) Baseline
Mean: 57.064 FPS
Stdev: 1.014 FPS (1.8%)
Runs: 55.05059230744538 55.207503685593224 55.25105991093485 55.2911395643524 55.446125820057844 55.52374259632347 55.72886072921184 55.749198289540914 55.85570914246985 56.05561932252696 56.06581816038331 56.15869603610115 56.237649397467784 56.37819727067934 56.41975582679436 56.48422317302832 56.50370486264834 56.503928749924 56.51881677744093 56.73108031861223 56.76277817982807 56.78047255562018 56.781468133424866 56.79952141414727 56.83384398046314 56.86045044724261 56.9528220259275 56.95353503680718 56.96788870830894 57.044041135871474 57.059463016526244 57.121197030570194 57.17714275353304 57.192440419530044 57.3174464324823 57.43841696000965 57.53518125804969 57.56974403984113 57.65035566187212 57.70153700582747 57.92584910385508 57.96450568548697 57.96924224790962 58.13229417423939 58.140647062083225 58.14369760375007 58.183157283384546 58.1896504620281 58.19446690227826 58.27747450826591 58.30233360484491 58.313896879597586 58.368876253891656 58.40141414043378 58.56508698256886 58.78873062938667 59.10333351383697

Current
Mean: 59.282 FPS
Stdev: 0.783 FPS (1.3%)
Runs: 57.324618661778665 57.5925012158843 57.62434353988307 57.82068604501376 57.94116031267115 58.06966713067586 58.154215953698134 58.317328185881365 58.32531979295584 58.34297139275151 58.38491697985644 58.41750491961002 58.49139129653416 58.60445605009001 58.778401201618586 58.91900811376811 58.960403927671095 58.999037765586046 59.02775768258316 59.24538968234465 59.32886363464088 59.37773611534046 59.38686297659594 59.39876053804908 59.42225902596283 59.451881349569966 59.46801339849335 59.47152555915572 59.548200781108314 59.65660300543747 59.675898354115475 59.721542615239365 59.773592965763825 59.85461819305524 59.873360873221785 59.91004343442779 59.922303491676715 59.946578029463545 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 382.448 MB
Stdev: 4.390 MB (1.1%)
Runs: 374.97578125 375.23671875 375.46484375 375.58125 375.82734375 376.56484375 377.6578125 377.66640625 377.7890625 378.0015625 378.0609375 378.21796875 378.48984375 379.09609375 379.16484375 379.35703125 379.6265625 379.8296875 380.17421875 380.2194010416667 380.23984375 380.31328125 380.33671875 380.63125 380.86796875 381.1203125 381.44140625 381.46171875 381.5618489583333 381.6453125 381.66171875 381.94921875 382.06328125 382.48828125 383.17578125 383.28203125 383.46640625 383.546875 384.04921875 384.1536458333333 384.3248697916667 384.36953125 384.54140625 384.9765625 384.990625 385.6328125 385.7747395833333 385.846875 385.96015625 386.3684895833333 386.9671875 388.1390625 388.5265625 389.69375 389.7125 389.89609375 390.01171875 391.2015625 391.2140625 392.265625

Current
Mean: 381.278 MB
Stdev: 3.698 MB (1.0%)
Runs: 373.1984375 374.6640625 375.2609375 376.36640625 376.61796875 376.97890625 377 377.11875 377.18046875 377.27109375 377.49921875 377.5140625 377.92421875 377.9390625 378.3046875 378.76875 378.77109375 379.03203125 379.36484375 379.578125 379.58203125 379.90390625 380.0828125 380.10546875 380.35859375 380.61328125 380.7671875 380.8072916666667 380.8703125 381.01328125 381.03203125 381.0924479166667 381.23515625 381.35703125 381.39453125 381.9515625 382.2421875 382.3078125 382.40234375 382.503125 382.583984375 382.65703125 382.9125 383.75390625 383.76171875 383.81484375 383.86640625 383.984375 384.06953125 384.25703125 384.89453125 385.5515625 386.2125 386.63203125 386.83359375 387.4234375 387.92421875 388.43671875 388.6921875 390.46796875
Open search router TTI (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Open search router TTI (CPU/UI) Baseline
Mean: 23.487 %
Stdev: 1.457 % (6.2%)
Runs: 20.5 21.1 21.2 21.3 21.3 21.6 21.9 21.9 21.9 22.2 22.2 22.3 22.3 22.3 22.3 22.3 22.3 22.4 22.4 22.4 22.7 22.7 22.7 22.7 23.1 23.1 23.1 23.2 23.2 23.2 23.3 23.5 23.5 23.6 23.8 23.8 23.9 23.9 23.9 24 24.3 24.3 24.4 24.7 24.7 24.7 24.7 25 25.1 25.1 25.2 25.3 25.3 25.3 25.4 25.9 25.9 26.3 26.3 26.3

Current
Mean: 24.460 %
Stdev: 1.465 % (6.0%)
Runs: 22.3 22.3 22.4 22.5 22.7 22.7 22.7 22.8 22.8 23.1 23.1 23.1 23.2 23.3 23.4 23.4 23.4 23.4 23.5 23.6 23.9 23.9 23.9 23.9 23.9 23.9 23.9 23.9 24.1 24.1 24.2 24.2 24.3 24.3 24.3 24.3 24.4 24.5 24.6 24.7 25.1 25.2 25.3 25.3 25.5 25.6 25.7 25.8 25.8 25.9 25.9 26.3 26.4 26.7 26.7 26.7 27.1 27.6 27.9 28.2
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 463.732 ms
Stdev: 38.413 ms (8.3%)
Runs: 390.87849900033325 391.7528079999611 392.79353899974376 407.9475100003183 410.6425379998982 410.8600260000676 412.1167810000479 418.02396599948406 423.2351480005309 424.5863439999521 424.6642660005018 427.27726200036705 428.4388840002939 429.030965000391 430.86848900001496 431.0673020007089 432.321981000714 433.56656900048256 437.2881269995123 437.6284999996424 438.98978700023144 440.34745300002396 441.5945639992133 442.6959230005741 448.4457599995658 456.20568799972534 456.2421469995752 456.7587480004877 465.16760200075805 466.1665450008586 472.5850019995123 472.5920000001788 473.4185800002888 475.15148999914527 476.34037300013006 481.20629899948835 481.7407630002126 484.18644200079143 484.5511469999328 484.8298340002075 485.5646569998935 487.290568000637 488.38879400026053 490.1801359998062 490.95125399995595 492.69185400009155 497.8194580003619 500.05786100029945 500.80175799969584 506.3463139999658 510.469197999686 510.57442199997604 510.5947270002216 513.8529470004141 513.8859060006216 520.625121999532 523.699585000053 526.5718189999461 529.6066890005022 529.7456459999084

Current
Mean: 467.982 ms
Stdev: 41.892 ms (9.0%)
Runs: 390.07796300016344 400.64473500009626 400.88069699984044 401.4932859996334 405.4766029994935 407.7672530002892 408.2558189993724 417.45658400002867 417.5707189999521 418.31970299966633 420.57543999981135 425.3635260006413 425.57568399980664 426.63704499974847 430.01269599981606 434.6474200002849 438.38004600070417 438.66951599996537 439.20031800027937 439.80696599930525 441.2140300003812 442.67492699995637 447.5239669997245 450.13143000006676 451.2324219997972 454.6313070002943 459.8586430000141 467.72920700069517 467.8898520004004 472.422933999449 473.98701999988407 475.3216559998691 475.67598500009626 481.97550499998033 483.3708910001442 486.4050289997831 487.59830799978226 489.47326700016856 490.31091399956495 492.2879230007529 492.45682800002396 492.4672039998695 493.3200279995799 503.33182800002396 503.6510830000043 506.25447600055486 508.28385400027037 510.92635099962354 511.4136560000479 514.8161220001057 515.1024170005694 520.015298999846 521.7002360001206 522.5474450001493 523.3545329999179 523.7480059992522 527.5642499998212 529.7921959999949 532.7893070001155 546.8507900005206
Report typing (CPU) Baseline
Mean: 105.789 %
Stdev: 2.211 % (2.1%)
Runs: 100.44812831446615 101.61740955208923 101.6410266936631 102.06610490948937 102.17891600097083 102.82661418300263 103.0698387789212 103.37739528624238 103.61837899371127 103.86053859723167 103.90831930419205 103.99025420849885 104.06625868026794 104.24028141654041 104.29582803941729 104.34784486102384 104.40092500450942 104.44192246290645 104.46525273140514 104.6457906083794 104.67095499821795 104.74738619480057 104.90249374177372 105.0683371404355 105.24383405974893 105.2852212058475 105.28726161249499 105.40913616029891 105.43472505127794 105.61447043745136 105.9125372904291 106.11245187560793 106.15090055183701 106.22595962676222 106.31302179462257 106.33751652823521 106.3658571597171 106.6509839846945 106.72569355488092 106.76492035295907 106.84924711785976 106.91604071860988 106.94450650372097 107.12750500444365 107.30011459264199 107.38579963286588 107.54647206938472 107.6931567161196 107.7316450422943 107.90817807870168 108.32366401724653 108.47210368697338 108.55157591034914 108.65141589174607 108.85360748019777 108.9725401998935 109.42146154020504 109.56941346392125 109.78739033337891 110.61252611387772

Current
Mean: 105.636 %
Stdev: 2.345 % (2.2%)
Runs: 101.21326622243258 101.3379103780289 101.64957841702947 102.11148794990248 102.19512825224722 102.34629427489058 102.4853317309733 102.57324038094767 102.79684959979032 103.04047302632138 103.05887492505421 103.08383427107623 103.11441191207328 103.16672248021207 103.23072203218223 103.31621032072009 103.42053957866945 104.06416018192928 104.74559055285117 104.74752630763976 104.82162288180692 104.82262011256283 104.84296905737664 105.08170537258464 105.09042090921088 105.0955793625963 105.10054908225588 105.22514751455952 105.49317949955095 105.53957584352456 105.55901726079878 105.63930986722305 106.02000880848344 106.09759177617237 106.20586982945571 106.21447476129774 106.31615008728224 106.652083625227 106.68761315814392 107.28494573764182 107.29877592396657 107.33640121419589 107.51515438208102 107.89697696384216 107.95729402162404 107.97526241739642 108.28755051818727 108.28867956188331 108.31924182042559 108.42724892331623 108.45765204932438 108.47614376765044 108.49996802759304 108.50214862891418 108.55768674426882 108.56753765053213 108.87376381175068 109.1296172550365 109.15182491362434 109.17731056496957
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 454.496 MB
Stdev: 3.899 MB (0.9%)
Runs: 446.2943474264706 447.30744485294116 447.5755974264706 447.8173828125 448.041748046875 448.4202665441176 449.29572610294116 449.4951746323529 449.6413143382353 449.72219669117646 449.921875 450.13465073529414 450.60595703125 450.7975643382353 451.88396139705884 451.9053308823529 451.93152573529414 452.01976102941177 452.40966796875 452.5693933823529 452.7943474264706 453.20427389705884 453.39568014705884 453.46897977941177 453.85363051470586 454.017822265625 454.37063419117646 454.71142578125 454.80615234375 455.34030330882354 455.3508731617647 455.5415900735294 455.67463235294116 455.737060546875 456.0188419117647 456.1047794117647 456.75896139705884 456.77320772058823 456.8150275735294 456.8662109375 456.9271599264706 456.95680147058823 457.11052389705884 457.8343290441176 457.93994140625 457.98621323529414 458.08157169117646 458.226318359375 458.296875 458.49755859375 459.14306640625 459.14453125 459.28125 459.5263671875 459.5498621323529 459.58386948529414 460.0806525735294 460.5383731617647 461.16130514705884

Current
Mean: 455.255 MB
Stdev: 5.363 MB (1.2%)
Runs: 445.49494485294116 445.8228400735294 446.16130514705884 446.6171875 446.7334558823529 448.1256893382353 448.25436580882354 448.50114889705884 448.5852481617647 449.42529296875 449.83180147058823 450.0420496323529 450.4556525735294 450.7727481617647 450.85546875 450.88878676470586 451.22610294117646 451.3408203125 451.81456801470586 452.0344669117647 452.38235294117646 452.3954503676471 452.91796875 454.21047794117646 454.21484375 454.3352481617647 454.4241727941176 455.05583639705884 455.2630974264706 455.4788602941176 455.69715073529414 455.7236328125 456.02294921875 456.11534926470586 456.85546875 457.06755514705884 457.2251838235294 457.34788602941177 457.51125919117646 457.7180606617647 458.029541015625 458.2782628676471 458.86083984375 459.14269301470586 459.18566176470586 459.71760110294116 459.7688419117647 459.82927389705884 459.92141544117646 460.387939453125 460.46116727941177 460.65188419117646 460.83616727941177 461.515869140625 462.2798713235294 462.76056985294116 464.1475183823529 464.9733455882353 466.07996323529414 467.50965073529414
Report typing (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report typing (CPU/UI) Baseline
Mean: 25.884 %
Stdev: 0.500 % (1.9%)
Runs: 24.8 24.9 25 25.1 25.2 25.2 25.3 25.4 25.4 25.4 25.5 25.5 25.5 25.5 25.5 25.6 25.6 25.6 25.6 25.6 25.7 25.7 25.7 25.7 25.7 25.8 25.8 25.8 25.8 25.8 25.9 25.9 26 26 26 26 26.1 26.1 26.1 26.1 26.1 26.2 26.2 26.2 26.2 26.3 26.3 26.3 26.3 26.4 26.5 26.5 26.7 26.8 26.8 26.8 26.9 26.9

Current
Mean: 25.660 %
Stdev: 0.492 % (1.9%)
Runs: 24.5 24.6 24.9 24.9 25 25 25.1 25.1 25.1 25.2 25.2 25.2 25.2 25.3 25.3 25.3 25.3 25.3 25.4 25.4 25.5 25.5 25.5 25.5 25.5 25.5 25.6 25.6 25.6 25.6 25.7 25.7 25.7 25.7 25.7 25.8 25.8 25.9 25.9 25.9 25.9 25.9 26 26 26 26 26 26.1 26.1 26.1 26.2 26.2 26.3 26.3 26.3 26.4 26.5 26.5 26.5 26.8
Chat opening Chat TTI Baseline
Mean: 371.980 ms
Stdev: 28.017 ms (7.5%)
Runs: 306.343791000545 313.2814530003816 324.55008900072426 338.59903999976814 338.83142099995166 340.59008800052106 340.8367519993335 346.072387999855 346.11181600019336 348.2335209995508 348.78299899958074 349.8203940000385 351.0625409996137 351.10091200005263 351.1317539997399 353.1250409996137 353.18457000050694 353.3435060000047 354.48543299920857 354.75211599934846 355.85628299973905 358.28861599974334 359.447550999932 360.797485999763 362.72753899917006 363.5017499998212 365.67744999937713 366.33492100052536 368.8773600002751 370.1572679998353 371.5733650000766 372.23661299981177 374.5342210000381 374.9586179992184 376.4922279994935 377.6504720002413 377.7937820004299 378.55029300041497 378.6499029994011 378.8986410005018 381.8765460001305 382.2668049996719 385.40799899958074 386.72977699991316 390.01184100005776 393.5427660001442 398.5178640000522 398.5871179997921 399.9684649994597 403.87268100026995 405.39445000048727 406.55497199948877 416.18733800016344 417.47119100019336 418.0247400002554 419.8899739999324 423.2358809998259 424.8382980003953 437.2169590005651

Current
Mean: 368.299 ms
Stdev: 17.375 ms (4.7%)
Runs: 328.34944699984044 336.6170650003478 340.52718099951744 343.3695480003953 343.7983400002122 345.00386600010097 345.50504600070417 348.82633499987423 349.8265379993245 350.3348390003666 352.7435309998691 352.7946380004287 353.09171599987894 353.62988299969584 354.66068500000983 356.1697589997202 357.1674810005352 357.81075099948794 359.0668129995465 359.1375330006704 360.4429930001497 364.2028000000864 364.45088700018823 367.8050130000338 368.32177700009197 368.40222200006247 369.2019039997831 369.6006269995123 369.7334799999371 370.37870300002396 370.8200279995799 371.4935309998691 372.75227800011635 373.45874099992216 373.7749429997057 374.1476640002802 374.4396569998935 374.6180010000244 375.40462299995124 376.60668900050223 376.7758790003136 379.65262800082564 379.8852949999273 380.7930100001395 382.446940000169 382.95963599998504 383.80944800004363 384.0723069999367 384.9444169998169 385.19291200023144 385.8298749998212 385.9366049999371 387.7952880002558 389.8296309998259 399.0448810001835 406.01359099987894 419.58565300051123
Chat opening (CPU) Baseline
Mean: 167.979 %
Stdev: 5.944 % (3.5%)
Runs: 156.0542862347298 156.4291205777843 157.14400565870824 159.1587289688212 159.30989876725957 159.4226548179859 159.4700814993737 160.2167761111959 160.34754102107394 160.74752248144148 161.67156659836618 162.0529304683575 162.10756178486085 163.18865474269055 163.60654927555842 163.7144866917641 164.0784963936669 164.38114493345984 164.60163814554488 164.97650273814958 165.312664573444 165.67803150270257 166.3788774510678 166.958269555222 167.32266199004508 167.3622580730777 167.74269540344383 167.96184137810826 168.3896193880605 168.40594623120512 168.47455346609448 168.7008225002248 169.35522567704925 169.71925568672933 169.84441234181293 170.22197202256856 170.43219764506009 171.18129121847875 171.2619047619048 171.63734305404554 171.65894108197955 171.66020343589872 171.771407104042 172.40224875692402 172.72203800800014 173.01779415975264 173.21761058667875 173.34478826204455 173.6926287966077 173.7945361411497 173.81525920165336 174.444047646811 175.2051684416412 175.34425803326883 175.43361421391816 176.98232163261164 177.43766209799776 177.87312149754624 181.9139886337652

Current
Mean: 166.068 %
Stdev: 2.854 % (1.7%)
Runs: 160.28545808905827 160.34830339321363 160.57043863970156 161.31633268574947 161.45694966159223 161.48881586784407 162.25137925252903 162.29375227656482 162.5225970216665 162.70742293859743 163.73129826236996 163.7634631813429 163.8208465614638 163.8367910934718 163.92284129445648 164.13011512405123 164.22949320368716 164.6120024149989 164.96643904440805 165.0429099029709 165.0577210632987 165.44296781930217 165.61582271682946 165.7015045174855 165.92596430889452 165.9375922710792 166.10327767265298 166.16924137777627 166.2208997567385 166.34859068900002 166.43801826010179 166.45248449983367 166.55042679192746 166.60693554106228 166.89662964500454 166.98041608579342 167.19728405986416 167.41919117975272 167.42153239296522 167.42160407972244 167.44196466512767 167.5195547854864 167.57236394479028 167.62475111424266 167.67702841329302 168.0299390998293 168.08019750659597 168.08904800681907 168.21550074977716 168.55347028540908 168.62107661063823 169.21188055482583 169.51832346008064 170.2068447260519 170.4885627057084 170.5204833848353 171.13789525585108 171.81894048867537 172.49602385685876
Chat opening (FPS) Baseline
Mean: 56.016 FPS
Stdev: 1.430 FPS (2.6%)
Runs: 53.7000155065852 53.72532795883018 53.85067836417517 53.91772349497733 54.066565586048306 54.29695437358679 54.31359810195833 54.32364264616953 54.467622700880774 54.52254074352452 54.541292186910084 54.70315088892835 54.727239103425006 54.784221073616315 54.99962893408539 55.0161272858147 55.08601168860297 55.17841454306561 55.24960192186933 55.377525011408835 55.37788478531343 55.442267731944575 55.503742655374865 55.5190498079057 55.521715160479346 55.54560880266182 55.6665184388836 55.72574159242435 55.73689195477179 55.811651468248556 55.93576353543169 56.04050013561085 56.141696969494475 56.21933174426498 56.32279832751474 56.34491658744298 56.359454375984434 56.371678344402305 56.403338150600504 56.6049876804433 56.61700526649642 56.7233364762394 56.72636473683566 56.88199622250287 56.97533935883289 57.12630067898233 57.24231180267566 57.640200631579006 57.68130851453676 57.68475218263987 57.86221090724434 57.99976913201674 58.09197745958602 58.36265275310334 58.412042600286206 58.421548021746524 59.25167508610163 59.75524213091824

Current
Mean: 59.835 FPS
Stdev: 0.252 FPS (0.4%)
Runs: 59.111036986354065 59.22303608786696 59.26825630286613 59.348669306782924 59.3631696612715 59.41043223526374 59.424189602983624 59.47740318827865 59.51938297063327 59.53837281102081 59.558708103900706 59.621949851529784 59.64956235343334 59.73136052096319 59.76705361303242 59.78056499085918 59.80404633916436 59.805528317635805 59.816887088246354 59.91835446653155 59.96489640687844 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 373.649 MB
Stdev: 4.689 MB (1.3%)
Runs: 365.8623046875 365.892578125 368.265625 368.3857421875 368.4794921875 368.97265625 369.125 369.357421875 369.4091796875 369.4482421875 369.490234375 369.6591796875 370.1455078125 370.357421875 370.3642578125 370.3916015625 370.8544921875 371.0126953125 371.0263671875 371.0537109375 371.5634765625 371.5712890625 371.5966796875 371.6103515625 371.73046875 371.763671875 371.9375 372.1298828125 372.171875 372.376953125 372.4560546875 372.4853515625 372.7001953125 372.82421875 373.494140625 374.0361328125 374.240234375 374.900390625 375.3408203125 375.3798828125 375.6298828125 375.947265625 376.154296875 376.4205729166667 376.798828125 377.63671875 377.8193359375 378.390625 378.5515625 379.37578125 380.1484375 380.935546875 381.314453125 382.61328125 384.28515625 385.591796875 386.505859375

Current
Mean: 370.419 MB
Stdev: 3.233 MB (0.9%)
Runs: 363.9111328125 364.197265625 365.33984375 365.857421875 366.185546875 366.5537109375 367.123046875 367.453125 367.533203125 367.6748046875 367.9423828125 367.9677734375 368.0654296875 368.1162109375 368.404296875 368.5263671875 368.658203125 369.1435546875 369.494140625 369.5458984375 369.6640625 369.6904296875 369.8212890625 369.9638671875 370.0126953125 370.0576171875 370.12890625 370.20703125 370.376953125 370.6171875 371.0439453125 371.0810546875 371.1171875 371.9130859375 372.091796875 372.2734375 372.361328125 372.4130859375 372.677734375 372.716796875 372.9599609375 373.1240234375 373.1435546875 373.2119140625 373.212890625 373.5556640625 374.5986328125 375.8896484375 376.1962890625 377.5078125 380.0283203125
Chat opening (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Chat opening (CPU/UI) Baseline
Mean: 34.469 %
Stdev: 1.722 % (5.0%)
Runs: 30.2 30.9 31.4 31.5 31.7 31.8 31.9 32.2 32.3 32.8 32.8 32.8 32.9 32.9 33.2 33.5 33.6 33.7 33.7 33.8 33.9 34 34 34 34.2 34.3 34.4 34.4 34.5 34.6 34.9 35 35 35.3 35.3 35.4 35.4 35.4 35.4 35.5 35.5 35.7 35.9 35.9 35.9 36 36.1 36.1 36.2 36.2 36.3 36.3 36.3 36.3 36.4 36.4 36.5 36.7 38.5

Current
Mean: 36.475 %
Stdev: 1.490 % (4.1%)
Runs: 33.1 33.4 33.9 34.2 34.3 34.5 34.8 34.8 34.9 34.9 35.1 35.1 35.2 35.2 35.4 35.4 35.4 35.5 35.5 35.7 35.7 35.8 35.9 36 36 36.1 36.3 36.4 36.4 36.4 36.5 36.6 36.7 36.9 36.9 37 37 37.1 37.1 37.2 37.2 37.2 37.4 37.4 37.4 37.4 37.6 37.7 37.9 38 38 38.1 38.1 38.4 38.4 38.8 39.1 39.2 39.4 39.5

⚠️ Some tests did not pass successfully, so some results are omitted from final report: Linking

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@danieldoglas danieldoglas removed the DeployBlockerCash This issue or pull request should block deployment label Jan 27, 2025
@danieldoglas
Copy link
Contributor Author

Removing the deploy blocker. After talking to @mountiny, the e2e performance tests is sometimes flakey, and we can't find anything specific on this PR that would cause that.

Copy link
Contributor

🚀 Deployed to staging by https://github.com/NikkiWines in version: 9.0.90-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to production by https://github.com/yuwenmemon in version: 9.0.90-6 🚀

platform result
🤖 android 🤖 true ❌
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants