Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manual test run on macOS (arm64) for 1.66.x - Release #38227

Closed
59 tasks done
LaurenWags opened this issue May 10, 2024 · 1 comment
Closed
59 tasks done

Manual test run on macOS (arm64) for 1.66.x - Release #38227

LaurenWags opened this issue May 10, 2024 · 1 comment

Comments

@LaurenWags
Copy link
Member

LaurenWags commented May 10, 2024

Installer

  • Ensured that the following executables work as expected
    • Brave-Browser-arm64.dmg
      • Check executable size, should be ~290mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-arm64.pkg
      • Check executable size, should be ~290mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-universal.dmg
      • Check executable size, should be ~500mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-universal.pkg
      • Check executable size, should be ~500mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
  • Visited brave://version and ensure the following:
    • arm64 is being displayed when installing via arm64 and universal binaries on M1 mac

Widevine

  • Using universal build:
    • Verify Widevine Notification is shown when you visit Netflix for the first time
    • Test that you can stream on Netflix on a fresh profile after installing Widevine
  • Using arm64 build:
    • Verify Widevine Notification is shown when you visit Netflix for the first time
    • Test that you can stream on Netflix on a fresh profile after installing Widevine

Components

  • Delete Adblock folder from browser profile and restart browser. Visit brave://components and verify Brave Ad Block Updater downloads and update the component. Repeat for all Brave components

Upgrade - Brave-Browser-arm64.dmg

  • Make sure that data from the last version appears in the new version OK
  • Ensure that brave://version lists the expected Brave & Chromium versions
  • With data from the last version, verify that
    • Bookmarks on the bookmark toolbar and bookmark folders can be opened
    • Cookies are preserved
    • Installed extensions are retained and work correctly
    • Opened tabs can be reloaded
    • Stored passwords are preserved
    • Sync chain created in previous version is retained
    • Social media blocking buttons changes are retained
    • Custom filters under brave://settings/shields/filters are retained
    • Custom lists under brave://settings/shields/filters are retained
    • Rewards
      • BAT balance is retained
      • Auto-contribute list is retained
      • Both Tips and Monthly Contributions are retained
      • Panel transactions list is retained
      • Changes to rewards settings are retained
      • Ensure that Auto Contribute is not being enabled when upgrading to a new version if AC was disabled
    • Ads
      • Both Estimated pending rewards & Ad notifications received this month are retained
      • Changes to ads settings are retained
      • Ensure that ads are not being enabled when upgrading to a new version if they were disabled
      • Ensure that ads are not disabled when upgrading to a new version if they were enabled

Upgrade - Brave-Browser-universal.dmg

Pre-requisite: Make sure that the previous version is installed using the universal build

  • Make sure that after upgrade, the universal build is upgraded to the appropriate architecture specific version
  • Confirm that the .app file size has decreased as a result of the upgrade
  • Make sure that data from the last version appears in the new version OK
  • Ensure that brave://version lists the expected Brave & Chromium versions
  • With data from the last version, verify that
    • Bookmarks on the bookmark toolbar and bookmark folders can be opened
    • Cookies are preserved
    • Opened tabs can be reloaded
    • Stored passwords are preserved
    • Sync chain created in previous version is retained
    • Social media blocking buttons changes are retained
    • Custom filters under brave://settings/shields/filters are retained
    • Custom lists under brave://settings/shields/filters are retained
@LaurenWags LaurenWags changed the title Manual test run on macOS (arm64) for 1.65.x - Release #6 Manual test run on macOS (arm64) for 1.66.x - Release May 10, 2024
@LaurenWags LaurenWags self-assigned this May 13, 2024
@LaurenWags LaurenWags added the QA/In-Progress Indicates that QA is currently in progress for that particular issue label May 13, 2024
@LaurenWags
Copy link
Member Author

Tests above verified with

Brave	1.66.105 Chromium: 125.0.6422.41 (Official Build) (arm64) 
Revision	ba88d7bb175a55287d14014823d5da31fe9c8a47
OS	macOS Version 14.5 (Build 23F79)

@LaurenWags LaurenWags added QA Pass-macOS-arm64 and removed QA/In-Progress Indicates that QA is currently in progress for that particular issue labels May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant