Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manual test run on Android ARM for Android 1.11.x - Release #10988

Closed
76 of 77 tasks
srirambv opened this issue Jul 29, 2020 · 1 comment
Closed
76 of 77 tasks

Manual test run on Android ARM for Android 1.11.x - Release #10988

srirambv opened this issue Jul 29, 2020 · 1 comment

Comments

@srirambv
Copy link
Contributor

srirambv commented Jul 29, 2020

Per release specialty tests

  • Implement "simplified" shield design on Android. (#7754)
  • [Android] Issues to be tested on Android 1.11.x . (#10587)
  • [Android] Rate Brave does not send feedback on older Android devices - follow up to 8243. (#10945)

Installer

  • Check that installer is close to the size of the last release
  • Check the Brave version in About and make sure it is EXACTLY as expected

Visual look

  • Make sure thereafter every merge
    • No Chrome/Chromium words appear on normal or private tabs
    • No Chrome/Chromium icons are shown in normal or private tabs

Data

Pre-Requisite: Put previous build shortcut on the home screen. Also, have several sites 'Added to home screen' (from 3 dots menu) and then upgrade to new build

  • Verify that data from the previous build appears in the updated build as expected (bookmarks, etc)
  • Verify that the cookies from the previous build are preserved after upgrade
  • Verify shortcut is still available on the home screen after upgrade
  • Verify sites added to home screen are still visible and able to be used after upgrade
  • Verify sync chain created in the previous version is still retained on upgrade
  • Verify settings changes done in the previous version are still retained on upgrade

Custom tabs

  • Make sure Brave handles links from Gmail, Slack
  • Make sure Brave works as custom tabs provide with Chrome browser
  • Ensure custom tabs work even with sync enabled/disabled

Developer Tools

  • Verify you can inspect sub-links via dev tools

Settings and Bottom bar

  • Verify changing default settings are retained and don't cause the browser to crash
  • Verify bottom bar buttons (Home/Bookmark/Search/Tabs) work as expected

Downloads

  • Verify downloading a file works and that all actions on the download item work.
  • Verify that PDF is downloaded over HTTPS at https://basicattentiontoken.org/BasicAttentionTokenWhitePaper-4.pdf
  • Verify that PDF is downloaded over HTTP at http://www.pdf995.com/samples/pdf.pdf

Bravery settings

  • Check that HTTPS Everywhere works by loading http://https-everywhere.badssl.com/
  • Turning HTTPS Everywhere off and shields off both disable the redirect to https://https-everywhere.badssl.com/
  • Check that toggling to blocking and allow ads works as expected
  • Verify that clicking through a cert error in https://badssl.com/ works
  • Visit https://brianbondy.com/ and then turn on script blocking, nothing should load. Allow it from the script blocking UI in the URL bar and it should work.
  • Verify that default Bravery settings take effect on pages with no site settings
  • Verify that 3rd party storage results are blank at https://jsfiddle.net/7ke9r14a/7/ when 3rd party cookies are blocked

Fingerprint Tests

  • Visit https://browserleaks.com/webrtc, ensure 2 blocked items are listed in shields
  • Verify that https://diafygi.github.io/webrtc-ips/ doesn't leak IP address when Block all fingerprinting protection is on

Content Tests

  • Go to https://brianbondy.com/ and click on the twitter icon on the top right. Verify that context menus work in the new twitter tab
  • Go to https://trac.torproject.org/projects/tor/login and make sure that the password can be saved. Make sure the saved password is auto-populated when you visit the site again
  • Open a GitHub issue and type some misspellings, make sure they aren't autocorrected
  • Open an email on http://mail.google.com/ or inbox.google.com and click on a link. Make sure it works
  • Verify that https://mixed-script.badssl.com/ shows up as grey not red (no mixed content scripts are run)

Brave Rewards/Ads

  • Verify wallet is auto-created after enabling rewards(either via Panel or Rewards page)
  • Verify account balance shows correct BAT and USD value
  • Verify actions taken (claiming grant, tipping, auto-contribute) display in wallet panel
  • Verify grant details are shown in expanded view when a grant is claimed
  • Verify monthly budget shows correct BAT and USD value
  • Verify you can exclude a publisher from the auto-contribute table by clicking on the trash bin icon in the auto-contribute table
  • Verify you can exclude a publisher by using the toggle on the Rewards Panel
  • Verify you can remove excluded sites via Restore All button
  • Verify when you click on the BR panel while on a site, the panel displays site-specific information (site favicon, domain, attention %)
  • Verify when you click on Send a tip, the custom tip banner displays
  • Verify you can make a one-time tip and they display in tips panel
  • Verify you can make a recurring tip and they display in tips panel
  • Verify you can tip a verified publisher
  • Verify you can tip a verified YouTube creator
  • Verify tip panel shows a verified check mark for a verified publisher/verified YouTube creator
  • Verify tip panel shows a message about the unverified publisher
  • Verify BR panel shows the message about an unverified publisher
  • Verify you can perform a contribution
  • Verify if you disable auto-contribute you are still able to tip regular sites and YouTube creators
  • Verify that disabling Rewards and enabling it again does not lose state
  • Verify that disabling auto-contribute and enabling it again does not lose state
  • Verify unchecking Allow contribution to videos option doesn't list any YouTube creator in ac list
  • Adjust min visit/time in settings. Visit some sites and YouTube channels to verify they are added to the table after the specified settings
  • Verify you can reset rewards from advance setting. Resetting should delete wallet and bring it back to the pre-optin state
  • Verify on BR panel Verify wallet button only enables when balance in >=25 BAT
  • Verify you are able to disconnect/re-connect a user wallet when min balance is available
  • Upgrade from an older version
    • Verify the wallet balance (if available) is retained
    • Verify auto-contribute list is not lost after upgrade
    • Verify tips list is not lost after upgrade
    • Verify wallet panel transactions list is not lost after upgrade

Brave Ads

  • Verify ads is auto-enabled when rewards is enabled for the supported region
  • Verify ads are only shown when the app is being used
  • Verify ad notification are shown based on ads per hour setting
  • Verify ad notifications stack up in notification tray
  • Verify swipe left/right dismisses the ad notification when shown and is not stored in the notification tray
  • Verify clicking on an ad notification shows the landing page
  • Verify view,clicked and landed and dismiss states are logged based on the action

Top sites view

  • Long-press on top sites to get to deletion mode, and delete a top site (note this will stop that site from showing up again on top sites, so you may not want to do this a site you want to keep there)

Session storage

  • Verify that tabs restore when closed, including active tab
@srirambv srirambv added this to the Android 1.11.x - Release milestone Jul 29, 2020
@srirambv srirambv self-assigned this Jul 29, 2020
@srirambv
Copy link
Contributor Author

Verification passed on OnePlus 6T with Android 10 running 1.11.105 x64 build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant