QA/Fenix/94.0.0/beta.1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
 
(17 intermediate revisions by 5 users not shown)
Line 1: Line 1:
<small>« [[QA/Fenix/93.1.0/RC | Fenix 93.1.0 RC]] | [[QA/Fenix/94.0.0/beta.1 | Fenix 94.0.0 Beta 1]] </small>
<small>« [[QA/Fenix/93.1.0/RC | Fenix 93.1.0 RC]] | [[QA/Fenix/94.0.0/beta.1 | Fenix 94.0.0 Beta 1]] | [[QA/Fenix/94.0.0/beta.2 | Fenix 94.0.0 Beta 2]] </small>


= Firefox 94.0.0 Beta 1 Test Plan =
= Firefox 94.0.0 Beta 1 Test Plan =
Line 30: Line 30:
  | ARM
  | ARM
  | Huawei MediaPad M3 (Android 7)
  | Huawei MediaPad M3 (Android 7)
  | October 6th, 2021
  | October 7th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Bodea Andrei
  | Bodea Andrei
  | ARM
  | ARM
  | Google Pixel 4 XL (Android 11)
  | Google Pixel 4 XL (Android 11)
  | October 6th, 2021
  | October 7th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Andrei Jolțan
  | Andrei Jolțan
  | ARM
  | ARM
  | OnePlus A3 (Android 6.0.1)
  | OnePlus A3 (Android 6.0.1)
  | October 6th, 2021
  | October 7th, 2021
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Mira Lobonțiu
  | Mira Lobonțiu
  | ARM
  | ARM
  | Samsung Galaxy Tab A6 (Android 5.1.1)
  | Samsung Galaxy Tab A6 (Android 5.1.1)
  | October 6th, 2021
  | October 7th, 2021
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Oana Horvath
  | Oana Horvath
  | ARM
  | ARM
  | Huawei P9 Lite (Android 8)
  | Huawei P9 Lite (Android 8)
  | October 6th, 2021
  | October 7th, 2021
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Lorand Janos
  | Lorand Janos
  | ARM
  | ARM
  | Samsung Galaxy Tab S3 (Android 9)
  | Samsung Galaxy Tab S3 (Android 9)
  | October 6th, 2021
  | October 7th, 2021
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  |}  
  |}  
Line 94: Line 94:
* [https://github.com/mozilla-mobile/fenix/issues/16437 16437] - Unnecessary space in site permission exceptions - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/16437 16437] - Unnecessary space in site permission exceptions - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/21313 21313] - [Telemetry] Renew/delete probes for Nov/Dec - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/21313 21313] - [Telemetry] Renew/delete probes for Nov/Dec - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/21174 21174] - inconsistent shadow on Recently Saved first tile - '''✅ Verified as fixed'''


== Issues ==
== Issues ==
Line 100: Line 101:


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/21763 21763] - [Bug]: Inconsistent tabs setting displayed in Settings
* [https://github.com/mozilla-mobile/fenix/issues/21736 21736] - The "Jump back in" Contextual Hint is not displayed.
* [https://github.com/mozilla-mobile/fenix/issues/21736 21736] - The "Jump back in" Contextual Hint is not displayed.
* [https://github.com/mozilla-mobile/fenix/issues/21739 21739] - [Bug]: The onboarding dialog keeps showing up if the "Start browsing" (from the onboarding dialog) isn't tapped
* [https://github.com/mozilla-mobile/fenix/issues/21768 21768] - [Bug]: The info panel doesn't always display the ETP details on some social media websites
* [https://github.com/mozilla-mobile/fenix/issues/21770 21770] - [Bug]: The Inactive tabs area is scrollable entirely
* [https://github.com/mozilla-mobile/fenix/issues/21771 21771] - [Bug]: “Jump back in” cards created by non-Google searches do not have titles
* [https://github.com/mozilla-mobile/fenix/issues/21767 21767] - [Bug]: The application crashes when being idle on a certain website


=== Known issues ===
=== Known issues ===
Line 107: Line 114:
Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
* [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
* [https://github.com/mozilla-mobile/fenix/issues/14939 14939] - [Bug]White "Run in private browsing" icon  
* [https://github.com/mozilla-mobile/fenix/issues/14939 14939] - [Bug]White "Run in private browsing" icon
* [https://github.com/mozilla-mobile/fenix/issues/12661 12661] - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
* [https://github.com/mozilla-mobile/fenix/issues/12661 12661] - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
* [https://github.com/mozilla-mobile/fenix/issues/10057 10057] - [Bug] Weird graphic glitches when using Dark Reader extension
* [https://github.com/mozilla-mobile/fenix/issues/10057 10057] - [Bug] Weird graphic glitches when using Dark Reader extension
Line 137: Line 144:
* [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
* [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
* [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
* [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
* [https://github.com/mozilla-mobile/fenix/issues/14290 14290] - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
* [https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
* [https://github.com/mozilla-mobile/fenix/issues/16602 16602] - [Bug] Fenix thinks that its reader mode is insecure
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query
* [https://github.com/mozilla-mobile/fenix/issues/8545 8545] - [Bug] Home screen scrolls when it doesn't need to
* [https://github.com/mozilla-mobile/fenix/issues/20833 20833] - [Bug]: Little black bar at bottom of home screen
* [https://github.com/mozilla-mobile/fenix/issues/18897 18897] - [Bug] Dynamic toolbar isn't working on yr.no timetable
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/19664 19664] - [Bug] The tab menu cannot be dismissed on Android 5 devices
* [https://github.com/mozilla-mobile/fenix/issues/19667 19667] - [Bug] Unable to sign in via scanning the QR code on Samsung Galaxy Tab A6 (Android 5.1.1)
* [https://github.com/mozilla-mobile/fenix/issues/18896 18896] - [Bug] The new page menu cannot be scrolled entirely in portrait mode on Android 5.1.1 devices
* [https://github.com/mozilla-mobile/fenix/issues/13123 13123] - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color
* [https://github.com/mozilla-mobile/fenix/issues/8761 8761] - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/20280 20280] - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/12854 12854] - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
* [https://github.com/mozilla-mobile/fenix/issues/21414 21414] - [Bug]: Add logins dialog: save button is enabled when password field is blank
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
* [https://github.com/mozilla-mobile/fenix/issues/21467 21467] - [Bug] Language name missing after switching to a different language on Android 5
* [https://github.com/mozilla-mobile/fenix/issues/21168 21168] - [Bug]: "Recently closed" button isn't displayed in tabs tray after closing some open pages

Latest revision as of 13:04, 11 October 2021

«  Fenix 93.1.0 RC | Fenix 94.0.0 Beta 1 | Fenix 94.0.0 Beta 2

Firefox 94.0.0 Beta 1 Test Plan

Full Functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Laurentiu Apahidean ARM Huawei MediaPad M3 (Android 7) October 7th, 2021 Pass
Bodea Andrei ARM Google Pixel 4 XL (Android 11) October 7th, 2021 Pass
Andrei Jolțan ARM OnePlus A3 (Android 6.0.1) October 7th, 2021 Pass
Mira Lobonțiu ARM Samsung Galaxy Tab A6 (Android 5.1.1) October 7th, 2021 Pass
Oana Horvath ARM Huawei P9 Lite (Android 8) October 7th, 2021 Pass
Lorand Janos ARM Samsung Galaxy Tab S3 (Android 9) October 7th, 2021 Pass


Full Functional and UI Tests

Tablets

Phones

Telemetry

Bug verification

All October 6th, 2021 In progress


  • 21239 - Add telemetry for Allow users to customize their home screen - ✅ Verified as fixed
  • 21671 - Do not display Recently Closed under Inactive tabs - ✅ Verified as fixed
  • 21565 - FNXV2-17823 - Contextual message for Inactive tabs - ✅ Verified as fixed
  • 21642 - Do not display Media tab under Jump Back In - ✅ Verified as fixed
  • 21708 - Missing lower gray border for inactive tabs - ✅ Verified as fixed
  • 21621 - Pocket stories horizontal shadows are clipped - ✅ Verified as fixed
  • 21599 - Pocket recommended stories: Add UTM links for opened Pocket recommendations - ✅ Verified as fixed
  • 21582 - Thumbnail images on Jump Back In do not persist after closing/reopening Fenix - ✅ Verified as fixed
  • 16437 - Unnecessary space in site permission exceptions - ✅ Verified as fixed
  • 21313 - [Telemetry] Renew/delete probes for Nov/Dec - ✅ Verified as fixed
  • 21174 - inconsistent shadow on Recently Saved first tile - ✅ Verified as fixed

Issues

New issues

Major:

Other:

  • 21763 - [Bug]: Inconsistent tabs setting displayed in Settings
  • 21736 - The "Jump back in" Contextual Hint is not displayed.
  • 21739 - [Bug]: The onboarding dialog keeps showing up if the "Start browsing" (from the onboarding dialog) isn't tapped
  • 21768 - [Bug]: The info panel doesn't always display the ETP details on some social media websites
  • 21770 - [Bug]: The Inactive tabs area is scrollable entirely
  • 21771 - [Bug]: “Jump back in” cards created by non-Google searches do not have titles
  • 21767 - [Bug]: The application crashes when being idle on a certain website

Known issues

Major:

Other:

  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 14939 - [Bug]White "Run in private browsing" icon
  • 12661 - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
  • 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
  • 15627 - [Bug] Tomato Clock "Stats" are opened in the background
  • 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
  • 17716 - [Bug] can not donwload images from Pixiv anymore
  • 20848 - Downloaded items can be deleted individually in multiselect mode
  • 21162 - [Bug]: The app crashes when returning to the edit bookmarks menu after changing device settings
  • 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
  • 5298 - [Bug] The same page appears in the History section multiple times
  • 17523 - [Bug] The Recently closed tabs counter is not updated before opening the list
  • 8456 - [Bug] distorted audio while playing video at higher speed
  • 5133 - Bug] Phone goes to sleep while audio is playing
  • 9748 - Streaming downloadable media does not have media notification
  • 7907 - ETP doesn't work on a quick first load on first run
  • 13389 - FNX-14569 ⁃ [Bug] Private browsing homescreen displayed when tapping "View" after creating a collection from tabs tray
  • 4178 - Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
  • 20391 - [Bug]: Empty collection can be created
  • 16685 - Bug]Tab selection checkmark disappears after background/resume
  • 16114 - [Bug] The Firefox logo is covered when toolbar is set to the top and there is a link in clipboard
  • 13833 - [Bug] The opened tabs / bookmarks suggestions are displayed at the bottom of the search screen
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 7866 - [Bug] Custom search engines do not provide search suggestions
  • 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
  • 17431 - [Bug] Some strings provide search suggestions
  • 16152 - [Grid View] Tab titles should have dark background for dark theme
  • 20812 - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
  • 20811 - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
  • 14290 - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
  • 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
  • 16602 - [Bug] Fenix thinks that its reader mode is insecure
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 8545 - [Bug] Home screen scrolls when it doesn't need to
  • 20833 - [Bug]: Little black bar at bottom of home screen
  • 18897 - [Bug] Dynamic toolbar isn't working on yr.no timetable
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 19664 - [Bug] The tab menu cannot be dismissed on Android 5 devices
  • 19667 - [Bug] Unable to sign in via scanning the QR code on Samsung Galaxy Tab A6 (Android 5.1.1)
  • 18896 - [Bug] The new page menu cannot be scrolled entirely in portrait mode on Android 5.1.1 devices
  • 13123 - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
  • 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 20280 - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
  • 9910 - Display video in full-screen when returning from PiP mode
  • 12854 - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
  • 21414 - [Bug]: Add logins dialog: save button is enabled when password field is blank
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 21467 - [Bug] Language name missing after switching to a different language on Android 5
  • 21168 - [Bug]: "Recently closed" button isn't displayed in tabs tray after closing some open pages