QA/Fenix/94.0.0/beta.1: Difference between revisions
< QA
Jump to navigation
Jump to search
No edit summary |
|||
(20 intermediate revisions by 5 users not shown) | |||
Line 1: | Line 1: | ||
<small>« [[QA/Fenix/93.1.0/RC | Fenix 93.1.0 RC]] | [[QA/Fenix/94.0.0/beta.1 | Fenix 94.0.0 Beta 1]] </small> | <small>« [[QA/Fenix/93.1.0/RC | Fenix 93.1.0 RC]] | [[QA/Fenix/94.0.0/beta.1 | Fenix 94.0.0 Beta 1]] | [[QA/Fenix/94.0.0/beta.2 | Fenix 94.0.0 Beta 2]] </small> | ||
= Firefox 94.0.0 Beta 1 Test Plan = | = Firefox 94.0.0 Beta 1 Test Plan = | ||
Line 30: | Line 30: | ||
| ARM | | ARM | ||
| Huawei MediaPad M3 (Android 7) | | Huawei MediaPad M3 (Android 7) | ||
| October | | October 7th, 2021 | ||
|''' | |'''Pass''' | ||
|- | |- | ||
| Bodea Andrei | | Bodea Andrei | ||
| ARM | | ARM | ||
| Google Pixel 4 XL (Android 11) | | Google Pixel 4 XL (Android 11) | ||
| October | | October 7th, 2021 | ||
|''' | |'''Pass''' | ||
|- | |- | ||
| Andrei Jolțan | | Andrei Jolțan | ||
| ARM | | ARM | ||
| OnePlus A3 (Android 6.0.1) | | OnePlus A3 (Android 6.0.1) | ||
| October | | October 7th, 2021 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Mira Lobonțiu | | Mira Lobonțiu | ||
| ARM | | ARM | ||
| Samsung Galaxy Tab A6 (Android 5.1.1) | | Samsung Galaxy Tab A6 (Android 5.1.1) | ||
| October | | October 7th, 2021 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Oana Horvath | | Oana Horvath | ||
| ARM | | ARM | ||
| Huawei P9 Lite (Android 8) | | Huawei P9 Lite (Android 8) | ||
| October | | October 7th, 2021 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Lorand Janos | | Lorand Janos | ||
| ARM | | ARM | ||
| Samsung Galaxy Tab S3 (Android 9) | | Samsung Galaxy Tab S3 (Android 9) | ||
| October | | October 7th, 2021 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
|} | |} | ||
Line 83: | Line 83: | ||
|} | |} | ||
</onlyinclude> | </onlyinclude> | ||
* [https://github.com/mozilla-mobile/fenix/issues/21239 21239] - Add telemetry for Allow users to customize their home screen - '''✅ Verified as fixed''' | * [https://github.com/mozilla-mobile/fenix/issues/21239 21239] - Add telemetry for Allow users to customize their home screen - '''✅ Verified as fixed''' | ||
* [https://github.com/mozilla-mobile/fenix/issues/21671 21671] - Do not display Recently Closed under Inactive tabs - '''✅ Verified as fixed''' | * [https://github.com/mozilla-mobile/fenix/issues/21671 21671] - Do not display Recently Closed under Inactive tabs - '''✅ Verified as fixed''' | ||
Line 90: | Line 91: | ||
* [https://github.com/mozilla-mobile/fenix/issues/21621 21621] - Pocket stories horizontal shadows are clipped - '''✅ Verified as fixed''' | * [https://github.com/mozilla-mobile/fenix/issues/21621 21621] - Pocket stories horizontal shadows are clipped - '''✅ Verified as fixed''' | ||
* [https://github.com/mozilla-mobile/fenix/issues/21599 21599] - Pocket recommended stories: Add UTM links for opened Pocket recommendations - '''✅ Verified as fixed''' | * [https://github.com/mozilla-mobile/fenix/issues/21599 21599] - Pocket recommended stories: Add UTM links for opened Pocket recommendations - '''✅ Verified as fixed''' | ||
* [https://github.com/mozilla-mobile/fenix/issues/21582 21582] - Thumbnail images on Jump Back In do not persist after closing/reopening Fenix - '''✅ Verified as fixed''' | |||
* [https://github.com/mozilla-mobile/fenix/issues/16437 16437] - Unnecessary space in site permission exceptions - '''✅ Verified as fixed''' | |||
* [https://github.com/mozilla-mobile/fenix/issues/21313 21313] - [Telemetry] Renew/delete probes for Nov/Dec - '''✅ Verified as fixed''' | |||
* [https://github.com/mozilla-mobile/fenix/issues/21174 21174] - inconsistent shadow on Recently Saved first tile - '''✅ Verified as fixed''' | |||
== Issues == | == Issues == | ||
Line 96: | Line 101: | ||
Other: | Other: | ||
* [https://github.com/mozilla-mobile/fenix/issues/21763 21763] - [Bug]: Inconsistent tabs setting displayed in Settings | |||
* [https://github.com/mozilla-mobile/fenix/issues/21736 21736] - The "Jump back in" Contextual Hint is not displayed. | |||
* [https://github.com/mozilla-mobile/fenix/issues/21739 21739] - [Bug]: The onboarding dialog keeps showing up if the "Start browsing" (from the onboarding dialog) isn't tapped | |||
* [https://github.com/mozilla-mobile/fenix/issues/21768 21768] - [Bug]: The info panel doesn't always display the ETP details on some social media websites | |||
* [https://github.com/mozilla-mobile/fenix/issues/21770 21770] - [Bug]: The Inactive tabs area is scrollable entirely | |||
* [https://github.com/mozilla-mobile/fenix/issues/21771 21771] - [Bug]: “Jump back in” cards created by non-Google searches do not have titles | |||
* [https://github.com/mozilla-mobile/fenix/issues/21767 21767] - [Bug]: The application crashes when being idle on a certain website | |||
=== Known issues === | === Known issues === | ||
Line 103: | Line 114: | ||
Other: | Other: | ||
* [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it | * [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it | ||
* [https://github.com/mozilla-mobile/fenix/issues/14939 14939] - [Bug]White "Run in private browsing" icon | * [https://github.com/mozilla-mobile/fenix/issues/14939 14939] - [Bug]White "Run in private browsing" icon | ||
* [https://github.com/mozilla-mobile/fenix/issues/12661 12661] - [Feature request] Add-ons sub-menu overlay should not disappear after rotation | * [https://github.com/mozilla-mobile/fenix/issues/12661 12661] - [Feature request] Add-ons sub-menu overlay should not disappear after rotation | ||
* [https://github.com/mozilla-mobile/fenix/issues/10057 10057] - [Bug] Weird graphic glitches when using Dark Reader extension | * [https://github.com/mozilla-mobile/fenix/issues/10057 10057] - [Bug] Weird graphic glitches when using Dark Reader extension | ||
Line 133: | Line 144: | ||
* [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync | * [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync | ||
* [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency | * [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency | ||
* [https://github.com/mozilla-mobile/fenix/issues/14290 14290] - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture | |||
* [https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar | |||
* [https://github.com/mozilla-mobile/fenix/issues/16602 16602] - [Bug] Fenix thinks that its reader mode is insecure | |||
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query | |||
* [https://github.com/mozilla-mobile/fenix/issues/8545 8545] - [Bug] Home screen scrolls when it doesn't need to | |||
* [https://github.com/mozilla-mobile/fenix/issues/20833 20833] - [Bug]: Little black bar at bottom of home screen | |||
* [https://github.com/mozilla-mobile/fenix/issues/18897 18897] - [Bug] Dynamic toolbar isn't working on yr.no timetable | |||
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version | |||
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen | |||
* [https://github.com/mozilla-mobile/fenix/issues/19664 19664] - [Bug] The tab menu cannot be dismissed on Android 5 devices | |||
* [https://github.com/mozilla-mobile/fenix/issues/19667 19667] - [Bug] Unable to sign in via scanning the QR code on Samsung Galaxy Tab A6 (Android 5.1.1) | |||
* [https://github.com/mozilla-mobile/fenix/issues/18896 18896] - [Bug] The new page menu cannot be scrolled entirely in portrait mode on Android 5.1.1 devices | |||
* [https://github.com/mozilla-mobile/fenix/issues/13123 13123] - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar | |||
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices | |||
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color | |||
* [https://github.com/mozilla-mobile/fenix/issues/8761 8761] - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix | |||
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA | |||
* [https://github.com/mozilla-mobile/fenix/issues/20280 20280] - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode | |||
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode | |||
* [https://github.com/mozilla-mobile/fenix/issues/12854 12854] - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs | |||
* [https://github.com/mozilla-mobile/fenix/issues/21414 21414] - [Bug]: Add logins dialog: save button is enabled when password field is blank | |||
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x" | |||
* [https://github.com/mozilla-mobile/fenix/issues/21467 21467] - [Bug] Language name missing after switching to a different language on Android 5 | |||
* [https://github.com/mozilla-mobile/fenix/issues/21168 21168] - [Bug]: "Recently closed" button isn't displayed in tabs tray after closing some open pages |
Latest revision as of 13:04, 11 October 2021
« Fenix 93.1.0 RC | Fenix 94.0.0 Beta 1 | Fenix 94.0.0 Beta 2
Firefox 94.0.0 Beta 1 Test Plan
- Release date: October 6th, 2021
- QA Contact: Oana Horvath; Sorina Florean; SV QA team
- Slack: SV Mobile QA Team
- Build: Firefox 94.0.0 Beta 1
- TestRail test plan: Test Plan
Full Functional & UI tests
QA Task | Person/Group |
Softvision | Alternating |
QA Assignment
Assigned | Build type | Device | Completed | Results |
---|---|---|---|---|
Laurentiu Apahidean | ARM | Huawei MediaPad M3 (Android 7) | October 7th, 2021 | Pass |
Bodea Andrei | ARM | Google Pixel 4 XL (Android 11) | October 7th, 2021 | Pass |
Andrei Jolțan | ARM | OnePlus A3 (Android 6.0.1) | October 7th, 2021 | Pass |
Mira Lobonțiu | ARM | Samsung Galaxy Tab A6 (Android 5.1.1) | October 7th, 2021 | Pass |
Oana Horvath | ARM | Huawei P9 Lite (Android 8) | October 7th, 2021 | Pass |
Lorand Janos | ARM | Samsung Galaxy Tab S3 (Android 9) | October 7th, 2021 | Pass |
Full Functional and UI Tests
Tablets
Phones
Telemetry
Bug verification
All | October 6th, 2021 | In progress |
- 21239 - Add telemetry for Allow users to customize their home screen - ✅ Verified as fixed
- 21671 - Do not display Recently Closed under Inactive tabs - ✅ Verified as fixed
- 21565 - FNXV2-17823 - Contextual message for Inactive tabs - ✅ Verified as fixed
- 21642 - Do not display Media tab under Jump Back In - ✅ Verified as fixed
- 21708 - Missing lower gray border for inactive tabs - ✅ Verified as fixed
- 21621 - Pocket stories horizontal shadows are clipped - ✅ Verified as fixed
- 21599 - Pocket recommended stories: Add UTM links for opened Pocket recommendations - ✅ Verified as fixed
- 21582 - Thumbnail images on Jump Back In do not persist after closing/reopening Fenix - ✅ Verified as fixed
- 16437 - Unnecessary space in site permission exceptions - ✅ Verified as fixed
- 21313 - [Telemetry] Renew/delete probes for Nov/Dec - ✅ Verified as fixed
- 21174 - inconsistent shadow on Recently Saved first tile - ✅ Verified as fixed
Issues
New issues
Major:
Other:
- 21763 - [Bug]: Inconsistent tabs setting displayed in Settings
- 21736 - The "Jump back in" Contextual Hint is not displayed.
- 21739 - [Bug]: The onboarding dialog keeps showing up if the "Start browsing" (from the onboarding dialog) isn't tapped
- 21768 - [Bug]: The info panel doesn't always display the ETP details on some social media websites
- 21770 - [Bug]: The Inactive tabs area is scrollable entirely
- 21771 - [Bug]: “Jump back in” cards created by non-Google searches do not have titles
- 21767 - [Bug]: The application crashes when being idle on a certain website
Known issues
Major:
Other:
- 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
- 14939 - [Bug]White "Run in private browsing" icon
- 12661 - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
- 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
- 15627 - [Bug] Tomato Clock "Stats" are opened in the background
- 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
- 17716 - [Bug] can not donwload images from Pixiv anymore
- 20848 - Downloaded items can be deleted individually in multiselect mode
- 21162 - [Bug]: The app crashes when returning to the edit bookmarks menu after changing device settings
- 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
- 5298 - [Bug] The same page appears in the History section multiple times
- 17523 - [Bug] The Recently closed tabs counter is not updated before opening the list
- 8456 - [Bug] distorted audio while playing video at higher speed
- 5133 - Bug] Phone goes to sleep while audio is playing
- 9748 - Streaming downloadable media does not have media notification
- 7907 - ETP doesn't work on a quick first load on first run
- 13389 - FNX-14569 ⁃ [Bug] Private browsing homescreen displayed when tapping "View" after creating a collection from tabs tray
- 4178 - Bug] Sharing multiple tabs to another browser, only opens 1 tab
- 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
- 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
- 20391 - [Bug]: Empty collection can be created
- 16685 - Bug]Tab selection checkmark disappears after background/resume
- 16114 - [Bug] The Firefox logo is covered when toolbar is set to the top and there is a link in clipboard
- 13833 - [Bug] The opened tabs / bookmarks suggestions are displayed at the bottom of the search screen
- 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
- 7866 - [Bug] Custom search engines do not provide search suggestions
- 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
- 17431 - [Bug] Some strings provide search suggestions
- 16152 - [Grid View] Tab titles should have dark background for dark theme
- 20812 - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
- 20811 - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
- 14290 - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
- 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
- 16602 - [Bug] Fenix thinks that its reader mode is insecure
- 9713 - [Bug] Find in page finds something even after erasing query
- 8545 - [Bug] Home screen scrolls when it doesn't need to
- 20833 - [Bug]: Little black bar at bottom of home screen
- 18897 - [Bug] Dynamic toolbar isn't working on yr.no timetable
- 7230 - [Bug] Option to open external links with private Firefox missing in the new version
- 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
- 19664 - [Bug] The tab menu cannot be dismissed on Android 5 devices
- 19667 - [Bug] Unable to sign in via scanning the QR code on Samsung Galaxy Tab A6 (Android 5.1.1)
- 18896 - [Bug] The new page menu cannot be scrolled entirely in portrait mode on Android 5.1.1 devices
- 13123 - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
- 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
- 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
- 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
- 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
- 20280 - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
- 9910 - Display video in full-screen when returning from PiP mode
- 12854 - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
- 21414 - [Bug]: Add logins dialog: save button is enabled when password field is blank
- 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
- 21467 - [Bug] Language name missing after switching to a different language on Android 5
- 21168 - [Bug]: "Recently closed" button isn't displayed in tabs tray after closing some open pages