Releases/Firefox 40/Test Plan/Beta/7: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "<small> « Firefox 40 Beta 6 | Firefox 40 Beta 7 | Releases/Firefox 40/Test Plan/Beta/...")
 
No edit summary
Line 5: Line 5:
* QA Contacts: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida]
* QA Contacts: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida]
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
* Build 1: [https://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/40.0b7-candidates/build1/ Firefox 40 Beta 7 build 1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/ changeset] | (ID: TBA)
* Build 1: [https://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/40.0b7-candidates/build1/ Firefox 40 Beta 7 build 1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/5657e76d4ee5 changeset] | (ID: 20150723165742)


== QE recommendation regarding the quality of the build ==
== QE recommendation regarding the quality of the build ==
Line 11: Line 11:
{| class="wikitable" width=50%
{| class="wikitable" width=50%
  ! Recommendation based on results from manual testing
  ! Recommendation based on results from manual testing
  | style="background:#FFA500; text-align:center;" | '''TBA'''
  | style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
|}
|}


Line 26: Line 26:
  | class="header" style="width:20%; text-align:center;" | Results: [https://docs.google.com/spreadsheets/d/1ZGOcdnEVy8RC1OPf2YPzKNPY3Df9lLmrdKarwjPcbFA/edit#gid=331256753 report]
  | class="header" style="width:20%; text-align:center;" | Results: [https://docs.google.com/spreadsheets/d/1ZGOcdnEVy8RC1OPf2YPzKNPY3Df9lLmrdKarwjPcbFA/edit#gid=331256753 report]
  |-
  |-
  | Windows XP (Graphics: )
  | Windows XP (Graphics: Intel HD Graphics 2500)
  | Camelia Badau
  | Camelia Badau
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{done|}}
  |-
  |-
  | Windows 10 x64 (Graphics: )
  | Windows 7 x64 (Graphics: Intel HD Graphics 2500)
  | Petruta Rasa
  | Petruta Rasa
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{done|}}
  |-
  |-
  | Mac OS X 10.9.5 (Graphics: )
  | Mac OS X 10.9.5 (Graphics: Intel Iris Pro 1024 MB)
  | Catalin Varga
  | Catalin Varga
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{done|}}
  |-
  |-
  | Ubuntu 14.04 x64 (Graphics: )
  | Ubuntu 14.04 x64 (Graphics: ATI Radeon 3000)
  | Vasilica Mihasca
  | Vasilica Mihasca
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{done|}}
  |}
  |}


Line 52: Line 52:
  | BROWSER CUSTOMIZATION
  | BROWSER CUSTOMIZATION
  | Regression Testing
  | Regression Testing
  | style="background:#FFA500; text-align:center;" | tba
  | style="background:#9D9; text-align:center;" | PASS
  |-
  |-
  | SEARCH
  | SEARCH
  | Regression Testing
  | Regression Testing
  | style="background:#FFA500; text-align:center;" | tba
| style="background:#9D9; text-align:center;" | PASS
|-
| BREAKPAD
| Regression Testing
| style="background:#9D9; text-align:center;" | PASS
|-
| PDF COMPATIBILITY
| Regression Testing
  | style="background:#FFA500; text-align:center;" | CONDITIONAL PASS
  |-
  |-
  |}
  |}
Line 109: Line 117:
  | [https://bugzilla.mozilla.org/show_bug.cgi?id=1115340 Hello - Context]
  | [https://bugzilla.mozilla.org/show_bug.cgi?id=1115340 Hello - Context]
  | Bogdan Maris
  | Bogdan Maris
  | {{mrisk}}  
  | {{mok}}  
  | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40
  | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40
  | -
  | -
Line 127: Line 135:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"1187306",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 136: Line 144:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"1186842",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 144: Line 152:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"972658,1008178,1113580,1144722,1154298,1175902,1175917,1177382,1179739,1181059,1181060,1182473",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 153: Line 161:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"1165321,1173725,1173728,1173740,1177237,1181554,1184737,1184974,1185958",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}

Revision as of 13:39, 24 July 2015

«  Firefox 40 Beta 6 | Firefox 40 Beta 7 | Firefox 40 Beta 8  »

Firefox 40 Beta 7 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows XP (Graphics: Intel HD Graphics 2500) Camelia Badau [DONE]
Windows 7 x64 (Graphics: Intel HD Graphics 2500) Petruta Rasa [DONE]
Mac OS X 10.9.5 (Graphics: Intel Iris Pro 1024 MB) Catalin Varga [DONE]
Ubuntu 14.04 x64 (Graphics: ATI Radeon 3000) Vasilica Mihasca [DONE]

AREAS TESTED

Tested Area Testing Type Results
BROWSER CUSTOMIZATION Regression Testing PASS
SEARCH Regression Testing PASS
BREAKPAD Regression Testing PASS
PDF COMPATIBILITY Regression Testing CONDITIONAL PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [ON TRACK] Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 -
First Run for 40 release Catalin Varga [NOT STARTED] New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 -
Suggested tiles: Sponsored Cornel Ionce [ON TRACK] Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 Test Plan
New Add-on Signing Vasilica Mihasca DROPPED FROM 40 Feature dropped from Firefox 39 & 40 (not enough add-ons signed) -
Unified telemetry/FHR Stuart Philp DROPPED FROM 40 Testing performed is tracked in bug 1169037 -
OMTC by default on Linux Alexandra Lucinet [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Hello - Context Bogdan Maris [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Windows 10 support Andrei Vaida / Cornel Ionce [AT RISK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -

Results

New bugs

Full Query
ID Summary Status Resolution
1187306 [Windows 10] Taskbar context menu items not working when installed without Start Menu shortcut RESOLVED INCOMPLETE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1186842 Unresponsive keyboard buttons using a PDF file VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
972658 Undo 'restore defaults' does not restore toolbar visibility (bookmarks / menu toolbar ) NEW
1008178 Intermittently, mouse-over on personas doesn't preview the themes RESOLVED INACTIVE
1113580 On Mac Crash Reporter is out of focus RESOLVED DUPLICATE
1144722 Hello button cannot be positioned at the top of Menu panel RESOLVED INCOMPLETE
1154298 Crashes on Windows XP link to about/throttling by default RESOLVED FIXED
1175902 Empty screenshot box should be hidden in about:addons VERIFIED FIXED
1175917 ”Check for updates” link from add-on details tab does not return any message for an up to date add-on NEW
1177382 Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar RESOLVED FIXED
1179739 Errors are thrown in the Browser Console each time the user enters Customize RESOLVED DUPLICATE
1181059 Intermittently, theme preview remains blocked RESOLVED WORKSFORME
1181060 Themes 2row titles are overlapped by the "+ Add" button on hover VERIFIED FIXED
1182473 "None" word should be removed from theme details tab in about:addons RESOLVED INACTIVE

12 Total; 2 Open (16.67%); 8 Resolved (66.67%); 2 Verified (16.67%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1165321 Do not open a new window when the Firefox icon is clicked on the taskbar/start menu/start screen while Firefox is in windows 10 tablet mode VERIFIED FIXED
1173725 Title bar and tab strip should have a darker background color on Windows 10 VERIFIED FIXED
1173728 Remove border between tab strip and the navigation toolbar on Windows 10 VERIFIED FIXED
1173740 Update switch-to-tab icon for the URL bar autocomplete popup on Windows 8 and 10 VERIFIED FIXED
1177237 Implement OS query parsing and user search choice VERIFIED FIXED
1181554 [HiDPI] box-shadow rendered unevenly at uneven scaling factors, e.g. 150%, 250% VERIFIED FIXED
1184737 Windows 10 search rewrite should handle more results VERIFIED FIXED
1184974 The submissionURL should not be recorded for packed add-ons in the profile VERIFIED FIXED
1185958 Windows 10: Only show box-shadow of location bar and search field on focus VERIFIED FIXED

9 Total; 0 Open (0%); 0 Resolved (0%); 9 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://dev.wikimo.nonprod.webservices.mozgcp.net/index.php?title=Releases/Firefox_40/Test_Plan/Beta/7&oldid=1086513"