Releases/Firefox 67/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "= Summary = This page is to track testing of Firefox 67 from mozilla-central (Nightly) through to mozilla-release. This is intended to be a minimal set of information to help...")
 
 
(99 intermediate revisions by 19 users not shown)
Line 60: Line 60:


; End of cycle status
; End of cycle status
* Total bugs filed affecting 66: tbd
* Total bugs filed affecting 67: tbd
* Bugs fixed / verified on 66: tbd / tbd
* Bugs fixed / verified on 67: tbd / tbd
* Conditional signoff for merge: <date>, <person> (email sent to release-drivers at <time>)
* Conditional signoff for merge: <date>, <person> (email sent to release-drivers at <time>)
* QE signoff: N/A
* QE signoff: N/A
Line 68: Line 68:
During the Beta cycle, there are several beta releases. Communication with the release coordination, release engineering, and automation teams is key.  
During the Beta cycle, there are several beta releases. Communication with the release coordination, release engineering, and automation teams is key.  


While Firefox 66 is on the Beta channel, QA will mainly focus on:
While Firefox 67 is on the Beta channel, QA will mainly focus on:
* Signing off each Beta build prior to being pushed to the beta channel - RelQA
* Signing off each Beta build prior to being pushed to the beta channel - RelQA
* [https://docs.google.com/spreadsheets/d/1vPyFxPmnQt5YZThJlFaeyriLkeXU6sE6jgEHgAryUbo/edit#gid=0 Feature Testing] - RelQA team
* [https://docs.google.com/spreadsheets/d/1J83OlNavefkzcOiy79iVDh6FrHQkpRFejRZ9u76lIVk/edit#gid=0 Feature Testing] - RelQA team
** Focus is on fixes that land in Beta, and Regression and Smoke testing
** Focus is on fixes that land in Beta, and Regression and Smoke testing
* Regular validation of DevEdition builds - about once every two weeks
* Regular validation of DevEdition builds - about once every two weeks
Line 111: Line 111:
''This section tracks bugs representing the most urgent stability issues. [[QA/Desktop_Firefox/Walkthroughs/Stability|Consult this wiki]] for more information.''
''This section tracks bugs representing the most urgent stability issues. [[QA/Desktop_Firefox/Walkthroughs/Stability|Consult this wiki]] for more information.''
* Ensure new and explosive crashes have actionable bug reports which are in progress
* Ensure new and explosive crashes have actionable bug reports which are in progress
* [https://crash-stats.mozilla.com/topcrashers/?product=Firefox&version=66.0a1&days=7 Top Crashes] - ensure the highest ranked crashes have actionable bug reports which are in progress
* [https://crash-stats.mozilla.com/topcrashers/?product=Firefox&version=67.0a1 Top Crashes] - ensure the highest ranked crashes have actionable bug reports which are in progress
* [https://bugzilla.mozilla.org/buglist.cgi?f1=keywords&o1=anywordssubstr&query_format=advanced&bug_status=UNCONFIRMED&v1=crash&component=Untriaged Untriaged Bugs] - ensure bugs are actionable and in the correct component
* [https://bugzilla.mozilla.org/buglist.cgi?f1=keywords&o1=anywordssubstr&query_format=advanced&bug_status=UNCONFIRMED&v1=crash&component=Untriaged Untriaged Bugs] - ensure bugs are actionable and in the correct component
* [https://bugzilla.mozilla.org/buglist.cgi?j_top=OR&keywords=topcrash-win%2C%20topcrash-mac%2C%20topcrash-linux%2C%20topcrash-plugin%2C%20&keywords_type=anywords&f1=cf_status_firefox66&list_id=14453385&o1=nowordssubstr&o2=anyexact&query_format=advanced&f2=target_milestone&v1=---%20unaffected%20verified%20wontfix&v2=Firefox%2066%2Cmozilla66 topcrash bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?j_top=OR&keywords=topcrash-win%2C%20topcrash-mac%2C%20topcrash-linux%2C%20topcrash-plugin%2C%20&keywords_type=anywords&list_id=14612785&o1=nowordssubstr&o2=anyexact&v1=---%20unaffected%20verified%20wontfix&v2=Firefox%2067%2Cmozilla67&f1=cf_status_firefox67&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&f2=target_milestone topcrash bugs]


=== Unconfirmed Bug Triage ===
=== Unconfirmed Bug Triage ===
Line 125: Line 125:
Queries:
Queries:
* All Unconfirmed Bugs
* All Unconfirmed Bugs
** https://bugzilla.mozilla.org/buglist.cgi?list_id=14453324&query_format=advanced&bug_status=UNCONFIRMED&version=66%20Branch
** https://bugzilla.mozilla.org/buglist.cgi?list_id=14612788&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&bug_status=UNCONFIRMED&version=67%20Branch
* Unchanged Since One Week
* Unchanged Since One Week
** These bugs may need extra attention.
** These bugs may need extra attention.
** https://bugzilla.mozilla.org/buglist.cgi?list_id=14453327&chfieldto=-1w&query_format=advanced&bug_status=UNCONFIRMED&version=66%20Branch
** https://bugzilla.mozilla.org/buglist.cgi?list_id=14612831&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&chfieldto=-1w&query_format=advanced&bug_status=UNCONFIRMED&version=67%20Branch
* Unchanged Since One Month
* Unchanged Since One Month
** These are likely to be confusing or non-reproducible issues. '''We should make decisions to either close these or tag these non-actionable, and filter them out'''
** These are likely to be confusing or non-reproducible issues. '''We should make decisions to either close these or tag these non-actionable, and filter them out'''
** https://bugzilla.mozilla.org/buglist.cgi?list_id=14453331&chfieldto=-1m&query_format=advanced&bug_status=UNCONFIRMED&version=66%20Branch
** https://bugzilla.mozilla.org/buglist.cgi?list_id=14612833&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&chfieldto=-1m&query_format=advanced&bug_status=UNCONFIRMED&version=67%20Branch


=== Verification Needed Bugs ===
=== Verification Needed Bugs ===
Line 151: Line 151:
Queries:
Queries:
* Dashboard showing current active iteration: https://crash-analysis.mozilla.com/rkaiser/crash-report-tools/qa/
* Dashboard showing current active iteration: https://crash-analysis.mozilla.com/rkaiser/crash-report-tools/qa/
* Iteration 66.1, all bugs: https://bugzilla.mozilla.org/buglist.cgi?f1=OP&j1=OR&f2=cf_fx_iteration&o2=substring&v2=66.1&f3=status_whiteboard&o3=substring&v3=s%3D66.1&f4=CP
* Iteration 67.1, all bugs: https://bugzilla.mozilla.org/buglist.cgi?f1=OP&o3=substring&list_id=14612838&v3=s%3D67.1&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&o2=substring&f4=CP&query_format=advanced&j1=OR&f3=status_whiteboard&f2=cf_fx_iteration&v2=67.1
* Iteration 66.2, all bugs: https://bugzilla.mozilla.org/buglist.cgi?f1=OP&j1=OR&f2=cf_fx_iteration&o2=substring&v2=66.2&f3=status_whiteboard&o3=substring&v3=s%3D66.2&f4=CP
* Iteration 67.2, all bugs: https://bugzilla.mozilla.org/buglist.cgi?f1=OP&o3=substring&list_id=14612842&v3=s%3D67.2&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&o2=substring&f4=CP&query_format=advanced&j1=OR&f3=status_whiteboard&f2=cf_fx_iteration&v2=67.2
* Iteration 66.3, all bugs: https://bugzilla.mozilla.org/buglist.cgi?f1=OP&j1=OR&f2=cf_fx_iteration&o2=substring&v2=66.3&f3=status_whiteboard&o3=substring&v3=s%3D66.3&f4=CP
* Iteration 67.3, all bugs: https://bugzilla.mozilla.org/buglist.cgi?list_id=14612848&o2=substring&v2=67.3&f1=OP&o3=substring&v3=s%3D67.3&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&f4=CP&query_format=advanced&j1=OR&f3=status_whiteboard&f2=cf_fx_iteration


= Feature status =
= Feature status =
Line 172: Line 172:
  ! width="200" | TEST REPORT
  ! width="200" | TEST REPORT
  |-
  |-
  | style="text-align:center;" | 2018-12-20
  | style="text-align:center;" | 2019-02-07
  | style="background:green; color: white;" | GREEN
  | style="background:green; color: white;" | GREEN
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1515332%2C1515289&list_id=14609242 2 new bugs] uncovered, low-impact.
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1525599%2C1525607%2C1512047&list_id=14613020 3 new bugs] uncovered, low-impact.
* Known (old) bugs are low-impact.
* Known (old) bugs are low-impact.
  | style="text-align: center;" | ---
  | style="text-align: center;" | ---
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=558178%2C%201476585%2C%201465445%2C%201393460%2C%201511869%2C%201511999%2C%201396732%2C%201441881%2C%201443511%2C%201194214%2C%201471233%2C1481496%2C%201360545%2C%201378105%2C%201354992%2C1494258%2C%201476591%2C%201445644%2C%201282075%2C%201503603%2C1449956%2C%201490833%2C%201494270%2C1352397%2C1473904%2C%201512428%2C1482918&bug_id_type=anyexact&query_format=advanced&list_id=14482784 Bugzilla link]
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1511869%201503603%201481496%201360545%201449956%201445644%201354992%201494258%201494270%201462283%201518802%201515289%201511999%201396732%201441881%201443511%201194214%201282075%20558178%201393460%201465445%201476585&list_id=14613022 Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1338 TestRail link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1427 TestRail link]
  |-
  |-
  | style="text-align:center;" | 2019-01-10
  | style="text-align:center;" | 2019-02-21
  | style="background:green; color: white;" | GREEN
  | style="background:green; color: white;" | GREEN
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1518802%2C1518473&list_id=14609244 2 new bugs] uncovered, low-impact.
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1528958%2C1529216&list_id=14613024 2 new bugs] uncovered, low-impact.
* Known (old) bugs are low-impact.
* Known (old) bugs are low-impact.
  | style="text-align: center;" | ---
  | style="text-align: center;" | ---
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201511869%2C%201393460%2C%201465445%2C%20558178%2C%201476585%2C%201360545%2C%201378105%2C%201354992%2C%201392028%2C%201328984%2C%201288773%2C1515332%2C%201471233%2C%201511999%2C%201396732%2C%201441881%2C%201443511%2C%201194214%2C%201481496%2C%201494258%2C1185974%2C1494270%2C%20478200%2C%201430114%2C1429084%2C1485135%2C%201490833%2C%20169132%2C%201454005%2C%20%2C1308007%2C&bug_id_type=anyexact&query_format=advanced&list_id=14505852 Bugzilla link]
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1288773%2C%201308007%2C%201328984%2C%201392028%2C%201430114%2C%20478200%2C%201524640%2C%201494270%2C%201354992%2C%201449956%2C%201360545%2C%201481496%2C%201511869%2C%201503603%2C%201465445%2C%201282075%2C%201515332%2C%201515289%2C%201476585%2C%20558178%2C%201194214%2C%201525607%2C%201525585%2C%201393460%2C%201518802%2C%201471233%2C%201511999%2C%201396732%2C%201441881%2C%201443511%2C%201370743%2C%201494298%2C%201429084%2C%201485135%2C%201494258%2C%20169132&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14613026 Bugzilla link]
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1355 TestRail link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1455 TestRail link]
|-
| style="text-align:center;" | 2019-01-23
| style="background:green; color: white;" | GREEN
| style="text-align: left;" |
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1522099%2C1521865&list_id=14609247  2 new bugs] uncovered, low-impact.
* Known (old) bugs are low-impact.
| style="text-align: center;" | ---
| style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515332%2C%201515289%2C%201282075%2C%201194214%2C%20558178%2C%201393460%2C%201465445%2C%201476585%2C%201511869%2C%201518802%2C%201471233%2C%201511999%2C%201396732%2C%201441881%2C%201443511%2C%201481496%2C%201360545%2C%201449956%2C%201354992%2C%201494258%2C%201185974%2C%201494270%2C%201499557%2C%201499805%2C%201481755%2C%201470409%2C%201358102%2C%201470409%2C%201358102%2C%201470152%2C%201251982%2C%201204241%2C%201470152&bug_id_type=anyexact&list_id=14526616&resolution=---&query_format=advanced Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1410 TestRail link]
  |-
  |-
|}
|}
Line 221: Line 212:
! style="text-align: center;" width=400 | Known (old)
! style="text-align: center;" width=400 | Known (old)
|-
|-
| style="text-align: center;" | 66.0b1-build1
| style="text-align: center;" | 67.0b1-build1
| style="text-align: center; background: green; color:white" | GREEN
| style="text-align: center; background: green; color:white" | GREEN
|  
|  
* Two new issue uncovered during testing {{bug|1521711}} {{bug|1521769}}
* Two new issue uncovered during testing {{bug|1534622}}
* Known issues are low impact.
* Known issues are low impact.
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/14878 TestRail link]
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/16020 TestRail link]
| style="text-align: left;" |  
| style="text-align: left;" |  
* Regressions: {{bug|1521769}}
* Regressions: {{bug|1534622}}
* Non-regressions: {{bug|1521711}}
* Non-regressions: none
| style="text-align: left;" |  
| style="text-align: left;" |  
* High-impact: none
* High-impact: none
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1176218+1194214+1282075+1360545+1378105+1491256+1497835+1504197+1515289 list]
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=974971%201194214%201282075%201360545%201378105%201427280%201445644%201491256%201497835%201504197%201513239%201515289%201521769%201526271&list_id=14609449 list]
|-
|-
| style="text-align: center;" | 66.0b2-build1
| style="text-align: center;" | 67.0b2-build1
| style="text-align: center; background: green; color:white" | GREEN
| style="text-align: center; background: green; color:white" | GREEN
|  
|  
* One new issue uncovered during testing {{bug|1522805}}
* One new issue uncovered during testing {{bug|}}
* Known issues are low impact.
* Known issues are low impact.
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/14937 TestRail link]
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/ TestRail link]
| style="text-align: left;" |  
| style="text-align: left;" |  
* Regressions: {{bug|1522805}}
* Regressions:  
* Non-regressions: none
* Non-regressions:
| style="text-align: left;" |  
| style="text-align: left;" |  
* High-impact: none
* High-impact: none
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1037792+1194214+1373830+1441881+1446411 list]
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi list]
|-
|-
| style="text-align: center;" | 66.0b6-build1
| style="text-align: center;" | 67.0b5-build1
| style="text-align: center; background: green; color:white" | GREEN
| style="text-align: center; background: green; color:white" | GREEN
|  
|  
* No new issues uncovered during testing.
* No new issues uncovered during testing.
* Known issues are low impact.
* Known issues are low impact.
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/15280 TestRail link]
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/16450 TestRail link]
| style="text-align: left;" |  
| style="text-align: left;" |  
* Regressions: none
* Regressions: none
Line 258: Line 249:
| style="text-align: left;" |  
| style="text-align: left;" |  
* High-impact: none
* High-impact: none
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=428378%20558178%201009132%201194214%201230678%201305744%201306590%201309534%201319761%201393460%201407718%201411533%201429065%201441128%201451402%201457858%201458470%201463062%201503603%201512599%201518816%201525850&list_id=14564670 list]
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=428378%201009132%201194214%201393460%201407718%201411533%201429065%201458471%201463062%201476569%201476585%201490614%201491256%201503603%201529882%201539098&list_id=14636238 list]
|-
|-
| style="text-align: center;" | 66.0b10-build1
| style="text-align: center;" | 67.0b9-build1
| style="text-align: center; background: green; color:white" | GREEN
| style="text-align: center; background: green; color:white" | GREEN
|  
|  
* One new issues uncovered during testing {{bug|1530288}}, but not a blocker.
* One new issue uncovered during testing {{bug|1543386}}
* Known issues are low impact.
* Known issues are low impact.
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/15592 TestRail link]
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/16816 TestRail link]
| style="text-align: left;" |  
| style="text-align: left;" |  
* Regressions: {{bug|1530288}}
* Regressions: none
* Non-regressions: none
* Non-regressions: none
| style="text-align: left;" |  
| style="text-align: left;" |  
* High-impact: none
* High-impact:  
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=428378%20558178%201009132%201194214%201305744%201306561%201306590%201309534%201393460%201407718%201411533%201429065%201441128%201441690%201457858%201458470%201458471%201460032%201463062%201469200%201470154%201470419%201472094%201476569%201476585%201490614%201491256%201494254%201498112%201502093%201503603%201506137%201512599%201512619%201518788%201528958%201529882%201529903&list_id=14583851 list]
* Low-impact: [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=428378%201009132%201194214%201306561%201393460%201407718%201463062%201476569%201476585%201490614%201539401%201539443&list_id=14660586 list]
|-
|}
|}


Line 280: Line 270:
=== Beta 3 ===
=== Beta 3 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b3-candidates/build1/ 66.0b3-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/0aee0dd24221 0aee0dd24221] | (ID: 20190128143734)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b3-candidates/build1/ 67.0b3-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/018abdd16060 018abdd16060] | (ID: 20190318154932)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/3 Firefox 66 Beta 3]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/3 Firefox 67 Beta 3]
** 66.0b3-build1
** 67.0b3-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: File system interaction, Toolbars & window controls and Image compatibility & support.
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Graphics compatibility & support, Download manager & Build installation & uninstallation.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/14959 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/14959 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1lS20btfn6n1g3gB9bloDPmVpUv8xUqa8EvvnH9pzmwc/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1KIOUTNr-pWz2HeDZINEPppJe4BTAc8C6awC6UD4VU9U/edit# report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1lS20btfn6n1g3gB9bloDPmVpUv8xUqa8EvvnH9pzmwc/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1KIOUTNr-pWz2HeDZINEPppJe4BTAc8C6awC6UD4VU9U/edit# report]


=== Beta 4 ===
=== Beta 4 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b4-candidates/build1/ 66.0b4-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/a4da2c3de38f a4da2c3de38f] | (ID: 20190131191227)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b4-candidates/build2/ 67.0b4-build2] | [https://hg.mozilla.org/releases/mozilla-beta/rev/77536919b121 77536919b121] | (ID: 20190321164326)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/4 Firefox 66 Beta 4]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/4 Firefox 67 Beta 4]
** 66.0b4-build1
** 67.0b4-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Session restore and Content scroll, zoom & drag support.
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Awesomebar & indicators and Profile support & compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15003 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16337 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1p5m6Axe-15qpqVVFSxCtd5W6cn3xsJR9-MUh2oD8DiI/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://drive.google.com/open?id=1piRaxlQpDV0FPHFtSJvh44r0XU17gBsho2awWKb7Qds report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1p5m6Axe-15qpqVVFSxCtd5W6cn3xsJR9-MUh2oD8DiI/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://drive.google.com/open?id=1piRaxlQpDV0FPHFtSJvh44r0XU17gBsho2awWKb7Qds report]


=== Beta 5 ===
=== Beta 5 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b5-candidates/build1/ 66.0b5-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/02146faf5ac1 02146faf5ac1] | (ID: 20190204181317)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b5-candidates/build1/ 67.0b5-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728 a89261364728] | (ID: 20190325125126)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/5 Firefox 66 Beta 5]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/5 Firefox 67 Beta 5]
** 66.0b5-build1
** 67.0b5-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Data migration, Geolocation & Crash reporting.
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Media playback & support and Printing.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15168 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16395 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1eBzmMT0dFZfDZhGhCvogrFMR50ueLVcaAKPtRG3SogQ/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1hPna90IGnQCaSeBTCQlKJdD4b0a868wEhu7hM9ugxTk/edit# report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1eBzmMT0dFZfDZhGhCvogrFMR50ueLVcaAKPtRG3SogQ/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1hPna90IGnQCaSeBTCQlKJdD4b0a868wEhu7hM9ugxTk/edit# report]


=== Beta 6 ===
=== Beta 6 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b6-candidates/build1/ 66.0b6-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/a9f6e3381fb3 a9f6e3381fb3] | (ID: 20190207161357)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b6-candidates/build1/ 67.0b6-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/https://hg.mozilla.org/releases/mozilla-beta/rev/0b745b93a430983cdcd6c748e6e2098d012e1969 0b745b93a430983cdcd6c748e6e2098d012e1969] | (ID: 20190328152334)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/6 Firefox 66 Beta 6]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/6 Firefox 67 Beta 6]
** 66.0b6-build1
** 67.0b6-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Media playback & support, Download manager and Default & custom theme support.
*** {{mdone|}} Smoke and Exploratory Testing with focus on: WebExtensions compatibility & support, Content scroll, zoom & drag support and In-Browser PDF support.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15248 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16493 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1qY9-jfAggdIK5xbvhAK7fVX5renRgJEKXfIAumnvPFY/edit?usp=sharing report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1C3b12eHnlHdiRLVmzxyKvCWAKlvqZgNEOLN5BGCOe0o/edit?usp=sharing report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1qY9-jfAggdIK5xbvhAK7fVX5renRgJEKXfIAumnvPFY/edit?usp=sharing report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1C3b12eHnlHdiRLVmzxyKvCWAKlvqZgNEOLN5BGCOe0o/edit?usp=sharing report]


=== Beta 7 ===
=== Beta 7 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b7-candidates/build1/ 66.0b7-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/d9a3fc93437f d9a3fc93437f] | (ID: 20190211185957)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b7-candidates/build1/ 67.0b7-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/13d26dc811fe 13d26dc811fe] | (ID: 20190331141835)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/7 Firefox 66 Beta 7]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/7 Firefox 67 Beta 7]
** 66.0b7-build1
** 67.0b7-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Safe browsing, Awesomebar & indicators and In-browser PDF support.  
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Smart Card, Bookmarks, Toolbars & window controls, Anti-Tracking.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15307 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16563 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1ALnRLKPoiBa2p889aba_AsH6HE4nrQFDQ1GWjeunRME/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1etcHKWnR3_araUGxjyN3sg1pqsEtBIWiLlW2B36WYDE/edit report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1ALnRLKPoiBa2p889aba_AsH6HE4nrQFDQ1GWjeunRME/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1etcHKWnR3_araUGxjyN3sg1pqsEtBIWiLlW2B36WYDE/edit report]


=== Beta 8 ===
=== Beta 8 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b8-candidates/build1/ 66.0b8-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/bf56566e9cdb bf56566e9cdb] | (ID: 20190214195736)
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/67.0b8-candidates/build2/ 67.0b8-build2] | [https://hg.mozilla.org/releases/mozilla-beta/rev/13b7d4d4df59f7f2e50f66644daf655bad40bec8 13b7d4d4df59f7f2e50f66644daf655bad40bec8] | (ID: 20190404040123)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/8 Firefox 66 Beta 8]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/8 Firefox 67 Beta 8]
** 66.0b8-build1
** 67.0b8-build2
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Privacy, Bookmarks, Content scroll, zoom & drag support.  
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Media playback & support and Image compatibility & support.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15389 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16710 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1xpRrUOQ8GLtwCQHq0jrsUdsDEkY0dGgv8NXJXlS1DI4/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://drive.google.com/open?id=1iFqiGfjiiO6Wxx4Lw5zB_qhBiBF7eibDva71VAvOvt4 report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1xpRrUOQ8GLtwCQHq0jrsUdsDEkY0dGgv8NXJXlS1DI4/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://drive.google.com/open?id=1iFqiGfjiiO6Wxx4Lw5zB_qhBiBF7eibDva71VAvOvt4  report]


=== Beta 9 ===
=== Beta 9 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b9-candidates/build1/ 66.0b9-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/bce0092f646c52d0402531a5b5a860905dfe7ad8 bce0092f646c] | (ID: 20190218131312)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b9-candidates/build1/ 67.0b9-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/b6fdd2540f52de0279a2bd14e7e52736530c987b b6fdd2540f52de0279a2bd14e7e52736530c987b] | (ID: 20190408123043)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/9 Firefox 66 Beta 9]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/9 Firefox 67 Beta 9]
** 66.0b9-build1
** 67.0b9-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Printing, Profile support & compatibility, Image compatibility & support.  
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Search, geolocation and default & custom theme support.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15460 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16770 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1VF00h3imn_replMJ6rsGm8GxBkZpzRK7hsWP8gf7_tA/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1u_vo6-PcMTFX-ES0LH3qImOrHEZyE4ymKfbOGKhHI_U/edit report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1VF00h3imn_replMJ6rsGm8GxBkZpzRK7hsWP8gf7_tA/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1u_vo6-PcMTFX-ES0LH3qImOrHEZyE4ymKfbOGKhHI_U/edit report]


=== Beta 10 ===
=== Beta 10 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b10-candidates/build1/ 66.0b10-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/e0a8013cd9c9723b19427ca24e7202e37822e3ad e0a8013cd9c9] | (ID: 20190221160854)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b10-candidates/build1/ 67.0b10-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/03e1b51654e2 03e1b51654e2] | (ID: 20190411084603)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/10 Firefox 66 Beta 10]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/10 Firefox 67 Beta 10]
** 66.0b10-build1
** 67.0b10-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Activity Stream and History .  
*** {{mdone|}} Smoke and Exploratory Testing with focus on: File system interaction, Data migration and Anti-Tracking (privacy).
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15572 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16857 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1ZiKVzzYA7sA8AgJyfPEwC3ZH7UJ5r_E7f6xErNyehbg/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1PChu3DphouNbq9nXxMudWIqAKpg0w94ioDb-Umirle8/edit# report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1ZiKVzzYA7sA8AgJyfPEwC3ZH7UJ5r_E7f6xErNyehbg/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1PChu3DphouNbq9nXxMudWIqAKpg0w94ioDb-Umirle8/edit#  report]


=== Beta 11 ===
=== Beta 11 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b11-candidates/build1/ 66.0b11-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/b08f44691ec3b9cdfb99bfd1a09c464e0a35785b] | (ID: 20190225143245)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b11-candidates/build1/ 67.0b11-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/3445cafb3544 3445cafb3544] | (ID: 20190415085659)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/11 Firefox 66 Beta 11]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/11 Firefox 67 Beta 11]
** 66.0b11-build1
** 67.0b11-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Graphics compatibility & support, WebExtensions compatibility & support and Anti-Tracking.
*** {{mdone|}} Smoke and Exploratory Testing with focus on: History and Password Manager & Form Autofill
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15647 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16927 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1rrS9nvJyRrJIfA5LwpcZnM4qifpGeJxmtpYMZ8_FA04/edit# report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1cbqqEq9MY2_bMrAfV8SWBSxQq3mtae8YUr4DWwV6RL4/edit report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1rrS9nvJyRrJIfA5LwpcZnM4qifpGeJxmtpYMZ8_FA04/edit# report]
** {{mnotstarted|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1cbqqEq9MY2_bMrAfV8SWBSxQq3mtae8YUr4DWwV6RL4/edit report]
 


=== Beta 12 ===
=== Beta 12 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b12-candidates/build1/ 66.0b12-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/67710331eb1f 67710331eb1f] | (ID: 20190228180200)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b12-candidates/build1/ 67.0b12-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/3445cafb3544 3445cafb3544] | (ID: 20190418160535)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/12 Firefox 66 Beta 12]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/12 Firefox 67 Beta 12]
** 66.0b12-build1
** 67.0b12-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Plug-in compatibility, Smart Cards and Password Manager & Form Autofill.
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Media playback & support, Plugin compatibility & support & Build installation & uninstallation
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15810 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17016 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1pdhpLWG93lZtygJS2ZX341x11uBcPouAPYmgrjxPuM8/edit# report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1u99lFSsfBNp5tnmIS9L2tORjAmVAWwdEf5P3HS4arCw/edit report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1pdhpLWG93lZtygJS2ZX341x11uBcPouAPYmgrjxPuM8/edit# report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1u99lFSsfBNp5tnmIS9L2tORjAmVAWwdEf5P3HS4arCw/edit report]


=== Beta 13 ===
=== Beta 13 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b13-candidates/build1/ 66.0b13-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/42bac7964f74 42bac7964f74] | (ID: 20190304101322)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b13-candidates/build1/ 67.0b13-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/ceb8833f34c3 ceb8833f34c3] | (ID: 20190422163745)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/13 Firefox 66 Beta 13]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/13 Firefox 67 Beta 13]
** 66.0b13-build1
** 67.0b13-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Search, Default & custom theme support.  
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Graphics compatibility & support and Crash reporting.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15857 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17091 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1TmCfARCCdWMimAxDeYKYBDRmN8yqUsyKZc60rFSaJno/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/10K_3OJsjJHB4I8SHpkeRW0dzd84xNgCDAwoiovAHRFY/edit report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1TmCfARCCdWMimAxDeYKYBDRmN8yqUsyKZc60rFSaJno/edit report]
** {{mnotstarted|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/10K_3OJsjJHB4I8SHpkeRW0dzd84xNgCDAwoiovAHRFY/edit report]


=== Beta 14 ===
=== Beta 14 ===
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b14-candidates/build1/ 66.0b14-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/13bfcad39c39 13bfcad39c39] | (ID: 20190307095232)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b14-candidates/build1/ 67.0b14-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/151cf24aa0fe 151cf24aa0fe] | (ID: 20190424140259)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/14 Firefox 67 Beta 14]
** 67.0b14-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Awesomebar & indicators & Profile support & compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17140 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/18JjsAoAvVkJzrgd03951dmNFjUAQ58Lq2L5Z9ReCBDY/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/18JjsAoAvVkJzrgd03951dmNFjUAQ58Lq2L5Z9ReCBDY/edit  report]
 
=== Beta 15 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/67.0b15-candidates/build2/ 67.0b15-build2] | [https://hg.mozilla.org/releases/mozilla-beta/rev/2be09493d405 2be09493d405] | (ID: 20190429125729)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/15 Firefox 67 Beta 15]
** 67.0b15-build2
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Session restore & Safe browsing & Geolocation .
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17140 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1YxOEo2HamycC0ewB2HUyhAs0UGAWX2Jv5Li-H3k2kDU/edit report]
** {{mnotstarted|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1YxOEo2HamycC0ewB2HUyhAs0UGAWX2Jv5Li-H3k2kDU/edit  report]
=== Beta 16 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/67.0b16-candidates/build2/ 67.0b16-build2] | [https://hg.mozilla.org/releases/mozilla-beta/rev/bb9c48a4e71a bb9c48a4e71a] | (ID: 20190502232159)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/16 Firefox 67 Beta 16]
** 67.0b16-build2
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Download manager & In-browser PDF support & Toolbars & window controls & DLL Interceptor .
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17241 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/15weRRX13jYuSLtWFxtFZhYYUZ_ijmvqXbu5vadpkRuM/edit report]
** {{mnotstarted|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/15weRRX13jYuSLtWFxtFZhYYUZ_ijmvqXbu5vadpkRuM/edit  report]
=== Beta 17 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/67.0b17-candidates/build2/ 67.0b17-build2] | [https://hg.mozilla.org/releases/mozilla-beta/rev/be8cd9575508ce1a95b971ccbfe3a7ceec59bc0b be8cd9575508ce1a95b971ccbfe3a7ceec59bc0b] | (ID: 20190505015947)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/17 Firefox 67 Beta 17]
** 67.0b17-build2
*** {{mdone|}} Smoke and Exploratory Testing with focus on: WebExtensions compatibility & Web compatibility .
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1645 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1yQtKWgxPNmr0oRmU95GQsUcvAfceuw529GrvPZasY6k/edit# report]
** {{mnotstarted|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1yQtKWgxPNmr0oRmU95GQsUcvAfceuw529GrvPZasY6k/edit#  report]
 
=== Beta 18 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b18-candidates/build1/ 67.0b18-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/fe6ddfaa325f8e9b57b134cd5ff48753726b8aff fe6ddfaa325f8e9b57b134cd5ff48753726b8aff] | (ID: 20190506235559)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/18 Firefox 67 Beta 18]
** 67.0b18-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Web compatibility .
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17342 TestRail]..
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1KqPlgZDi9iolJ6INSyylg1Yzofq7doSl3RJgh4_Cz1k/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1KqPlgZDi9iolJ6INSyylg1Yzofq7doSl3RJgh4_Cz1k/edit#  report]
 
=== Beta 19 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0b19-candidates/build1/ 67.0b19-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/9c4cd169d5d07b75453e6574e13bf4f912814fb0 9c4cd169d5d07b75453e6574e13bf4f912814fb0] | (ID: 20190509185224)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/19 Firefox 67 Beta 19]
** 67.0b19-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Activity Stream.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17405 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1782626591 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1qRkSwIbiisuaz5GPaKXm4ArWd3FRsUm8lL7efFOtcK0/edit report]
** {{mnotstarted|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1qRkSwIbiisuaz5GPaKXm4ArWd3FRsUm8lL7efFOtcK0/edit#  report]
 
== Release Candidates ==
 
=== 67.0-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0-candidates/build1/ 67.0-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/3126a5c2560c34a8acb33d62e54b2be0f704a190 3126a5c2560c34a8acb33d62e54b2be0f704a190 ] | (ID: 20190513195729)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan Firefox 67.0 RC1]
** 67.0-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17458 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://docs.google.com/document/d/1xWsLI7hZFFuRUR2a21IPwCCRGdn1Osd3hpbZxY1MnAA/edit report]
** {{mnotstarted|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/1xWsLI7hZFFuRUR2a21IPwCCRGdn1Osd3hpbZxY1MnAA/edit report]
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1QGTFcz8MWcqFUDArqbG8Mh6WK2ppkVteLKhtumOlbKo/edit report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1QGTFcz8MWcqFUDArqbG8Mh6WK2ppkVteLKhtumOlbKo/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1QGTFcz8MWcqFUDArqbG8Mh6WK2ppkVteLKhtumOlbKo/edit report]
 
=== 67.0-build2 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/67.0-candidates/build2/ 67.0-build2] | [https://hg.mozilla.org/releases/mozilla-release/rev/2a7896ba9aa5d982abe01f859d771d411fda8101 2a7896ba9aa5d982abe01f859d771d411fda8101] | (ID: 20190516215225)


==== Testing ====
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/14 Firefox 66 Beta 14]
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan Firefox 67.0 RC2]
** 66.0b14-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Session restore, Build installation & uninstallation, File system interaction and macOS signing.  
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17519 TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15947 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://docs.google.com/document/d/1z6gMHa2PcnRqyIqVjMjllPwynmOC-wUvcdpWlJRXtL4/edit report]
** {{mdone|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/1z6gMHa2PcnRqyIqVjMjllPwynmOC-wUvcdpWlJRXtL4/edit report]
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/19yHIVr8j5-rEt_Ecn285buG6P1r-k2EIdhCISHSwvZo/edit report]
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/19yHIVr8j5-rEt_Ecn285buG6P1r-k2EIdhCISHSwvZo/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/19yHIVr8j5-rEt_Ecn285buG6P1r-k2EIdhCISHSwvZo/edit report]
 
=== 67.0.1-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0.1-candidates/build1/ 67.0.1-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/e219b566bff6 e219b566bff6] | (ID: 20190529130856)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/67.0.1 67.0.1]
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17785 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1v3goHSTMBdPcHdycQ358oV7I5j16N58igaPBvr7jCmI/edit# report]
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1v3goHSTMBdPcHdycQ358oV7I5j16N58igaPBvr7jCmI/edit# report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1v3goHSTMBdPcHdycQ358oV7I5j16N58igaPBvr7jCmI/edit# report]
 
=== 67.0.2-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0.2-candidates/build1/ 67.0.2-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/b83af63ec81d b83af63ec81d] | (ID: 20190605225443)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/67.0.2 67.0.2]
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17936 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1I--5MnbzMWiROAcFc6b253UAYx3XAr3ShEqXdSbKIy8/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1I--5MnbzMWiROAcFc6b253UAYx3XAr3ShEqXdSbKIy8/edit report]
 
=== 67.0.2-build2 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0.2-candidates/build1/ 67.0.2-build2] | [https://hg.mozilla.org/releases/mozilla-release/rev/1a95e4b8b2d28e76ef63335f96f2b4cc151497f9] | (ID: 20190607204818)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/67.0.2 67.0.2]
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1716 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1I--5MnbzMWiROAcFc6b253UAYx3XAr3ShEqXdSbKIy8/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1I--5MnbzMWiROAcFc6b253UAYx3XAr3ShEqXdSbKIy8/edit report]
 
=== 67.0.3-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0.3-candidates/build1/ 67.0.3-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/99a829d2a2a7859b10508b6f05e99780c5e2dc68] | (ID: 20190618025334)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/67.0.3 67.0.3]
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1749 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1jgkwVrP0kMcZqyv4w1NCw36WDe2YrGjtSSQZUnNUyJw/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1jgkwVrP0kMcZqyv4w1NCw36WDe2YrGjtSSQZUnNUyJw/edit report]
 
=== 67.0.4-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/67.0.4-candidates/build1/ 67.0.4-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/ea5154beddff08b919697e3bed6f38cfe3a3d82f] | (ID: 20190618025334)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_67/Test_Plan/Beta/67.0.4 67.0.4]
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1749 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1jI_6C_s8fkR6RAGG6Dhw3rPjhqEptmRM_o-ZxZttGM0/edit report]  
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/152BPqap4ljZY8Y7Lub4skyirwEG3yvI2CShljKL1wOI/edit report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1jI_6C_s8fkR6RAGG6Dhw3rPjhqEptmRM_o-ZxZttGM0/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/152BPqap4ljZY8Y7Lub4skyirwEG3yvI2CShljKL1wOI/edit report]

Latest revision as of 16:38, 20 June 2019

Summary

This page is to track testing of Firefox 67 from mozilla-central (Nightly) through to mozilla-release. This is intended to be a minimal set of information to help Firefox QA understand and communicate the quality of upcoming releases. Our current walkthrough of the release and QA process might be changing due to recent reorgs.

The QA efforts are mostly split up between two teams:

  • Engineering QA
    • team reports to Tom Grabowski
    • the Project Manager (and main contact) for the team is Rares Bologa
    • team is based in Romania (most part) and Las Vegas (5 people)
    • the team mainly tests the Desktop app, but covers the Mobile (Android, iOS) side as well
    • main responsibilities:
      • Feature Testing - new Firefox features, prior to landing and during Nightly
      • Bug Triage - older as well as incoming Unconfirmed bugs
      • Bug Investigation - various investigation as requested by other people (e.g. finding steps, setting component, finding regression windows)
      • Misc - other miscellaneous requests
  • Release QA Desktop and Release QA Mobile
    • team reports to Tom Grabowski
    • the Project Manager (and main contact) for the team is Andrei Vaida
    • team is based in Romania
    • main responsibilities:
      • Build Validation - mostly Beta, Release, and ESR builds (including automated ondemand update, and throttling tests)
      • Feature Testing - new features not covered by the Engineering QA team, and those covered by the Engineering QA team after they enter Beta
      • Bug Verification - verifying the most important / high risk fixes, with focus on those closer to release
      • Bug Investigation - various investigation as requested by other people (e.g. finding steps, setting component, finding regression windows)
      • Misc - other miscellaneous requests

Schedule

Error in widget Widget:Google Calendar: Unable to load template 'wiki:Widget:Google Calendar'
Milestone Date Checks
Nightly - Conduct daily bug triage, regular build validation, and feature testing
Beta - Feature testing and sign off every beta release, regular testing of DevEdition builds
Release - Review tests and sign off release

Please consult the Rapid Release Calendar for more information.

Meetings

Meeting Purpose When Vidyo Room IRC Backchannel Notes
Channel Status Raise quality concerns with the Release Management team 10:00 AM Pacific on Tuesday & 08:00 AM Pacific on Thursday ReleaseCoordination #planning Notes archive

Nightly

While Firefox 67 is on the Nightly channel, QA will mainly focus on:

  • Feature Testing - EngQA team (for Firefox features assigned to them) + RelQA team (for other new features - Platform or Firefox)
  • Regular Nightly validation - 3 rounds per cycle - EngQA team + RelQA team, alternately
  • Triaging newly reported bugs - EngQA team
  • Bug Verification - both teams - with main focus on: fixes related to new features, fixes tracked as Sprint work, fixes for major bugs

Reference: https://wiki.mozilla.org/QA/Desktop_Firefox/Walkthroughs/Release_Coordination#Nightly

End of cycle status
  • Total bugs filed affecting 67: tbd
  • Bugs fixed / verified on 67: tbd / tbd
  • Conditional signoff for merge: <date>, <person> (email sent to release-drivers at
  • QE signoff: N/A

Beta

During the Beta cycle, there are several beta releases. Communication with the release coordination, release engineering, and automation teams is key.

While Firefox 67 is on the Beta channel, QA will mainly focus on:

  • Signing off each Beta build prior to being pushed to the beta channel - RelQA
  • Feature Testing - RelQA team
    • Focus is on fixes that land in Beta, and Regression and Smoke testing
  • Regular validation of DevEdition builds - about once every two weeks
  • Triaging newly reported bugs - EngQA team
  • Bug Verification - mostly RelQA - with main focus on: fixes related to new features, fixes for major bugs, fixes assessed as high risk

QA also analyzes the results of update testing which is done manually at this stage. We run them on at least two channels for each beta release cycle.

Pivotal bugs may need verification during each beta cycle.

  • Link to release notes. review & update.
  • Crash evaluation/escalation.
  • Feature evaluation.

QA Activities

QA wanted

The following tracks bugs which have requests for urgent QA assistance.

  • Choose a bug to test from the list below
  • Read it and make sure you understand what information is needed (this may be steps or URLs to reproduce, a regression range, or something else altogether)
  • Use the latest build of this Firefox version and test until you've discovered the information necessary. Ask for help if you need it.
  • Report this information to the bug and remove the qe-verify+ flag

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Stability

This section tracks bugs representing the most urgent stability issues. Consult this wiki for more information.

  • Ensure new and explosive crashes have actionable bug reports which are in progress
  • Top Crashes - ensure the highest ranked crashes have actionable bug reports which are in progress
  • Untriaged Bugs - ensure bugs are actionable and in the correct component
  • topcrash bugs

Unconfirmed Bug Triage

The following tracks triage and testing of incoming, unconfirmed bug reports.

  • Choose a bug to test from the list below
  • Use the latest Nightly build to confirm the bug reproduces
  • Flag with reporter with needinfo if you cannot reproduce and need more information
  • Set the status to NEW and ensure the bug is in the appropriate component if you can reproduce the bug (provide as much detail about your testing as possible)
  • If it's a Firefox bug you may want to add the firefox-backlog=? flag to it.

Queries:

Verification Needed Bugs

  • Review the bugs below in the Pending Triage section and select a bug you want to test
  • Make sure you understand the bug before you begin testing it
  • Test on a previously known broken build to make sure you can reproduce the bug
  • Test on the latest build from the branches which are fixed to confirm the bug no longer reproduces
  • Mark the bug VERIFIED FIXED if the bug appears to be fixed and set the appropriate status-firefox flag to verified
  • Reopen the bug if it still reproduces

Iteration Development

Firefox development during Nightly works on two-week iterations as of 2014. This section tracks the bugs selected for development in these iterations. Please consult the Iteration Dev Walkthrough and the Firefox/IterativeDevelopment page for more information on this process.

  • Ensure all bugs are marked qe-verify:+ or -
  • Ensure all qe-verify:+ bugs have a QA Contact (The Feature Owner page may help here)
  • Ensure all selected bugs are VERIFIED before the end of the iteration
  • Anything incomplete at the end of the iteration will be automatically carried over to the next iteration

Queries:

Feature status

Milestones

Regular Nightly Validation

SIGN-OFF DATE SIGN-OFF STATUS REASON(S) MAJOR ISSUES MINOR ISSUES TEST REPORT
2019-02-07 GREEN
  • 3 new bugs uncovered, low-impact.
  • Known (old) bugs are low-impact.
 --- Bugzilla link TestRail link
2019-02-21 GREEN
  • 2 new bugs uncovered, low-impact.
  • Known (old) bugs are low-impact.
 --- Bugzilla link TestRail link

Nightly Migration

Pre-sign-off Checks:

  • [NOT STARTED] Features - all scoped features are signed off as ready for Beta by owners. (If you haven't heard anything to the contrary, that is probably true, but make sure we don't know of blocking issues.)

Post-sign-off Checks (as soon as updates are enabled again):

  • None yet for migration of Nightly to Beta

Developer Edition

Note: Developer Edition builds are usually signed off once every two weeks.
BUILD SIGN OFF ENCOUNTERED BUGS
Status Reason(s) Test Report New Known (old)
67.0b1-build1 GREEN
  • Two new issue uncovered during testing bug 1534622
  • Known issues are low impact.
 TestRail link
  • High-impact: none
  • Low-impact: list
67.0b2-build1 GREEN
  • One new issue uncovered during testing bug
  • Known issues are low impact.
 TestRail link
  • Regressions:
  • Non-regressions:
  • High-impact: none
  • Low-impact: list
67.0b5-build1 GREEN
  • No new issues uncovered during testing.
  • Known issues are low impact.
 TestRail link
  • Regressions: none
  • Non-regressions: none
  • High-impact: none
  • Low-impact: list
67.0b9-build1 GREEN
  • One new issue uncovered during testing bug 1543386
  • Known issues are low impact.
 TestRail link
  • Regressions: none
  • Non-regressions: none
  • High-impact:
  • Low-impact: list

Beta

Note: Beta builds are usually signed off twice a week.

Beta 3

Build Information

Testing

  • Manual - Firefox 67 Beta 3
    • 67.0b3-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Graphics compatibility & support, Download manager & Build installation & uninstallation.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 4

Build Information

Testing

  • Manual - Firefox 67 Beta 4
    • 67.0b4-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Awesomebar & indicators and Profile support & compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 5

Build Information

Testing

  • Manual - Firefox 67 Beta 5
    • 67.0b5-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Media playback & support and Printing.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 6

Build Information

Testing

  • Manual - Firefox 67 Beta 6
    • 67.0b6-build1
      • [DONE] Smoke and Exploratory Testing with focus on: WebExtensions compatibility & support, Content scroll, zoom & drag support and In-Browser PDF support.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 7

Build Information

Testing

  • Manual - Firefox 67 Beta 7
    • 67.0b7-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Smart Card, Bookmarks, Toolbars & window controls, Anti-Tracking.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 8

Build Information

Testing

  • Manual - Firefox 67 Beta 8
    • 67.0b8-build2
      • [DONE] Smoke and Exploratory Testing with focus on: Media playback & support and Image compatibility & support.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 9

Build Information

Testing

  • Manual - Firefox 67 Beta 9
    • 67.0b9-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Search, geolocation and default & custom theme support.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 10

Build Information

Testing

  • Manual - Firefox 67 Beta 10
    • 67.0b10-build1
      • [DONE] Smoke and Exploratory Testing with focus on: File system interaction, Data migration and Anti-Tracking (privacy).
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 11

Build Information

Testing

  • Manual - Firefox 67 Beta 11
    • 67.0b11-build1
      • [DONE] Smoke and Exploratory Testing with focus on: History and Password Manager & Form Autofill
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [NOT STARTED] Updates on beta & aurora channels, report


Beta 12

Build Information

Testing

  • Manual - Firefox 67 Beta 12
    • 67.0b12-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Media playback & support, Plugin compatibility & support & Build installation & uninstallation
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 13

Build Information

Testing

  • Manual - Firefox 67 Beta 13
    • 67.0b13-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Graphics compatibility & support and Crash reporting.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [NOT STARTED] Updates on beta & aurora channels, report

Beta 14

Build Information

Testing

  • Manual - Firefox 67 Beta 14
    • 67.0b14-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Awesomebar & indicators & Profile support & compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 15

Build Information

Testing

  • Manual - Firefox 67 Beta 15
    • 67.0b15-build2
      • [DONE] Smoke and Exploratory Testing with focus on: Session restore & Safe browsing & Geolocation .
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [NOT STARTED] Updates on beta & aurora channels, report

Beta 16

Build Information

Testing

  • Manual - Firefox 67 Beta 16
    • 67.0b16-build2
      • [DONE] Smoke and Exploratory Testing with focus on: Download manager & In-browser PDF support & Toolbars & window controls & DLL Interceptor .
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [NOT STARTED] Updates on beta & aurora channels, report

Beta 17

Build Information

Testing

  • Manual - Firefox 67 Beta 17
    • 67.0b17-build2
      • [DONE] Smoke and Exploratory Testing with focus on: WebExtensions compatibility & Web compatibility .
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [NOT STARTED] Updates on beta & aurora channels, report

Beta 18

Build Information

Testing

  • Manual - Firefox 67 Beta 18
    • 67.0b18-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Web compatibility .
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [DONE] Updates on beta & aurora channels, report

Beta 19

Build Information

Testing

  • Manual - Firefox 67 Beta 19
    • 67.0b19-build1
      • [DONE] Smoke and Exploratory Testing with focus on: Activity Stream.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest & aurora-cdntest channels, report
    • [NOT STARTED] Updates on beta & aurora channels, report

Release Candidates

67.0-build1

Build Information

Testing

  • Manual - Firefox 67.0 RC1
    • 67.0-build1
      • [DONE] Smoke Testing on: Web Compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest channel, report
    • [NOT STARTED] Updates on beta channel, report
    • [DONE] Updates on release-localtest channel, report
    • [NOT STARTED] Updates on release-cdntest channel, report
    • [NOT STARTED] Updates on release channel, report

67.0-build2

Build Information

Testing

  • Manual - Firefox 67.0 RC2
      • [DONE] Smoke Testing on: Web Compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on beta-cdntest channel, report
    • [DONE] Updates on beta channel, report
    • [DONE] Updates on release-localtest channel, report
    • [DONE] Updates on release-cdntest channel, report
    • [DONE] Updates on release channel, report

67.0.1-build1

Build Information

Testing

  • Manual - 67.0.1
      • [DONE] Smoke Testing on: Web Compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on release-localtest channel, report
    • [DONE] Updates on release-cdntest channel, report
    • [DONE] Updates on release channel, report

67.0.2-build1

Build Information

Testing

  • Manual - 67.0.2
      • [DONE] Smoke Testing on: Web Compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [NOT STARTED] Updates on release-cdntest channel, report
    • [NOT STARTED] Updates on release channel, report

67.0.2-build2

Build Information

Testing

  • Manual - 67.0.2
      • [DONE] Smoke Testing on: Web Compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on release-cdntest channel, report
    • [DONE] Updates on release channel, report

67.0.3-build1

Build Information

Testing

  • Manual - 67.0.3
      • [DONE] Smoke Testing on: Web Compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on release-cdntest channel, report
    • [NOT STARTED] Updates on release channel, report

67.0.4-build1

Build Information

Testing

  • Manual - 67.0.4
      • [DONE] Smoke Testing on: Web Compatibility.
      • [DONE] Bug verification with focus on the latest fixes to land in this build.
  • Updates testing
    • [DONE] Updates on release-cdntest channel, report
    • [DONE] Updates on release channel, report
Retrieved from "https://dev.wikimo.nonprod.webservices.mozgcp.net/index.php?title=Releases/Firefox_67/Test_Plan&oldid=1214037"