Releases/Firefox 71/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(18 intermediate revisions by 5 users not shown)
Line 187: Line 187:
** '''Functional tests (manual)''':
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser'''  → [https://testrail.stage.mozaws.net/index.php?/plans/view/22281 TestRail]
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser'''  → [https://testrail.stage.mozaws.net/index.php?/plans/view/22281 TestRail]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b11</div>
<div class="mw-collapsible-content">
* '''Build''': 71.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5c921325dd03 5c921325dd03], 20191118154140) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser'''  → [https://testrail.stage.mozaws.net/index.php?/plans/view/22577 TestRail]
</div></div>
</div></div>


Line 201: Line 209:
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit#gid=850719639 report]
</div></div>
</div></div>


Line 213: Line 221:
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit#gid=850719639 report]
</div></div>
</div></div>


Line 225: Line 233:
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]
</div></div>
</div></div>


Line 237: Line 245:
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1N0V5DH7Y-A5sOBXILwbodKzkMzZK2wWyRCjG-4ZzDi8/edit#gid=850719639 report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1N0V5DH7Y-A5sOBXILwbodKzkMzZK2wWyRCjG-4ZzDi8/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1N0V5DH7Y-A5sOBXILwbodKzkMzZK2wWyRCjG-4ZzDi8/edit#gid=850719639 report]
</div></div>
</div></div>


Line 249: Line 257:
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit#gid=850719639 report]
</div></div>
</div></div>


Line 261: Line 269:
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]
</div></div>
</div></div>


Line 273: Line 281:
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
</div></div>
</div></div>


Line 280: Line 288:
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
* Build: 71.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/992520c31cde6750358c5d5c3a610f77ebadd404 992520c31cde6750358c5d5c3a610f77ebadd404.], 20191114160003) - <font style="color:green; font-weight:bold;">GREEN</font>
* Build: 71.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/992520c31cde6750358c5d5c3a610f77ebadd404 992520c31cde6750358c5d5c3a610f77ebadd404.], 20191114160003) - <font style="color:green; font-weight:bold;">GREEN</font>
*** {{mprog|}} Smoke testing on '''Audio/Video''', '''Crash Reporting''', '''Startup and Profile''', and '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22456 TestRail]
*** {{mdone|}} Smoke testing on '''Audio/Video''', '''Crash Reporting''', '''Startup and Profile''', and '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22456 TestRail]
*** {{mprog|}} Smoke testing on Ubuntu snap package → [ TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22478 TestRail]
*** {{mnotstarted|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
</div></div>
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b11</div>
<div class="mw-collapsible-content">
* Build: 71.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5c921325dd03885c3392512722c7cede4ed9e00e 5c921325dd03885c3392512722c7cede4ed9e00e], 20191118154140) - <font style="color:green; font-weight:bold;">GREEN</font>
*** {{mdone|}} Smoke testing on '''Installer''', '''Geolocation''', '''Preferences''' and '''Address Bar and Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22524 TestRail]
*** {{mnotstarted|}} Smoke testing on Ubuntu snap package → [https://bugzil.la/1596135 Blocked by bug 1596135]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]
*** {{mdone|}} beta, aurora → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]
</div></div>
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b12</div>
<div class="mw-collapsible-content">
* Build: 71.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a5ce9b31b825  a5ce9b31b825], 20191121155457) - <font style="color:green; font-weight:bold;">GREEN</font>
*** {{mdone|}} Smoke testing on '''WebExtensions''', '''Browser Window''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22652 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22670 TestRail]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11Ur9INe5LSGUy3W2FUFbUimK7xziF36bc75GKRYNwFs/edit#gid=850719639 report]
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11Ur9INe5LSGUy3W2FUFbUimK7xziF36bc75GKRYNwFs/edit#gid=850719639 report]
</div></div>
 
=== Release 71 build readiness ===
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">RC1 71.0</div>
<div class="mw-collapsible-content">
* Build: 71.0-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e136c48f3e88  e136c48f3e88], 20191125204040) - <font style="color:green; font-weight:bold;">GREEN</font>
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/22771 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22779 TestRail]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]
** '''Update tests (manual)''':
*** {{mdone|}} release-cdntest, beta-cdntest → [https://docs.google.com/spreadsheets/d/1bAEduCwNxVwhlq16vtkY44sc8giPxx1bLxjz_T61Dao/edit report]
*** {{mdone|}}  beta→ [https://docs.google.com/spreadsheets/d/1bAEduCwNxVwhlq16vtkY44sc8giPxx1bLxjz_T61Dao/edit report]
</div></div>
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">RC2 71.0</div>
<div class="mw-collapsible-content">
* Build: 71.0-build4 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ee54407d806f  ee54407d806f], 20191128221751) - <font style="color:green; font-weight:bold;">GREEN</font>
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/22881 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22892 TestRail]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]
** '''Update tests (manual)''':
*** {{mdone|}} release-cdntest, beta-cdntest → [https://docs.google.com/spreadsheets/d/1HBea6fQshCN86Xmrt4EnWZgLtpX7g4fnohNig3Zz3mw/edit?usp=sharing report]
*** {{mdone|}}  beta→ [https://docs.google.com/spreadsheets/d/1HBea6fQshCN86Xmrt4EnWZgLtpX7g4fnohNig3Zz3mw/edit?usp=sharing report]
</div></div>
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">RC3 71.0</div>
<div class="mw-collapsible-content">
* Build: 71.0-build5 ([https://hg.mozilla.org/releases/mozilla-release/rev/501aef7fe1d9  501aef7fe1d9], 20191202093317) - <font style="color:green; font-weight:bold;">GREEN</font>
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/22924 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22937 TestRail]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mnotstarted|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
*** {{mdone|}} release-cdntest, beta-cdntest → [https://docs.google.com/spreadsheets/d/1VsCeFo1P6O9nTuwQPpVKwyzzUrm5XtsjPBhrt0XKQ90/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]
*** {{mdone|}} beta→ [https://docs.google.com/spreadsheets/d/1VsCeFo1P6O9nTuwQPpVKwyzzUrm5XtsjPBhrt0XKQ90/edit#gid=850719639 report]
</div></div>
</div></div>

Latest revision as of 16:07, 2 December 2019

Summary

The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.

Release schedule

Status meetings

The Channel Status meeting is used to raise quality concerns with the Release Management team.

QA points of contact

Communication channels

Firefox for Desktop

Engineering QA
  • Reporting to: Tom Grabowski, Tania Maity
  • Softvision Manager: Rares Bologa
  • Team Leads: Brindusa Tot
  • Offices: Romania (EEST), Argentina (GMT-3)
  • Responsible for: new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation
Release QA
  • Reporting to: Tom Grabowski, Tania Maity
  • Softvision Manager: Andrei Vaida
  • Team Leads: Bogdan Maris, Cornel Ionce
  • Office: Romania (EEST)
  • Responsible for: new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation

Firefox for Mobile

Release QA
Firefox for iOS QA

AMO, WebExtensions

Add-ons QA
  • Reporting to: Krupa Raj
  • Softvision Manager: Rares Bologa
  • Team Leads: Victor Carciu, Madalin Cotetiu
  • Office: Romania (EEST)
  • Responsible for: AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry

Experiments, Normandy, Subscription services, and other Firefox features

Experiments QA
  • Reporting to: Krupa Raj
  • Softvision Manager: Rares Bologa
  • Team Leads: Paul Oiegas
  • Office: Romania (EEST)
  • Responsible for: testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop.

QA activities

New feature readiness

All new features tested by QA and shipping with Firefox 71 are available here.

The feature testing process followed by QA is available here.

Bug fix verification

  • Daily verification of uplifted bugs - these are uplifts, triaged daily and verified under ~48hrs
  • Ongoing verification of Nightly bugs - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of qe-verify? bugs
  • Ongoing verification of Beta bugs - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of qe-verify? bugs
  • On-demand verification of bugs - these are special requests (ideally coming in through PI, but also through Bugzilla needinfo?, chat or emails)
  • Periodical verification of security bugs - these are post-critsmash bugs, triaged and verified ~every 2wks

Unconfirmed bug triage

This is the triage conducted by Engineering QA.

Security bug triage

This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).

Bug investigation

This is the daily check and investigation of new regressionwindow-wanted bugs, conducted by Engineering QA and Release QA.

Nightly 72 milestones

[early/mid cycle] Nightly build readiness

Scope: assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge (more on this).

Nightly 72.0a1 (2019-05-30)
  • Build: 72.0a1 (commit, ID) - NOT STARTED
    • [DONE] Functional testing (manual) → report
      • New bugs
        • Regressions: --
        • Non-regressions: --
      • Known bugs
        • High-impact: --
        • Low/medium-impact: [link bug list]
Nightly 72.0a1 (2019-06-13)
  • Build: 72.0a1 (commit, ID) - GREEN
    • [DONE] Functional testing (manual) → report
      • New bugs
        • Regressions: --
        • Non-regressions: --
      • Known bugs
        • High-impact: --
        • Low/medium-impact: [link bug list]

[prior to merge] Nightly regression testing

Nightly 69.0a1 (date)
  • Build: 72.0a1 (commit, ID) - Sign off_Status
    • [NOT STARTED] Regression testing (manual) → [report]
      • New bugs
        • Regressions: ID1, ID2, IDn
        • Non-regressions: ID1, ID2, IDn
      • Known bugs
        • High-impact: ID1, ID2, IDn
        • Low/medium-impact: [bug list]

[optional] [prior to merge] Nightly new feature smoke testing

Note: this is optional, based on available QA bandwidth.

Beta/DevEd 71 milestones

Developer Edition build readiness

Scope: assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel (more on this).

DevEd 71.0b1
  • Build: 71.0b1-build1 (e1479d4d94da, 20191014171118) - GREEN
    • Functional tests (manual):
    • Update tests (manual):
      • [DONE] aurora-cdntest → report
      • [NOT STARTED] aurora → report
DevEd 71.0b2
  • Build: 71.0b2-build1 (5d743fd9d6bd, 20191016150816) - GREEN
    • Functional tests (manual):
    • Update tests (manual):
      • [DONE] aurora-cdntest → report
      • [NOT STARTED] aurora → report
DevEd 71.0b7
  • Build: 71.0b7-build1 (8436f40e05c0, 20191104135555) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Build Branding , Build Configuration , User Profile , Build interface , Build stability and functionality , Sync , Default Browser → TestRail
DevEd 71.0b11
  • Build: 71.0b11-build1 (5c921325dd03, 20191118154140) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Build Branding , Build Configuration , User Profile , Build interface , Build stability and functionality , Sync , Default Browser → TestRail

Beta build readiness

Beta 71.0b3
  • Build: 71.0b3-build3 (--, --) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Plug-ins, Address Bar and Crash Reporting → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Smoke testing on DLL interceptor → Test Results
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 71.0b4
  • Build: 71.0b4-build1 (d5a8eb9b5da997aa995a4aa6199ba37bbb581063, 20191024095932) - GREEN
      • [DONE] Smoke, Regression and Exploratory testing on Address Bar, Downloads and Search → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 71.0b5
  • Build: 71.0b5-build1 (105200ed1cf6753d13dbeecc4bbb9e4837b7711d, 20191028110005) - GREEN
      • [DONE] Smoke, Regression and Exploratory testing on Graphics, Installer and Geolocation → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 71.0b6
  • Build: 71.0b6-build1 (abe7cbe63f04be2e33810e6fa757fa73e257c4d0, 20191031113544) - GREEN
      • [DONE] Smoke testing on Audio/Video, Search, Address Bar and Preferences → TestRail
      • [IN PROGRESS] Smoke testing on Ubuntu snap package → TestRail
      • [IN PROGRESS] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 71.0b7
  • Build: 71.0b7-build1 (aa565b96885044b65e176acc9e3286e81eb0abe5, 20191107101713) - GREEN
      • [DONE] Smoke testing on Bookmarks and History', Scrolling, Panning and Zooming, and Theme and Toolbar Customization → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 71.0b8
  • Build: 71.0b8-build1 (aa565b96885044b65e176acc9e3286e81eb0abe5, 20191107101713) - GREEN
      • [DONE] Smoke testing on Bookmarks and History, WebExtensions, PDF Viewer, Printing, and Downloads → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 71.0b9
Beta 71.0b10
  • Build: 71.0b10-build1 (992520c31cde6750358c5d5c3a610f77ebadd404., 20191114160003) - GREEN
      • [DONE] Smoke testing on Audio/Video, Crash Reporting, Startup and Profile, and OS Integration → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 71.0b11
Beta 71.0b12
  • Build: 71.0b12-build1 (a5ce9b31b825, 20191121155457) - GREEN
      • [DONE] Smoke testing on WebExtensions, Browser Window and Audio/Video → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report

Release 71 build readiness

RC1 71.0
  • Build: 71.0-build2 (e136c48f3e88, 20191125204040) - GREEN
      • [DONE] Smoke, regression, exploratory → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] release-cdntest, beta-cdntest → report
      • [DONE] beta→ report
RC2 71.0
  • Build: 71.0-build4 (ee54407d806f, 20191128221751) - GREEN
      • [DONE] Smoke, regression, exploratory → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] release-cdntest, beta-cdntest → report
      • [DONE] beta→ report
RC3 71.0
  • Build: 71.0-build5 (501aef7fe1d9, 20191202093317) - GREEN
      • [DONE] Smoke, regression, exploratory → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] release-cdntest, beta-cdntest → report
      • [DONE] beta→ report
Retrieved from "https://dev.wikimo.nonprod.webservices.mozgcp.net/index.php?title=Releases/Firefox_71/Test_Plan&oldid=1220812"