Releases/Firefox 69/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(-)
 
(42 intermediate revisions by 10 users not shown)
Line 203: Line 203:
*** {{mdone|}} aurora-cdntest  (as part of Beta 69.0b9 update tests)
*** {{mdone|}} aurora-cdntest  (as part of Beta 69.0b9 update tests)
*** {{mdone|}} aurora (as part of Beta 69.0b9 update tests)
*** {{mdone|}} aurora (as part of Beta 69.0b9 update tests)
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">DevEd 69.0b13</div>
<div class="mw-collapsible-content">
* '''Build''': 69.0b13-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8ecc148a2fad 8ecc148a2fad], 20190812173625) - <font style="color:black; font-weight:bold;">IN PROGRESS</font>
** '''Functional tests (manual)''':
*** {{mprog|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/19718 TestRail]
*** {{mprog|}} [Bug fix verification]
** '''Update tests (manual)''':
*** {{mnotstarted|}} aurora-cdntest  (as part of Beta 69.0b9 update tests)
*** {{mnotstarted|}} aurora (as part of Beta 69.0b9 update tests)
</div></div>
</div></div>


Line 322: Line 334:
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">


* Build: 69.0b11-build1 ([], ) - <font style="color:TBA; font-weight:bold;">TBA</font>
* Build: 69.0b11-build1 ([], ) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
** '''Functional tests (manual)''':
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Data Migration''' and '''Toolbars & window controls''' → [TestRail]
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19518]
*** {{mnotstarted|}} Smoke testing on Ubuntu snap package → [TBA report]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1897]
*** {{mnotstarted|}} Bug fix verification – [Bug List]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110]
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mnotstarted|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/15zGbclq-2mK4Ew1q7LXiDszshq3yeg7mWV6GWYsWrOw/edit?usp=sharing report]
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/15zGbclq-2mK4Ew1q7LXiDszshq3yeg7mWV6GWYsWrOw/edit?usp=sharing report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15zGbclq-2mK4Ew1q7LXiDszshq3yeg7mWV6GWYsWrOw/edit?usp=sharing report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15zGbclq-2mK4Ew1q7LXiDszshq3yeg7mWV6GWYsWrOw/edit?usp=sharing report]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b12</div>
<div class="mw-collapsible-content">
* Build: 69.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8055f364e2cc60f0f721ec2694f684b715a2c037 8055f364e2cc], 20190807220259) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''', '''Adress Bar''' and '''Smart Card''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1913 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1912 report]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/15RoLcoXy758E8a8HlVfMNPwwsrWyJ6T7W6IvZ7UUzEU/edit?usp=sharing report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15RoLcoXy758E8a8HlVfMNPwwsrWyJ6T7W6IvZ7UUzEU/edit?usp=sharing report]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b13</div>
<div class="mw-collapsible-content">
* Build: 69.0b13-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8ecc148a2fad 8ecc148a2fad], 20190812173625) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''' and '''Bookmarks and History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19691 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1915 report]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/15C7uQXB6re70_sAAkmrfHy1R_woxbjap4WwE14WCTSU/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15C7uQXB6re70_sAAkmrfHy1R_woxbjap4WwE14WCTSU/edit#gid=850719639 report]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b14</div>
<div class="mw-collapsible-content">
* Build: 69.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/: 3a3ff2f2324c 3a3ff2f2324c], 20190815163925) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Search''' and '''Data Migration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19828 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/19854 report]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1lJZo6b_Sp13JKYay_oD6pZVAyT2wAXGk700TcUYiI0Y/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1lJZo6b_Sp13JKYay_oD6pZVAyT2wAXGk700TcUYiI0Y/edit#gid=850719639 report]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b15</div>
<div class="mw-collapsible-content">
* Build: 69.0b15-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/66a12ddcf77c 66a12ddcf77c], 20190819184224) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''', '''WebExtensions''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19885 TestRail]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/19911 report]
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]
** '''Update tests (manual)''':
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b16</div>
<div class="mw-collapsible-content">
* Build: 69.0b16-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/91c666707c219c5215117da97cbbec3bf07f42e1 91c666707c21], 20190822210915) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Password Manager & Form Autofill''' and '''Startup and Profile''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19962]
*** {{mprog|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/19911 report]
*** {{mprog|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]
** '''Update tests (manual)''':
*** {{mnotstarted|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]
</div></div>
</div></div>


Line 336: Line 418:
<div style="font-weight:bold;line-height:1.6;">RC1 69.0</div>
<div style="font-weight:bold;line-height:1.6;">RC1 69.0</div>
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
* '''Build''': 69.0-build1 (commit, ID) - Sign off_Status
* '''Build''': 69.0-build2 ([https://hg.mozilla.org/releases/mozilla-release/rev/cce4622026ab8e0130a0afc03f829f9b19ca38c2 9f9b19ca38c2], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
** '''Functional tests (manual)''':
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on _ → report
*** {{mdone|}} Smoke, Regression and Exploratory testing on _ → [https://testrail.stage.mozaws.net/index.php?/plans/view/20004 report]
*** {{mnotstarted|}} Smoke testing on Ubuntu snap package → report
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20104 report]
*** {{mnotstarted|}} Smoke testing on Windows Acer builds → report
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1MeF9I76qp94Bu8NwPuGoRWfzgewJg5mOfhCucKqKrOE/edit report]
*** {{mnotstarted|}} Bug fix verification – <bug list>
*** {{mprog|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug verification]
** '''Update tests (manual)''':
** '''Update tests (manual)''':
*** {{mnotstarted|}} beta-cdntest → report
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/16nH7Qo0lGw7s6C_Z1GwReojOj99-x6YBvOf7_OgwrdY/edit#gid=850719639 report]
*** {{mnotstarted|}} beta → report
*** {{mnotstarted|}} beta → report
*** {{mnotstarted|}} release-localtest → report
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1ekp9cni0mM52BWr5FaQthfhpPn7682YzKa8Q3lXOy4A/edit#gid=850719639 report]
*** {{mnotstarted|}} release-cdntest → report
*** {{mnotstarted|}} release-cdntest → report
*** {{mnotstarted|}} release → report
*** {{mnotstarted|}} release → report
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">RC 69.0.1</div>
<div class="mw-collapsible-content">
* '''Build''': 69.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/bf6ea738ba07 bf6ea738ba07], 20190917135527) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20716 report]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20733 report]
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1kemnj1nSUBIInf_AOhoKfGq2Xo_CEEA5eO9CcZcTwlw/edit#heading=h.ra59jc33u21r report]
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1567600%2C%201578075%2C%201578136%2C%201578454%2C%201578633%2C%201580506%2C%201570845%2C%201576372%2C%201577324%2C%201578354%2C%201580416%2C%201581160&list_id=14900769 Bug verification]
** '''Update tests (manual)''':
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1CJKBZpVmmelzpUxhfv1wNPzP-fddwWGCS2BuvFNMVFY/edit?usp=drive_web&ouid=102568952189939481948 report]
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/u/1/d/1CJKBZpVmmelzpUxhfv1wNPzP-fddwWGCS2BuvFNMVFY/edit?usp=drive_web&ouid=102568952189939481948 report]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">RC 69.0.2</div>
<div class="mw-collapsible-content">
* '''Build''': 69.0.2-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/e40b66e55c28 e40b66e55c28], 20191001234643) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' & '''Telemetry''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2047 report]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2043 report]
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1mfJ7r-K5ez9Jz_AqakEXXThmTl-3xm-lF22mdJqkEnk/edit# report]
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1583368%2C1582222%2C1579858%2C1584613%2C1582726%2C1583225%2C1562686 Bug verification]
** '''Update tests (manual)''':
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1s3ncylyl8y9u_vH1VauTdj7zABRFRX4fLL9Hg2wC8xw/edit#gid=850719639 report]
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/d/1s3ncylyl8y9u_vH1VauTdj7zABRFRX4fLL9Hg2wC8xw/edit#gid=850719639 report]
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;">
<div style="font-weight:bold;line-height:1.6;">RC 69.0.3</div>
<div class="mw-collapsible-content">
* '''Build''': 69.0.3-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/c4227f95dae9 c4227f95dae9], 20191009172106) - <font style="color:green; font-weight:bold;">GREEN</font>
** '''Functional tests (manual)''':
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' & '''Telemetry''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2080 report]
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2043 report]
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1fKG91Lf1UHh2TL23w2czUvJSdtjlwRD0Gac0DCe6D0A/edit# report]
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1586228%201586354&list_id=14934669 Bug verification]
** '''Update tests (manual)''':
*** {{mnotstarted|}} release-cdntest → [link report]
*** {{mnotstarted|}} release → [link report]
</div></div>
</div></div>

Latest revision as of 13:56, 10 October 2019

Summary

The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.

Release schedule

Status meetings

The Channel Status meeting is used to raise quality concerns with the Release Management team.

QA points of contact

Communication channels

Firefox for Desktop

Engineering QA
  • Reporting to: Tom Grabowski, Tania Maity
  • Softvision Manager: Rares Bologa
  • Team Leads: Brindusa Tot
  • Offices: Romania (EEST), Argentina (GMT-3)
  • Responsible for: new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation
Release QA
  • Reporting to: Tom Grabowski, Tania Maity
  • Softvision Manager: Andrei Vaida
  • Team Leads: Bogdan Maris, Cornel Ionce
  • Office: Romania (EEST)
  • Responsible for: new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation

Firefox for Mobile

Release QA
Firefox for iOS QA

AMO, WebExtensions

Add-ons QA
  • Reporting to: Krupa Raj
  • Softvision Manager: Rares Bologa
  • Team Leads: Victor Carciu, Madalin Cotetiu
  • Office: Romania (EEST)
  • Responsible for: AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry

Experiments, Normandy, Subscription services, and other Firefox features

Experiments QA
  • Reporting to: Krupa Raj
  • Softvision Manager: Rares Bologa
  • Team Leads: Paul Oiegas
  • Office: Romania (EEST)
  • Responsible for: testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop.

QA activities

New feature readiness

All new features tested by QA and shipping with Firefox 69 are available here.

The feature testing process followed by QA is available here.

Bug fix verification

  • Daily verification of uplifted bugs - these are uplifts, triaged daily and verified under ~48hrs
  • Ongoing verification of Nightly bugs - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of qe-verify? bugs
  • Ongoing verification of Beta bugs - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of qe-verify? bugs
  • On-demand verification of bugs - these are special requests (ideally coming in through PI, but also through Bugzilla needinfo?, chat or emails)
  • Periodical verification of security bugs - these are post-critsmash bugs, triaged and verified ~every 2wks

Unconfirmed bug triage

This is the triage conducted by Engineering QA.

Security bug triage

This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).

Bug investigation

This is the daily check and investigation of new regressionwindow-wanted bugs, conducted by Engineering QA and Release QA.

Nightly 69 milestones

[early/mid cycle] Nightly build readiness

Scope: assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge (more on this).

Nightly 69.0a1 (2019-05-30)
  • Build: 69.0a1 (commit, ID) - GREEN
    • [DONE] Functional testing (manual) → report
      • New bugs
        • Regressions: none
        • Non-regressions: 1554912, 1555113
      • Known bugs
        • High-impact: none
        • Low/medium-impact: bug list
Nightly 69.0a1 (2019-06-13)
  • Build: 69.0a1 (commit, ID) - GREEN
    • [DONE] Functional testing (manual) → report
      • New bugs
        • Regressions: none
        • Non-regressions: 1558762
      • Known bugs
        • High-impact: none
        • Low/medium-impact: bug list

[prior to merge] Nightly regression testing

Nightly 69.0a1 (date)
  • Build: 69.0a1 (commit, ID) - Sign off_Status
    • [NOT STARTED] Regression testing (manual) → [report]
      • New bugs
        • Regressions: ID1, ID2, IDn
        • Non-regressions: ID1, ID2, IDn
      • Known bugs
        • High-impact: ID1, ID2, IDn
        • Low/medium-impact: [bug list]

[optional] [prior to merge] Nightly new feature smoke testing

Note: this is optional, based on available QA bandwidth.

Beta/DevEd 69 milestones

Developer Edition build readiness

Scope: assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel (more on this).

DevEd 69.0b1
  • Build: 69.0b1-build2 (625005a94d4, 20190701201355) - GREEN
    • Functional tests (manual):
    • Update tests (manual):
      • [NOT STARTED] aurora-cdntest → [report]
      • [NOT STARTED] aurora → [report]
DevEd 69.0b2
  • Build: 69.0b2-build1 (88e401857465, 20190704152356 ) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Session Restore and Download Manager → TestRail
      • [DONE] [Bug fix verification]
    • Update tests (manual):
      • [NOT STARTED] aurora-cdntest → Report
      • [NOT STARTED] aurora → Report
DevEd 69.0b5
  • Build: 69.0b5-build1 ([], ) - Sign off_Status
    • Functional tests (manual):
      • [IN PROGRESS] Developer Edition Recurring Sign off → [TestRail]
      • [NOT STARTED] [Bug fix verification]
    • Update tests (manual):
      • [NOT STARTED] aurora-cdntest → [report]
      • [NOT STARTED] aurora → [report]
DevEd 69.0b9
  • Build: 69.0b9-build2 (7a6223dba05a, 20190730004747) - GREEN
    • Functional tests (manual):
      • [DONE] Developer Edition Recurring Sign off → TestRail
      • [DONE] [Bug fix verification]
    • Update tests (manual):
      • [DONE] aurora-cdntest (as part of Beta 69.0b9 update tests)
      • [DONE] aurora (as part of Beta 69.0b9 update tests)
DevEd 69.0b13
  • Build: 69.0b13-build1 (8ecc148a2fad, 20190812173625) - IN PROGRESS
    • Functional tests (manual):
      • [IN PROGRESS] Developer Edition Recurring Sign off → TestRail
      • [IN PROGRESS] [Bug fix verification]
    • Update tests (manual):
      • [NOT STARTED] aurora-cdntest (as part of Beta 69.0b9 update tests)
      • [NOT STARTED] aurora (as part of Beta 69.0b9 update tests)

Beta build readiness

Beta 69.0b3
  • Build: 69.0b3-build1 (9cdcc170dc1a, 20190708182549) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Search and Awesomebar & indicators → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → TestRail
      • [DONE] Smoke testing on DLL interceptor → Test Results
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 69.0b4
  • Build: 69.0b4-build2 (a7b97568af69, 20190712011116) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Media playback & support and Profile support & compatibility → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug list
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → report
Beta 69.0b5
  • Build: 69.0b5-build1 (e5d98eda2ec3, 20190715173502) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on WebExtensions compatibility & support and Content scroll, zoom & drag support → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report
Beta 69.0b6
  • Build: 69.0b6-build1 (df88785f07c8, 20190718172058) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Graphics, Crash and Build installation & uninstallation → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → [ report]
Beta 69.0b7
  • Build: 69.0b7-build1 (f8413df45c55, 20190722201635) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Plug-ins', Safe browsing and Geolocation → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → [ report]
Beta 69.0b8
  • Build: 69.0b8-build1 (53bb71da50e5, 20190722201635) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Default & custom theme support and Image compatibility & support → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [DONE] beta, aurora → [report]
Beta 69.0b9
  • Build: 69.0b9-build3 (7a6223dba05a,20190730004747 ) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Crash Reporting , Graphics compatibility & support → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → [report]
      • [IN PROGRESS] Bug fix verification – 17
    • Update tests (manual):
      • [NOT STARTED] beta-cdntest, aurora-cdntest → report]
      • [NOT STARTED] beta, aurora → report]
Beta 69.0b10
  • Build: 69.0b10-build1 (2fc476538438, 20190801185445) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on In-browser PDF support and Anti-Tracking-Privacy → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report]
Beta 69.0b11
  • Build: 69.0b11-build1 ([], ) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Session Restore and Downloads → [1]
      • [DONE] Smoke testing on Ubuntu snap package → [2]
      • [DONE] Bug fix verification – [3]
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report
Beta 69.0b12
  • Build: 69.0b12-build1 (8055f364e2cc, 20190807220259) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Graphics, Adress Bar and Smart Card → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report
Beta 69.0b13
  • Build: 69.0b13-build1 (8ecc148a2fad, 20190812173625) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Plug-ins and Bookmarks and History → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report
Beta 69.0b14
  • Build: 69.0b14-build1 (3a3ff2f2324c 3a3ff2f2324c, 20190815163925) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Search and Data Migration → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report
Beta 69.0b15
  • Build: 69.0b15-build1 (66a12ddcf77c, 20190819184224) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Safe Browsing, WebExtensions and Crash Reporting → TestRail
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Bug fix verification – Bug List
    • Update tests (manual):
      • [DONE] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report
Beta 69.0b16
  • Build: 69.0b16-build1 (91c666707c21, 20190822210915) - GREEN
    • Functional tests (manual):
      • [IN PROGRESS] Smoke, Regression and Exploratory testing on Password Manager & Form Autofill and Startup and Profile → [4]
      • [IN PROGRESS] Smoke testing on Ubuntu snap package → report
      • [IN PROGRESS] Bug fix verification – Bug List
    • Update tests (manual):
      • [NOT STARTED] beta-cdntest, aurora-cdntest → report
      • [NOT STARTED] beta, aurora → report

Release 69 milestones

RC1 69.0
  • Build: 69.0-build2 (9f9b19ca38c2, 20190827005903) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on _ → report
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Smoke testing on Windows Acer builds → report
      • [IN PROGRESS] Bug fix verification – Bug verification
    • Update tests (manual):
      • [DONE] beta-cdntest → report
      • [NOT STARTED] beta → report
      • [DONE] release-localtest → report
      • [NOT STARTED] release-cdntest → report
      • [NOT STARTED] release → report
RC 69.0.1
  • Build: 69.0.1-build1 (bf6ea738ba07, 20190917135527) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Web Compatibility → report
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Smoke testing on Windows Acer builds → report
      • [DONE] Bug fix verification – Bug verification
    • Update tests (manual):
      • [DONE] release-cdntest → report
      • [NOT STARTED] release → report
RC 69.0.2
  • Build: 69.0.2-build1 (e40b66e55c28, 20191001234643) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Web Compatibility & Telemetry → report
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Smoke testing on Windows Acer builds → report
      • [DONE] Bug fix verification – Bug verification
    • Update tests (manual):
RC 69.0.3
  • Build: 69.0.3-build1 (c4227f95dae9, 20191009172106) - GREEN
    • Functional tests (manual):
      • [DONE] Smoke, Regression and Exploratory testing on Web Compatibility & Telemetry → report
      • [DONE] Smoke testing on Ubuntu snap package → report
      • [DONE] Smoke testing on Windows Acer builds → report
      • [DONE] Bug fix verification – Bug verification
    • Update tests (manual):
      • [NOT STARTED] release-cdntest → [link report]
      • [NOT STARTED] release → [link report]
Retrieved from "https://dev.wikimo.nonprod.webservices.mozgcp.net/index.php?title=Releases/Firefox_69/Test_Plan&oldid=1218887"