QA/Firefox3.5/TestPlan/Alpha1: Difference between revisions
< QA | Firefox3.5 | TestPlan
Jump to navigation
Jump to search
Samuelsidler (talk | contribs) |
|||
(21 intermediate revisions by 4 users not shown) | |||
Line 28: | Line 28: | ||
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1 | **Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1 | ||
**Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1 | **Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1 | ||
**Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1 | |||
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1 | |||
===Build 2 (mac respin)=== | ===Build 2 (mac respin only)=== | ||
*ftp://ftp.mozilla.org/pub/firefox/nightly/3.1a1-candidates/build2/ | *ftp://ftp.mozilla.org/pub/firefox/nightly/3.1a1-candidates/build2/ | ||
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1 | ** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1 | ||
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1 | |||
== Test Coverage == | == Test Coverage == | ||
Line 74: | Line 77: | ||
**[https://bugzilla.mozilla.org/show_bug.cgi?id=444963 Bug 444963] - Sites with java applets freeze the browser and require a force quit '''Pending blocker review''' | **[https://bugzilla.mozilla.org/show_bug.cgi?id=444963 Bug 444963] - Sites with java applets freeze the browser and require a force quit '''Pending blocker review''' | ||
*Themes were not tested due to the fact no themes were compatible | *Themes were not tested due to the fact no themes were compatible | ||
'''Testing of Build 2 [marcia] ''' | |||
*Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1 | |||
*Bugs Filed | |||
**[https://bugzilla.mozilla.org/show_bug.cgi?id=448023 Bug 448203] | |||
**[https://bugzilla.mozilla.org/show_bug.cgi?id=448031 Bug 448031] | |||
====Linux [hasham]==== | ====Linux [hasham]==== | ||
Line 100: | Line 109: | ||
*Tested Installing Certificates - PASS | *Tested Installing Certificates - PASS | ||
*Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected. | *Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected. | ||
====Verifying Signing on XP [Hasham] ==== | |||
*'''PASS''' | |||
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1 | |||
====Verifying Signing on Vista [marcia]==== | |||
*'''PASS''' | |||
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1 | |||
**Checked updater, crash reporter, app and several dlls and all were signed | |||
====Verify Crash Reporter fires==== | |||
*Install Crash Reporter xpi and verify Crash Reporter fires | |||
**XP - Hasham - '''PASS''' | |||
**Vista - marcia | |||
**'''PASS''' using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1 | |||
**Mac - marcia | |||
** '''PASS''' using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1 | |||
**Linux - Tomcat | |||
** using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1 | |||
====Spot Checks of Live Builds==== | |||
*Sanity check of all builds from ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/3.1a1/ to make sure Build IDs match | |||
[[Category:Shiretoko Alpha|1]] |
Latest revision as of 03:44, 24 March 2009
Firefox 3.1 Alpha1 Test Results
The covered testing for this release will focus on smoketests and spotchecks. This will only be on the en-US locale.
Related Pages
Contact Info
PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony / Marcia / Hasham
Schedule
- Builds hand to QA
- ETA 7/23
- QA test signoff
- ETA 7/25
- Smoketests PASS
- Spotchecks PASS
Build Location and IDs
Build 1
- http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
Build 2 (mac respin only)
- ftp://ftp.mozilla.org/pub/firefox/nightly/3.1a1-candidates/build2/
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
Test Coverage
- Areas Covered (en-US):
- Spotchecks
- Smoketests
- Areas Not Covered:
- BFTs
- FFTs
- Updates
- L10n
- Web regression
Test Results
Types of Tests | Windows XP | Mac 10.5 | Linux |
---|---|---|---|
Smoketests | Hasham - PASS | Marcia - PASS | Hasham - PASS |
Spotchecks | Hasham - PASS | Marcia - PASS | Hasham - PASS |
Smoketests Results
Mac Leopard [marcia]
- PASS
- Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Bugs Filed
- Bugs Hit during testing
- Bug 444963 - Sites with java applets freeze the browser and require a force quit Pending blocker review
- Themes were not tested due to the fact no themes were compatible
Testing of Build 2 [marcia]
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Bugs Filed
Linux [hasham]
- PASS
- Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Bugs Filed -
- Bug 447690 - Rendering issue with Litmus on 3.1 SCREENSHOT
- Bugs Come Across -
- Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)
Windows XP [hasham]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Bugs Come Across -
- Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)
Spotcheck Results
Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken. Test a few extensions and plugins to make sure web compatibility looks good.
Spotchecks on 10.4/10.5 [marcia]
- Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1/Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Tested the Alexa Top 10 Global Sites - PASS
- Tested Installing Certificates - PASS
- Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.
Verifying Signing on XP [Hasham]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Verifying Signing on Vista [marcia]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Checked updater, crash reporter, app and several dlls and all were signed
Verify Crash Reporter fires
- Install Crash Reporter xpi and verify Crash Reporter fires
- XP - Hasham - PASS
- Vista - marcia
- PASS using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Mac - marcia
- PASS using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Linux - Tomcat
- using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
Spot Checks of Live Builds
- Sanity check of all builds from ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/3.1a1/ to make sure Build IDs match