QA/Firefox3.5/TestPlan/Alpha1
< QA | Firefox3.5 | TestPlan
Jump to navigation
Jump to search
Firefox 3.1 Alpha1 Test Results
The covered testing for this release will focus on smoketests and spotchecks. This will only be on the en-US locale.
Related Pages
Contact Info
PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony / Marcia / Hasham
Schedule
- Builds hand to QA
- ETA 7/23
- QA test signoff
- ETA 7/25
- Smoketests PASS
- Spotchecks PASS
Build Location and IDs
Build 1
- http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
Build 2 (mac respin only)
- ftp://ftp.mozilla.org/pub/firefox/nightly/3.1a1-candidates/build2/
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
Test Coverage
- Areas Covered (en-US):
- Spotchecks
- Smoketests
- Areas Not Covered:
- BFTs
- FFTs
- Updates
- L10n
- Web regression
Test Results
Types of Tests | Windows XP | Mac 10.5 | Linux |
---|---|---|---|
Smoketests | Hasham - PASS | Marcia - PASS | Hasham - PASS |
Spotchecks | Hasham - PASS | Marcia - PASS | Hasham - PASS |
Smoketests Results
Mac Leopard [marcia]
- PASS
- Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Bugs Filed
- Bugs Hit during testing
- Bug 444963 - Sites with java applets freeze the browser and require a force quit Pending blocker review
- Themes were not tested due to the fact no themes were compatible
Testing of Build 2 [marcia]
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Bugs Filed
Linux [hasham]
- PASS
- Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Bugs Filed -
- Bug 447690 - Rendering issue with Litmus on 3.1 SCREENSHOT
- Bugs Come Across -
- Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)
Windows XP [hasham]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Bugs Come Across -
- Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)
Spotcheck Results
Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken. Test a few extensions and plugins to make sure web compatibility looks good.
Spotchecks on 10.4/10.5 [marcia]
- Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1/Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Tested the Alexa Top 10 Global Sites - PASS
- Tested Installing Certificates - PASS
- Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.
Verifying Signing on XP [Hasham]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Verifying Signing on Vista [marcia]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Checked updater, crash reporter, app and several dlls and all were signed
Verify Crash Reporter fires
- Install Crash Reporter xpi and verify Crash Reporter fires
- XP - Hasham - PASS
- Vista - marcia
- PASS using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Mac - marcia
- PASS using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Linux - Tomcat
- using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected
Spot Checks of Live Builds
- Sanity check of all builds from ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/3.1a1/ to make sure Build IDs match