QA/Firefox3.5/TestPlan/Alpha1: Difference between revisions

From MozillaWiki
< QA‎ | Firefox3.5‎ | TestPlan
Jump to navigation Jump to search
 
(23 intermediate revisions by 5 users not shown)
Line 18: Line 18:


;QA test signoff: ETA 7/25
;QA test signoff: ETA 7/25
* Smoketests '''result'''
* Smoketests '''PASS'''
* Spotchecks '''result'''
* Spotchecks '''PASS'''


== Build Location and IDs ==
== Build Location and IDs ==


===Build 1===
*http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
*http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
===Build 2 (mac respin only)===
*ftp://ftp.mozilla.org/pub/firefox/nightly/3.1a1-candidates/build2/
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1


== Test Coverage ==  
== Test Coverage ==  
Line 69: Line 77:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=444963 Bug 444963] - Sites with java applets freeze the browser and require a force quit '''Pending blocker review'''
**[https://bugzilla.mozilla.org/show_bug.cgi?id=444963 Bug 444963] - Sites with java applets freeze the browser and require a force quit '''Pending blocker review'''
*Themes were not tested due to the fact no themes were compatible
*Themes were not tested due to the fact no themes were compatible
'''Testing of Build 2 [marcia] '''
*Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
*Bugs Filed
**[https://bugzilla.mozilla.org/show_bug.cgi?id=448023 Bug 448203]
**[https://bugzilla.mozilla.org/show_bug.cgi?id=448031 Bug 448031]


====Linux [hasham]====
====Linux [hasham]====
Line 95: Line 109:
*Tested Installing Certificates - PASS
*Tested Installing Certificates - PASS
*Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.
*Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.
====Verifying Signing on XP [Hasham] ====
*'''PASS'''
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
====Verifying Signing on Vista [marcia]====
*'''PASS'''
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Checked updater, crash reporter, app and several dlls and all were signed
====Verify Crash Reporter fires====
*Install Crash Reporter xpi and verify Crash Reporter fires
**XP - Hasham - '''PASS'''
**Vista - marcia
**'''PASS''' using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Mac - marcia
** '''PASS''' using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
**Linux - Tomcat
** using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
====Spot Checks of Live Builds====
*Sanity check of all builds from ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/3.1a1/ to make sure Build IDs match
[[Category:Shiretoko Alpha|1]]

Latest revision as of 03:44, 24 March 2009

« QA/Firefox3.1/TestPlan

Firefox 3.1 Alpha1 Test Results

The covered testing for this release will focus on smoketests and spotchecks. This will only be on the en-US locale.

Related Pages

Firefox 3.1 Tracking Site

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony / Marcia / Hasham

Schedule

Builds hand to QA
ETA 7/23
QA test signoff
ETA 7/25
  • Smoketests PASS
  • Spotchecks PASS

Build Location and IDs

Build 1

  • http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1

Build 2 (mac respin only)

Test Coverage

  • Areas Covered (en-US):
    • Spotchecks
    • Smoketests
  • Areas Not Covered:
    • BFTs
    • FFTs
    • Updates
    • L10n
    • Web regression

Test Results

Types of Tests Windows XP Mac 10.5 Linux
Smoketests Hasham - PASS Marcia - PASS Hasham - PASS
Spotchecks Hasham - PASS Marcia - PASS Hasham - PASS

Smoketests Results

Mac Leopard [marcia]

  • PASS
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
  • Bugs Filed
  • Bugs Hit during testing
    • Bug 444963 - Sites with java applets freeze the browser and require a force quit Pending blocker review
  • Themes were not tested due to the fact no themes were compatible

Testing of Build 2 [marcia]

  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
  • Bugs Filed

Linux [hasham]

  • PASS
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
  • Bugs Filed -
  • Bugs Come Across -
    • Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)

Windows XP [hasham]

  • PASS
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
  • Bugs Come Across -
    • Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)

Spotcheck Results

Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken. Test a few extensions and plugins to make sure web compatibility looks good.

Spotchecks on 10.4/10.5 [marcia]

  • Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1/Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
  • Tested the Alexa Top 10 Global Sites - PASS
  • Tested Installing Certificates - PASS
  • Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.

Verifying Signing on XP [Hasham]

  • PASS
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1

Verifying Signing on Vista [marcia]

  • PASS
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
    • Checked updater, crash reporter, app and several dlls and all were signed

Verify Crash Reporter fires

  • Install Crash Reporter xpi and verify Crash Reporter fires
    • XP - Hasham - PASS
    • Vista - marcia
    • PASS using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
    • Mac - marcia
    • PASS using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
    • Linux - Tomcat
    • using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1

Spot Checks of Live Builds

Retrieved from "https://dev.wikimo.nonprod.webservices.mozgcp.net/index.php?title=QA/Firefox3.5/TestPlan/Alpha1&oldid=135707"