Releases/Firefox 5b1/Test Plan:Updates: Difference between revisions
Line 127: | Line 127: | ||
===mac (10.5.8) (marcia)=== | ===mac (10.5.8) (marcia)=== | ||
*3.7a5 | *3.7a5 '''PASS''' | ||
** | **Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.3a5) Gecko/20100610 MozillaDeveloperPreview/3.7a5 | ||
** Crash when the update is being applied (Apple Crash Reporter) | **Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:5.0b1) Gecko/20100101 Firefox/5.0 | ||
**Billboard: Text | |||
**Test Pilot: PASS | |||
**Notes | |||
*** Crash when the update is being applied (Apple Crash Reporter) | |||
*** TP not installed in the alpha. After update goes to 1.0.9. Manually updated to 1.1.1 | |||
*4.0b11 | *4.0b11 |
Revision as of 22:24, 3 May 2011
Fx5 Channel switcher (not-auto)
Qualifying 5.0b1
Note: MUs will not be offered to FF3.7a1,a2 because of a change in size of billboard. MUs will be offered to FF3.7a3/4/5 and to FF4.0b* users --> 5.0b1.
Relevant Bugs
https://bugzilla.mozilla.org/show_bug.cgi?id=653636 is the main bug for Billboard Testing
https://bugzilla.mozilla.org/show_bug.cgi?id=654343 is a won't fix, so some users will not get the graphical version of the billboard update.
First Round MU testing
First round of testing performed by marcia and geo on 2011-05-02
linux (geo)
- 3.7a5 (placeholder) disabled addon: Ubuntu Firefox Modifications
- 4.0b12 (billboard)
linux64 (geo)
- 3.7a5 (placeholder) disabled addon: Ubuntu Firefox Modifications
- 4.0b12 (billboard)
mac (10.6) (marcia)
- 3.7a5 (Note 32 bit builds will not work, Mac64 builds will work)
- Filed https://bugzilla.mozilla.org/show_bug.cgi?id=654306
- Hit https://bugzilla.mozilla.org/show_bug.cgi?id=577967 while testing on two machines. Unfortunately the fix for this bug came after MozDev Preview was cut
- 4.0b12 (billboard)
mac (10.5) (marcia)
- 3.7a5
- https://bugzilla.mozilla.org/show_bug.cgi?id=577967 while testing on 10.5 machine. Unfortunately the fix for this bug came after MozDev Preview was cut. Will try on another 10.5 machine.
- 4.0b12 (billboard)
vista (geo)
- 3.7a5 (placeholder)
- 4.0b12 (billboard)
win7_64 (geo)
- 3.7a5 (placeholder)
- 4.0b12 (billboard)
winxp (geo)
- 3.7a5
- 4.0b12
win7 (time permitting)
- 3.7a5
- 4.0b12 (billboard)
win2k (time permitting)
- 3.7a5
- 4.0b12
Second Round MU Testing
What we will be checking on en-US only:
- MU Billboard offered on <betatest> for 3.7a5 (text-only)
- MU Billboard offered on <betatest> for 4.0b12 (graphical)
- MU Billboard NOT offered on <betatest> for 3.7a1
- MU installs for 3.7a5 and 4.0b12 on <betatest>
- Test Pilot compatibility during and post update (should update to 1.1.1, display all studies)
Please specify if you receive the Graphical Billboard Update or the Text Version. Due to bug 654343, 3.7a3 thru to 4.0b6 will not get the Graphical Billboard update.
MUs will not be offered to FF3.7a1,a2 because of a change in size of billboard. MUs will be offered to FF3.7a3/4/5 and to FF4.0b* users --> 5.0b1.
linux (ashughes)
- 3.7a5 en-US: PASS (see notes)
- Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.3a5) Gecko/20100610 MozillaDeveloperPreview/3.7a5
- Mozilla/5.0 (X11; Linux i686; rv:5.0b1) Gecko/20100101 Firefox/5.0
- Test Pilot: FAIL (see notes)
- Notes:
- Update offered was labeled "Mozilla Developer Preview 5"
- Test Pilot is not installed initially with Firefox 3.7a5
- Post-update I see "Feedback 1.0.9" in add-ons list but no "Test Pilot" in the Tools menu
- Feedback > All Studies > Current permanently displays "Loading", never loads any studies
- 4.0b12 en-US: PASS
- Mozilla/5.0 (X11; Linux i686; rv:2.0b12) Gecko/20100101 Firefox/4.0b12
- Mozilla/5.0 (X11; Linux i686; rv:5.0b1) Gecko/20100101 Firefox/5.0
- Billboard: Graphical
- Test Pilot: PASS
- Feedback 1.0.6 -> 1.0.9
- No compatibility check, just updated seamlessly
- "All Studies" viewable
linux64 (ashughes)
- 3.7a4
- 4.0b9
mac (10.6) (marcia)
- 3.7a4
- PASS - Text Billboard Offer
- 4.0b6 en-US: PASS
- Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0b6) Gecko/20100101 Firefox/4.0b6
- Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0b1) Gecko/20100101 Firefox/5.0
- Billboard: Text
- Test Pilot: PASS
- Feedback 1.0.3 -> 1.0.9, then had to manually update to 1.1.1 after 5.0 update applied
mac (10.5.8) (marcia)
- 3.7a5 PASS
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.3a5) Gecko/20100610 MozillaDeveloperPreview/3.7a5
- Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:5.0b1) Gecko/20100101 Firefox/5.0
- Billboard: Text
- Test Pilot: PASS
- Notes
- Crash when the update is being applied (Apple Crash Reporter)
- TP not installed in the alpha. After update goes to 1.0.9. Manually updated to 1.1.1
- 4.0b11
- PASS - Graphical billboard offer
vista (geo)
- 3.7a1
- EXPECTED: no update
- ACTUAL: update to 5.0 w/ broken billboard prompt (screenshot of dialog)
- Feedback 1.0.9 after update; user studies did not load. Searched for ext. updates, got 1.1.1, user studies loaded.
- 4.0b10
win7_64 (geo)
- 3.7a5
- 4.0b11
winxp (geo)
- 3.7a5
- 4.0b6
win7 (time permitting)
- 3.7a4
- 4.0b3
win2k (time permitting)
- 3.7a4
- 4.0b5
Bugs filed during Test Cycle
- https://bugzilla.mozilla.org/show_bug.cgi?id=654343 Not getting offered Billboard graphic in update from 3.7a5
- https://bugzilla.mozilla.org/show_bug.cgi?id=654306 [Mac] Major Update Billboard not offered from 3.7a5 thru 4.0b6 Universal builds