QA/Send Tab: Difference between revisions
Line 63: | Line 63: | ||
== Channel dependent settings (configs) and environment setups == | == Channel dependent settings (configs) and environment setups == | ||
=== Nightly === | === Nightly === | ||
Firefox Nightly 56.0a1, no special configuration is required<br> | |||
Firefox Nightly 56.0a1 <br | |||
=== Beta === | === Beta === | ||
Beta 56.0bx, no special configuration is required<br> | |||
Beta 56. | |||
< | |||
= Test Strategy = | = Test Strategy = |
Revision as of 17:40, 10 August 2017
Revision History
This section describes the modifications that have been made to this wiki page. A new row has been completed each time the content of this document is updated (small corrections for typographical errors do not need to be recorded). The description of the modification contains the differences from the prior version, in terms of what sections were updated and to what extent.
Date | Version | Author | Description |
---|---|---|---|
7/31/2017 | 1.0 | Abe Masresha | Created first draft |
Overview
Purpose
The purpose of this work is to make the send tab discoverable to non-Sync/FxA users
Scope
- Testing will focus on:
- Stability of the browser with this work.
- If send tab is discoverable to non-Sync/FxA users (Desktop only - at this time)
- If user able to send links to other devices when signed-in to sync
- How testing will be performed:
- Manual
- Automation is covered by the developer
- [Link to automation test script will be provided here]
Ownership
Mozilla Development
Edouard Oger
QA Eng. Softvision Las Vegas
Stefan Georgiev - Team Lead
Abe Masresha - Test Lead
Justin Williams - Tester
Grover Wimberly IV - Tester
Kanchan Kumari - Tester
Testing summary
Scope of Testing
In Scope
This feature will be tested manually on Windows, Mac, and Linux operating systems and on iOS and Android devices.
Out of Scope
Automation will be handled by the developer
Risk Analysis
- The send tab feature may not send tab
- The send tab may not be discoverable to non-Sync/FxA users (Desktop only - at this time)
Requirements for testing
Test Environment Combinations
Windows 10 with iOS device Windows 7 32bits with Linux OS Linux with Android device MacOSX 10.12 with Android device Android with another Android device
Channel dependent settings (configs) and environment setups
Nightly
Firefox Nightly 56.0a1, no special configuration is required
Beta
Beta 56.0bx, no special configuration is required
Test Strategy
Test Objectives
Testing will focus on verifying the following scenarios:
- Unconfigured-Sync not loaded
- Unconfigured-Sync loaded
- Signed-in - Sync not loaded
- Signed-in - Sync loaded
- Signed-in but unverified
- Signed-in but password changed
- Signed-in with only 1 device
- Signed-in (happy case)
- Signed-in / Unsendable link
Builds
This section should contain links for builds with the feature -
- Links for Nightly builds: Lastest nightly
- Links for Beta builds [Will be here when it is ready]
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
Project phase | Start Date | End Date |
---|---|---|
Start project | 07/25/2017 | |
Study documentation/specs received from developers | 07/25/2017 | |
QA - Test plan creation | 7/31/2017 | |
QA - Test cases/Env preparation | 7/25/2017 | |
QA - Nightly Testing | 7/27/2017 | |
QA - Beta Testing | ||
Release Date |
Testing Tools
Detail the tools to be used for testing, for example see the following table:
Process | Tool |
---|---|
Test plan creation | Mozilla wiki |
Test case creation | TestRail/ Google docs |
Test case execution | TestRail |
Bugs management | Bugzilla |
Status
Overview
Landed on Nightly on: 7/19/2017
Merged to Beta on: [date]
References
Testcases
Test Areas
Test Areas | Covered | Details |
---|---|---|
Private Window | n/a | |
Multi-Process Enabled | Yes | |
Multi-process Disabled | n/a | |
Theme (high contrast) | n/a | |
Install/Upgrade | ||
Feature upgrades /Browser update | n/a | |
Add-ons | ||
Addon API required? | n/a | |
Testing with existing/popular addons | yes | Feature functionality will be tested with popular addons |
Web Compatibility | ||
Survey of popular sites for compatibility | n/a | |
Interoperability | ||
Interaction of this feature with other browser features | n/a |
Test suite
Full Test suite - Link to test rail - testcases should be added under Firefox Desktop project link Smoke Test suite - Link with the tests - if available/needed Regression Test suite - Link with the tests - if available/needed
Bug Work
Bug No | Summary | Status | Firefox Version |
---|---|---|---|
1385440 | Only one device receives the link when "Send to All Devices" is clicked | NEW | 56 |
1385442 | Android device is not listed in sync'd device list on mac | NEW | 56 |
1385451 | in Android "send to other devices" is not displayed | NEW | 56 |
1385454 | on Android, "verify your account" option is not available when the user changes password from other device | NEW | 56 |
1385930 | Frozen spinner is shown when there are no devices to send tab to (iOS) | NEW | 56 |
1385442 | In Android, Send Tab is not discoverable to non Sync/FxA users | RESOLVED INVALID | 56 |
1385447 | All previously logged in devices are displayed in sync'd device list | RESOLVED WORKSFORME | 56 |
Sign off
Criteria
Checklist
- All test cases should be executed
- Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
List of OSes that will be covered by testing
- Link for the tests run
- Full Test suite, link to TestRail - Tests Runs and Results link
- Daily Smoke, if needed/available
- Regression Test suite, if needed/available
Merge to Beta Sign-off
List of OSes that will be covered by testing
- Link for the tests run
- Full Test suite
Checklist
Exit Criteria | Status | Notes/Details |
---|---|---|
Testing Prerequisites (specs, use cases) | [DONE] | |
Testing Infrastructure setup | [DONE] | |
Test Plan Creation | [DONE] | |
Test Cases Creation | [DONE] | |
Automation Coverage | Covered by developer/ if needed | |
Performance Testing | Covered by developer /if needed | |
All Defects Logged | ||
Critical/Blockers Fixed and Verified | ||
Basic/Core functionality Nightly testing | ||
QA mid-Nightly Signoff | missed- test build and documentations were not available for QE | |
QA pre-Beta Signoff | signed-off with YELLOW | |
QA Beta - Full Testing | ||
QA pre-Release Signoff | Email to be sent |