QA/Send Tab

< QA
Revision as of 19:23, 31 July 2017 by Amasresha (talk | contribs) (Created page with "'''Revision History''' This section describes the modifications that have been made to this wiki page. A new row has been completed each time the content of this document is...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Revision History

This section describes the modifications that have been made to this wiki page. A new row has been completed each time the content of this document is updated (small corrections for typographical errors do not need to be recorded). The description of the modification contains the differences from the prior version, in terms of what sections were updated and to what extent.

Date Version Author Description
7/31/2017 1.0 Abe Masresha Created first draft

Overview

Purpose

The purpose of this work is to make the send tab option discoverable to non-Sync/FxA users


Scope

  • Testing will focus on:
Stability of the browser with this work.
If send tab is discoverable to non-Sync/FxA users (Desktop only - at this time)
If user able to send links to other devices when signed-in to sync
  • How testing will be performed:
Manual
  • Automation is covered by the developer
[Link to automation test script will be provided here]


Ownership

Mozilla Development
Matt Howell

QA Eng. Softvision Las Vegas
Stefan Georgiev - Team Lead
Abe Masresha - Test Lead
Justin Williams - Tester
Grover Wimberly IV - Tester
Kanchan Kumari - Tester

Testing summary

Scope of Testing

In Scope

This feature will be tested manually on Windows, Mac, and Linux operating systems and on iOS and Android devices.

Out of Scope

Automation will be handled by the developer

Risk Analysis

  • The send tab feature may not send tab
  • The send tab may not be discoverable to non-Sync/FxA users (Desktop only - at this time)

Requirements for testing

Test Environment Combinations

Windows 10 with iOS device
Windows 7 32bits with Linux OS
Linux with Android device
MacOSX 10.12 with Android device
Android with another Android device


Channel dependent settings (configs) and environment setups

Nightly

Firefox Nightly 56.0a1

Beta

Beta 56.0b1

Test Strategy

Test Objectives

Test focus on verifying the following scenarios:

  • Unconfigured-Sync not loaded
  • Unconfigured-Sync loaded
  • Signed-in - Sync not loaded
  • Signed-in - Sync loaded
  • Signed-in but unverified
  • Signed-in but password changed
  • Signed-in with only 1 device
  • Signed-in (happy case)
  • Signed-in / Unsendable link

Builds

This section should contain links for builds with the feature -

  • Links for Nightly builds: Lastest nightly
  • Links for Beta builds [Will be here when it is ready]

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 07/25/2017
Study documentation/specs received from developers 07/25/2017
QA - Test plan creation 7/31/2017
QA - Test cases/Env preparation 7/25/2017
QA - Nightly Testing 7/27/2017
QA - Beta Testing
Release Date

Testing Tools

Detail the tools to be used for testing, for example see the following table:

Process Tool
Test plan creation Mozilla wiki
Test case creation TestRail/ Google docs
Test case execution TestRail
Bugs management Bugzilla

Status

Overview

Landed on Nightly on: 7/19/2017
Merged to Beta on: [date]

References

Testcases

Test Areas

Test Areas Covered Details
Private Window n/a
Multi-Process Enabled Yes
Multi-process Disabled n/a
Theme (high contrast) n/a
Install/Upgrade
Feature upgrades /Browser update n/a
Add-ons
Addon API required? n/a
Testing with existing/popular addons yes Feature functionality will be tested with popular addons
Web Compatibility
Survey of popular sites for compatibility n/a
Interoperability
Interaction of this feature with other browser features n/a

Test suite

Full Test suite - Link to test rail - testcases should be added under Firefox Desktop project link
Smoke Test suite - Link with the tests - if available/needed
Regression Test suite - Link with the tests - if available/needed

Bug Work

Bug No Summary Status Firefox Version
1385440 Only one device receives the link when "Send to All Devices" is clicked NEW 56
1385442 Android device is not listed in sync'd device list on mac NEW 56
1385451 in Android "send to other devices" is not displayed NEW 56
1385454 on Android, "verify your account" option is not available when the user changes password from other device NEW 56
1385930 Frozen spinner is shown when there are no devices to send tab to (iOS) NEW 56
1385442 In Android, Send Tab is not discoverable to non Sync/FxA users RESOLVED INVALID 56
1385447 All previously logged in devices are displayed in sync'd device list RESOLVED WORKSFORME 56

Sign off

Criteria

Checklist

  • All test cases should be executed
  • Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Nightly testing

List of OSes that will be covered by testing

  • Link for the tests run
    • Full Test suite, link to TestRail - Tests Runs and Results link
    • Daily Smoke, if needed/available
    • Regression Test suite, if needed/available


Merge to Beta Sign-off
List of OSes that will be covered by testing

  • Link for the tests run
    • Full Test suite

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases) [DONE]
Testing Infrastructure setup [DONE]
Test Plan Creation [DONE]
Test Cases Creation [DONE]
Automation Coverage Covered by developer/ if needed
Performance Testing Covered by developer /if needed
All Defects Logged
Critical/Blockers Fixed and Verified
Basic/Core functionality Nightly testing
QA mid-Nightly Signoff Email to be sent
QA pre-Beta Signoff Email to be sent
QA Beta - Full Testing
QA pre-Release Signoff Email to be sent