TestEngineering: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(new team structure)
 
(22 intermediate revisions by 5 users not shown)
Line 1: Line 1:


= Overview =
= Mission Statement =
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).
The Test Engineering team supports the larger Firefox organization by enabling identification of risk to our products and eliminating quality related blind spots through tooling, testing, automation, benchmarks, and reporting.


= Mission =
More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/
Our mission is to provide testing and tools to positively impact the quality of Mozilla sites, apps, and services.


= The Team =
= Focus Areas =
* Manager: Stuart Philp
* Technical Lead: Krupa Raj
* Technical Lead: [https://mozillians.org/u/davehunt/ Dave Hunt]
* Technical Lead: Richard Pappalardo
* Staff Engineer: Tarek Ziade
* Senior Test Engineer: [[User:Kthiessen|Karl Thiessen]]
* Senior Test Engineer: Peter deHaan
* Staff Test Engineer: Chris Hartjes
* Senior Test Engineer: [https://mozillians.org/en-US/u/stephend/ Stephen Donner]
* Senior Test Engineer: Kevin Brosnan
* Senior Test Engineer: Aaron Train
* Senior Test Engineer: Matt Brandt
* Senior Test Engineer: Rebecca Billings
* Senior Test Engineer: John Dorlus
* Senior Test Engineer: No-Jun Park
* Junior Test Engineer: Benny Forehand Jr.


=Technical Groups=
* Interop
Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.
* Performance
* GeckoView
* Fenix
* Amazon
* CI Automation
* Ecosystem
* Telemetry
* Premium Services
* Energy
* Accessibility
* Reporting
* Monitoring
* Experiments


==User Interfaces==
= Enduring Objectives =
* https://wiki.mozilla.org/TestEngineering/UI
* Increase visibility into product risks
* Lead: Dave Hunt
** Streamline reporting
** Reduce blind spots
* Improve efficiency and clarity of risk assessments
** Tight feedback loops
** Be opinionated (i.e binary or traffic light recommendations)
** Reduce guesswork, roundtrips
** Standardize between projects and types of reports
* Maintain or improve coverage and quality standards
** Identify and fill gaps
** Document and measure existing work
** Establish/Improve release criteria consistency
** Reduce effort on maintenance
* Reduce cross-functional friction
** Advocacy
** Reporting
** Tools
** Benchmarks
** Relationship building


==Services==
=People=
* https://wiki.mozilla.org/TestEngineering/Services
* Lead: Richard Pappalardo


==Customization==
Director: Stuart Philp
* https://wiki.mozilla.org/TestEngineering/Customization
* Lead: Krupa Raj


=Full Project List=
Architect: Tarek Ziade
{| class="wikitable sortable"
 
|-
==Interop==
! Project !! Primary !! Secondary !! IRC Channel !! Technical Group !! Test Suite !! Unit !! Functional/UI !! Load !! Performance !! Accessibility !! Security !! Localization !! Swagger (route def)
Manager: David Burns
|-
 
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
==Performance==
| style="background:lightgray;text-align:center;" | n/a
Manager: Dave Hunt
| style="background:lightgray;text-align:center;" | n/a
 
| style="background:pink;text-align:center;" | none
==Ecosystem==
| style="background:lightgray;text-align:center;" | n/a
Manager: Krupa Raj
| style="background:lightgray;text-align:center;" | n/a
 
| style="background:lightgray;text-align:center;" | n/a
==CI Automation==
| style="background:lightgray;text-align:center;" | n/a
Manager: Joel Maher
| style="background:lightgray;text-align:center;" | n/a
 
| style="background:lightgray;text-align:center;" | n/a
==Mobile==
|-
Manager: No-Jun Park
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/35]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/37]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Socorro || Matt || Richard || #socorro || Customization
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/34]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/socorro/unittest]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/e2e-tests]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Telemetry || John || Softvision || #telemetry || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| addons.mozilla.org || Krupa || Softvision || #amo || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/Addon-Tests] [https://github.com/mozilla/addons-server/tree/master/tests/ui] [https://github.com/mozilla/addons-frontend/tree/master/tests/ui]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Blok (Test Pilot) || Rebecca || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder-tests]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| developer.mozilla.org || Matt || Dave || #mdndev || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/24]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests/ui]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| mozilla.org || Rebecca || Dave || #bedrock || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/bedrock/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| FoxPuppet || Benny || Dave/John || #fx-test || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Android) || Kevin || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Prox (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Focus (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/321]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-mobile/focus/tree/master/XCUITest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| ABSearch || Karl || Chris || #absearch || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://mana.mozilla.org/wiki/display/SVCOPS/ABSearch Private repos]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/mozilla/antenna Antenna] || Matt || Richard || #breakpad || Services
| style="background:lightgreen;text-align:center;"  | [https://testrail.stage.mozaws.net/index.php?/projects/overview/40]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/antenna/tree/master/tests/unittest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;"  | [https://github.com/rpappalax/antenna-loadtests/]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [http://autopush.readthedocs.io Autopush] || Richard || Matt || #push || Services
| style="background:lightgreen;text-align:center;" |  [https://testrail.stage.mozaws.net/index.php?/projects/overview/31]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/autopush]
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/ap-loadtester]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Balrog || Chris || Karl || #balrog || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/balrog]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Bouncer || Matt || Dave || #stubby || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/33]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/blob/master/handlers_test.go]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/tree/master/tests/e2e]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/35]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-content-server#testing] [https://github.com/mozilla/fxapom]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-auth-server/tree/master/test/load]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://kinto.readthedocs.io Kinto] || Chris || Karl || #storage || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/23]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/loads Loads Tool] || Richard || Chris || #fx-test || Services
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Shavar (Tracking Protection) || Rebecca || Richard || #shavar || Services
| style="background:lightgreen;text-align:center;"  |[https://testrail.stage.mozaws.net/index.php?/suites/view/354]
| style="background:lightgreen;text-align:center;" |[https://github.com/mozilla-services/shavar/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/rpappalax/shavar-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| SHIELD || Chris || Karl || #normandy || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/153]
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/normandy]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Firefox/Stub_Attribution Stub Attribution] || Stephen || Matt || #stubby || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/stub_attribution] [https://github.com/mozilla/bedrock/tree/master/bedrock/firefox/tests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Services/Sync Sync] || Karl || Chris || #sync || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/36]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://developer.mozilla.org/en-US/docs/Mozilla/Projects/TPS]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/server-syncstorage/tree/master/loadtest] [https://github.com/mozilla-services/tokenserver/tree/master/loadtest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|}

Latest revision as of 16:31, 22 January 2019

Mission Statement

The Test Engineering team supports the larger Firefox organization by enabling identification of risk to our products and eliminating quality related blind spots through tooling, testing, automation, benchmarks, and reporting.

More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/

Focus Areas

  • Interop
  • Performance
  • GeckoView
  • Fenix
  • Amazon
  • CI Automation
  • Ecosystem
  • Telemetry
  • Premium Services
  • Energy
  • Accessibility
  • Reporting
  • Monitoring
  • Experiments

Enduring Objectives

  • Increase visibility into product risks
    • Streamline reporting
    • Reduce blind spots
  • Improve efficiency and clarity of risk assessments
    • Tight feedback loops
    • Be opinionated (i.e binary or traffic light recommendations)
    • Reduce guesswork, roundtrips
    • Standardize between projects and types of reports
  • Maintain or improve coverage and quality standards
    • Identify and fill gaps
    • Document and measure existing work
    • Establish/Improve release criteria consistency
    • Reduce effort on maintenance
  • Reduce cross-functional friction
    • Advocacy
    • Reporting
    • Tools
    • Benchmarks
    • Relationship building

People

Director: Stuart Philp

Architect: Tarek Ziade

Interop

Manager: David Burns

Performance

Manager: Dave Hunt

Ecosystem

Manager: Krupa Raj

CI Automation

Manager: Joel Maher

Mobile

Manager: No-Jun Park