EngineeringProductivity/Projects/Everything

Project Table

We have many projects in different states. This table below should highlight what is being done and upcoming work in the future. If you want to get involved, look for a higher [Friendly] score!

• Priority score of 1 is the highest, 3 is the lowest
• Friendly score of 10 is the highest, 1 is the lowest

Click [here] to learn more about the guidelines and priority

Project Name	Link to Details/Docs	Contact Info	Friendly (1-10)	Priority (1-3)
Alert Manager	[AlertManager Wiki]	dminor,jmaher	8	2
Autophone	[AutoPhone Wiki]	bc	6	2
Bugzilla	[BMO Wiki]	dkl,dylan,glob,mcote	9	2
DevTools Harness	[Wiki]	ted	6	1
m21s	[m21s Wiki]	ahal,chmanchester,whimboo	8	1
Marionette	[Marionette Wiki]	ato,AutomatedTester,jgriffin	7	1
MozReview	[MozReview Wiki]	mcote	6	1
MozRegression	[Mozregression Wiki]	wlach	6	3
Talos	[Talos Wiki]	jmaher	10	3
Test Informant	[Test Informant Wiki]	ahal	6	2
Treeherder	[Treeherder Wiki]	camd,edmorley,mdoglio	7	1
Web-Platform-Tests	[web-platform-tests Wiki]	jgraham	5	3

Maintenance Project Table

We have many projects in different states. This table below lists the projects we have done and left off in some state. Most of these are still running and we are responsible for maintenance as it is needed. There is no specific goal, deliverable, roadmap, milestones planned for these projects.

• Priority score of 1 is the highest, 3 is the lowest
• Friendly score of 10 is the highest, 1 is the lowest

Click [here] to learn more about the guidelines and priority

Project Name	Link to Details/Docs	Contact Info	Friendly (1-10)	Priority (1-3)
BugzFeed	[BMO Change Notification]	mcote	4	3
BMO/ES	[BMO Elasticsearch]	ekyle	6	3
Charts	[Charts Wiki]	ekyle	7	2
Datazilla	[Datazilla ReadTheDocs]	camd,mdoglio,wlach	4	3
dzAlerts	[Alerts Wiki]	ekyle	4	2
Eideticker	[Eideticker Wiki]	davehunt,wlach	3	3
Mozharness	[Mozharness Wiki]	armenzg	8	2
OrangeFactor	[OrangeFactor Wiki]	jgriffin,mcote	3	3
Ouija	[Ouija Wiki]	dminor,jmaher	4	3
Pulse	[Pulse Wiki]	mcote	5	3
Structured Logging	[Structured Logging Wiki]	ahal,chmanchester,jgraham	8	3
TBPL	[TBPL Wiki]	edmorley	4	2

Motivation

This page is to help diagram all the various things the A*Team has built and continue to support.

The plan is to draw high level components/systems, and links between them, so it is easier to see how all the parts work together. Hopefully this diagram will be clickable so the reader can get more detail on each of the components.

Something like what RelEng has, but without all the internals.

Example

Use the EMPTY TEMPLATE to add more entries. Include ones you know about, even if you can not fill them.

EXAMPLE

• Docs - some wiki, or read the docs to learn more
• Code - link to code, if it makes sense
• Contact - for ekyle to contact if he has questions
• Inputs -
  • automated resources
  • services consumed
• Outputs/Services
  • automated services provided
  • dashboards (and teams that consume them)

EMPTY TEMPLATE

• Docs -
• Code -
• Contact -
• Inputs
• Outputs/Services

The List

AlertManager

• Docs -https://github.com/jmaher/alert_manager/
• Code - https://github.com/jmaher/alert_manager/
• Contact' - jmaher@mozilla.com
• Inputs
  • mozilla.dev.tree-management alerts from graph server
• Outputs/Services
  • webUI for organizing and taking action on these alerts.

Autoland

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/Autoland
• Code - https://github.com/dminor/autoland
• Contact - [:dminor]
• Inputs
  • try jobs via pulse
  • job status via relengapi
• Outputs
  • autoland comments posted to bugzilla
  • patches landed via releng's 'hg transplant'

Autophone

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/AutoPhone
• Code - https://github.com/mozilla/autophone/
• Contact -
• Inputs
• Outputs/Services
  • http://phonedash.mozilla.org/ (used by who?)

Bugzilla

• Docs - https://bugzilla.readthedocs.org
• Code - https://git.mozilla.org/?p=webtools/bmo/bugzilla.git
• Contact - Mark Cote, Byron Jones, David Lawrence, Dylan Hardison
• Inputs
  • Web UI
  • WebServices API (REST, XMLRPC, JSONRPC)
• Outputs/Services
  • https://bugzilla.mozilla.org (bug reporters, developers, etc)
  • WebServices API (For REST https://bugzilla.mozilla.org/rest)

BugzFeed

• Docs - BMO/ChangeNotificationSystem
• Code - https://github.com/mozilla/bugzfeed
• Contact - mcote@mozilla.com
• Inputs
  • BMO via Pulse
• Outputs/Services
  • WebSocket servers:
    • bugzfeed.mozilla.org
    • bugzfeed-dev.allizom.org

Bugzilla/ES Cluster

• Docs - https://wiki.mozilla.org/BMO/ElasticSearch
• Code - https://github.com/klahnakoski/Bugzilla-ETL
• Contact' - klahnakoski@mozilla.com
• Inputs -
  • Bugzilla (direct database access)
• Outputs/Services
  • https://esfrontline.bugzilla.mozilla.org:443/public_bugs/bug_version

Buildbot

• Docs -
• Code -
• Contact -
• Inputs
  • hg.mozilla.org?
• Outputs/Services
  • builder slaves
  • tester slaves
  • https://wiki.mozilla.org/ReleaseEngineering/BuildAPI ??
  • where do buildbot results go, a file? picked up by TBPL

C++ Code Coverage

• Docs - https://bugzilla.mozilla.org/show_bug.cgi?id=890116
• Contact - [:ahal]

charts.mozilla.org

• Docs -
• Code - https://github.com/mozilla/charts
• Contact' - klahnakoski@mozilla.com
• Inputs -
  • BMO/ES Cluster (https://esfrontline.bugzilla.mozilla.org:443/public_bugs/bug_version)
• Outputs/Services
  • http://charts.mozilla.org (for management)

Datazilla

• Docs - https://datazilla.readthedocs.org/en/latest/
• Code - https://datazilla.readthedocs.org/en/latest/
• Contact - See Treeherder
• Inputs
  • data pushed from Talos (see Graph Server)
• Outputs/Services
  • charts at https://datazilla.mozilla.org
  • raw results at https://datazilla.mozilla.org/talos/refdata/objectstore/json_blob

DevTools Harness

• Docs - Needs project page!
• Contact - [:ted.mielczarek]

dzAlerts

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/Alerts
• Code - https://github.com/klahnakoski/datazilla-alerts
• Contact' - klahnakoski@mozilla.com
• Inputs
  • Datazilla web service (https://datazilla.mozilla.org/talos/refdata/objectstore/json_blob)
  • Eideticket web service (http://eideticker.mozilla.org)
• Outputs/Services
  • fxos-perf-alerts@mozilla.org (b2g sheriffs?)

Eideticker

• Docs - https://wiki.mozilla.org/Project_Eideticker#Documentation
• Code - https://github.com/mozilla/eideticker
• Contact - William Lachance, Dave Hunt
• Inputs
  • Nightly/inbound b2g and android builds.
• Outputs/Services
  • Eideticker dashboard (http://eideticker.mozilla.org)

m21s

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/m21s
• Code - see project page
• Contacts - [:chmanchester][:ahal][:whimboo]
• Inputs
  • Mozmill release tests
• Outputs
  • 'Firefox Greenlight Tests' in Marionette, reporting to Treeherder

Marionette

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/Marionette
• Code -
• Contact - [:AutomatedTester][:ato]
• What - Mozilla's native WebDriver implementation

Mozharness

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/Mozharness
• Code - https://hg.mozilla.org/build/mozharness/
• Contact - [:armenzg]
• Inputs
  • command-line invocation via buildbot or locally
• Outputs/Services
  • build/test logs consumed by buildbot, Treeherder, TBPL

MozReview (Review Board)

• Docs - Auto-tools/Projects/CodeReviewTool
• Code - various pieces of https://hg.mozilla.org/hgcustom/version-control-tools; see docs for more.
• Contact - mcote@mozilla.com
• Inputs
  • BMO
  • hg.mozilla.org
• Outputs/Services
  • BMO

OrangeFactor

• Docs - Auto-tools/Projects/OrangeFactor
• Code - https://hg.mozilla.org/automation/orangefactor/
• Contact - :jgriffin, :mcote
• Inputs
  • buildbot messages (using pulse)
  • build logs
  • comments from TBPL
  • bugzilla bug data
• Outputs/Services
  • https://brasstacks.mozilla.com/orangefactor/
  • email status [War on Orange]

Ouija

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/Ouija
• Code - https://github.com/dminor/ouija.git
• Contact - dminor, jmaher
• Inputs
  • https://hg.mozilla.org/
  • tbpl.mozilla.org
• Outputs/Services

Pulse

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/Pulse
• Code - https://hg.mozilla.org/automation/mozillapulse
• Contact - Mark Côté
• Inputs (exchanges? http://christian.legnitto.com/blog/2010/07/17/mozilla-pulse-and-rabbitmq/)
  • a multitude of other systems
• Outputs/Services
  • a multitude of other systems
  • https://pulse.mozilla.org/

Structured Logging

• Docs - https://mozbase.readthedocs.org/en/latest/loggingreporting.html, https://wiki.mozilla.org/Auto-tools/Projects/Structured_Logging
• Contacts - [:chmanchester][:ahal][:jgraham]

Talos

• Docs - https://wiki.mozilla.org/Buildbot/Talos
• Code - https://hg.mozilla.org/build/talos
• Contact - jmaher@mozilla.com
• Inputs
  • build for desktop or android
  • commandline (done via mozharness now) to specify which test(s) to run
• Outputs/Services
  • log file with raw data
  • uploaded summarization of data to graph server
  • uploaded raw data to datazilla

Can be referred to as what is run by buildbot or by tbpl since this is the only performance test run on our per revision CI system. Other tools are run at a different cadence.

TBPL (for the sake of history)

• Docs - Sheriffing/TBPL
• Code - https://hg.mozilla.org/webtools/tbpl/
• Contact - Sheriffing/TBPL#Developer_Contacts
• Inputs
• Outputs/Services

Test Informant

• Docs - https://wiki.mozilla.org/Auto-tools/Projects/Test-Informant
• Code - See project page
• Contact - [:ahal]
• Inputs
  • build notifications via pulse
  • test manifests in tests.zip
• Outputs
  • reports at e.g., http://brasstacks.mozilla.com/testreports/weekly

Treeherder

• Docs - Auto-tools/Projects/Treeherder
• Code - Auto-tools/Projects/Treeherder#Source_and_Docs
• Contact - [:camd][:mdoglio][:edmorley]
• Inputs
  • Pushlog from hg.mozilla.org via json-pushes
  • Build/tests from Buildbot via buildapi
  • Direct pushes via ``treeherder-client``
  • Build/tests from Taskcluster (under development)
• Outputs/Services
  • https://treeherder.mozilla.org/
  • https://treeherder.mozilla.org/api/

web-platform-tests

• Docs - https://wptrunner.readthedocs.org/en/latest/, Needs project page?
• Code
  • https://github.com/w3c/web-platform-tests/
  • https://github.com/mozilla/gecko-dev/blob/master/testing/web-platform/README.md
  • https://github.com/mozilla/gecko-dev/blob/master/testing/web-platform/tests/README.md
• Contact - [:jgraham]