Compatibility/WebCompat Priority Flags: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
m (→‎webcompat? bugs: update search titles)
m (Karlcow moved page Compatibility/WebCompat Tracking And Triage to Compatibility/WebCompat Priority Flags: Better title for what people are really searching.)
 
(10 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== webcompat tracking flag ==
This page explains Webcompat Priority flags on Bugzilla. There is a specific [[Compatibility/Webcompat Reports|process for Triaging and processing webcompat.com reports]].


A Bugzilla webcompat tracking flag exists. Its purpose is to put interop and compat bugs on the radar, to be triaged and prioritized accordingly.
== WebCompat Priority project flag ==


==== webcompat? bugs ====
A Bugzilla "Webcompat Priority" project flag exists, and people can set its value to "?" to put a bug on the radar of this triage program.  
[https://bugzilla.mozilla.org/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=webcompat%3F&sharer_id=389500&list_id=14538489 webcompat? ] bugs are regularly triaged with the following outcomes:


1. [https://bugzilla.mozilla.org/buglist.cgi?cmdtype=runnamed&namedcmd=webcompat%2B webcompat+] is set and a priority is assigned to one of the following whiteboard tags, depending on the number of affected sites (or dupes), or how the issue affects top sites or other strategic initiatives.
[[File:Webcompat-priority-flag.png|frame|left]]


* [https://bugzilla.mozilla.org/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=webcompat-prio-p1&sharer_id=389500&list_id=14935238 [Webcompat Priority:P1<nowiki>]</nowiki>]: highest impact bugs or features for web compatibility
<br clear=all>
* [https://bugzilla.mozilla.org/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=webcompat-p2&sharer_id=389500&list_id=14911122 [Webcompat Priority:P2<nowiki>]</nowiki>]: medium impact bugs of features for web compatibility
* [https://bugzilla.mozilla.org/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=webcompat-p3&sharer_id=389500&list_id=14911142 [Webcompat Priority:P3<nowiki>]</nowiki>]: low impact bugs or features for web compatibility (but still considered important).


2. The tracking flag is left alone. The intention is to keep potentially important issues on our radar by not removing the flag — as we become aware of more site breakage it will be re-triaged and prioritized accordingly.
* [[Compatibility/Core Bugs|Core Bugs with an assigned Webcompat Priority]]
* [[Compatibility/Core Bugs Triage|Core bugs in need to be triaged]]


3. The tracking flag is cleared. This probably means the issue is not considered a compatibility issue.
== Webcompat Priority Meaning on Bugzilla ==
 
'''Webcompat Priority''' is an intended signal for the Core Teams to help them decide along Severity, Performance, Business objectives, if the work should be prioritized for a team. A core team may decide it's not worth working on this right now based on the Webcompat Priority. The '''Webcompat Priority''' will change depending on the circumstances. It can start as a P3 and evolves with time toward a P1, because the issue is acute across the Web.
 
Webcompat Priority have 3 essential values: from P1 to P3. P1 is the highest priority.  
 
* '''P1''': The Webcompat team sets P1 when usually the Core bug creates issues for a lot sites (spread widely) OR if the site has a high ranking internationally or in a specific locale (it affects a lot of users). A good indicator is to look at the seeAlso list of bugs and/or duplicates on this bug. We try as much as possible to have real live websites, more than just test cases illustrating the issues. A known implementation difference (aka interoperability issues) between Blink, WebKit and Gecko doesn't necessary create a higher priority for Webcompat.
* '''P2''': @@better definition here@@
* '''P3''': When a Webcompat issue affects a live site with a low ranking, we will usually start the priority at P3.
* '''revisit''': When we are not sure yet what we should do with this bug. It's not entirely clear that it breaks real websites in a significant way that would make it a priority. Some interop issues might fall in this category where we know that there are implementation differences, but these do not create breakages online.
* '''-''': Ideally this is never set because it seems rude. Clearing the flag for non-priorities seems like a better outcome.
* '''---''': This clears the flag. Perhaps this is a performance or a UI issue, or something else entirely. Not really an interop bug.
 
 
 
== From Webcompat issues to Core Bugs ==
 
=== Triage Process ===
 
The basic idea is as follows:
 
# The WebCompat team triages and diagnoses site compat bugs (generally reported by our users to webcompat.com).
# When they discover core interop bugs (as opposed to site bugs), they file a bug on Bugzilla, or identify an existing bug and they set `Webcompat Priority: ?` if it has not been set yet.
# During the Core Triage Meeting every other week of the Webcompat team Meeting, the Webcompat team (mostly people diagnosing webcompat issues) is looking at assessing a '''Webcompat Priority''' flag by checking the '''?''' bugs. (see above for the definition of values).


==== Untracked queries ====  
==== Untracked queries ====  

Latest revision as of 08:21, 2 April 2022

This page explains Webcompat Priority flags on Bugzilla. There is a specific process for Triaging and processing webcompat.com reports.

WebCompat Priority project flag

A Bugzilla "Webcompat Priority" project flag exists, and people can set its value to "?" to put a bug on the radar of this triage program.

Webcompat-priority-flag.png


Webcompat Priority Meaning on Bugzilla

Webcompat Priority is an intended signal for the Core Teams to help them decide along Severity, Performance, Business objectives, if the work should be prioritized for a team. A core team may decide it's not worth working on this right now based on the Webcompat Priority. The Webcompat Priority will change depending on the circumstances. It can start as a P3 and evolves with time toward a P1, because the issue is acute across the Web.

Webcompat Priority have 3 essential values: from P1 to P3. P1 is the highest priority.

  • P1: The Webcompat team sets P1 when usually the Core bug creates issues for a lot sites (spread widely) OR if the site has a high ranking internationally or in a specific locale (it affects a lot of users). A good indicator is to look at the seeAlso list of bugs and/or duplicates on this bug. We try as much as possible to have real live websites, more than just test cases illustrating the issues. A known implementation difference (aka interoperability issues) between Blink, WebKit and Gecko doesn't necessary create a higher priority for Webcompat.
  • P2: @@better definition here@@
  • P3: When a Webcompat issue affects a live site with a low ranking, we will usually start the priority at P3.
  • revisit: When we are not sure yet what we should do with this bug. It's not entirely clear that it breaks real websites in a significant way that would make it a priority. Some interop issues might fall in this category where we know that there are implementation differences, but these do not create breakages online.
  • -: Ideally this is never set because it seems rude. Clearing the flag for non-priorities seems like a better outcome.
  • ---: This clears the flag. Perhaps this is a performance or a UI issue, or something else entirely. Not really an interop bug.


From Webcompat issues to Core Bugs

Triage Process

The basic idea is as follows:

  1. The WebCompat team triages and diagnoses site compat bugs (generally reported by our users to webcompat.com).
  2. When they discover core interop bugs (as opposed to site bugs), they file a bug on Bugzilla, or identify an existing bug and they set `Webcompat Priority: ?` if it has not been set yet.
  3. During the Core Triage Meeting every other week of the Webcompat team Meeting, the Webcompat team (mostly people diagnosing webcompat issues) is looking at assessing a Webcompat Priority flag by checking the ? bugs. (see above for the definition of values).

Untracked queries

All bugs

Category Untracked Untracked to Revisit
DOM webcompat? webcompat-revisit
Layout webcompat? webcompat-revisit
All webcompat-revisit
Non-Core webcompat?

Recently Fixed Bugs

Priority set, fixed in the last 2 months

Priority unset, fixed in the last 2 months