B2G/QA/Meetings/2014-11-19

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/

Status Highlights

• Portland workweek Dec 1-5
• SV automation is off Dec 1
  • Q4 Goals B2G (Draft)

2.1 Release Update

• 11/21 - 2.1 CC
• Are we hitting our CC acceptance criteria? https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones#Code_Complete_Criteria
• Transitioning 2.1 work to devices QA team - 11/24

Features (Organized by Functional Team)

Communications

• Tester: Johan, Eric, Shing (cost control)
• Cost Control
  • Status: Green, No blockers
• Dialer
  • Status: Green, No blockers
• Contacts
  • Status: Green, No blockers
• SMS
  • Status: Green, No blockers

Media

• Tester: No-jun, Alison
• Ringtone: Green, no blockers
• Non-Ringtone: Green, no blockers

Multimedia Platform

• Tester: Edward Chen
• No feature in v2.1

Productivity

• Tester: Edward Chen, Teri Wen
• Healthy: Green
  • No blockers

Systems Front End

• Tester: Marcia, Parul
• Status: Red
• Several of the bugs require SHB to be enabled
• 2.1 Blockers: 9 -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.1_Dashboard
  • https://bugzil.la/1088157 [Window Management] The user cannot return home in card view
  • https://bugzil.la/1088224 [Window Management] When the user taps on the new voicemail notification nothing happens
  • https://bugzil.la/1090859 Race condition on startup with new Gecko, PIN code not asked on second SIM card with 2 SIMs
  • https://bugzil.la/1095142 [SHB] Dialer screen does not fully cover lockscreen
  • https://bugzil.la/1095805 [System] With Software Home button on, when a crash occurs the Mozilla crash report screen is cut off where the buttons are located
  • https://bugzil.la/1096704 [Window Management] Swiping up while edge gesturing causes the user to be stuck on a blank page
  • https://bugzil.la/1097359 [Window Management]With the software home button option enabled, the button will get pushed out of place and the icons in the notifications bar will overlap when the user selects on the cookies link
  • https://bugzil.la/1097941 B2G: Scrolling browser frame in landscape mode is broken
  • https://bugzil.la/1100714 [Window Mgmt] Status bar changes/stays white in some apps
• 2.1 Nominations: 2 -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Nomination_2.1_Dashboard
  • https://bugzil.la/1100507 [Browser] Time elapsed and time remaining in browser media player appear as though they are same number when in portrait mode
  • https://bugzil.la/1101780 [Marketplace] Holding back button and selecting "open link in new tab" takes user to a blank page.
• 2.0 Blockers: 1 -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.0_Dashboard
  • https://bugzil.la/1059650 [Browser]Back button stops working after clicking '+' icon multiple times

(Bugs found on Nov 17 no longer reproduce due to code backout on 2.2:

• • https://bugzil.la/1100549 Rocketbar completely broken in landscape mode with private browsing window
  • https://bugzil.la/1100615 Rocket bar is unresponsive)

Systems Platform

• Tester: Gerry Chang
• Healthy: Yellow
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1099006 - [Flame][Lock Screen]The keyboard of PIN input page will be displayed on lockscreen after restart device.
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1099374 - [Settings]The Mozilla link within the "Obtaining Source Code" legal page takes the user to a blank page - r+

Metrics Testing =

• Tester: Shing Lyu
• Status: Green, no blockers

Telephony/Networking

• Tester: Alison Shiue, Eric Chang
• NFC: Green, no blockers
• RIL: Green, no blockers

Devices

• Tester: Alison Shiue
• Bluetooth: Green, no blockers
• Storage: Yellow, 1 blocker: https://bugzilla.mozilla.org/show_bug.cgi?id=1073335 (full flash issue, blocked by bug 1085759)

Graphics

• Tester: No-Jun Park
• Status: Red, 3 Blockers
  • 1 down from last week, and currently open bugs have smaller risk
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1098654
  • (For this one, both myself and 2 other devs can't repro this in 2.1)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1097941
  • (Likely that the fix will be available after this Friday. The bug does not occur without SHB)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1088452
  • (This ONLY occurs in 512MB configuration, this does NOT reproduce in 319MB Flame config)

2.1 Smoketests

• Tester: Peter Bylenga
• Status: GREEN (5+ days no new blockers)
  • No new blockers
• Only 2 full flash blockers open which need to be Verified once we have v188 on pvt
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1092002 (Resolved Fixed)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1090813

2.2 Smoketests

• Tester: Peter Bylenga
• Status: Yellow
  • 1 blocker
• https://bugzilla.mozilla.org/show_bug.cgi?id=1101707
• 3 full flash blockers which need to be Verified once we have v188 on pvt
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1091659 (was 2.2 only)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1092002 (Resolved Fixed)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1090813
  • [marcia] Master had a pretty big regression the other day that caused a bunch of different bugs including:

Localization

• Tester: delphine
• Status: Yellow
  • 1 late-l10n bug still needs verification
    • WEB RTC: https://bugzilla.mozilla.org/show_bug.cgi?id=1079543
  • 1 bug under investigation, because not finding strings that need to be verified. Not sure if it's a regression or feature change yet, pp on it.
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1057188

Performance

• Tester: Geo Mealer
• Health: Green
• Status: https://wiki.mozilla.org/B2G/QA/2014-11-14_Performance_Acceptance
  • Cost control still over budget, but work is punted for 2.2
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1079557 — Calendar
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1079582 — SMS
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1093847 — Usage/Cost Control

Stability

• Tester: Paul Yang, Walter Chen
• Health: over 70 hours (same as last run)
• Status: https://etherpad.mozilla.org/mtbf
  • Major blocker:
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1094070
    • walter will try to apply the patch and do a custom run and provide more info on how to do the mtbf setup
    • other bugs own by partner's side

Exploratory

• Tester: Derek Harris
• Status: Red
  • Focused on 3rd Party apps, and Dual SIM testing
  • Most open blockers are found in Window Management
  • 12 blockers currently status "New"
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1088157 - [Window Management]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1088224 - [Window Management]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1095617 - [Browser]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1095716 - [Loop]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1096520 - [Video]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1096704 - [Window Management]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1097235 - [Loop]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1097359 - [Window Management]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1098654 - [Messages]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1099374 - [Settings]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1099411 - [Calendar]
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1100714 - [Window Management]

Agenda

• [jlorenzo] I can't receive "B2G QA Wanted bugs" email since November 18th. Instead, I have a warning about PGP and SMIME usage. Does anybody experience this too?
  • [pragmatic] emailed Martijn Wargers to take a look at it. Reply from Martijn:

  "That means there are security sensitive bugs in the list. This is the query that is being used for that mail: http://goo.gl/4j9Hty (It's called "B2G QA Triage - High Priority" in my bugzilla links) At the moment, there are 2 security sensitive bugs in that list: https://bugzil.la/1093017 and https://bugzil.la/1100686. I guess I should change the query so that it exclude the security sensitive bugs for the whine mail and I could then just add the bugzilla query link in that whine mail that has the security sensitive bugs included."

• Might be related to the latest push on BMO: http://globau.wordpress.com/2014/11/18/happy-bmo-push-day-119/
• [marcia] Reminder of RTL sessions at the WW: https://etherpad.mozilla.org/ArabicRTL-Sessions
• [delphine] Also MQM session at the WW: testing of quality of translation in fxOS (need to be fluent in a non-English language): https://etherpad.mozilla.org/MQM-PDX-TrainingSession
• flame base update

https://drive.google.com/a/mozilla.com/file/d/0ByC1WGFz4NMDZ0RLMFlOY19NQkU/view?usp=sharing

• 2.2 Feature list has been identified

https://docs.google.com/a/mozilla.com/spreadsheets/d/1_BothhkqSQLzUvzSZY8P8RFYgphLb_l0JYH32apoJmQ/edit#gid=623215577

• [marcia] Portland Work Week agenda (proposed, please comment)
  • https://docs.google.com/a/mozilla.com/spreadsheets/d/1eP0CXx1OM5TxjkpWGGOZzS6udXFILM1nlK4GihJpBY0/edit#gid=0
• [delphine] updates on RTL testing
  • getting in touch with each indivdual qa owners
  • bugzilla whiteboard: [rtl-impact]
  • moztrap tag: rtl
• [eric] Got an enquiry from EPM, the [Qanalyst-triage?|+][leader-review?|+] How does it work? Is there any other related tag?

This Week - Decisions & Action Items

• [Tony] Finalized Portland WW agenda
• [Eric] work with Devices QA team to transition 2.1 testing. Qanalysts to assist with qawanted and smoketest handoff work. 2.1 automation will be setup within the taipei lab.