Compatibility/Meetings/Sync w Mike
February 19 2020
FYI Anonymous reporting feedback (SV)
Overall it is working fine, moderating takes about 1h for 50-60 issues.
It would be useful to have the public link in the issue, in order to moderate and triage it at the same time - Karl is working on it.
Concern: issues will pile up like crazy since a lot of them are being reported (seems to be more than before /day), and we also need to focus on the OKRs, and also take PTO soon in this quarter - ML can help with this.
mike: will sent an email to Nemo about ML, CC SV team in the email
Anonymous reporting closed issues before being accepted (SV)
Some issues get closed before being accepted due to GH's lag/or by mistake and no longer end up in Public repository (thus they get lost).
Is there any mechanism to bypass this behavior so no issue will get lost?
mike: reopen a private closed issue and try to accept it again (test on staging)
Action item: SV team to check the flow for private closed issues, log issue in case it does not work as expected
Fenix issue on Tablet layout (SV)
Tablets receive phone UA layout on Fenix istead of tablet layout.
We recommended to test on Firefox Release or Firefox Beta until Fenix issue is fixed. What do you think ?
mike: continue testing on Firefox Release or Firefox Beta
New Webcompat form (SV)
Any news if the new form will remain or will it be closed/disabled?
mike: leave it on and collect data
oana: maybe request feedback from the users
mike: ksenia is writing tests for the new form, probably she will re-write the new form (JS - implementation)
mike: make small improvements
mike: meeting with Open Innovation and discuss about it next Monday
February 5 2020
Anonymous reporting on Staging (SV)
Are there manual tests needed here?
mike: is this on staging yet?
sergiu: not sure, but we saw it's merged.
mike: I'll get in touch with Karl, and we'll get some documentation. some light testing would be good.
mike: I'll deploy to staging in a few hours.
Action item: Testing anon-reporting tomorrow (06.02.2020) on staging
Action items following the All Hands (SV)
Are there any action items for us, as a result of the Berlin talks?
Any Tracking Protection testing news?
mike: keep doing what we are doing
mike: no news on TP for now
mike: focus on interventions/TSCI?
Presentations (good to watch):
Berlin 2020 - Firefox Web Technologies All Hands https://onlinexperiences.com/Launch/Event.htm?ShowKey=44908&DisplayItem=E356040 - get a sense of future directions
Berlin 2020 - Thursday Plenary - different cultures & communication https://onlinexperiences.com/Launch/Event.htm?ShowKey=44908&DisplayItem=E354347
Interventions testing (SV)
Is it ok to test the Interventions on Fennec Beta?
mike: it's probably good enough!
sergiu: we still have issues that are reproducible in beta/release but not Fenix Nightly.
mike: let's go ahead and close those.
January 22 2020
Non-compat issues rule (SV)
https://github.com/webcompat/web-bugs/issues/47700 - involved payment, valid data was needed to create account, not reproducible after clearing cookies.
Update on (anon) private reporting for webcompat.com (Mike)
mike: we hope to have this ready by the end of the week!
Update on Sergiu's surfing trip.
Went snow surfing.
January 09 2020
Enterprise TSCI (SV)
More context on https://github.com/mozilla/webcompat-team-okrs/issues/117
sergiu: what's up with this?
mike: this is a list of sites that are important for Enterprise. We may build a TSCI report for these sites this quarter, or propose a new Outreachy mentorship for it.
sergiu: probably we can come back to these after OKRs are finished.
oana: probably the next sites we test are 10 to 20.
Top Site Testing (10 - 20) (Mike)
mike: let's focus on severity-critical and -important!
Content Moderation (Mike)
mike: if anything illegal or harmful comes up during triage, please ping miketaylr immediately. no need to comment on issues, mike will take care of it until we have a better process in place.
mike: please read the below resources as well, they may be helpful.
- https://wiki.mozilla.org/Add-ons/Reviewers/Themes/Guidelines
- https://wiki.mozilla.org/Add-ons/Reviewers/Content_Review_Guidelines#Guidelines_for_Content_Review
- also useful: https://www.mozilla.org/en-US/about/legal/acceptable-use/
December 11 2019
ML issues with >95% probability (Sergiu)
We find it quite useful and we should continue closing these issues without checking them. We did not see any users that commented on closed "ml-probability-high" stuff.
Although, we ran into a contradictory labeling situation on a valid login related bug where the issue was filed by a user (https://github.com/webcompat/web-bugs/issues/46318) which was not labeled with `ml-probability-high` and another issue filed anonymously (https://github.com/webcompat/web-bugs/issues/45304) which was labeled (`ml-needsdiagnosis-false` and `ml-probability-high`).
Quality of reports (miketaylr)
mike: Rosana wondered if the subcategories were helpful. sergiu: When we don't have enough info from the description, it can be helpful. But so many are invalid.
oana: It's useful to have that icon, nice for the user.
Form v2 Metrics (miketaylr)
Valid/invalid: https://docs.google.com/spreadsheets/d/1tQkQ3NvvwWv6KMKZN4LUhfo7icBEfl8EZbttP6IZpGE/edit#gid=0
GA completion metrics: https://docs.google.com/spreadsheets/d/1SIhjfxyioHSfnMlm3H6iCK3YyWzzl1i2VUw5M6ZOAOs/edit#gid=777563269
TP (resource blocking) & ETP (cooking blocking) site breakage (Oana)
Are there any news from Security team, related to mobile device issues? Should we continue logging them on "Firefox - Protection UI" ?
mike: We can continue to file mobile ones there, according to Privacy team.
November 20 2019
ML issues probability > 95% (Cipri)
Starting next week we could close all the issues that have a probability above 95% to be invalid.
mike: what’s the rationale for waiting a week? ciprian: just wanting to gather some feedback, or know if it’s safe. mike: let’s go ahead and close them.
New Webcompat form (Oana)
We see more and more issue reported using the new form. We did not see any improvement in the quality of the issues reported, the content (description) is still vague and with few details.
oana: it’s probably easier to report an issue. looks nicer, but the content – it’s still as vague as ever. it’s probably better to focus on how to improve quality. mike: matt (the UX designer) shared some thoughts here: https://docs.google.com/document/d/1Qq0xTXTyy8xr9EE0SA7Abxesp39UaOiWRjlS0F5ff4I/edit
Incompat add-on (Sergiu)
https://github.com/andreicristianpetcu/incompat
sergiu: we got in touch with the developer, and now besides its original functionality, when we’re on Github looking at a web-bug it tells us how many issues are open and closed for a given domain. we can take a look at closed issues and see if the current bug is a duplicate.
mike: wowowowow, we should send him something.
Triage backlog
OI team trying to understand v1 vs v2 numbers (Mike)
https://docs.google.com/spreadsheets/d/1SIhjfxyioHSfnMlm3H6iCK3YyWzzl1i2VUw5M6ZOAOs/edit#gid=0
November 6 2019
webcompat.com testing
oana: Will there be another iteration on the new form? If needed, we can take a shot at it.
Action item: test the new form while doing TSCI top site testing, report bugs and suggestions.
ML add-on
sergiu: Do we have some data about how the ML performed? Is there a way for it to go live?
Proposal: turn the system on and have it
sergiu: has the system ever predicted something at 100%?
Another idea: automatically close (and label) issues at 95%, flag ones at 90% for manual verification, etc.
Facebook testing
cipri: You mentioned some time ago, about a session of Facebook testing. Are we still on?
Action item: mike to send profile of test account to st peter. Also, ask FB to flag the user to not get banned since it’s a test account.
October 16 2019
Secure Connection failed issues
Can we close them if the certificate is not A grade? mike: yes, except TSCI level sites.
ML add-on
How come apparently identical issues get different results from the add-on? mike: here's an older document with the experiment design, https://docs.google.com/document/d/1XFNVNx_0Eb3OozzZyg2wrfCOzNQH6KI5RfBAp5Tq0K8/edit mike: some word salad about statistics mike: how accurate is it? sergiu: it's about 75% accurate oana: for duplicates, it's not useful. sergiu: is the bot already trained? or still being trained? https://github.com/mozilla/webcompat-ml-webext https://github.com/mozilla/webcompat-ml-webext/blob/master/src/background.js#L1 oana: let's continue testing for 2 weeks. sergiu: we could improve this addon by having some kind of interaction method. when it's wrong, give it some feedback as to why it's wrong (or right). mike to follow up with nemo about this. oana: this is only possible when we get a notification.
Webcompat.com - new design
oana: Can I have the link to the new form? I want to fiddle around with some automated tests, as part of my own curiosity. mike: send oana the cookie name/value for staging.webcompat.com
IRC follow up
mike to send email to dennis