Confirmed users
6,361
edits
QA/StaffMeetings/QA-Staff-09-29-2010: Difference between revisions
QA/StaffMeetings/QA-Staff-09-29-2010 (view source)
Revision as of 21:34, 29 September 2010
, 29 September 2010→Round Table
| (41 intermediate revisions by 12 users not shown) | |||
| Line 11: | Line 11: | ||
* Overview (2 min brief update) | * Overview (2 min brief update) | ||
==Desktop Firefox (Juan)== | ==Desktop Firefox (Juan)== | ||
* Beta 7: Not code frozen yet. Maybe Today/Tomorrow. | |||
* Focus areas tests: They should all be ready in spreadsheet format. | |||
==Maintenance and Security (Geo)== | ==Maintenance and Security (Geo)== | ||
* 3.6.11/3.5.14 | |||
** On track: most blockers landed, remaining blockers deferred. | |||
** Doing last minute verification of NSS/NSPR changes today | |||
** Builds should be coming out tonight, will email QA stakeholders when build IDs updated. | |||
** Mozmill testing tonight (Henrik) | |||
** BFT/Smoketests tomorrow (Geo, Juan/Waverly, gaby2300). More volunteers would be great! You can sign up for a smoketest platform by editing test plans: | |||
*** [https://wiki.mozilla.org/Releases/Firefox_3.6.11/Test_Plan 3.6.11 Test Plan] | |||
*** [https://wiki.mozilla.org/Releases/Firefox_3.5.14/Test_Plan 3.5.14 Test Plan] | |||
** Update testing on Friday (Anthony) | |||
** Geo will be out of town on Friday, Juan will give final signoff. | |||
==Browser Technologies (Tony) == | ==Browser Technologies (Tony) == | ||
* Fennec ( | * Fennec (Aakash) | ||
** Mobifx has branched with trunk and b1 | |||
** Will start a release test once [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=cf_blocking_fennec&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=substring&value0-0-0=2.0b1%2B 2.0b1 blocker list is down to zero]. Rest of the blockers are all JS related. | |||
** Tests are being updated. | |||
* Sync (tracy) | * Sync (tracy) | ||
** Moderately successful test day on Friday | ** Moderately successful test day on Friday | ||
** Sync nearing 1.5 complete. Ship to coincide with Fx4beta7 | ** Sync nearing 1.5 complete. Ship to coincide with Fx4beta7 | ||
** FF Home shipped 1.0.2 to world, now awaiting FF 1.0.3 this week. Changes will pick up localization of home page support of email addresses and sync key logins. | |||
** Xmarks is shutting down their service | |||
* Test Pilot (tracy) | * Test Pilot (tracy) | ||
| Line 28: | Line 43: | ||
* Jetpack (ayan) | * Jetpack (ayan) | ||
** SDK 0.8 and Flightdeck 1.0a5 released last week, | |||
** Both delayed by 2 weeks due to blockers. | |||
** Reasons - For Flightdeck, there was a configuration problem on the server {{bug|594211}}. For Jetpack SDK, test failures took much longer than expected to track down and resolve. | |||
** Starting with SDK 0.9, planning to drop explicit support for Firefox 3.6. Will only support 4.0 betas and nightlies. | |||
** Meeting with PMs to initiate the creation of test plan for Add-ons builder. | |||
* Crossweave (ayan) | * Crossweave (ayan) | ||
** Bunch of automation [http://hg.mozilla.org/automation/crossweave/file/83f2790fdd8b/tests test cases] written and checked in to hg.Some more test cases in progress, will be done before end of Q3. | |||
** Features of private browsing and negative testing of tabs sync added to crossweave platform. | |||
** Need to figure out a strategy with Tony and Jonathan for crossweave on FFx 4.0 and higher as Sync is going to be integrated into FFx 4. | |||
==WebQA (Stephen) == | ==WebQA (Stephen) == | ||
* Mobile testing | |||
** We now have a Motorola Droid2; w00t! | |||
* AMO | * AMO | ||
** [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Server%20Software&query_format=advanced&product=addons.mozilla.org&target_milestone=5.12 5.12] will go out Thursday, 9/30 | |||
* SUMO | * SUMO | ||
** Small release to redirect http://mobile.support.mozilla.com -> http://support.mozilla.com/en-US/kb/Mobile+Help+and+Tutorials, so we can decommission the former | |||
** [https://bugzilla.mozilla.org/show_bug.cgi?id=584886 Customer Care (2.2.5)] postponed; should go out Tuesday, 10/5 | |||
* Mozilla.com | * Mozilla.com | ||
* Text Affiliates | ** [https://bugzilla.mozilla.org/buglist.cgi?keywords=push-needed&keywords_type=allwords&classification=Other&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&component=www.mozilla.com&product=Websites A bunch of pages] (Mobile beta/platforms included) ready to be pushed | ||
* Socorro | |||
** 1.8 - Ongoing [https://wiki.mozilla.org/QA/Execution/Web_Testing/Socorro/Test_Plan test plan work] / Litmus testcase writing | |||
** [https://wiki.mozilla.org/Breakpad/Status_Meetings/2010-Sep-29 1.7.4] | |||
*** Vishal and I are starting to plan for it | |||
* [https://bugzilla.mozilla.org/show_bug.cgi?id=586108 Text Affiliates] | |||
** Blocked by [https://bugzilla.mozilla.org/show_bug.cgi?id=599783 bug 599783] | |||
* Input | * Input | ||
** [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Server%20Software&query_format=advanced&component=Input&product=Webtools&target_milestone=1.8 1.8] went out last night | |||
==QA Services (Marcia)== | ==QA Services (Marcia)== | ||
*Meetups | *Meetups | ||
** | **Very successful meetup last Wednesday. We streamed the meetup live and have the .ogg video available. Need to figure where to house these videos on QMO. | ||
***Any other ideas for upcoming meetups? | |||
** Next Munich Meetup, October 22 | |||
*Crash Investigation | *Crash Investigation | ||
** | **chofmann produced some new crash reports that will help us prioritize crash investigation. An example is http://people.mozilla.com/~chofmann/crash-stats/20100926/signature-ranking-4.0b7pre.txt | ||
*Community Planning | *Community Planning | ||
**Plans in the works for a "Make Firefox Better" Workshop at the Drumbeat Festival in Barcelona. Marcia working on a proposal. | |||
* Video Work | * Video Work | ||
** Working with Rainer to put together the International Promo video. Rainer is suggesting that we consider doing just an international video instead of intercutting the new footage we shot during work week with the existing footage. | |||
* Tomcat | * Tomcat | ||
** Stability report now part of the platform meeting, see https://wiki.mozilla.org/Platform/2010-09-28#Roundtable and working on a email report. | |||
* Accessibility: | * Accessibility: | ||
** FF4 | |||
*** Battling some last fall-outs from the post-bug 130078 fixes successful, no new crashers turned up over the past couple of days in this area. | |||
*** Now working to land {{bug|570275}} soon which will fix a whole range of other bugs as well, and which was necessitated by other performance enhancements for this release. Try-server build testing work. | |||
** FF 3.6.11: | |||
*** Had another last-minute a11y fix landed yesterday, {{bug|600082}}, which was uncovered by one of the commercial assistive technology vendors. Waiting for verification from them on this since this code is not currently publicly available for me to test, but an initial try-server build test was successful. Together with {{bug|583952}}, this makes two important stability fixes for a11y in 3.6.11. | |||
==Test Automation (Henrik)== | |||
* Goals | |||
** [https://intranet.mozilla.org/QA/Q32010_QAgoals#Automation_QA_Goals Q3] | |||
** [https://intranet.mozilla.org/QA/Q42010_QAgoals#Automation_QA_Goals Q4] (not finalized) | |||
* Mozmill 1.5.1 release targeted for Oct. 8th | |||
** Contains fixes needed for buildbot integration and mostly all of our wanted features which haven't made it into Mozmill 1.5. | |||
* Tests | |||
** Finished part one of the local test data project (45s faster) | |||
** Updated AddonsAPI to support Firefox 4 (existing tests are getting updated right now) | |||
** DOMWalker which is needed for l10n and accessibility tests under review and lands soon | |||
* Events | |||
** Henrik will attend the Selenium meetup in London, Nov. 3rd | |||
** QA Test Automation work week planned for 2nd week in Nov. | |||
* General | |||
** We now have the #mozmill channel on IRC and the qa-auto(at)mozilla.com mailing list | |||
= Discussion Items = | = Discussion Items = | ||
| Line 64: | Line 126: | ||
= Round Table = | = Round Table = | ||
* (tchung) Propose ideas for QA projects for classroom curriculum at FIT. | |||
** '''Discussion''' Curriculum ideas | |||
*** How can we better Firefox interface (run test pilot studies?) | |||
*** What do we do with bugzilla data, and how can we best utilize the bugzilla system better? (bugzilla is a messy database and not maintained over time) | |||
*** Evaluate the effectiveness of Bugzilla at mozilla. (tools, analysis) | |||
*** Automation projects around Selenium | |||
*** Performance analysis. (eg. mac firefox has per issues compared to Windows. What do people do around performance testing) | |||
*** Designing new extensions that can make products more testable in firefox (jetpack?) | |||
*** Make nightly tester tools better | |||
*** HOw do we collect more data for feedback without compromising their privacy | |||
*** Look at the state of code coverage around firefox. How do we use the data collectively? | |||
*** How can we improve mobile device testing? (challenges around screen limitations, hardware, memory, a lot and lot of devices and OS) | |||
*** Building an test automation framework for a mobile Chrome testing | |||
*** Critique the current firefox crowdsourcing strategy. Create your own test strategy for firefox today | |||
** Doing a Tech talk next week on User interface Design and Testing | |||
** Also participating in a panel discussion with campus recruiting to first-year students (university sponsored) | |||
* http://etherpad.mozilla.com:9000/QACommunityRoadmap - we need to come up with a plan to carve out time to talk about this | |||
= Takeaways and Action Items = | = Takeaways and Action Items = | ||