Releases/Firefox 24/Test Plan

From MozillaWiki
Jump to: navigation, search

« Firefox 23 | Firefox 24 | Firefox 25 »

Contents

Firefox 24 Test Plan

Summary

Milestone Firefox 24
Status Currently in Beta - to Release on Week of September 17, 2013
Lead Tracy Walker (irc: tracy)
2nd Anthony Hughes (irc: ashughes)
Builds [ftp] [http] [web]

The following is the test plan for Firefox 24 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 24. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Details

The following is a description of the tasks which need to be completed throughout this release.

  • 2013.05.14: [DONE] Nightly Merge
  • 2013.06.24: [DONE] Aurora Merge
  • 2013.08.02: [DONE] Pre-Beta feature sign-offs
  • 2013.08.08: [DONE] Beta 1
  • 2013.08.13: [DONE] Beta 2
  • 2013.08.15: [DONE] Beta 3
  • 2013.08.20: [DONE] Beta 4
  • 2013.08.22: [DONE] Beta 5
  • 2013.08.27: [DONE] Beta 6
  • 2013.08.29: [DONE] Beta 7
  • 2013.09.03: [DONE] Beta 8
  • 2013.09.05: [DONE] Beta 9
  • 2013.09.10: [DONE] Beta 10
  • 2013.09.13: [DONE] Release Candidate
  • 2013.09.17: [DONE] Final

Features

See the Feature Release Tracking wiki for a general overview

Feature Owner Status Tests

Endurance Automation

The purpose of this section is to track any potential memory regressions via spikes reported in the dashboard.

What to Do
  1. Check the Endurance Charts
  2. If you see an anomalous event (ie. spike or dip), get the report for the specific event
  3. If the event happens twice in a row, file a bug under Mozmill Tests
  4. Notify Anthony Hughes of the issue
  5. Record the event in this wiki below
Current Status (Mihai Morar) - Last Updated - 2013.07.26
Full Query
ID Summary Priority Status
887791 Higher memory consumption on Mac 10.7.5 and 10.8.4 since June the 22nd -- VERIFIED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Functional Automation

The purpose of this section is to track any potential functional regressions via results reported in the dashboard.

What to Do
  1. Check the testrun reports
  2. If you see any failing tests, check that there are not any bugs on file for it already
  3. If not, file a bug under Mozmill Tests
  4. Notify Tracy Walker of the issue
  5. Record the event in this wiki below
Current Status (SoftVision) - Last Updated - yyyy-mm-dd

Bug Triage

The purpose of this section is to triage UNCONFIRMED incoming bugs.

What to Do
  1. Check the UNCONFIRMED bugs
  2. Test the bugs in the latest Firefox Nightly
  3. If you can't reproduce the bug, ask for the reporter to provide more information
  4. If you reproduce the bug, add your testing information and mark the bug NEW
  5. Notify Tracy Walker of the NEW issue
Current Status (SoftVision) - Last Updated

Result Spreadsheet

Bug Fix Verifications

note: this doesn't show the security fixes that have been verified.

Full Query
ID Summary Status Resolution
52500 Make regular CSS properties apply on <input type='file'> VERIFIED FIXED
633001 SSL cannot set exceptions on IPv6 addresses VERIFIED FIXED
644952 Bookmarks Sidebar mousover tooltip incorrect if preference layout.css.devPixelsPerPx;1.17 is user set VERIFIED FIXED
738396 Java applets may read arbitrary files on a user's system VERIFIED FIXED
744836 crash @ RtlEnterCriticalSection | PR_Lock | nsThread::Dispatch | nsTimerImpl::PostTimerEvent RESOLVED FIXED
763879 (CSP) implement blocking of inline stylesheets VERIFIED FIXED
769348 URLs auto-completed in address bar might unexpectedly use ftp:// instead of http:// VERIFIED FIXED
821073 full screen support for video chats VERIFIED FIXED
821877 The logging added to CSP in bug 783049 needs to go to the web console instead of the error console VERIFIED FIXED
828284 Force shortcut desktop icons off on Windows XP RESOLVED FIXED
829954 OOM crash in mozilla::gfx::AlphaBoxBlur::Blur VERIFIED FIXED
832963 Browser freezes when java applet calls showDocument() VERIFIED FIXED
842657 Flip the pref to enable the CSP 1.0 parser for Firefox VERIFIED FIXED
844606 Clicking "Remove From History" in the downloads view removes only a single entry when several items are selected VERIFIED FIXED
850571 crash in nsView::`.* deleting destructor' VERIFIED FIXED
851353 compartment mismatch in nsXBLBinding::DoInitJSClass RESOLVED FIXED
851606 Disable bug 818340 for Beta until we're ready VERIFIED FIXED
853774 crash in imgRequest::GetStatusTracker RESOLVED DUPLICATE
855221 crash in _cairo_quartz_draw_image @ CGAccessSessionRewind VERIFIED FIXED
856823 Turn off --enable-metro on Aurora after uplift to Aurora VERIFIED FIXED
857883 Crash with onreadystatechange and reload VERIFIED FIXED
858101 [[DefaultValue]] on XrayWrapper can call content-defined toString/valueOf methods VERIFIED FIXED
860490 Firefox stops repainting when an embedded Java applet launches a dialog VERIFIED FIXED
861595 multipart motion jpeg stops working immediately VERIFIED FIXED
862679 integrated pdf prints black areas outside paper area VERIFIED FIXED
863635 Windows taskbar previews don't show the address bar VERIFIED FIXED
864120 Use a display list item to create the focus ring for <input type=range> to avoid double focus rings when native theming handles the visual indication of focus VERIFIED FIXED
865537 Heap-use-after-free in mozilla::dom::HTMLMediaElement::LookupMediaElementURITable VERIFIED FIXED
865702 Weirdness with comboboxes pushed aside by Bookmarks sidebar VERIFIED FIXED
865806 [10.7] Make lion-style scrollbars brighter on dark background VERIFIED FIXED
866444 No Site favicon in History submenus – Recently Closed Tabs, Windows VERIFIED FIXED
866567 mask layers sometimes broken with OMTC? VERIFIED FIXED
866915 Do not send data XHR HEAD request VERIFIED FIXED
867226 Incomplete framebuffer abort in mozilla::layers::LayerManagerOGL::CreateFBOWithTexture with "error 0x8cdd" RESOLVED INVALID
867758 Coordinate start of animation for same-FPS images VERIFIED FIXED
868316 New scrollbars are not exactly the right dimensions VERIFIED FIXED
868405 Implement MediaStreamTrack::enabled VERIFIED FIXED
868416 Scrollbar size should not be altered by page-zoom RESOLVED FIXED
868432 Scrolling should be animated when Home/End is pressed VERIFIED FIXED
868498 Lion-style scrollbars do not change when System Preferences' "Show scroll bars" setting changes until browser restart VERIFIED FIXED
870007 Assertion failure: pn, at ion/AsmJS.cpp:1159 or Crash [@ ~ModuleCompiler] VERIFIED FIXED
870034 IonMonkey: Assertion failure: type == MIRType_Boolean || type == MIRType_Int32 || type == MIRType_Double || type == MIRType_String || type == MIRType_Object, at ion/MIR.h:1946 or Crash [@ LUnbox] VERIFIED FIXED
870192 Prevent rounding issues in gfxMatrix::ScaleFactors from combining with timing issues to cause sporadic invalidation of transforming elements VERIFIED FIXED
870216 Acrobat Reader plugin is initially sized larger than its window/frame VERIFIED FIXED
870400 audio distortion of tumblr videos in Firefox 21.0 (and FF22&23) VERIFIED FIXED
870529 Windows jumplist not showing anymore VERIFIED FIXED
871099 Heap-use-after-free in nsIDocument::GetRootElement VERIFIED FIXED
871156 Ctrl+W no longer close the tab when the Web Console is focused VERIFIED FIXED
871322 Customize... isn't accessible on second time when Bookmarks button is removed VERIFIED FIXED
871338 Layout problem on certain site since landing of Bug 828312 RESOLVED FIXED
871368 Arbitrary code execution using crypto.generateCRMFRequest RESOLVED FIXED
871560 Firefox nightly doesn't connect to IPv6 literal VERIFIED FIXED
871917 Image do not appear after navigation-back and/or switch back tab VERIFIED FIXED
871942 crash in nsWebShellWindow::RequestWindowClose VERIFIED FIXED
872307 3d-assembly does not draw anything RESOLVED FIXED
872375 Visual artifacts on H.264 video with DXVA enabled RESOLVED FIXED
872455 icon in social toolbar button is mis-sized on retina display VERIFIED FIXED
872466 Drop down menus sometimes not rendering since FF18 release VERIFIED FIXED
872479 Toolbox tab icons are misplaced VERIFIED FIXED
872605 re-activation to update provider manifest needs ux VERIFIED FIXED
873010 Artifacts around small overlay scrollbars in select boxes VERIFIED FIXED
873012 Horizontal and vertical overlay scrollbars should overlap on 10.8 VERIFIED FIXED
873073 nsNativeThemeWin seems to spin event loop during layout VERIFIED FIXED
873222 "ABORT: not an int value" serializing font and font-synthesis properties VERIFIED FIXED
873757 crash in JSStructuredCloneWriter::writeArrayBuffer VERIFIED FIXED
873812 Trying to establish a call from an Android device to a Windows machine fails to render the remote video streams VERIFIED FIXED
873902 Display Arabic text with diacritics is bad VERIFIED FIXED
873926 Github fragment links don't work VERIFIED FIXED
873963 Arbitrary code execution from Font Inspector VERIFIED FIXED
873966 Arbitrary code execution from Profiler VERIFIED FIXED
874053 crash in gfxFontEntry::TestCharacterMap VERIFIED FIXED
874090 Crash in mozilla::dom::Notification::GetPermissionInternal VERIFIED FIXED
874158 crash in xpc::GetNativeForGlobal VERIFIED FIXED
874391 Crash [@ nsNativeTheme::IsDarkBackground(nsIFrame*)] when opening DOM Inspector/Thunderbird VERIFIED FIXED
874469 Scrollbars/frames jiggle/resize in some cases in DOM Inspector VERIFIED FIXED
874546 getUserMedia - Video playback does not resume when browser returns to being the foreground activity VERIFIED FIXED
874569 getUserMedia - Video playback orientation does not adapt to device orientation VERIFIED FIXED
874572 getUserMedia - Browser holding lock on device camera despite browser activity in the background and paused VERIFIED FIXED
874870 Search plugins using POST broken in Firefox 23 Aurora, Firefox Nightly since 2013-05-17 RESOLVED DUPLICATE
874974 Crash [@ setStringThis] with controllable invalid read VERIFIED FIXED
875060 Image issues with apple.com VERIFIED FIXED
875252 Google+ "Upload from computer" unclickable on Firefox VERIFIED FIXED
875609 Refactor jump list code to decode images on the main thread VERIFIED FIXED
875748 Crash [@ js::types::TypeObject::readBarrier] with ParallelArray VERIFIED FIXED
875757 crash in js::ion::DoTypeUpdateFallback VERIFIED FIXED
875769 exe file handling is completely broken since landing of Bug 862088 VERIFIED FIXED
875777 Assertion failure: !(addr & ArenaMask), at gc/Heap.h:843 or Crash [@ GetGCThingMarkBitmap] VERIFIED FIXED
875790 crash in js::CloneScript on startup when adblock plus is enabled VERIFIED FIXED
875878 crash in gfxFontEntry::DisconnectSVG VERIFIED FIXED
876044 Domain displayed in cam/mic permission dialog matches URL location bar, not content VERIFIED FIXED
876080 Crash with expando on MediaStreamList RESOLVED FIXED
876129 [10.7] Tweak light/dark algorithm for Lion-style scrollbars RESOLVED FIXED
876155 Heap-use-after-free in mozilla::ResetDir RESOLVED FIXED
876313 [New Tab Page] Unpinning a site doesn't update pref VERIFIED FIXED
876332 Animated PNG does not work properly in certain demo RESOLVED FIXED
876346 Select options wrong position on dropdown after scrolling VERIFIED FIXED
876458 IonMonkey: Assertion failure: str, at ./dist/include/js/Value.h:640 or Assertion failure: hasBase(), at vm/String.h:948 or Crash on Heap or Crash [@ StringMatch] VERIFIED FIXED
876721 crash in mozilla::gl::SharedSurface_ANGLEShareHandle::Create RESOLVED FIXED
876806 Restart-less add-ons' scripts do not show up in browser debugger. VERIFIED FIXED
876856 Crash [@ mozilla::dom::MediaStreamList::Length] after closing a peer connection VERIFIED FIXED
877085 crash in nsGfxScrollFrameInner::GetNondisappearingScrollbarWidth @ nsNativeThemeCocoa::GetMinimumWidgetSize VERIFIED FIXED
877097 crash in mozilla::layout::ScrollbarActivity::UpdateOpacity VERIFIED FIXED
877127 Crash on Heap near [@ js::ion::Cannon] with invalid read involving FakeDOMObject VERIFIED FIXED
877164 crash in nsHTMLDocument::Release @ nsNodeUtils::LastRelease VERIFIED FIXED
877287 Assertion failure: !cx->compartment->activeAnalysis, at jsinterp.cpp:365 or Crash [@ js::ion::CodeGenerator::link] with Proxy VERIFIED FIXED
877351 Network Panel is broken on RTL UI VERIFIED FIXED
877390 crash in nsGlobalWindow::FinalClose RESOLVED FIXED
877532 IAccessible::accNavigate with NAVRELATION_* fails VERIFIED FIXED
877612 Cannot enter into fullscreen mode after print dialog is opened VERIFIED FIXED
877826 crash in js::ion::BaselineScript::pcForReturnOffset VERIFIED FIXED
877912 Very easy to hang with sticky global regexp VERIFIED FIXED
878406 PDF.js, character fails to render VERIFIED FIXED
878449 Fix mismatch between CoInitialize and CoUninitialize causing crash in mozilla::widget::JumpListBuilder::AddListToBuild @ CCliModalLoop::CCliModalLoop VERIFIED FIXED
878606 SSL Warning UI Telmetry should only measure top level frame warnings VERIFIED FIXED
878702 disabling sharing on cache-control: no-store is an unexpected limitation VERIFIED FIXED
878705 Clicking near scrollbar thumb scrolls down a page VERIFIED FIXED
878751 out-of-bounds read at mozilla::image::nsGIFDecoder2::WriteInternal VERIFIED FIXED
879096 Crash [@ js::ObjectImpl::getOps] or [@ js::EncapsulatedPtr] VERIFIED FIXED
879161 Firefox Nighty 24.0a1 opens blank page instead of calling the third-party PDF reader plugin VERIFIED FIXED
879723 Crash [@ check] or Opt-Crash [@ js::ToNumberSlow] with __proto__ and Proxy VERIFIED FIXED
879727 Assertion failure: argnum < argslots_, at ion/Lowering.cpp:2854 or Crash [@ insert] VERIFIED FIXED
879787 Cross Domain Policy override using webworkers VERIFIED FIXED
879799 Browser console lacks keyboard access VERIFIED FIXED
880042 file[multiple] form field nsIFilePicker crash if overriding component has not implemented a domfiles getter (Firefox 22+) VERIFIED FIXED
880237 crash in mozInlineSpellChecker::IgnoreWords VERIFIED FIXED
880377 Crash [@ IntersectDominators] VERIFIED FIXED
880591 Assertion failure: lengthShape->writable() == lengthIsWritable, at jsarray.cpp VERIFIED FIXED
880734 New Google Maps does not show/update the map when being loaded or dragged around VERIFIED FIXED
880842 crash in mozilla::gfx::DrawTargetCG::DrawSurface VERIFIED FIXED
880882 handle migration of search preferences on upgrade to Firefox 23 RESOLVED FIXED
880911 tear-off chat windows VERIFIED FIXED
880947 crash in nsExternalAppHandler::CreateTransfer VERIFIED FIXED
881022 potential for crash in mozilla::layout::ScrollbarActivity::SetIsFading VERIFIED FIXED
881264 webgl ThreeJS renderer is black VERIFIED FIXED
881266 shutdown crash in nsContentUtils::DropJSObjects or mozilla::cyclecollector::RemoveJSHolder VERIFIED FIXED
881370 Crash when using JSD2 Debugger API for profiling VERIFIED FIXED
881634 crash in mozilla::gfx::DrawTargetSkia::DrawSurface RESOLVED FIXED
881782 DCU Bank fails to display any accounts on "Accounts" page, in Nightly RESOLVED FIXED
882164 startup crash in nsHTMLDocument::GetAll @ js::CompartmentChecker::fail with Client-Side Adaptations Tool or McAfee Site Advisor VERIFIED FIXED
882652 After a restart the SocialAPI sidebar is displayed in popups that didn't show it before VERIFIED FIXED
882865 ASAN heap-buffer-overflow (read 1) in cryptojs_interpret_key_gen_type RESOLVED FIXED
883495 crash in nsDNSAsyncRequest::OnLookupComplete @ nsXPCWrappedJS::CallMethod RESOLVED FIXED
883514 Global buffer overflow (read 4) at nsFloatManager::GetFlowArea() with multicol, list, floats RESOLVED FIXED
883524 Crash Report [@ JSScript::ensureRanAnalysis(JSContext*) ] VERIFIED FIXED
883541 crash in nsInputStreamPump::Cancel VERIFIED FIXED
883544 crash in JSFunction::createScriptForLazilyInterpretedFunction RESOLVED FIXED
883554 Defect - Clipboard empty after copying due to other applications having the clipboard open VERIFIED FIXED
883560 crash in XPCJSStackFrame::CreateStack @ js::PCToLineNumber VERIFIED FIXED
883562 Crash [@ js::ObjectImpl::getSlot(unsigned int) ] RESOLVED FIXED
883589 crash in js::analyze::ScriptAnalysis::analyzeBytecode VERIFIED FIXED
883607 crash in nsLoadGroup::TelemetryReportChannel RESOLVED FIXED
883748 IonMonkey makes this version of Mersenne Twister 13x slower VERIFIED FIXED
883928 Firefox 23: Components.classes["@mozilla.org/dom/storagemanager;1"] is undefined VERIFIED FIXED
883973 crash in JSFunction::getExistingScript RESOLVED FIXED
884053 crash in js::CreateThisForFunctionWithProto @ js::types::TypeSet::hasType VERIFIED FIXED
884156 crash in JS::Value::isMagic, crash in js::ObjectImpl::getSlot when I open CKEditor demo if Web Console is staying open RESOLVED FIXED
884194 crash in Interpret RESOLVED FIXED
884334 startup jemalloc crash coming from WidgetShutdownObserver::Observe VERIFIED FIXED
885351 Google is always used in about:home and the URL bar when setting the default search engine to an invalid one VERIFIED FIXED
885433 CSP 1.0 should not block inline scripts or eval unless script-src or default-src are included VERIFIED FIXED
885668 crash in nsScriptSecurityManager::GetFunctionObjectPrincipal @ JS_GetFunctionScript VERIFIED FIXED
885751 dbg-server.jsm compartment is leaking 500,000-char JavaScript warning strings like a sieve VERIFIED FIXED
886067 Netmonitor displays request sizes as "0 KB" after opening Console VERIFIED FIXED
886134 SDP for data channel uses SCTP/DTLS instead of DTLS/SCTP VERIFIED FIXED
886137 Can't inspect objects in the webconsole, while debugging and inspecting VERIFIED FIXED
886255 crash in js::ion::IonFrameIterator::baselineScriptAndPc VERIFIED FIXED
886295 Printer error pop-up when printing PDF VERIFIED FIXED
886690 crashtests/880202.html will fail when Gecko 24 hits beta VERIFIED FIXED
886717 Some PDFs no longer render correctly with error "resources is null" VERIFIED FIXED
886803 Page (JIRA dashboard) not being rendered correctly VERIFIED FIXED
886886 Replace fixed-ratio audio resampler in webrtc.org capture code with Speex resampler and eliminate pseudo-44000Hz rate VERIFIED FIXED
887075 100+MB of memory usage in 'event-targets' category for no obvious reason VERIFIED FIXED
887098 InstallTrigger can use the wrong principal when validating URI loads VERIFIED FIXED
887210 cannot activate the provider (sidebar shows connect error) VERIFIED FIXED
887368 social notification icon not sized correctly on a retina screen VERIFIED FIXED
887466 motion JPEG server push (multipart/x-mixed-replace image stream) hangs / freezes Firefox VERIFIED FIXED
887773 CTP plugins no longer work on data: URLs VERIFIED FIXED
888172 CSP 1.0 does not process 'unsafe-inline' or 'unsafe-eval' for default-src VERIFIED FIXED
888252 Geolocation position is not displayed on Nightly VERIFIED FIXED
888274 Upgrade to RFC 5389 STUN VERIFIED FIXED
888292 De-emphasize plugin icon in the Address Bar when it doesn't need to catch the user's attention VERIFIED FIXED
888300 dom.w3c_touch_events.enabled=0 isn't fully respected VERIFIED FIXED
888304 Content touch-events on Firefox-desktop should be disabled until we can support them properly VERIFIED FIXED
888336 chat title not displayed after tearing off and reattaching a chat window VERIFIED FIXED
888458 [10.8] crash in -[ChildView nativeDirtyRegionWithBoundingRect:] VERIFIED FIXED
888510 Review theming for the new plugin in-page UI VERIFIED FIXED
888745 Visually separate links without icons in bookmarks toolbar RESOLVED FIXED
888834 Java won't load Runescape applet in Firefox Nightly 25.0a1(6-30), works in other browsers VERIFIED FIXED
888839 JavaScript alert loses formatting when copied and pasted RESOLVED FIXED
888867 chat nub not sized correctly on a Mac retina screen VERIFIED FIXED
888900 Clipboard is emptied(paste command gray out) when exiting the browser since Beta23.0b1, nsWindow destructor doesn't get called VERIFIED FIXED
888908 When the Navigation Bar is hidden the Click to Play dialog box appears when loading flash VERIFIED FIXED
888972 Username and password will not always auto-fill despite these having already been remembered by built-in Password manager VERIFIED FIXED
889193 Assertion failure: !aGCThing after setting expando property on a DOMCursor RESOLVED FIXED
889504 Exception while trying to go to the breakpoint RESOLVED FIXED
889788 Plugin doorhanger breaks when plugins were removed from the page VERIFIED FIXED
889821 Custom JS nsIChannel.asyncOpen implementation gets called with invalid parameters when request comes from an HTMLObjectElement VERIFIED FIXED
890085 Malformed browser.search.defaultenginename string can lock user's searchbox selection RESOLVED FIXED
890259 Aurora(Firefox 24.0 a2) can not handle PDF form annotation correctly. VERIFIED FIXED
890374 incorrect tooltips in the sidebar when interface are scaled VERIFIED FIXED
890690 Homepage broken when search engines contain engines with POST requests instead of GET RESOLVED FIXED
891035 Flash fullscreen video crashes VERIFIED FIXED
891158 getUserMedia - Switching between landscape orientations on a rendered camera video stream in FxAndroid does not switch to the other landscape orientation VERIFIED FIXED
891424 Modifying XUL panel while open causes the browser to hide VERIFIED FIXED
892340 Remove Off-Main-Thread XPCWrappedJS refcounting from (UDP)ServerSocketListenerProxy VERIFIED FIXED
892370 can't open long IDN domain VERIFIED FIXED
893061 When restoring a session, "about:home" is displayed in the selected tab before the tab is restored VERIFIED FIXED
893308 Heap-use-after-free in nsAnimationManager::BuildAnimations RESOLVED FIXED
893513 Crash with undoManager recursion VERIFIED FIXED
894007 WebGL regression on conformance test 1.0.2 VERIFIED FIXED
894234 "Assertion failure: !mIsOffline" [@ mozilla::dom::AudioContext::Unmute] VERIFIED FIXED
894576 Changing the PDF.js warning to be less alarming VERIFIED FIXED
895023 crash in mozilla::image::VectorImage::GetIntrinsicRatio(nsSize*), with "display:none" on root node in SVG as an image VERIFIED FIXED
895285 Firefox 22 SVG viewBox configure with jquery VERIFIED FIXED
895939 Click to play doorhanger notification is ugly VERIFIED FIXED
896443 Z-ordering of overlay scrollbars needs tweaking VERIFIED FIXED
898161 Detached chat windows should not have a menu bar VERIFIED FIXED
898832 crash in mozilla::dom::NodeBinding::get_childNodes VERIFIED FIXED
898871 ASAN heap-use-after-free in mozilla::layout::ScrollbarActivity RESOLVED FIXED
899447 Color picker in FoxyProxy extension is broken VERIFIED FIXED
900200 (apng) Strange transparent areas appear in some APNG files VERIFIED FIXED
901351 Assertion failure: !obj->is<ProxyObject>(), at js/src/json.cpp:676 RESOLVED FIXED
901747 When startup time is slow, point users to the Firefox Reset article VERIFIED FIXED
901955 CSS animations not working for SVG opacity VERIFIED FIXED
902156 Persist "disable protection" option for Mixed Content Blocker VERIFIED FIXED
902350 Mixed content block navigating from secure frameset to insecure page VERIFIED FIXED
902375 Firefox 23: The Load of a local java applet (*jar) fails silently VERIFIED FIXED
902532 Spellchecking broken with non-ASCII characters in profile path VERIFIED FIXED
902546 IFrame contents rendering outside iframe boundaries (related to positioning: absolute?) VERIFIED WORKSFORME
903475 hang collecting lookups within OT::LigatureSubstFormat1::collect_glyphs VERIFIED FIXED
904263 Some font CSS properties can't be removed on mozilla beta 24 VERIFIED FIXED
904315 BananaBread regression on Firefox 24 with IonMonkey VERIFIED FIXED
904521 Detaching the chat window and then opening another window, e.g. persona log in, closes the chat window VERIFIED FIXED
904561 [10.7] Scrollbars shouldn't grow on hover on OSX 10.7 (only on 10.8 and up) VERIFIED FIXED
904616 Correct sizes for hidden preload browsers are never applied VERIFIED FIXED
904810 Unexpected up/down arrow result RESOLVED FIXED
905084 "Activate this plugin" doesn't work VERIFIED FIXED
905176 For input/textarea/contenteditable with spellcheck="false", "Check Spelling" context menu should be disabled/hidden VERIFIED FIXED
906199 overflow:hidden only hides immediate children if 3d style applied. VERIFIED FIXED
906301 Memory corruption in nsGfxScrollFrameInner::IsLTR() RESOLVED FIXED
906979 I cannot force spell checking from right click context menu VERIFIED FIXED
907404 disable whatsnew for official branding VERIFIED FIXED
907503 SVG Animation is broken in SVG-as-image VERIFIED FIXED
907657 Firefox24 hangs if synchronous XMLHttpRequest was sent inside onkeydown VERIFIED FIXED
907727 Accessor user-defined properties on DOM proxies get the wrong "this" object: the expando object RESOLVED FIXED
908386 Distortion on H.264 videos in Windows 7 VERIFIED FIXED
908651 The sidebar overlaps the chat window VERIFIED FIXED
908824 CSP 1.0 does not block plugin content with object-src VERIFIED FIXED
910741 clicking on links in share panel does not open pages in tabs VERIFIED FIXED
912606 hellorun fails to create WebGL context VERIFIED FIXED

250 Total; 0 Open (0%); 41 Resolved (16.4%); 209 Verified (83.6%);


Known Issues

Full Query
ID Summary Priority Status
313959 On page print in landscape mode, the page is printed as portrait with cutoff -- NEW
694748 When I open Print Preview of the View Page Source, The Error console receives an error. -- RESOLVED
743563 Missing thumbnail previews on new tab page for not completely loaded URLs -- UNCONFIRMED
759334 Print to file creates a file with unknown format -- NEW
791195 Session is not restored after Firefox crash -- RESOLVED
835319 crash in CMIDTable::GetLocalMIDEntry [win7] -- RESOLVED
872413 facebook messenger blank name list -- RESOLVED
881634 crash in mozilla::gfx::DrawTargetSkia::DrawSurface -- RESOLVED
882819 Re-enabling a Social provider enables as inactive -- RESOLVED
890247 The Post Privacy Setting dropdown of the Share panel is not fully displayed -- RESOLVED
901527 Audio static/"burble"/breakup in mozilla to mozilla webrtc calls -- RESOLVED
906057 Delay on WebRTC calls -- RESOLVED
907213 Small hangs on webRTC calls initiated from Linux P4 NEW
907214 webRTC call freezes after 20 to 30 minutes on https://apprtc.webrtc.org/ page -- RESOLVED
912110 crash in nsXPCWrappedJS::Release() with DatamngrHlpFF24.dll (Bandoo) -- RESOLVED

15 Total; 4 Open (26.67%); 11 Resolved (73.33%); 0 Verified (0%);


Release Candidate

Build Info

Builds FTP, HTTP
Build ID 20130910201120
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [DONE]
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing on the below areas:

Platform Status (results)
Windows 7 64-bit [DONE]
Windows XP [DONE]
Mac OSX 10.8 [DONE]
Ubuntu 12.04 32-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Locales: all locales

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 19.0-23.0.1 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.0.4
  • Builds: 19.0-23.0.1 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 19.0-23.0.1 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Beta

Beta 10

Build Info

Builds FTP, HTTP
Build ID 20130909203154
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing on the below areas:

  • Breakpad End-to-End functionality (use this MozTrap test for guidelines).
  • Web compatibility exploratory smoketests
Platform Status (results)
Windows 7 64-bit [DONE]
Windows 8 32-bit [DONE]
Mac OSX 10.6 [DONE]
Ubuntu 12.04 32-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Locales: all locales

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b9 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.0.4
  • Builds: 20.0b1-24.0b9 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b9 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Beta 9

Build Info

Builds FTP, HTTP
Build ID 20130905180733
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing on the below areas:

  • WebRTC (one-on-one calls from each OS to each OS, multiple attendants calls, Firefox to Firefox, Firefox to other browers etc).
    • The multiple attendants calls have delays, burbles, and background noise - according to Bug 902428 these issues are improved in the latest Nightly 26.0a1 and are not fixed in Firefox 24 beta.
  • Breakpad End-to-End functionality (use this MozTrap test for guidelines).
Platform Status (results)
Windows 7 32-bit [DONE]
Windows 8 64-bit [DONE]
Mac OSX 10.7 32-bit mode [DONE]
Ubuntu 12.04 64-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Locales: all locales

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b8 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.0.4
  • Builds: 20.0b1-24.0b8 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b8 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
913043 [adbe 3627468] Flash 11.9 crash in F1987069282 -- RESOLVED
913449 Contextual menu not visible around an iframe containing Flash content P5 NEW
913474 Scrollbar overlaps the chat window -- RESOLVED

3 Total; 1 Open (33.33%); 2 Resolved (66.67%); 0 Verified (0%);


Beta 8

Build Info

Builds FTP, HTTP
Build ID 20130902131354
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing on the below areas:

Platform Status (results)
Windows 7 32-bit [DONE]
Windows 8 64-bit [DONE]
Mac OSX 10.7 [DONE]
Ubuntu 64-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Locales: all locales

Failures (known)

  • test Failure bug 912023 - ' A new window has been opened' in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b7 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.0.4
  • Builds: 20.0b1-24.0b7 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b7 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
911981 Chat panels are lost while detaching/attaching -- VERIFIED
912110 crash in nsXPCWrappedJS::Release() with DatamngrHlpFF24.dll (Bandoo) -- RESOLVED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);


Beta 7

Build Info

Builds FTP, HTTP
Build ID 20130829135643
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing around the following areas:

  • Audio/Video (H.264 and MP3 decoding).
  • Content Security Policy (guidelines in bug csp and wiki - most of this feature is already tested automatically, so only bug work and exploratory testing is needed, http://csptesting.herokuapp.com/).
  • DevTools: Browser Console (errors, warnings, info, logs of all types).


Platform Status (results)
Windows XP [DONE]
Windows 7 64-bit [DONE]
Mac OSX 10.8 [DONE]
Ubuntu 32-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Locales: all locales

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b6 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.0.4
  • Builds: 20.0b1-24.0b6 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b6 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
911164 Current window loses focus temporarily when hovering the pointer over the QuickTime volume button P4 RESOLVED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Beta 6

Build Info

Builds FTP, HTTP
Build ID 20130826142034
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing around the following areas:

  • New Tab page (all options/functionality)
  • Unified search preferences (Search bar, about:home, contextual menu option, URL bar)


Platform Status (results)
Windows XP [DONE]
Windows 7 64-bit [DONE]
Mac OSX 10.8 [DONE]
Ubuntu 32-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Locales: all locales

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b5 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.0.4
  • Builds: 20.0b1-24.0b5 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/13.04
  • Builds: 20.0b1-24.0b5 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
909700 DuckDuckGo Plus gives strange error message after installation on a clean profile -- RESOLVED
909715 DuckDuckGo Plus remains the selected engine in the search bar after changing it with Google and restarting Firefox -- RESOLVED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Beta 5

Build Info

Builds FTP, HTTP
Build ID 20130822154523
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE] only de, en-US, fr, it run by automation
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing around the following areas:

  • SocialAPI (chat - chat, open/close/detach/rearrange multiple chat windows, comment, like, share etc)
  • Session Restore (manual and automated restore, restore at startup, restore after crash etc)
  • Printing (use as many printing options as possible)


Platform Status (results)
Windows Vista [DONE]
Windows 7 32-bit [DONE]
Mac OSX 10.6 [DONE]
Ubuntu 32-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Locales: all locales

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b4 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b4 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
result (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b4 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
908639 Scrollbar overlapping the "Choose an emoticon" button in a chat window -- RESOLVED
908641 Chat area misplaced when the chat is detached -- RESOLVED
908642 Chat window is duplicated, after it was previously detached -- RESOLVED
908643 Last message and writing area are not visible in the chat window after re-attaching it -- RESOLVED
908646 Messages are hidden when detaching and attaching the window chat -- RESOLVED
908648 "Turn On" button remains disabled after pressing Oops, undo this! -- RESOLVED
908650 Chatting is still possible after turning the chat off -- RESOLVED
908651 The sidebar overlaps the chat window -- VERIFIED
908654 Chat window settings button misplaced upwards -- RESOLVED

9 Total; 0 Open (0%); 8 Resolved (88.89%); 1 Verified (11.11%);


Beta 4

Build Info

Builds FTP, HTTP
Build ID 20130819170952
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [DONE] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing around the following areas:

  • Crash Reporter spot checks (use this MozTrap test as a guideline)
  • WebRTC
    • Using the Moztrap test as a guideline, verify that Firefox 24.0b4 is no worse than Firefox 23.0.1 when making AppRTC calls of >5 minutes in length.
Caller Platform Callee Platform Caller Browser Callee Browser Result Notes/Issues
Windows XP Windows 7 Firefox 23.0.1 Firefox 24.0b4 [DONE] Caller: ~2s delay immediately
Callee: no issues
Windows XP Windows 8 Firefox 23.0b4 Firefox 23.0.1 [DONE] Caller: ~2s delay immediately
Callee: ~2s delay immediately
Windows 7 Windows XP Firefox 23.0.1 Firefox 24.0b4 [DONE] Caller: poor sound quality (unclear noise), delay (2s) after 5 minutes, increasing as time goes by
Callee: ~2s delay immediately
Windows 7 Mac OSX Chrome Stable Firefox 24.0b4 [DONE] Caller: no delay, poor sound quality
Callee: poor sound quality (unclear noise), no delay
Windows 7 Linux Firefox 24.0b4 Firefox 23.0.1 [DONE] Caller: no issues
Callee: no issues
Windows 8 Windows XP Firefox 24.0b4 Firefox 23.0.1 [DONE] Caller: ~1.5s delay immediately
Windows 8 Mac OSX Firefox 23.0.1 Firefox 24.0b4 [DONE] Caller: ~2s delay immediately
Callee: ~1.5s delay immediately
Windows 8 Linux Chrome Stable Firefox 24.0b4 [DONE] Caller: no issues
Callee: no issues
Mac OSX Windows 7 Firefox 24.0b4 Firefox 24.0b4 [DONE] Caller: no issues
Callee: no issues
Mac OSX Linux Firefox 23.0.1 Firefox 24.0b4 [DONE] Caller: no issues
Callee: no issues
Linux Windows 7 Firefox 24.0b4 Firefox 23.0.1 [DONE] Caller: increasing delay (2+ seconds) after 10 minutes
Callee: no delay, poor sound quality (unclear noise)
Linux Windows 8 Chrome Stable Firefox 24.0b4 [DONE] Caller: no delay, small hangs, good audio/video quality
Callee: small hangs if browsing other websites during chat, no delay, good audio/video quality
Linux Mac OSX Firefox 23.0.1 Firefox 24.0b4 [DONE] Caller: small hangs, poor sound quality (unclear noise), no delay
Callee: small hangs, no delay
*Note: at min 30, the call interrupted, the video blocked and audio stopped.

When testing, here are the guidelines to follow:

  • Have only one browser open on each machine at any given time
  • Have only one call running at any given time on a particular machine
  • Make sure the caller and callee are always on *different* machines.
  • Please don't test any 3+-way calls for this sanity check -- We just want to see the results for 1:1 (basic) calling
  • If testers find regressions during their testing, Randell and Maire can help track down if the regressions are real or not


Platform Status (results)
Windows Vista [DONE]
Windows 7 32-bit [DONE]
Mac OSX 10.6 [DONE]
Ubuntu 32-bit [DONE]

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Locales: da, de, en-US, es-ES, fr, it, ja, ko, pl, pt-BR, ro, ru, zh-TW

Failures (known)

  • bug 907101 Test failure "Certificate's country code is displayed - '(US)' should equal '(US,postalCode=94041,STREET=650 Castro St Ste 300)'" in testGreenLarry.js was seen in every testrun.

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b3 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b3 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b3 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
907213 Small hangs on webRTC calls initiated from Linux P4 NEW
907214 webRTC call freezes after 20 to 30 minutes on https://apprtc.webrtc.org/ page -- RESOLVED

2 Total; 1 Open (50%); 1 Resolved (50%); 0 Verified (0%);


Beta 3

Build Info

Builds FTP, HTTP
Build ID 20130815180504
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing around the following areas:

  • Crash Reporter spot checks (use this MozTrap test as a guideline)
Platform Status (results)
Windows 7 64-bit [DONE]
Windows 8 32-bit [DONE]
Mac OSX 10.7 [DONE]
Ubuntu 64-bit [DONE]
Notes & Issues Found

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Locales: da, de, en-US, es-ES, fr, it, ja, ko, pl, pt-BR, ro, ru, zh-TW

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b2 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b2 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-24.0b2 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
880140 crash in nsDeviceContextSpecX::EndPage @ decode_data when printing -- VERIFIED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Beta 2

Build Info

Builds FTP, HTTP
Build ID 20130812173056
Changes pushlog
Configs mozmill

Checklist

Task Status
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles}
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Regression Tests

Exploratory testing around the following areas:

  • Mac OSX scrollbars (simple pages, rich content pages, long pages etc)
  • WebRTC (one-on-one calls, multiple attendants calls, Firefox to Firefox, Firefox to other browers etc)
  • PDF Viewer (open simple and complex PDFs, print PDF, complete PDF form etc)
  • Network Monitor (different protocols, status codes, cookies etc)
Platform Status
Windows 7 64-bit [DONE] PASS
Windows 8 32-bit [DONE] PASS
Mac OSX 10.7 [DONE] PASS
Ubuntu 12.10 64-bit [DONE] PASS

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Locales: da, de, en-US, es-ES, fr, it, ja, ko, pl, pt-BR, ro, ru, zh-TW

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-23.0b10 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-23.0b10 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-23.0b10 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
904561 [10.7] Scrollbars shouldn't grow on hover on OSX 10.7 (only on 10.8 and up) -- VERIFIED
904575 crash [@ libobjc.A.dylib@0xb150][@ libobjc.A.dylib@0xb158] -- RESOLVED
904598 WebRTC not working on Ubuntu and Mac OS X machines -- VERIFIED

3 Total; 0 Open (0%); 1 Resolved (33.33%); 2 Verified (66.67%);


Beta 1

Because of l10n repack issues on Windows, Beta 1 will ship with all locales on Mac and Linux but only en-US on Windows. Release August 9th of 24.0beta1build#2

Build Info

Builds FTP, HTTP
Build ID 20130806170643
Changes pushlog
Configs mozmill

Checklist

Task Status
Feature Sign-off [DONE]
Regression Tests [DONE]
Automated Tests [DONE]
Bug Fix Verifications [ON TRACK] on going in beta cycles
Update Tests (betatest) [DONE]
Update Tests (releasetest) [DONE]
Update Tests (beta) [DONE]
Stability & Support sign-off [DONE]

Feature Sign Off

Feature QA Contact Status
link to bug or feature page contact(s) [DONE] status

Notes

  • Web Audio has also been disabled on Firefox 24, after the pre-beta sign off.

Regression Tests

Moztrap Testrun #1913

Platform Status (results)
Windows 7 32-bit [DONE] PASS
Windows 8 64-bit [DONE] PASS
Mac OSX 10.8 [DONE] PASS
Ubuntu Linux 32-bit [DONE] PASS

Automated Tests

Test Result Criteria
Automated Tests PASS (details) All Mozmill ondemand_functional testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Locales: da, de, en-US, es-ES, fr, it, ja, ko, pl, pt-BR, ro, ru, zh-TW

Failures (known)

Update Tests

Test Result Criteria
Update Tests
(betatest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-23.0b10 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(releasetest)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-23.0b10 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW
Update Tests
(beta)
PASS (details) All Mozmill ondemand_update testruns PASS with no new failures
  • Platforms: Windows XP/Vista/7/8, Mac OSX 10.6/10.7/10.8, Ubuntu Linux 12.04/12.10
  • Builds: 20.0b1-23.0b10 da de en-US es-ES fr it ja ko pl pt-BR ro ru zh-TW

New Issues

Full Query
ID Summary Priority Status
902463 This Connection is Untrusted message on facebook apps using clean profile -- RESOLVED
902468 Firefox gets stuck in Print Preview while trying to print a certain pdf file P3 NEW
902486 Firefox doesn't start on Mac OS X using a remote profile from Windows -- RESOLVED

3 Total; 1 Open (33.33%); 2 Resolved (66.67%); 0 Verified (0%);


Pre-beta Feature testing and Sign-off

  • Platforms: Windows XP/7/8, Ubuntu 13.04, Mac 10.7/10.8
Feature Owner Win32 Mac Linux
Web Audio Manuela Muntean PASS PASS PASS

Notes:

  • The following features have been disabled on Firefox 24:
    • Prototype DOM Gamepad API (Alexandra Lucinet)
    • Block cookies from sites I haven't visited (Bogdan Maris)

Aurora Merge

Builds nightlies
Changeset tip (pushlog)
Checklist

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform
Windows XP [DONE] - 2013-06-27
Windows Vista [DONE] - 2013-06-27
Windows 7 32-bit [DONE] - 2013-06-27
Windows 7 64-bit [DONE] - 2013-06-27
Windows 8 32-bit [DONE] - 2013-06-27
Windows 8 64-bit [DONE] - 2013-06-27
Mac OS X 10.6 [DONE] - 2013-06-27
Mac OS X 10.7 [DONE] - 2013-06-27
Mac OS X 10.8 [DONE] - 2013-06-27
Ubuntu 12.04 32-bit [DONE] - 2013-06-27
Ubuntu 12.04 64-bit [DONE] - 2013-06-27
Test Failures (known bugs)

Update Testing

Spotcheck updates from a previous Aurora to Aurora 24.

Platform auroratest channel aurora channel
Windows 7 64-bit [DONE]

en-US 23.a2 20130527004019 - 20130627004018
da 23.a2 20130620004019 - 20130627004018

Mac OS X 10.7 [DONE]

22.a2 en-US 20130420004013 - 20130627004018
21.a2 it 20130401042013 - 20130627004018

Ubuntu 12.04 32-bit [DONE]

en-US 21.a2 20130317042012 - 20130627004018
pl 23.a2 20130620004019 - 20130627004018

Issues

Important Features/Bugs

Bug Triage

  1. VERIFYME: verify the fix and do some exploratory testing around the issue
  2. FIXED: triage these bugs and test to ensure the fix is effective
  3. QAWANTED: triage these bugs and test to fulfill the QA request
  4. UNCONFIRMED: triage these bugs for potential new regressions

QAWANTED

Bugs requiring QA's assistance in debugging (steps, regression range, exploratory testing, verification, etc)


Nightly

Merge

Functional Automation - result
Update Spotchecks - result