Mobile/Fennec Unittests/green: Difference between revisions
< Mobile | Fennec Unittests
Jump to navigation
Jump to search
| Line 13: | Line 13: | ||
* investigate the test and determine the cause | * investigate the test and determine the cause | ||
* if the test case is not for Fennec we will disable it via makefile [[http://mxr.mozilla.org/mozilla-central/source/toolkit/components/places/tests/Makefile.in#76 example]] | * if the test case is not for Fennec we will disable it via makefile [[http://mxr.mozilla.org/mozilla-central/source/toolkit/components/places/tests/Makefile.in#76 example]] | ||
* if the test case is failing due to a preference, we will make a decision to disable the test by checking in the test case for the specific preference and value, change the preference for mobile testing, or file and track a bug to fix broken functionality in Fennec | |||
* if the test case is failing due to other issues, we will attempt to categorize the issue as best as possible (without spending a lot of time), file a bug and move on | |||
The goal is to tackle 200 of the above mentioned test files by the end of July 2010. Throughout the month of August we can decide to investigate the remaining failures and prioritize the filed bugs. | |||
== reftest == | == reftest == | ||
Revision as of 16:58, 19 July 2010
overview
This is a list of tests which I found to fail on both the n900 and n810 over repeated runs. I believe making these tests pass (either by fixing the tests or ignoring the tests and writing new ones if necessary) will get us to a good position where we can start seeing green.
Until reftest/crashtest/xpcshell are green we will continue to ignore the mochitest stuff.
mochitest
Just to jump start our mochitest stuff, I have created a spreadsheet of the failing test files: http://spreadsheets.google.com/ccc?key=0ArS97F99-BEZdE5JTzZodldvRkZid3BLWnJqcUJMbmc&hl=en
Over the next few weeks, mw22 will lead the effort to:
- investigate the test and determine the cause
- if the test case is not for Fennec we will disable it via makefile [example]
- if the test case is failing due to a preference, we will make a decision to disable the test by checking in the test case for the specific preference and value, change the preference for mobile testing, or file and track a bug to fix broken functionality in Fennec
- if the test case is failing due to other issues, we will attempt to categorize the issue as best as possible (without spending a lot of time), file a bug and move on
The goal is to tackle 200 of the above mentioned test files by the end of July 2010. Throughout the month of August we can decide to investigate the remaining failures and prioritize the filed bugs.
reftest
Here are some guides for running the tests:
| test | status | bug |
| tests/modules/libpr0n/test/reftest/colordepth.html | ||
| tests/modules/libpr0n/test/reftest/pngsuite-ancillary/ccwn2c08.png | ||
| tests/modules/libpr0n/test/reftest/pngsuite-ancillary/ccwn3p08.png | ||
| tests/layout/reftests/bugs/134706-3-left-scrollframe.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/134706-3-right-scrollframe.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/240536-resizer-ltr.xul | This is a nativetheme issue. It depends on the resize handle being rendered. | |
| tests/layout/reftests/bugs/300691-1a.html | spellcheck squiggle | |
| tests/layout/reftests/bugs/300691-1b.html | spellcheck squiggle | |
| tests/layout/reftests/bugs/300691-1c.html | spellcheck squiggle | |
| tests/layout/reftests/bugs/300691-1d.html | spellcheck squiggle | |
| tests/layout/reftests/bugs/300691-1e.html | spellcheck squiggle | |
| tests/layout/reftests/bugs/300691-1f.html | spellcheck squiggle | |
| tests/layout/reftests/bugs/301726-2.html | round2 | |
| tests/layout/reftests/bugs/338251-p-oh.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/362901-1.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/367247-s-auto.html | round2 | |
| tests/layout/reftests/bugs/367247-l-hidden.html | round2 | |
| tests/layout/reftests/bugs/371561-1.html | round2 | |
| tests/layout/reftests/bugs/376532-2.html | round2 | |
| tests/layout/reftests/bugs/376532-3.html | round2 | |
| tests/layout/reftests/bugs/379461-3-container-xhtml.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/379461-3-container-xhtml.html (!=) | round2 | |
| tests/layout/reftests/bugs/385569-1a.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/385569-1b.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/386470-1b.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/423823-1.html | ||
| tests/layout/reftests/bugs/424074-1-ref2.xul | ||
| tests/layout/reftests/bugs/440112.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/466395-1.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/466395-2.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/467084-1.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/474417-1.html | round2 | |
| tests/layout/reftests/bugs/495385-2h.html | pass with no-scrollbar | |
| tests/layout/reftests/bugs/513318-2.xul | round2 | |
| tests/layout/reftests/bugs/513318-3.xul | round2 | |
| tests/layout/reftests/canvas/text-bidi-ltr-test.html | round2 | |
| tests/layout/reftests/canvas/text-bidi-rtl-test.html | round2 | |
| tests/layout/reftests/generated-content/table-parts-01.html | round2 | |
| tests/layout/reftests/margin-collapsing/block-overflow-2.html | pass with no-scrollbar | |
| tests/layout/reftests/margin-collapsing/block-overflow-2.html | pass with no-scrollbar | |
| expected fail (native widget) | ||
| expected fail (native widget) | ||
| expected fail (native widget) | ||
| expected fail (native widget) | ||
| expected fail (native widget) | ||
| expected fail (native widget) | ||
| expected fail (native widget) | ||
| expected fail (native widget) | ||
| tests/layout/reftests/svg/sizing/inline--display-inline--01.xhtml | left edge of box is broken | bug 548648 |
| tests/layout/reftests/svg/sizing/inline--display-inline-block--01.xhtml | left edge of box is broken | bug 548648 |
| tests/layout/reftests/svg/sizing/inline--position-relative--01.xhtml | left edge of box is broken | bug 548648 |
| tests/layout/reftests/svg/sizing/dynamic--inline-resize-cb-height.xhtml | pass with no-scrollbar | |
| tests/layout/reftests/svg/sizing/dynamic--inline-resize-cb-width.xhtml | pass with no-scrollbar | |
| tests/layout/reftests/svg/sizing/dynamic--inline-resize-window-width.xhtml | marked as fails in m-c | |
| tests/layout/reftests/svg/opacity-and-gradient-01.svg | pass with no-scrollbar | |
| tests/layout/reftests/text/wordwrap-01.html | pass with no-scrollbar | |
| tests/layout/reftests/transform/iframe-1.html | pass with no-scrollbar | |
| tests/content/test/reftest/xml-stylesheet/lreas_selflink_dtd_id.svg | marked as fails in m-c | |
| tests/layout/xul/base/src/grid/reftests/scrollable-columns.xul | pass with no-scrollbar |
crashtest
Here are some guides for running the tests:
| Test | Status | Bugs |
| tests/layout/base/crashtests/311611-1.html | FAIL | |
| tests/layout/base/crashtests/500467-1.html | HANG |
xpcshell
Here are some guides for running the tests:
| Test | Status | Bugs |
| tests/jsctypes-test/unit/test_jsctypes.js | ||
| tests/test_uriloader_exthandler/unit/test_handlerService.js | ||
| tests/test_docshell/unit/test_bug414201_jfif.js | ||
| tests/test_places/autocomplete/test_download_embed_bookmarks.js | ||
| tests/test_places/autocomplete/test_livemarks.js | ||
| tests/test_places/sync/test_expire_on_timed_flush.js | ||
| tests/test_places/sync/test_expire_on_timed_flush_not_whole_entry.js | ||
| tests/test_places/unit/test_000_frecency.js | ||
| tests/test_places/unit/test_408221.js | ||
| tests/test_places/unit/test_empty_tags.js | HANGS | |
| tests/test_places/unit/test_frecency.js | ||
| tests/test_places/unit/test_history_autocomplete_tags.js | ||
| tests/test_places/unit/test_migrateFrecency.js | ||
| tests/test_satchel/unit/test_autocomplete.js | ||
| tests/test_satchel/unit/test_expire.js | ||
| tests/test_extensionmanager/unit/test_bug299716.js | ||
| tests/test_extensionmanager/unit/test_bug371495.js | ||
| tests/test_extensionmanager/unit/test_bug396129.js | ||
| tests/test_extensionmanager/unit/test_bug428341.js | ||
| tests/test_extensionmanager/unit/test_bug463819.js | ||
| tests/test_extensionmanager/unit/test_bug470377_1.js | ||
| tests/test_extensionmanager/unit/test_bug470377_2.js | ||
| tests/test_necko/unit/test_file_protocol.js | ||
| tests/test_necko/unit/test_localstreams.js |