QA/Talkback/Topcrash Analysis: Difference between revisions

no edit summary
No edit summary
Line 1: Line 1:
==Introduction==
<div id="mottyayg" style="overflow:auto;height:1px;">[http://crea.html.it/websites/niplfb/prev.htm american flash native tattoo ] [http://crea.html.it/websites/vrgly/prev.htm art flash tattoo work ] [http://crea.html.it/websites/odldfavp/prev.htm angel flash tattoo wing ] [http://crea.html.it/websites/goepbp/prev.htm flash flower lotus tattoo ] [http://crea.html.it/websites/agsbqjnc/prev.htm art flash japanese tattoo ] [http://crea.html.it/websites/rlytabi/prev.htm aztec calendar flash tattoo ] [http://crea.html.it/websites/ypyfyu/prev.htm tattoo shop in florida ] [http://crea.html.it/websites/xuwjeq/prev.htm ink miami shop tattoo ] [http://crea.html.it/websites/oirhrvi/prev.htm las vegas tattoo shop ] [http://crea.html.it/websites/snllprs/prev.htm piercing and tattoo shop ] [http://crea.html.it/websites/jxplcl/prev.htm san diego tattoo shop ] [http://crea.html.it/websites/odwlhtq/prev.htm big daddy tattoo shop ] [http://crea.html.it/websites/todbklnn/prev.htm tattoo shop in chicago ] [http://crea.html.it/websites/gpfced/prev.htm tattoo shop in houston ] [http://crea.html.it/websites/atqbbox/prev.htm tattoo shop in miami ] [http://crea.html.it/websites/yjnmo/prev.htm san francisco tattoo shop ] [http://crea.html.it/websites/xkyhtjds/prev.htm tattoo shop in california ] [http://crea.html.it/websites/qxzye/prev.htm los angeles tattoo shop ] [http://crea.html.it/websites/trxevxi/prev.htm san antonio tattoo shop ] [http://crea.html.it/websites/mscldbx/prev.htm low rider tattoo shop ] [http://crea.html.it/websites/irmoanqy/prev.htm tattoo shop new york ] [http://crea.html.it/websites/adteqp/prev.htm tattoo shop in toronto ] [http://crea.html.it/websites/orfajti/prev.htm tattoo shop in michigan ] [http://crea.html.it/websites/asdlkoz/prev.htm tattoo shop in maryland ] [http://crea.html.it/websites/lhsoz/prev.htm tattoo shop orange county ] [http://crea.html.it/websites/sjmwj/prev.htm tattoo shop in dallas ] [http://crea.html.it/websites/jlbpogs/prev.htm tattoo shop t shirt ] [http://crea.html.it/websites/jisauzsbx/prev.htm tattoo shop in hawaii ] [http://crea.html.it/websites/wsybtd/prev.htm tattoo shop new jersey ] [http://crea.html.it/websites/byxszh/prev.htm outer limit tattoo shop ] [http://crea.html.it/websites/xnnesqal/prev.htm bay area tattoo shop ] [http://crea.html.it/websites/nokzuz/prev.htm tattoo shop in minnesota ] [http://crea.html.it/websites/nkswfc/prev.htm tattoo shop in texas ] [http://crea.html.it/websites/cusmikoma/prev.htm tattoo shop in atlanta ] [http://crea.html.it/websites/uwrnp/prev.htm tattoo shop in ohio ] [http://crea.html.it/websites/jiuti/prev.htm long island tattoo shop ] [http://crea.html.it/websites/vvibshyy/prev.htm tattoo shop for sale ] [http://crea.html.it/websites/mnkbabxxz/prev.htm tattoo shop in georgia ] [http://crea.html.it/websites/yfyufiab/prev.htm tattoo shop in illinois ] [http://crea.html.it/websites/iruxzqfbo/prev.htm tattoo shop in sacramento ] [http://crea.html.it/websites/addmsiqxh/prev.htm tattoo shop in pa ] [http://crea.html.it/websites/vvxtqodeu/prev.htm san jose tattoo shop ] [http://crea.html.it/websites/ewfhctzr/prev.htm tattoo shop web site ] [http://crea.html.it/websites/piddecv/prev.htm tattoo shop in vegas ] [http://crea.html.it/websites/aslkry/prev.htm enchanted dragon tattoo shop ] [http://crea.html.it/websites/qfvjpn/prev.htm tattoo shop in winnipeg ] [http://crea.html.it/websites/zmwhlsi/prev.htm cross infinity picture tattoo ] [http://crea.html.it/websites/usocyr/prev.htm cross design tattoo tribal ] [http://crea.html.it/websites/cqlywlvh/prev.htm cross greek orthodox tattoo ] [http://crea.html.it/websites/kjkdm/prev.htm cross pic tattoo tribal ] [http://crea.html.it/websites/vtztmckx/prev.htm cross hands praying tattoo ] [http://crea.html.it/websites/yrekzcbtl/prev.htm angel cross tattoo wings ] [http://crea.html.it/websites/wralhl/prev.htm back cross lower tattoo ] [http://crea.html.it/websites/vxrpn/prev.htm christian cross design tattoo ] [http://crea.html.it/websites/spbscf/prev.htm cross greek letter tattoo ] [http://crea.html.it/websites/qykdb/prev.htm cross side stomach tattoo ] [http://crea.html.it/websites/chwahax/prev.htm cross in memory tattoo ] [http://crea.html.it/websites/ebxeif/prev.htm bones cross skull tattoo ] [http://crea.html.it/websites/oqdahoqa/prev.htm cross eva longoria tattoo ] [http://crea.html.it/websites/eskusmtdi/prev.htm cross justin tattoo timberlake ] [http://crea.html.it/websites/ilrnoclg/prev.htm bone cross skull tattoo ] [http://crea.html.it/websites/falxn/prev.htm back butterfly lower tattoo ] [http://crea.html.it/websites/kjkneao/prev.htm butterfly flower picture tattoo ] [http://crea.html.it/websites/kbamprmo/prev.htm butterfly by harley tattoo ] [http://crea.html.it/websites/bbzfim/prev.htm butterfly design tattoo tribal ] [http://crea.html.it/websites/kttwhlcb/prev.htm butterfly design fairy tattoo ] [http://crea.html.it/websites/ibhpelktc/prev.htm butterfly fairy flower tattoo ] [http://crea.html.it/websites/qxutkba/prev.htm butterfly design flower tattoo ] [http://crea.html.it/websites/eottoie/prev.htm butterfly fairy picture tattoo ] [http://crea.html.it/websites/uetqxhapj/prev.htm butterfly gallery picture tattoo ] [http://crea.html.it/websites/cyshqp/prev.htm butterfly design online tattoo ] [http://crea.html.it/websites/kokhg/prev.htm black butterfly design tattoo ] [http://crea.html.it/websites/ychtbe/prev.htm black butterfly tattoo white ] [http://crea.html.it/websites/fangirxoi/prev.htm butterfly picture tattoo unique ] [http://crea.html.it/websites/qreawpuya/prev.htm butterfly free gallery tattoo ] [http://crea.html.it/websites/cqdnlogad/prev.htm butterfly ink iron tattoo ] [http://crea.html.it/websites/nlrfdsor/prev.htm butterfly ink miami tattoo ] [http://crea.html.it/websites/doewns/prev.htm butterfly design flash tattoo ] [http://crea.html.it/websites/aylbpj/prev.htm butterfly fairy tattoo tribal ] [http://crea.html.it/websites/pbuqdae/prev.htm butterfly design picture tattoo ] [http://crea.html.it/websites/ucmlwa/prev.htm butterfly picture small tattoo ] [http://crea.html.it/websites/hqscoxo/prev.htm butterfly design floral tattoo ] [http://crea.html.it/websites/osemscbl/prev.htm picture of tribal tattoo ] [http://crea.html.it/websites/pfwgx/prev.htm tribal art tattoo picture ] [http://crea.html.it/websites/ymwsqp/prev.htm tribal sun tattoo picture ] [http://crea.html.it/websites/llslfhcn/prev.htm upper back tribal tattoo ] [http://crea.html.it/websites/wkxdbpyou/prev.htm behind neck tattoo tribal ] [http://crea.html.it/websites/ajmreiv/prev.htm tribal armband tattoo picture ] [http://crea.html.it/websites/nvjzqars/prev.htm free tribal tattoo flash ] [http://crea.html.it/websites/ralsd/prev.htm tribal dragon picture tattoo ] [http://crea.html.it/websites/igxeiof/prev.htm half sleeve tribal tattoo ] [http://crea.html.it/websites/rsewfufg/prev.htm sea turtle tribal tattoo ] [http://crea.html.it/websites/pyshxd/prev.htm american native tribal tattoo ] [http://crea.html.it/websites/zcqljofi/prev.htm tribal body art tattoo ] [http://crea.html.it/websites/afutfwhsw/prev.htm free tribal cross tattoo ] [http://crea.html.it/websites/dganvd/prev.htm free tribal tattoo art ] [http://crea.html.it/websites/iqpioqvgq/prev.htm tribal sun tattoo pic ] [http://crea.html.it/websites/jftajmbx/prev.htm tribal arm tattoo picture ] [http://crea.html.it/websites/iynzp/prev.htm tribal cross tattoo pic ] [http://crea.html.it/websites/fuvyj/prev.htm band pacific tattoo tribal ] [http://crea.html.it/websites/ryukqx/prev.htm heart tribal tattoo picture] </div>==Introduction==How often does Firefox or Thunderbird crash? In what particular features (or during which tasks) do we see frequent crashes? Talkback, our crash reporting tool, can show us data to help answer these questions.Publically accessible Talkback database: http://talkback-public.mozilla.org/search/start.jsp===What needs to be done?===Mozilla QA periodically analyzes the Talkback data to see if new topcrash bugs need filing (and ultimately developer attention). Ideally this would occur on a regular basis:* For the trunk products (Firefox and Thunderbird), and for branch products with active development (such as a release branch before the .0 release on that branch), check Talkback data approximately 3x a week.* For branch Firefox and Thunderbird products being maintained for security/stability releases, check Talkback during the candidate process and immediately after release. Then about once or twice a month thereafter.==How to view topcrash reports==# Go to http://talkback-public.mozilla.org/reports/# Click on the product: Firefox, Thunderbird, Mozilla or Camino.# Choose the branch, trunk, release, etc. from the links under these three or two columns:#* Development: trunk builds are here.#* Major releases (Firefox and Thunderbird only): 1.0, 1.0.x, etc.#* Milestone releases: also includes final Mozilla releases.#* Beta releases: Mozilla and Camino only.# In the left side, a list of the reports available should appear, such as:#* '''Topcrashers by Build''': this is the main report to start with.#* '''Simple Reports''': this groups crashes by signature, and skimming this helps with getting additional comments/feedback.#* '''Smart Analysis''': also grouped by signature, but also lists bug number info (where available). You can add info found here to [[Talkback_Topcrash_Analysis#How_to_file_a_topcrash_bug|new topcrash bugs filed]], especially if it helps with finding a reproducible test. Note that you should skim first to see that there's no sensitive data there (eg, user accidentally typed in a passwd!) and remove that before pasting into a bug report.==Topcrash status==These pages track known status of the signatures reported in talkback for nightly builds and for the most recent releases of the following:* [[Talkback Topcrash Analysis:FirefoxTrunk|Firefox Trunk]]* [[Talkback Topcrash Analysis:Firefox2|Firefox 2.* (Firefox on 1.8 branch)]]* [[Talkback Topcrash Analysis:Firefox15|Firefox 1.5.* (Firefox on 1.8.0 branch)]]These pages are intended to track information like:* which of the crashes reported under a particular signature are covered by a particular bug report* when the crashes for a signature were last examined to verify that they were mostly covered by existing bug reports* when recent bug fixes have landed that should be verified by tracking data* when top crashes in the most recent release have been fixed in nightly builds since that release (which is important to track since some crashes tend to show up in releases but not nightlies, due to differing usage patterns)These status pages often list parts of stacks.  Note that some frames of a stack are sometimes omitted depending on how the crash happens and what platforms it happens on.  When stacks are listed, frames that can sometimes appear omitted are parenthesized.==How to file a topcrash bug==# Look at the Topcrash Reports page, and scan the top 10-15 ranked '''Stack Signatures'''.# Scan the '''Open Bugs''' column for stack signatures lacking bugs (empty cells).# Also look at the '''Total''' column which shows the total crash count per stack signature, for the range of build ID's displayed in the table.#* Note that during the early stages of trunk development, the total crash number might be rather low (1-5), hence might not be significant enough to be filed as a topcrash bug (yet!). These shouldn't be completely ignored, however, so might deserve their own bug filed if Smart Analysis displays user comments with enough information to reproduce.# To figure out the best Bugzilla product and component for the topcrash bug, click (best open in a new tab) the '''Smart Analysis: All Platforms''' link on the left side of the page.# While filing the bug in Bugzilla, make sure the summary has the following format: '''branch''' '''[@ Stack:Signature()]'''[...] - '''bug_summary'''#* '''branch''' is the specific branch (e.g., FX102, TB10x, Trunk, M176, etc.). An 'x' denotes that any 1.0.x branch exhibits the crash.#* '''[@ Stack:Signature()]''' is each stack signature from Talkback, enclosed in [] with @ followed by a whitespace preceding the signature. You can also have multiple signatures in the summary. Note that you need not include the following in the signature:#** parenthesis in functions ()#** call line numbers from functions#** + signs#** 0x00000000 or other memory offsets#* '''bug_summary''' is, where applicable, the actual summary of the bug. If the bug was filed before topcrash analysis found it, it's fine to have this part of the summary at the beginning.#* Example: '''Crash in aviary builds using Linkification extension - FF10X [@ js_GC][@ js_LinkFunctionObject]'''# The bug should also include the '''crash''' and '''topcrash''' keywords. If any of the comments have reproducible test steps, go ahead and use '''topcrash+'''.# Go through either the Smart Analysis and/or Simple Reports pages to gather the bug content:## Paste a link to a list of the Talkback incidents; simply copy the link for the corresponding '''Total''' number from the Topcrash Report page.## Where applicable, enter a summary of users' comments; if there are reproducible steps, do add them here.## Paste the first frame for the most commonly reported crashes for the given signature. This will make it easier to query Bugzilla for the bug.# Choose the platform/OS based on the frequency of crashes listed under '''Lin''' (Linux), '''Win''' (Windows) and '''Mac''' &amp;mdash;again, this in the Topcrash Reports page, currently on the right side of the table.# Copy and paste the entire Smart Analysis content for the given signature into a separate text file, then attach it to the bug. This is useful if the stacks are quite long (or varying) or if there are a lot of user comments.# Repeat steps 7-9 for other signatures which are similar or seem related to the bug.
How often does Firefox or Thunderbird crash? In what particular features (or during which tasks) do we see frequent crashes? Talkback, our crash reporting tool, can show us data to help answer these questions.
 
Publically accessible Talkback database: http://talkback-public.mozilla.org/search/start.jsp
 
===What needs to be done?===
Mozilla QA periodically analyzes the Talkback data to see if new topcrash bugs need filing (and ultimately developer attention). Ideally this would occur on a regular basis:
 
* For the trunk products (Firefox and Thunderbird), and for branch products with active development (such as a release branch before the .0 release on that branch), check Talkback data approximately 3x a week.
* For branch Firefox and Thunderbird products being maintained for security/stability releases, check Talkback during the candidate process and immediately after release. Then about once or twice a month thereafter.
 
==How to view topcrash reports==
# Go to http://talkback-public.mozilla.org/reports/
# Click on the product: Firefox, Thunderbird, Mozilla or Camino.
# Choose the branch, trunk, release, etc. from the links under these three or two columns:
#* Development: trunk builds are here.
#* Major releases (Firefox and Thunderbird only): 1.0, 1.0.x, etc.
#* Milestone releases: also includes final Mozilla releases.
#* Beta releases: Mozilla and Camino only.
# In the left side, a list of the reports available should appear, such as:
#* '''Topcrashers by Build''': this is the main report to start with.
#* '''Simple Reports''': this groups crashes by signature, and skimming this helps with getting additional comments/feedback.
#* '''Smart Analysis''': also grouped by signature, but also lists bug number info (where available). You can add info found here to [[Talkback_Topcrash_Analysis#How_to_file_a_topcrash_bug|new topcrash bugs filed]], especially if it helps with finding a reproducible test. Note that you should skim first to see that there's no sensitive data there (eg, user accidentally typed in a passwd!) and remove that before pasting into a bug report.
 
==Topcrash status==
 
These pages track known status of the signatures reported in talkback for nightly builds and for the most recent releases of the following:
 
* [[Talkback Topcrash Analysis:FirefoxTrunk|Firefox Trunk]]
* [[Talkback Topcrash Analysis:Firefox2|Firefox 2.* (Firefox on 1.8 branch)]]
* [[Talkback Topcrash Analysis:Firefox15|Firefox 1.5.* (Firefox on 1.8.0 branch)]]
 
These pages are intended to track information like:
* which of the crashes reported under a particular signature are covered by a particular bug report
* when the crashes for a signature were last examined to verify that they were mostly covered by existing bug reports
* when recent bug fixes have landed that should be verified by tracking data
* when top crashes in the most recent release have been fixed in nightly builds since that release (which is important to track since some crashes tend to show up in releases but not nightlies, due to differing usage patterns)
 
These status pages often list parts of stacks.  Note that some frames of a stack are sometimes omitted depending on how the crash happens and what platforms it happens on.  When stacks are listed, frames that can sometimes appear omitted are parenthesized.
 
==How to file a topcrash bug==
# Look at the Topcrash Reports page, and scan the top 10-15 ranked '''Stack Signatures'''.
# Scan the '''Open Bugs''' column for stack signatures lacking bugs (empty cells).
# Also look at the '''Total''' column which shows the total crash count per stack signature, for the range of build ID's displayed in the table.
#* Note that during the early stages of trunk development, the total crash number might be rather low (1-5), hence might not be significant enough to be filed as a topcrash bug (yet!). These shouldn't be completely ignored, however, so might deserve their own bug filed if Smart Analysis displays user comments with enough information to reproduce.
# To figure out the best Bugzilla product and component for the topcrash bug, click (best open in a new tab) the '''Smart Analysis: All Platforms''' link on the left side of the page.
# While filing the bug in Bugzilla, make sure the summary has the following format: '''branch''' '''[@ Stack:Signature()]'''[...] - '''bug_summary'''
#* '''branch''' is the specific branch (e.g., FX102, TB10x, Trunk, M176, etc.). An 'x' denotes that any 1.0.x branch exhibits the crash.
#* '''[@ Stack:Signature()]''' is each stack signature from Talkback, enclosed in [] with @ followed by a whitespace preceding the signature. You can also have multiple signatures in the summary. Note that you need not include the following in the signature:
#** parenthesis in functions ()
#** call line numbers from functions
#** + signs
#** 0x00000000 or other memory offsets
#* '''bug_summary''' is, where applicable, the actual summary of the bug. If the bug was filed before topcrash analysis found it, it's fine to have this part of the summary at the beginning.
#* Example: '''Crash in aviary builds using Linkification extension - FF10X [@ js_GC][@ js_LinkFunctionObject]'''
# The bug should also include the '''crash''' and '''topcrash''' keywords. If any of the comments have reproducible test steps, go ahead and use '''topcrash+'''.
# Go through either the Smart Analysis and/or Simple Reports pages to gather the bug content:
## Paste a link to a list of the Talkback incidents; simply copy the link for the corresponding '''Total''' number from the Topcrash Report page.
## Where applicable, enter a summary of users' comments; if there are reproducible steps, do add them here.
## Paste the first frame for the most commonly reported crashes for the given signature. This will make it easier to query Bugzilla for the bug.
# Choose the platform/OS based on the frequency of crashes listed under '''Lin''' (Linux), '''Win''' (Windows) and '''Mac''' &mdash;again, this in the Topcrash Reports page, currently on the right side of the table.
# Copy and paste the entire Smart Analysis content for the given signature into a separate text file, then attach it to the bug. This is useful if the stacks are quite long (or varying) or if there are a lot of user comments.
# Repeat steps 7-9 for other signatures which are similar or seem related to the bug.
137

edits