Compatibility/Mobile Testing Surveys

From MozillaWiki
Jump to: navigation, search

Mobile Testing Surveys

SoftVision will be testing the top mobile sites—in Firefox for Android—in a list of prioritized locales, and reporting bugs as they find them.

Test Plan

In general, we want to test a site in the most useful ways it can be tested, beyond looking at the home page, i.e., play and pause video, create an account and log in, add and remove an item to/from a cart, open a menu and select items, upvote a post, etc.

It's hard to know a priori what this will end up looking like. The plan is to start exploratory testing with the US locale and make notes of what is and isn't useful (or possible) to test. From that we'll create a test plan of the remaining locales based on the types of sites and their related common interactions.

As part of this testing, we should also document obstacles. For example, do we need to create paid accounts to test some of the sites? Do we need to purchase items, or is it enough to take a transaction all the way until payment is requested?

(Note: if we need to get money for this type of testing, we can request it.)

Wiki Test Plan

Bug Reporting Guidelines

All sites should be tested in Firefox for Android Nightly. If an issue doesn't reproduce in Chrome for Android, AND reproduces in Firefox for Android Nightly, a bug should be filed on webcompat.com with steps to reproduce and a screenshot (except for NSFW content; see below).

Bug identifier

Each bug report should have a lowercase bug identifier to help us link back to all bug reports filed as part of this project, and by country (via a search query). It should look like this:

sv; country: us

That is, the string "sv;" followed by a space, followed by the string "country:" followed by a space, followed by the 2 letter ISO 3166-1 alpha-2 code that corresponds to the top site list.

See here for a reference on country codes: https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2#Officially_assigned_code_elements

NSFW Content

Some sites tested may be adult or pornographic in nature. If bugs are encountered in these types of sites, screenshots should either not be included in the bug reports, or have the Not-Safe-For-Work portions blurred out before uploading.

Locales

We will start with the following locales, more to come after. Each locale should link to a query to bring up reported bugs, a link to the tested URLs, and have a summary once it has been tested.

Getting top sites

Top Sites can be obtained from Alexa: http://www.alexa.com/topsites/countries


The following snippet of code can be run in the browser console on a result page to make it easy to copy and paste into the wiki.

(Note: https://aws.amazon.com/alexa-top-sites/ also exists, but subscribing doesn't seem to be working for me at the moment)

$$('div.tr > div > p > a:nth-child(1)').map(el => {
  return `#  ${el.textContent} \n`;
}).join('')

US

Some of these won't be useful to test (t.co, for example). And others will have additional popular subdomains worth testing. Alexa doesn't provide that info, unfortunately.

  1. Google.com
  2. Youtube.com
  3. Facebook.com
  4. Amazon.com
  5. Yahoo.com
  6. Wikipedia.org
  7. Reddit.com
  8. Twitter.com
  9. Ebay.com
  10. Linkedin.com
  11. Netflix.com
  12. Diply.com
  13. Instagram.com
  14. Live.com
  15. Craigslist.org
  16. Ntd.tv
  17. Bing.com
  18. Imgur.com
  19. Cnn.com
  20. Office.com
  21. Pinterest.com
  22. Tumblr.com
  23. Microsoftonline.com
  24. T.co
  25. Chase.com
  26. Nytimes.com
  27. Blogspot.com
  28. Paypal.com
  29. Imdb.com
  30. Livejasmin.com
  31. Pornhub.com
  32. Wordpress.com
  33. Espn.com
  34. Apple.com
  35. Walmart.com
  36. Msn.com
  37. Wikia.com
  38. Breitbart.com
  39. Salesforce.com
  40. Bankofamerica.com
  41. Weather.com
  42. Wellsfargo.com
  43. Washingtonpost.com
  44. Microsoft.com
  45. Zillow.com
  46. Huffingtonpost.com
  47. Twitch.tv
  48. Instructure.com
  49. Dropbox.com
  50. Intuit.com
  51. Foxnews.com
  52. Googleusercontent.com
  53. Stackoverflow.com
  54. Yelp.com
  55. Github.com
  56. Pandora.com
  57. Adobe.com
  58. Conservativetribune.com
  59. Soundcloud.com
  60. Indeed.com
  61. Etsy.com
  62. Aol.com
  63. Force.com
  64. Gfycat.com
  65. Amazonaws.com
  66. Spotify.com
  67. Vice.com
  68. Xfinity.com
  69. Onclkds.com
  70. Buzzfeed.com
  71. Godaddy.com
  72. Txxx.com
  73. Quora.com
  74. Weebly.com
  75. Patch.com
  76. Bestbuy.com
  77. Thesaurus.com
  78. Capitalone.com
  79. Baidu.com
  80. Blackboard.com
  81. Thepiratebay.org
  82. Bbc.com
  83. Go.com
  84. Tripadvisor.com
  85. Roblox.com
  86. Dingit.tv
  87. Forbes.com
  88. Homedepot.com
  89. Stackexchange.com
  90. Vimeo.com
  91. Deviantart.com
  92. Target.com
  93. Rumble.com
  94. Usps.com
  95. 123movies.is
  96. Irs.gov
  97. Cnet.com
  98. Citi.com
  99. Dailymail.co.uk
  100. Businessinsider.com

France

Note: Top 125 included, in case there are duplicates not worth testing. Mike can get more if needed.

  1. Google.fr
  2. Youtube.com
  3. Google.com
  4. Facebook.com
  5. Wikipedia.org
  6. Amazon.fr
  7. Leboncoin.fr
  8. Yahoo.com
  9. Live.com
  10. Orange.fr
  11. Twitter.com
  12. Livejasmin.com
  13. Free.fr
  14. Linkedin.com
  15. Lemonde.fr
  16. Instagram.com
  17. Reddit.com
  18. Lefigaro.fr
  19. Ebay.fr
  20. Cdiscount.com
  21. T.co
  22. Zone-telechargement.ws
  23. Jeuxvideo.com
  24. Labanquepostale.fr
  25. Allocine.fr
  26. Msn.com
  27. Commentcamarche.net
  28. Pole-emploi.fr
  29. Sfr.fr
  30. Pornhub.com
  31. Vk.com
  32. Lequipe.fr
  33. Twitch.tv
  34. Xhamster.com
  35. Pinterest.com
  36. Voirfilms.co
  37. Programme-tv.net
  38. Credit-agricole.fr
  39. 20minutes.fr
  40. Github.com
  41. Netflix.com
  42. Aliexpress.com
  43. Caf.fr
  44. Wordpress.com
  45. Francetvinfo.fr
  46. Bongacams.com
  47. Torrent9.biz
  48. Tumblr.com
  49. Stackoverflow.com
  50. Linternaute.com
  51. Dailymotion.com
  52. Microsoft.com
  53. T411.ai
  54. Bing.com
  55. Paypal.com
  56. Xvideos.com
  57. Onclkds.com
  58. Meteofrance.com
  59. Bfmtv.com
  60. Laposte.fr
  61. Txxx.com
  62. Voyages-sncf.com
  63. Porn555.com
  64. Leparisien.fr
  65. Amazon.com
  66. Dl-protecte.com
  67. Reverso.net
  68. Pagesjaunes.fr
  69. Nouvelobs.com
  70. Fnac.com
  71. Apple.com
  72. Imgur.com
  73. Huffingtonpost.fr
  74. Lcl.fr
  75. Dingit.tv
  76. Tf1.fr
  77. Impots.gouv.fr
  78. Office.com
  79. Vente-privee.com
  80. Societegenerale.fr
  81. Bouyguestelecom.fr
  82. Caisse-epargne.fr
  83. Creditmutuel.fr
  84. Boursorama.com
  85. Priceminister.com
  86. Wordreference.com
  87. Laposte.net
  88. Lexpress.fr
  89. 01net.com
  90. Wikia.com
  91. Linguee.fr
  92. Ok.ru
  93. Banquepopulaire.fr
  94. Adobe.com
  95. Booking.com
  96. Ouest-france.fr
  97. Deezer.com
  98. Leroymerlin.fr
  99. Service-public.fr
  100. Dealabs.com
  101. Microsoftonline.com
  102. 9gag.com
  103. Soundcloud.com
  104. Uptobox.com
  105. Tripadvisor.fr
  106. Clubic.com
  107. Libertyland.co
  108. Over-blog.com
  109. 1fichier.com
  110. Mabanque.bnpparibas
  111. Imdb.com
  112. Airbnb.fr
  113. Wlp-acs.com
  114. Lesechos.fr
  115. Google.ru
  116. Amazonaws.com
  117. Outbrain.com
  118. Liberation.fr
  119. Vimeo.com
  120. Streamcomplet.com
  121. Secretsdujeu.com
  122. Dropbox.com
  123. Zimbra.free.fr
  124. Societe.com
  125. Buzzfil.net

India

  1. Google.co.in
  2. Youtube.com
  3. Google.com
  4. Facebook.com
  5. Yahoo.com
  6. Amazon.in
  7. Wikipedia.org
  8. Flipkart.com
  9. Onlinesbi.com
  10. Irctc.co.in
  11. Hotstar.com
  12. Linkedin.com
  13. Indiatimes.com
  14. Onclkds.com
  15. Ntd.tv
  16. Blogspot.in
  17. Stackoverflow.com
  18. Cricbuzz.com
  19. Xvideos.com
  20. Quora.com
  21. Hdfcbank.com
  22. Twitter.com
  23. Paytm.com
  24. Torrentz2.eu
  25. Ndtv.com
  26. Popads.net
  27. Instagram.com
  28. Uidai.gov.in
  29. Billdesk.com
  30. Icicibank.com
  31. Naukri.com
  32. Rediff.com
  33. Wittyfeed.com
  34. Bet365.com
  35. Thewhizmarketing.com
  36. Amazon.com
  37. Microsoft.com
  38. Wordpress.com
  39. Whatsapp.com
  40. Ebay.in
  41. Bookmyshow.com
  42. Live.com
  43. Pornhub.com
  44. Moneycontrol.com
  45. Googleusercontent.com
  46. Snapdeal.com
  47. Imdb.com
  48. Intoday.in
  49. Jabong.com
  50. Msn.com
  51. Airtel.in
  52. Makemytrip.com
  53. Xnxx.com
  54. Espncricinfo.com
  55. Justdial.com
  56. Bhaskar.com
  57. Olx.in
  58. Freejobalert.com
  59. Savefrom.net
  60. Bing.com
  61. Blogger.com
  62. Sarkariresult.com
  63. Clicksgear.com
  64. W3schools.com
  65. Manoramaonline.com
  66. Github.com
  67. Indianrail.gov.in
  68. Andhrajyothy.com
  69. Softonic.com
  70. India.com
  71. Indianexpress.com
  72. Porn555.com
  73. Tamilrockers.lv
  74. Paytm.in
  75. Reddit.com
  76. Adobe.com
  77. Yts.ag
  78. Tutorialspoint.com
  79. Apple-kungfu.com
  80. Pinterest.com
  81. Rambler.ru
  82. Xhamster.com
  83. Mi.com
  84. Incometaxindiaefiling.gov.in
  85. Shopclues.com
  86. Newstrend.news
  87. Ask.com
  88. Aarth.com
  89. Doubleclick.net
  90. Godaddy.com
  91. 1337x.to
  92. Axisbank.co.in
  93. Myntra.com
  94. Nsdl.com
  95. Oneindia.com
  96. Iwanttodeliver.com
  97. Slideshare.net
  98. Quikr.com
  99. Hindustantimes.com
  100. Office.com
  101. Blogspot.com
  102. Txxx.com
  103. Insistpost.com
  104. Amazonaws.com
  105. Thehindu.com
  106. Filehippo.com
  107. Torrentproject.se
  108. Microsoftonline.com
  109. Indiamart.com
  110. Stackexchange.com
  111. Sportzwiki.com
  112. Voot.com
  113. Eenadu.net
  114. News18.com
  115. Mydala.com
  116. Primevideo.com
  117. Myway.com
  118. Uptodown.com
  119. Dailymotion.com
  120. T.co
  121. Trackmedia101.com
  122. Sarvgyan.com
  123. Emailaccessonline.com
  124. Actcorp.in
  125. Ozee.com

Germany

  1. Google.de
  2. Youtube.com
  3. Google.com
  4. Facebook.com
  5. Amazon.de
  6. Ebay.de
  7. Wikipedia.org
  8. Vk.com
  9. Ebay-kleinanzeigen.de
  10. Web.de
  11. Ok.ru
  12. Livejasmin.com
  13. Yahoo.com
  14. Gmx.net
  15. Reddit.com
  16. Mail.ru
  17. T-online.de
  18. Twitter.com
  19. Instagram.com
  20. Spiegel.de
  21. Xhamster.com
  22. Paypal.com
  23. Bild.de
  24. Live.com
  25. Chip.de
  26. Google.com.tr
  27. Yandex.ru
  28. Bing.com
  29. Pornhub.com
  30. Twitch.tv
  31. Google.ru
  32. Whatsapp.com
  33. Gutefrage.net
  34. Tellonym.de
  35. Txxx.com
  36. Netflix.com
  37. Focus.de
  38. Tumblr.com
  39. Welt.de
  40. Google.com.ua
  41. Linkedin.com
  42. Wetter.com
  43. Mobile.de
  44. Wordpress.com
  45. Blogspot.de
  46. Postbank.de
  47. Immobilienscout24.de
  48. Imgur.com
  49. Bs.to
  50. Microsoft.com
  51. Msn.com
  52. Dict.cc
  53. Bahn.de
  54. Amazon.com
  55. Otto.de
  56. Github.com
  57. T.co
  58. Heise.de
  59. Telekom.com
  60. Hclips.com
  61. Streamcloud.eu
  62. Xing.com
  63. Stackoverflow.com
  64. Xvideos.com
  65. Idealo.de
  66. Aliexpress.com
  67. Dhl.de
  68. Pinterest.de
  69. Booking.com
  70. 1und1.de
  71. Upornia.com
  72. Apple.com
  73. Deutsche-bank.de
  74. Wikia.com
  75. Deref-web-02.de
  76. Zeit.de
  77. Vice.com
  78. Wetteronline.de
  79. Chaturbate.com
  80. Kinox.to
  81. Imdb.com
  82. Mozilla.org
  83. Deref-gmx.net
  84. 9gag.com
  85. Bongacams.com
  86. Adobe.com
  87. Wetter.de
  88. Dropbox.com
  89. Tagesschau.de
  90. Youporn.com
  91. Onclkds.com
  92. Junbi-tracker.com
  93. Computerbild.de
  94. Commerzbank.de
  95. Mydealz.de
  96. Sueddeutsche.de
  97. Tipico.de
  98. Faz.net
  99. Leo.org
  100. Vodafone.de
  101. Zdf.de
  102. Mediamarkt.de
  103. N-tv.de
  104. Soundcloud.com
  105. Steamcommunity.com
  106. Popads.net
  107. Chefkoch.de
  108. Rambler.ru
  109. Likemag.com
  110. Zalando.de
  111. Autoscout24.de
  112. Ing-diba.de
  113. Olx.ua
  114. Check24.de
  115. Ebay.com
  116. Dkb.de
  117. Hotmovs.com
  118. Stargames.com
  119. Ablogica.com
  120. Outbrain.com
  121. Kicker.de
  122. Sunnyplayer.com
  123. Duden.de
  124. Comdirect.de
  125. Amazonaws.com

Taiwan

  1. Google.com.tw
  2. Pixnet.net
  3. Youtube.com
  4. Facebook.com
  5. Ettoday.net
  6. Google.com
  7. Yahoo.com
  8. Ltn.com.tw
  9. Setn.com
  10. Momoshop.com.tw
  11. Nownews.com
  12. Wikipedia.org
  13. Gamer.com.tw
  14. Tvbs.com.tw
  15. Ptt.cc
  16. Ck101.com
  17. Ebc.net.tw
  18. 104.com.tw
  19. Appledaily.com.tw
  20. Pchome.com.tw
  21. Life.tw
  22. Ruten.com.tw
  23. Eyny.com
  24. Udn.com
  25. Mobile01.com
  26. Ctitv.com.tw
  27. Baidu.com
  28. Dcard.tw
  29. Ipetgroup.com
  30. Epochtimes.com
  31. Talk.tw
  32. Teepr.com
  33. Instagram.com
  34. Storm.mg
  35. Taobao.com
  36. Feebee.com.tw
  37. Businessweekly.com.tw
  38. 1111.com.tw
  39. Twitch.tv
  40. Sina.com.tw
  41. Xuite.net
  42. Cmoney.tw
  43. Bomb01.com
  44. Shopee.tw
  45. Everydayhealth.com.tw
  46. Twitter.com
  47. Line.me
  48. Kknews.cc
  49. Books.com.tw
  50. Cool3c.com
  51. Qoolquiz.com
  52. Techbang.com
  53. Elle.com.tw
  54. Plurk.com
  55. Coco01.net
  56. Live.com
  57. Imgur.com
  58. 591.com.tw
  59. 99kubo.com
  60. Icook.tw
  61. Juksy.com
  62. Read01.com
  63. Buy123.com.tw
  64. Qq.com
  65. Weibo.com
  66. Chinatimes.com
  67. Disp.cc
  68. Commonhealth.com.tw
  69. Vogue.com.tw
  70. Cnyes.com
  71. Ipeen.com.tw
  72. Buzzorange.com
  73. Niusnews.com
  74. Cwb.gov.tw
  75. Dongtw.com
  76. Tmall.com
  77. Pcstore.com.tw
  78. Jkforum.net
  79. Hinet.net
  80. Wetalk.tw
  81. Apple.com
  82. Github.com
  83. Litv.tv
  84. Chenderroad.com
  85. Cna.com.tw
  86. Playsport.cc
  87. Healthylives.tw
  88. Gomaji.com
  89. Microsoft.com
  90. Tumblr.com
  91. Stackoverflow.com
  92. 518.com.tw
  93. Parenting.com.tw
  94. Thenewslens.com
  95. Github.io
  96. Biggo.com.tw
  97. Liontravel.com
  98. Popdaily.com.tw
  99. Blogspot.com
  100. Gamme.com.tw
  101. Yungching.com.tw
  102. Amazon.com
  103. Top1health.com
  104. Xvideos.com
  105. Koreastardaily.com
  106. Sina.com.cn
  107. Eprice.com.tw
  108. Mamibuy.com.tw
  109. Colatour.com.tw
  110. Marieclaire.com.tw
  111. Dm5.com
  112. Popads.net
  113. Maplestage.com
  114. 8maple.ru
  115. I-gamer.net
  116. Wordpress.com
  117. Walkerland.com.tw
  118. Pornhub.com
  119. Gq.com.tw
  120. Findprice.com.tw
  121. Pinterest.com
  122. Reddit.com
  123. Dropbox.com
  124. Click108.com.tw
  125. Fc2.com

Indonesia

Hong Kong

Singapore

Poland

UK

Russia