Compatibility/Mobile Testing Surveys
Mobile Testing Surveys
SoftVision will be testing the top mobile sites—in Firefox for Android—in a list of prioritized locales, and reporting bugs as they find them.
Test Plan
In general, we want to test a site in the most useful ways it can be tested, beyond looking at the home page, i.e., play and pause video, create an account and log in, add and remove an item to/from a cart, open a menu and select items, upvote a post, etc.
It's hard to know a priori what this will end up looking like. The plan is to start exploratory testing with the US locale and make notes of what is and isn't useful (or possible) to test. From that we'll create a test plan of the remaining locales based on the types of sites and their related common interactions.
As part of this testing, we should also document obstacles. For example, do we need to create paid accounts to test some of the sites? Do we need to purchase items, or is it enough to take a transaction all the way until payment is requested?
(Note: if we need to get money for this type of testing, we can request it.)
Bug Reporting Guidelines
All sites should be tested in Firefox for Android Nightly. If an issue doesn't reproduce in Chrome for Android, AND reproduces in Firefox for Android Nightly, a bug should be filed on webcompat.com with steps to reproduce and a screenshot (except for NSFW content; see below).
Bug identifier
Each bug report should have a lowercase bug identifier to help us link back to all bug reports filed as part of this project, and by country (via a search query). It should look like this:
sv; country: us
That is, the string "sv;" followed by a space, followed by the string "country:" followed by a space, followed by the 2 letter ISO 3166-1 alpha-2 code that corresponds to the top site list.
See here for a reference on country codes: https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2#Officially_assigned_code_elements
NSFW Content
Some sites tested may be adult or pornographic in nature. If bugs are encountered in these types of sites, screenshots should either not be included in the bug reports, or have the Not-Safe-For-Work portions blurred out before uploading.
Locales
We will start with the following locales, more to come after. Each locale should link to a query to bring up reported bugs, a link to the tested URLs, and have a summary once it has been tested.
Getting top sites
Top Sites can be obtained from Alexa: http://www.alexa.com/topsites/countries
The following snippet of code can be run in the browser console on a result page to make it easy to copy and paste into the wiki.
(Note: https://aws.amazon.com/alexa-top-sites/ also exists, but subscribing doesn't seem to be working for me at the moment)
$$('div.tr > div > p > a:nth-child(1)').map(el => {
return `# ${el.textContent} \n`;
}).join('')
US
Some of these won't be useful to test (t.co, for example). And others will have additional popular subdomains worth testing. Alexa doesn't provide that info, unfortunately.
- Google.com
- Youtube.com
- Facebook.com
- Amazon.com
- Yahoo.com
- Wikipedia.org
- Reddit.com
- Twitter.com
- Ebay.com
- Linkedin.com
- Netflix.com
- Diply.com
- Instagram.com
- Live.com
- Craigslist.org
- Ntd.tv
- Bing.com
- Imgur.com
- Cnn.com
- Office.com
- Pinterest.com
- Tumblr.com
- Microsoftonline.com
- T.co
- Chase.com
- Nytimes.com
- Blogspot.com
- Paypal.com
- Imdb.com
- Livejasmin.com
- Pornhub.com
- Wordpress.com
- Espn.com
- Apple.com
- Walmart.com
- Msn.com
- Wikia.com
- Breitbart.com
- Salesforce.com
- Bankofamerica.com
- Weather.com
- Wellsfargo.com
- Washingtonpost.com
- Microsoft.com
- Zillow.com
- Huffingtonpost.com
- Twitch.tv
- Instructure.com
- Dropbox.com
- Intuit.com
- Foxnews.com
- Googleusercontent.com
- Stackoverflow.com
- Yelp.com
- Github.com
- Pandora.com
- Adobe.com
- Conservativetribune.com
- Soundcloud.com
- Indeed.com
- Etsy.com
- Aol.com
- Force.com
- Gfycat.com
- Amazonaws.com
- Spotify.com
- Vice.com
- Xfinity.com
- Onclkds.com
- Buzzfeed.com
- Godaddy.com
- Txxx.com
- Quora.com
- Weebly.com
- Patch.com
- Bestbuy.com
- Thesaurus.com
- Capitalone.com
- Baidu.com
- Blackboard.com
- Thepiratebay.org
- Bbc.com
- Go.com
- Tripadvisor.com
- Roblox.com
- Dingit.tv
- Forbes.com
- Homedepot.com
- Stackexchange.com
- Vimeo.com
- Deviantart.com
- Target.com
- Rumble.com
- Usps.com
- 123movies.is
- Irs.gov
- Cnet.com
- Citi.com
- Dailymail.co.uk
- Businessinsider.com
France
Note: Top 125 included, in case there are duplicates not worth testing. Mike can get more if needed.
- Google.fr
- Youtube.com
- Google.com
- Facebook.com
- Wikipedia.org
- Amazon.fr
- Leboncoin.fr
- Yahoo.com
- Live.com
- Orange.fr
- Twitter.com
- Livejasmin.com
- Free.fr
- Linkedin.com
- Lemonde.fr
- Instagram.com
- Reddit.com
- Lefigaro.fr
- Ebay.fr
- Cdiscount.com
- T.co
- Zone-telechargement.ws
- Jeuxvideo.com
- Labanquepostale.fr
- Allocine.fr
- Msn.com
- Commentcamarche.net
- Pole-emploi.fr
- Sfr.fr
- Pornhub.com
- Vk.com
- Lequipe.fr
- Twitch.tv
- Xhamster.com
- Pinterest.com
- Voirfilms.co
- Programme-tv.net
- Credit-agricole.fr
- 20minutes.fr
- Github.com
- Netflix.com
- Aliexpress.com
- Caf.fr
- Wordpress.com
- Francetvinfo.fr
- Bongacams.com
- Torrent9.biz
- Tumblr.com
- Stackoverflow.com
- Linternaute.com
- Dailymotion.com
- Microsoft.com
- T411.ai
- Bing.com
- Paypal.com
- Xvideos.com
- Onclkds.com
- Meteofrance.com
- Bfmtv.com
- Laposte.fr
- Txxx.com
- Voyages-sncf.com
- Porn555.com
- Leparisien.fr
- Amazon.com
- Dl-protecte.com
- Reverso.net
- Pagesjaunes.fr
- Nouvelobs.com
- Fnac.com
- Apple.com
- Imgur.com
- Huffingtonpost.fr
- Lcl.fr
- Dingit.tv
- Tf1.fr
- Impots.gouv.fr
- Office.com
- Vente-privee.com
- Societegenerale.fr
- Bouyguestelecom.fr
- Caisse-epargne.fr
- Creditmutuel.fr
- Boursorama.com
- Priceminister.com
- Wordreference.com
- Laposte.net
- Lexpress.fr
- 01net.com
- Wikia.com
- Linguee.fr
- Ok.ru
- Banquepopulaire.fr
- Adobe.com
- Booking.com
- Ouest-france.fr
- Deezer.com
- Leroymerlin.fr
- Service-public.fr
- Dealabs.com
- Microsoftonline.com
- 9gag.com
- Soundcloud.com
- Uptobox.com
- Tripadvisor.fr
- Clubic.com
- Libertyland.co
- Over-blog.com
- 1fichier.com
- Mabanque.bnpparibas
- Imdb.com
- Airbnb.fr
- Wlp-acs.com
- Lesechos.fr
- Google.ru
- Amazonaws.com
- Outbrain.com
- Liberation.fr
- Vimeo.com
- Streamcomplet.com
- Secretsdujeu.com
- Dropbox.com
- Zimbra.free.fr
- Societe.com
- Buzzfil.net
India
- Google.co.in
- Youtube.com
- Google.com
- Facebook.com
- Yahoo.com
- Amazon.in
- Wikipedia.org
- Flipkart.com
- Onlinesbi.com
- Irctc.co.in
- Hotstar.com
- Linkedin.com
- Indiatimes.com
- Onclkds.com
- Ntd.tv
- Blogspot.in
- Stackoverflow.com
- Cricbuzz.com
- Xvideos.com
- Quora.com
- Hdfcbank.com
- Twitter.com
- Paytm.com
- Torrentz2.eu
- Ndtv.com
- Popads.net
- Instagram.com
- Uidai.gov.in
- Billdesk.com
- Icicibank.com
- Naukri.com
- Rediff.com
- Wittyfeed.com
- Bet365.com
- Thewhizmarketing.com
- Amazon.com
- Microsoft.com
- Wordpress.com
- Whatsapp.com
- Ebay.in
- Bookmyshow.com
- Live.com
- Pornhub.com
- Moneycontrol.com
- Googleusercontent.com
- Snapdeal.com
- Imdb.com
- Intoday.in
- Jabong.com
- Msn.com
- Airtel.in
- Makemytrip.com
- Xnxx.com
- Espncricinfo.com
- Justdial.com
- Bhaskar.com
- Olx.in
- Freejobalert.com
- Savefrom.net
- Bing.com
- Blogger.com
- Sarkariresult.com
- Clicksgear.com
- W3schools.com
- Manoramaonline.com
- Github.com
- Indianrail.gov.in
- Andhrajyothy.com
- Softonic.com
- India.com
- Indianexpress.com
- Porn555.com
- Tamilrockers.lv
- Paytm.in
- Reddit.com
- Adobe.com
- Yts.ag
- Tutorialspoint.com
- Apple-kungfu.com
- Pinterest.com
- Rambler.ru
- Xhamster.com
- Mi.com
- Incometaxindiaefiling.gov.in
- Shopclues.com
- Newstrend.news
- Ask.com
- Aarth.com
- Doubleclick.net
- Godaddy.com
- 1337x.to
- Axisbank.co.in
- Myntra.com
- Nsdl.com
- Oneindia.com
- Iwanttodeliver.com
- Slideshare.net
- Quikr.com
- Hindustantimes.com
- Office.com
- Blogspot.com
- Txxx.com
- Insistpost.com
- Amazonaws.com
- Thehindu.com
- Filehippo.com
- Torrentproject.se
- Microsoftonline.com
- Indiamart.com
- Stackexchange.com
- Sportzwiki.com
- Voot.com
- Eenadu.net
- News18.com
- Mydala.com
- Primevideo.com
- Myway.com
- Uptodown.com
- Dailymotion.com
- T.co
- Trackmedia101.com
- Sarvgyan.com
- Emailaccessonline.com
- Actcorp.in
- Ozee.com
Germany
- Google.de
- Youtube.com
- Google.com
- Facebook.com
- Amazon.de
- Ebay.de
- Wikipedia.org
- Vk.com
- Ebay-kleinanzeigen.de
- Web.de
- Ok.ru
- Livejasmin.com
- Yahoo.com
- Gmx.net
- Reddit.com
- Mail.ru
- T-online.de
- Twitter.com
- Instagram.com
- Spiegel.de
- Xhamster.com
- Paypal.com
- Bild.de
- Live.com
- Chip.de
- Google.com.tr
- Yandex.ru
- Bing.com
- Pornhub.com
- Twitch.tv
- Google.ru
- Whatsapp.com
- Gutefrage.net
- Tellonym.de
- Txxx.com
- Netflix.com
- Focus.de
- Tumblr.com
- Welt.de
- Google.com.ua
- Linkedin.com
- Wetter.com
- Mobile.de
- Wordpress.com
- Blogspot.de
- Postbank.de
- Immobilienscout24.de
- Imgur.com
- Bs.to
- Microsoft.com
- Msn.com
- Dict.cc
- Bahn.de
- Amazon.com
- Otto.de
- Github.com
- T.co
- Heise.de
- Telekom.com
- Hclips.com
- Streamcloud.eu
- Xing.com
- Stackoverflow.com
- Xvideos.com
- Idealo.de
- Aliexpress.com
- Dhl.de
- Pinterest.de
- Booking.com
- 1und1.de
- Upornia.com
- Apple.com
- Deutsche-bank.de
- Wikia.com
- Deref-web-02.de
- Zeit.de
- Vice.com
- Wetteronline.de
- Chaturbate.com
- Kinox.to
- Imdb.com
- Mozilla.org
- Deref-gmx.net
- 9gag.com
- Bongacams.com
- Adobe.com
- Wetter.de
- Dropbox.com
- Tagesschau.de
- Youporn.com
- Onclkds.com
- Junbi-tracker.com
- Computerbild.de
- Commerzbank.de
- Mydealz.de
- Sueddeutsche.de
- Tipico.de
- Faz.net
- Leo.org
- Vodafone.de
- Zdf.de
- Mediamarkt.de
- N-tv.de
- Soundcloud.com
- Steamcommunity.com
- Popads.net
- Chefkoch.de
- Rambler.ru
- Likemag.com
- Zalando.de
- Autoscout24.de
- Ing-diba.de
- Olx.ua
- Check24.de
- Ebay.com
- Dkb.de
- Hotmovs.com
- Stargames.com
- Ablogica.com
- Outbrain.com
- Kicker.de
- Sunnyplayer.com
- Duden.de
- Comdirect.de
- Amazonaws.com
- Linguee.de
- Lidl.de
- Transfermarkt.de
- Stern.de
- Giga.de
- Telekom.de
- Mpnrs.com
- Clicksgear.com
- Seasonvar.ru
- Office.com
- Redtube.com
- Yandex.ua
- Bbc.com
- Quasargaming.com
- Arbeitsagentur.de
- Ikea.com
- Steampowered.com
- Livejournal.com
- Vimeo.com
- Reallifecam.com
- Fritz.box
- Vivo.sx
- Spotify.com
- Freenet.de
- Gamestar.de
- Xnxx.com
- Openload.co
- Rt.com
- Golem.de
- Immowelt.de
- Convert2mp3.net
- Serienstream.to
- Startpage.com
- Filecrypt.cc
- Googleusercontent.com
- Pr0gramm.com
- Uploaded.net
- Shop-apotheke.com
- Porn555.com
- Sunmaker.com
- O2online.de
- Aol.com
- Stackexchange.com
- Microsoftonline.com
- Wikimedia.org
- Deviantart.com
- Battle.net
- Theguardian.com
- Finanzen.net
- Saturn.de
- Savefrom.net
- Diply.com
- Computerbase.de
- Meinestadt.de
- Avira.com
- Bonprix.de
- Holidaycheck.de
- Tripadvisor.de
- Sport1.de
- Kinopoisk.ru
- Rutracker.org
- Ardmediathek.de
- Movie4k.to
- Airbnb.de
- Ecosia.org
- Fbcdn.net
- Quora.com
- Goldesel.to
- Beeg.com
- Dailymotion.com
- Pcwelt.de
- Ensonhaber.com
- Duckduckgo.com
- Stepstone.de
- Sputniknews.com
- Performanceadexchange.com
- Gamepedia.com
- Hm.com
- Plarium.com
- Hoortols.org
- Trello.com
- Conrad.de
- Hdfilme.tv
- Pons.com
- Immonet.de
- Drtuber.com
- Pornomenge.com
- Tagesspiegel.de
- Jimdo.com
- Markt.de
- Berliner-sparkasse.de
- Dingit.tv
- Translit.net
- Buzzadexchange.com
- Daserste.de
- Mygully.com
- Vporn.com
- My-hit.org
- Motor-talk.de
- Userapi.com
- Sky.de
- Tvspielfilm.de
- Kinogo.club
- Indeed.com
- Dw.com
- Webmasterplan.com
- Pinimg.com
- Boerse.to
- Adscale.de
- Payback.de
- Ard.de
- Sofort.com
- Exoclick.com
- Adexchangeprediction.com
- Iwanttodeliver.com
- Movie-blog.org
- Real.de
- Gearbest.com
- Share-online.biz
- Berlin.de
- 1tv.ru
- Wdr.de
- Sinoptik.ua
- Planetromeo.com
- Notebooksbilliger.de
- Gotporn.com
- Ask.com
- Slack.com
- Myhermes.de
- Salesforce.com
- 4chan.org
- Vidzi.tv
- Kinokrad.co
- Quoka.de
- Github.io
- Google.co.uk
- Dasoertliche.de
- Lenta.ru
- Arcor.de
- Consorsbank.de
- Mmofreegames.online
- Gidonline.club
- Germany.ru
- Tvnow.de
- Spotscenered.info
- Flickr.com
- Aol.de
- Hornbach.de
- Huffingtonpost.de
- Obi.de
- Pinterest.com
- Skype.com
- Kinoprofi.org
- Movie4k.tv
- Thomann.de
- Rp-online.de
- Blogspot.com
- Filmix.me
- Discogs.com
- Joyclub.de
- Wiktionary.org
- Sabah.com.tr
- Wg-gesucht.de
- Deutschepost.de
- Ria.ru
- Ndr.de
- Mydirtyhobby.com
- Moviepilot.de
- Tube8.com
- Sourceforge.net
- Eventim.de
- Zippyshare.com
- Dastelefonbuch.de
- Force.com
- Discordapp.com
- Samsung.com
- Wetransfer.com
- Skyscanner.de
- Leagueoflegends.com
- Echo.msk.ru
- Gfycat.com
- Dailymail.co.uk
- Songtexte.com
- Kinozal.tv
- Porn.com
- Zononi.com
- Etsy.com
- Mediafire.com
- Strato.de
- Express.de
- Adf.ly
- Wikihow.com
- Spox.com
- Doodle.com
- Tchibo.de
- Elvenar.com
- Handelsblatt.com
- Startfenster.de
- Alternate.de
- Sexfriendfinder.club
- Ddl-warez.to
- Asos.de
- Archive.org
- Pcgameshardware.de
- Groupon.de
- Codeonclick.com
- Filmstarts.de
- Nytimes.com
- Proxer.me
- Redd.it
- Popcash.net
- Woxikon.de
- Pi-news.net
- Fwbntw.com
- Vesti.ru
- Atlassian.net
- Geizhals.de
- Serienjunkies.org
- Br.de
- Nametests.com
- Cnn.com
- Twimg.com
- Tnctrx.com
- Wish.com
- Jameda.de
- W3schools.com
- Tnaflix.com
- Media.tumblr.com
- Unitymedia.de
- Ab-in-den-urlaub.de
- Bbc.co.uk
- Baur.de
- Blogger.com
- Dawanda.com
- Piz7ohhujogi.com
- Testberichte.de
- Nuvid.com
- Multitran.ru
- Doublepimp.com
- Pixabay.com
- Pipeschannels.com
- Yaplakal.com
- T3n.de
- Yadi.sk
- Buzzfeed.com
- Messenger.com
- Ryanair.com
- Epochtimes.de
- Targobank.de
- Avm.de
- Genius.com
- Telegram.org
- Feedly.com
- Adac.de
- Mindfactory.de
- Gazetaexpress.com
- Voyeurhit.com
- Winfuture.de
- Aldi-sued.de
- Reimageplus.com
- Netzwelt.de
- Ixquick.com
- Thepiratebay.org
- Boerse.sx
- Lieferando.de
- Privatbank.ua
- Amazon.co.uk
- Giphy.com
- Doublepimpssl.com
- Shutterstock.com
- Fernsehserien.de
- Files.wordpress.com
- Softonic.com
- Flixbus.de
- Serienjunkies.de
- Tz.de
- Reverso.net
- Pulseonclick.com
- Bento.de
- Lufthansa.com
- Canna.to
- Bauhaus.info
- Imagetwist.com
- Alibaba.com
- Europa.eu
- Youjizz.com
- Nurxxx.net
- Digitalprivacyalert.org
- Bp.blogspot.com
- Wordpress.org
- Researchgate.net
- Fishki.net
- Businessinsider.de
- Kleiderkreisel.de
- Kino.de
- Prom.ua
- Liveinternet.ru
- Dref.pw
- Humblebundle.com
- Mega.nz
- Gomovies.to
- Icloud.com
- Boredpanda.com
- Zf.fm
- Hilltopads.net
- Cloudfront.net
- Arte.tv
- Sportschau.de
- Google.co.in
- Coinmarketcap.com
- Pearl.de
- Autobild.de
- Cnet.com
- Kaufmich.com
- Cpm10.com
- Cam4.de.com
- Patreon.com
- Spieletipps.de
- Expedia.de
- Eroprofile.com
- Poppen.de
- Forgeofempires.com
- Bunte.de
- Milf-finder.com
- Ddl.me
- Baidu.com
- Rewe.de
- Mmoga.de
- Href.li
- Airbnb.com
- Pikabu.ru
- Rbc.ru
- Speedtest.net
- Nih.gov
- Pc-magazin.de
- Bayern.de
- Finya.de
- Motherless.com
- Fewo-direkt.de
- Schulferien.org
- Ixxx.com
- Rakuten.de
- Haspa.de
- Yourporn.sexy
- Mopo.de
- Merkur.de
- Wowhead.com
- Gismeteo.ua
- Relink.to
- Nrw.de
- Terraclicks.com
- Fluege.de
- Fidor.de
- Mirtesen.ru
- Google.pl
- Hartgeld.com
- Iwank.tv
- Bet-at-home.com
- Mywatchseries.to
- Fu-berlin.de
- Rutube.ru
- Jizzbunker.com
- Turbobit.net
- Apotheken-umschau.de
- Blablacar.de
- Tripadvisor.com
- 4tube.com
- Rebuy.de
- Tubepornclassic.com
- Springer.com
- Xtube.com
- Taboola.com
- Opodo.de
- Android-hilfe.de
- Xda-developers.com