Confirmed users, Bureaucrats and Sysops emeriti
3,599
edits
Firefox/Projects/Places DB Creation Scripts: Difference between revisions
Firefox/Projects/Places DB Creation Scripts (view source)
Revision as of 22:16, 7 August 2009
, 7 August 2009moved Firefox/Sprints/Places DB Creation Scripts to Firefox/Projects/Places DB Creation Scripts: They're actually projects
m (moved Firefox/Sprints/Places DB Creation Scripts to Firefox/Projects/Places DB Creation Scripts: They're actually projects) |
|||
| (12 intermediate revisions by 3 users not shown) | |||
| Line 6: | Line 6: | ||
:Create python scripts to generate Places DBs with various characteristics such as "many visits within the same domain", "visits across many domains", "many tags", "many bookmarks", etc. Also, collect data from real-world users to inform the profiles of our generated DBs. | :Create python scripts to generate Places DBs with various characteristics such as "many visits within the same domain", "visits across many domains", "many tags", "many bookmarks", etc. Also, collect data from real-world users to inform the profiles of our generated DBs. | ||
= Status = | |||
If you are feeling adventurous, please download the | Sprint's been on the back burner while we're getting Firefox 3.5b4 out the door. | ||
Currently collecting stats from Mozilla community at https://places-stats.mozilla.com/. Been doing so since early March. Stats will inform our database generation script. | |||
Database generation script (Python) being worked on. Patches are up on {{bug|480340}}. If you are feeling adventurous, please download the Python and try it out. I would like to document bootstrapping this better. Feel free to ping ddahl in #places. | |||
Relevant links: | |||
* [http://forums.mozillazine.org/viewtopic.php?f=23&t=1172765 Mozillazine forum posting] about stats collection portion | |||
* [http://daviddahl.blogspot.com/2009/03/places-database-generator-stats.html ddahl's blog post] about database generation script | |||
* [http://blog.mozilla.com/adw/2009/03/25/places-stats/ adw's blog post] about stats collection implementation and initial results | |||
= Goals / Use Cases = | = Goals / Use Cases = | ||
| Line 104: | Line 114: | ||
=== Stats collector === | === Stats collector === | ||
https:// | https://places-stats.mozilla.com/ | ||
The stats collector is a CGI script written in Ruby | The stats collector is a CGI script written in Ruby located at the above address. Visitors are presented with instructions on how to submit statistics related to their Places databases. They copy a small piece of JavaScript, located at | ||
https:// | https://places-stats.mozilla.com/places.js and embedded in the page, and paste it into Firefox's JavaScript console and evaluate it. The JavaScript computes numerous statistics from their Places database, presents them to the user, and allows him to submit them to the site. Once submitted, the stats are inserted into a MySQL database, from which they are presented to all visitors to the site. | ||
We | We will publicize the site via blogs, forums, and wherever else to solicit submissions from the community. | ||
= Bugs = | = Bugs = | ||
* {{bug|480340}} | * {{bug|480340}} | ||
* https:// | * https://places-stats.mozilla.com/ | ||
= Misc notes for ddahl and adw = | = Misc notes for ddahl and adw = | ||
=== Awesomebar autocomplete === | |||
How should AutoComplete be stressed? Shawn says: | How should AutoComplete be stressed? Shawn says: | ||
| Line 286: | Line 298: | ||
AutoComplete is definitely important, but we'd like our database construction scripts/methodology to be general enough to generate places databases for any kind of testing context. | AutoComplete is definitely important, but we'd like our database construction scripts/methodology to be general enough to generate places databases for any kind of testing context. | ||
=== Frecency === | |||
* [https://developer.mozilla.org/en/The_Places_frecency_algorithm Algorithm description], though sdwilsh says this may be out of date | |||
* Actual frecency calculation at nsNavHistory::CalculateFrecencyInternal(), http://mxr.mozilla.org/mozilla-central/source/toolkit/components/places/src/nsNavHistory.cpp#7275 | |||
=== Stats we should have collected but did not === | |||
For each data point: | |||
* Distribution of moz_historyvisits.visit_type. This value is one of the nsINavHistoryService.TRANSITION_* constants. | |||
* Distribution of moz_places.typed | |||
* Distribution of moz_places.frecency | |||
* Nested folder stats (ddahl) | |||