MozillaWiki - User contributions [en]

Engagement/Peace Love and Firefox

2011-06-23T21:50:47Z

Diyang: /* Signups */

The Peace, Love, and Firefox event will take place in San Francisco on June 25, 2011 during the city's Pride Celebration. The Engagement team has rented an ice cream truck for the event, and it will be parked around Dolores Park from 11:30 am to 3 pm. We'll be at the park talking with people as we give out free ice cream and swag. This is a great opportunity for Mozillians to interact with our users and spread Firefox. Please sign-up to volunteer for this event. We look forward to having as many of you out there!!

Location: Dolores Park, 20th street between Church St. and Dolores St.

Twitter: @MozMobile

Pride event that will be taking place: http://thedykemarch.org/ 

== Activities ==

*Ice Cream Truck:
**Free ice cream from 11:30-3pm
**Prize Wheel

*DJ: Raymond has volunteered to DJ!
**S&M - Rihanna
**Bad Romance/ Born this way - Lady Gaga (Special Live Performance to Bad Romance coordinated by Laura F) 
**I Just Can't Get Enough (Please make sure DJ gets this song. By Depech Mode ~ Special Live Performance coordinated by Laura F)
**I don't feel like dancing- Scissor Sisters
**Ani DiFranco (I'm not kidding. It will be all chicks)
**Till the World Ends- Britney Spears
**Vogue- Madonna
**On the floor- Jennifer Lopez
**Onto the next one - Jay-Z
**Hung up - Madonna
**Music sounds better with you - Stardust
**Barbara Streisand - DuckSauce
**I believe in you - Kylie M
**Drunk girls - LCD Soundsystem
***Totally Recommend this List of Music Below:
**Cthulhu Sleeps - Deadmau5
**Hey Baby - Mellefresh vs Deadmau5 [please listen to the music before using :)]
**Starf****r (yes, that's their band name) - Rawnald Gregory Erickson the Second
**Starf****r - Bury Us Alive
**Beck - E-Pro
**Major Lazer - Pon de Floor
**Housse de Racket - Roman
**Polarset - Sunshine Eyes
**Swedish House Mafia - Miami to Ibiza
**Swedish House Mafia - Save the World
**MGMT - Electric Feel (Justice Remix)

 

**feel free to add songs you would like to hear!

== Signups ==

Saturday June 25th

*11:00 AM - 12:00 PM
**Wilson
**ShawnG
**Diane
**Atul
**mrz
**Grace
**Winston
**Stas
**Eljon
**William
**Nikhil
**Diyang
**__
**We need as many of you at this event

*12:00 PM - 1:00 PM
**Wilson
**AndyS
**WilliamR
**mrz
**Arzhel
**Jérémy
**Grace
**Winston
**Stas
**Eljon
**William
**Nikhil
**Diyang
**__
**We need as many of you at this event

*1:00 PM - 2:00 PM
**Wilson
**mrz
** 
**name
**__
**__
**__
**We need as many of you at this event

*2:00 PM - 3:00 PM
**Wilson
** 
**mrz
**name
**__
**__
**__
**We need as many of you at this event

Labs/Test Pilot/New Tab Study

2011-06-20T22:53:54Z

Diyang: /* Useful References */

= Introduction =
[[Image:Newtabstudy-thumbnail.png]]

This is a study on the effects of a new tab design on users' browsing behaviors. We will be doing a user study through Test Pilot. The study will first establish a baseline for user behavior, and then the next phase is A/B split testing.

In the A/B split testing phase, participants will be randomly divided into two groups with either '''(A) a blank new tab''' or '''(B) a new tab with most-visited sites''' (hereby known as "fancy tab"). The comparison between two groups of users will help us understand which type of new tab design can provide better browsing experience.

== Goal ==
We want to know the benefits and drawbacks of a fancy tab page through full comparison between the blank tab page and the new one. The final results will be served as a reference for the work of UX design team on the new tab design.

== Timeline ==
Tentative:
* 05/31 - 06/03 Problem defined
* 06/05 - 06/10 Confirm research questions and basic measures
* 06/12 - 06/17 Implementation of both the study and the fancy tab interface
* 06/19 - 06/24 More implementation refinement and testing
* .......

= Process =
== Research Questions ==
# Does the fancy tab slow users down (e.g., by distracting them), or speed them up (e.g., help them find the target site faster)? (time)
# Does the fancy tab discourage breadth in visited sites? (unique sites, frequency, distribution)
# How do users navigate to a website after they open a new tab? (location bar, search bar, top sites, bookmarks, history, etc.)
# Are there users who are more mouse-based and some who are more keyboard-based? How does a fancy tab affect them?

== Survey Question ==
May launch a survey after the new tab study and ask questions explicitly.

Possible survey questions:

* Do you mainly use the keyboard more or the mouse to navigate?
* When you open a new tab, do you usually have a destination in mind?
* How many websites do you mainly visit?
* How familiar you do consider yourself with keyboard shortcuts?
* How often do you open a new tab in order to visit a website?

== Measures ==
All features and events that we would like to detect and record.

Current implementation without A/B options:
* DB schema (
** type_double timestamp,
** type_double tab_id, // Same as the timestamp when the tab is created
** type_string event,
** type_string method, // Method that triggered the event
** type_string url, // It should be hashed later
** type_string clipboard, //will be removed later
** type_int is_clipboard_url
)

* EVENTS code:
** start
** navigation
** leave

* METHODS code:
** unknown
** -----------------------start
** command_t
** plus_btn
** double_click
** file_menu
** ------------------------ navigation / cancelled_navigation
** urlbar_enter
** urlbar_go_btn
** urlbar_drop_click
** urlbar_drop_enter
** urlbar_drop_button
** search_enter
** search_go_btn
** search_drop_enter
** search_drop_click
** bookmark_bar
** bookmark_menu
** bookmark_top_sites
** history_menu
** ------------------------leave
** leave
** close

== Implementation ==
Probably need to collaborate with UI design team, especially on the fancy tab interface design and implementation.

= Results =
== Analysis ==
[[Image:DB.png|The screenshot of the collected data]]

With the user data collected by the study, we can measure:

# Domains
## measure entropy of the set of domains for each user --> distribution of the browsing entropies
## number of unique domains
## number of total browsing domains
## frequency of each domain
# Preferences
## frequency of each EVENTS.METHOD
## compare the keyboard-based methods and the mouse-based methods
# Timing
## time between the new tab open and the first page load
## time spent on each new tab before the user leaves or closes it
## time spent on each new page before the user leaves the tab or changes to another page
# Clipboard
## percentage of copying an url string before opening a new tab

== Conclusion ==
= Useful References =
#[http://unbounce.com/support/knowledge-base/running-your-first-a-b-test/ HOW TO: Run Your First A/B Test in 4 Simple Steps]
#[http://www.marketingexperiments.com/improving-website-conversion/ab-split-testing.html Some tips to make a better A/B test]
#[http://techsling.com/2011/06/why-ab-or-multivariate-testing-could-be-the-easiest-way-to-get-more-out-of-your-website/?wpmp_switcher=mobile Why A/B or Multivariate Testing Could Be The Easiest Way To Get More Out Of Your Website]
#[http://www.seomarketing30days.com/webanalytics/multivariate-testing-explained.shtml What Is Multivariate Testing, And Why It Is Superior To A/B Split Tests?]
#[http://www.invesp.com/conversion-optimization-research/a/b-multivariate-testing.html Things you must know before you start A/B & Multivariate testing]
#[http://www.widerfunnel.com/conversion-rate-optimization/ab-split-testing-vs-multivariate-pros-cons some downsides of A/B testing and multivariate testing]
#[http://www.targetmarketingmag.com/article/what-mix-split-run-multivariate-testing-is-best-160022/1 A/B test or multivariate test?]
#[https://bugzilla.mozilla.org/show_bug.cgi?id=649457]

Labs/Test Pilot/New Tab Study

2011-06-06T23:28:46Z

Diyang: /* Survey Question */

= Introduction =

This is a study on the effects of a new tab design on users' browsing behaviors. We will be doing a user study through Test Pilot. The study will first establish a baseline for user behavior, and then the next phase is A/B split testing.

In the A/B split testing phase, participants will be randomly divided into two groups with either '''(A) a blank new tab''' or '''(B) a new tab with most-visited sites''' (hereby known as "fancy tab"). The comparison between two groups of users will help us understand which type of new tab design can provide better browsing experience.

== Goal ==
We want to know the benefits and drawbacks of a fancy tab page through full comparison between the blank tab page and the new one. The final results will be served as a reference for the work of UX design team on the new tab design.

== Timeline ==
Tentative:
* 05/31 - 06/03 Problem defined
* 06/05 - 06/10 Confirm research questions and basic measures
* 06/12 - 06/17 Implementation of both the study and the fancy tab interface
* 06/19 - 06/24 More implementation refinement and testing
* .......

= Process =
== Research Questions ==
# Does the fancy tab slow users down (e.g., by distracting them), or speed them up (e.g., help them find the target site faster)? (time)
# Does the fancy tab discourage breadth in visited sites? (unique sites, frequency, distribution)
# How do users navigate to a website after they open a new tab? (location bar, search bar, top sites, bookmarks, history, etc.)
# Are there users who are more mouse-based and some who are more keyboard-based? How does a fancy tab affect them?

== Survey Question ==
May launch a survey after the new tab study and ask questions explicitly.

Possible survey questions:

* Do you mainly use the keyboard more or the mouse to navigate?
* When you open a new tab, do you usually have a destination in mind?
* How many websites do you mainly visit?
* How familiar you do consider yourself with keyboard shortcuts?
* How often do you open a new tab in order to visit a website?

== Measures ==
All features and events that we would like to detect and record.

Current implementation without A/B options:
* DB schema (type_double timestamp, type_double tabid, type_int event, type_int method, type_string url)
* EVENTS code:
** START: 0,
** LOAD_PAGE: 1,
** LEAVE: 2
* METHODS code:
** COMMAND_T: 000,
** PLUS_BTN: 001,
** DOUBLE_CLICK: 002,
** MENU: 003,
** BAR_ENTER: 100,
** BAR_GO_BTN: 101,
** BAR_DROP_CLICK: 102,
** BAR_DROP_ENTER: 103,
** SEARCH_ENTER: 110,
** SEARCH_GO_BTN: 111,
** TOP_SITES: 120,
** BOOKMARK_BAR: 121,
** BOOKMARK_MENU: 122,
** HISTORY_MENU: 130,
** BAR_DROP: 199,
** LEAVE: 200,
** CLOSE: 201

== Implementation ==
Probably need to collaborate with UI design team, especially on the fancy tab interface design and implementation.

= Results =
== Analysis ==
== Conclusion ==
= Useful References =
#[http://unbounce.com/support/knowledge-base/running-your-first-a-b-test/ HOW TO: Run Your First A/B Test in 4 Simple Steps]
#[http://www.marketingexperiments.com/improving-website-conversion/ab-split-testing.html Some tips to make a better A/B test]
#[http://techsling.com/2011/06/why-ab-or-multivariate-testing-could-be-the-easiest-way-to-get-more-out-of-your-website/?wpmp_switcher=mobile Why A/B or Multivariate Testing Could Be The Easiest Way To Get More Out Of Your Website]
#[http://www.seomarketing30days.com/webanalytics/multivariate-testing-explained.shtml What Is Multivariate Testing, And Why It Is Superior To A/B Split Tests?]
#[http://www.invesp.com/conversion-optimization-research/a/b-multivariate-testing.html Things you must know before you start A/B & Multivariate testing]
#[http://www.widerfunnel.com/conversion-rate-optimization/ab-split-testing-vs-multivariate-pros-cons some downsides of A/B testing and multivariate testing]
#[http://www.targetmarketingmag.com/article/what-mix-split-run-multivariate-testing-is-best-160022/1 A/B test or multivariate test?]

Labs/Test Pilot/New Tab Study

2011-06-06T23:22:51Z

Diyang: /* Introduction */

= Introduction =

This is a study on the effects of a new tab design on users' browsing behaviors. We will be doing a user study through Test Pilot. The study will first establish a baseline for user behavior, and then the next phase is A/B split testing.

In the A/B split testing phase, participants will be randomly divided into two groups with either '''(A) a blank new tab''' or '''(B) a new tab with most-visited sites''' (hereby known as "fancy tab"). The comparison between two groups of users will help us understand which type of new tab design can provide better browsing experience.

== Goal ==
We want to know the benefits and drawbacks of a fancy tab page through full comparison between the blank tab page and the new one. The final results will be served as a reference for the work of UX design team on the new tab design.

== Timeline ==
Tentative:
* 05/31 - 06/03 Problem defined
* 06/05 - 06/10 Confirm research questions and basic measures
* 06/12 - 06/17 Implementation of both the study and the fancy tab interface
* 06/19 - 06/24 More implementation refinement and testing
* .......

= Process =
== Research Questions ==
# Does the fancy tab slow users down (e.g., by distracting them), or speed them up (e.g., help them find the target site faster)? (time)
# Does the fancy tab discourage breadth in visited sites? (unique sites, frequency, distribution)
# How do users navigate to a website after they open a new tab? (location bar, search bar, top sites, bookmarks, history, etc.)
# Are there users who are more mouse-based and some who are more keyboard-based? How does a fancy tab affect them?

== Survey Question ==
May launch a survey after the new tab study and ask questions explicitly.

== Measures ==
All features and events that we would like to detect and record.

Current implementation without A/B options:
* DB schema (type_double timestamp, type_double tabid, type_int event, type_int method, type_string url)
* EVENTS code:
** START: 0,
** LOAD_PAGE: 1,
** LEAVE: 2
* METHODS code:
** COMMAND_T: 000,
** PLUS_BTN: 001,
** DOUBLE_CLICK: 002,
** MENU: 003,
** BAR_ENTER: 100,
** BAR_GO_BTN: 101,
** BAR_DROP_CLICK: 102,
** BAR_DROP_ENTER: 103,
** SEARCH_ENTER: 110,
** SEARCH_GO_BTN: 111,
** TOP_SITES: 120,
** BOOKMARK_BAR: 121,
** BOOKMARK_MENU: 122,
** HISTORY_MENU: 130,
** BAR_DROP: 199,
** LEAVE: 200,
** CLOSE: 201

== Implementation ==
Probably need to collaborate with UI design team, especially on the fancy tab interface design and implementation.

= Results =
== Analysis ==
== Conclusion ==
= Useful References =
#[http://unbounce.com/support/knowledge-base/running-your-first-a-b-test/ HOW TO: Run Your First A/B Test in 4 Simple Steps]
#[http://www.marketingexperiments.com/improving-website-conversion/ab-split-testing.html Some tips to make a better A/B test]
#[http://techsling.com/2011/06/why-ab-or-multivariate-testing-could-be-the-easiest-way-to-get-more-out-of-your-website/?wpmp_switcher=mobile Why A/B or Multivariate Testing Could Be The Easiest Way To Get More Out Of Your Website]
#[http://www.seomarketing30days.com/webanalytics/multivariate-testing-explained.shtml What Is Multivariate Testing, And Why It Is Superior To A/B Split Tests?]
#[http://www.invesp.com/conversion-optimization-research/a/b-multivariate-testing.html Things you must know before you start A/B & Multivariate testing]
#[http://www.widerfunnel.com/conversion-rate-optimization/ab-split-testing-vs-multivariate-pros-cons some downsides of A/B testing and multivariate testing]
#[http://www.targetmarketingmag.com/article/what-mix-split-run-multivariate-testing-is-best-160022/1 A/B test or multivariate test?]

Labs/Test Pilot/New Tab Study

2011-06-06T23:22:22Z

Diyang: /* Introduction */

= Introduction =

This is a study on the effects of a new tab design on users' browsing behaviors. We will be doing a user study through Test Pilot. The study will first establish a baseline for user behavior, and then the next phase is A/B split testing.

In the A/B split testing phase, participants will be randomly divided into two groups with either '''(A) a blank new tab''' or '''(B) a new tab with top sites''' (hereby known as "fancy tab"). The comparison between two groups of users will help us understand which type of new tab design can provide better browsing experience.

== Goal ==
We want to know the benefits and drawbacks of a fancy tab page through full comparison between the blank tab page and the new one. The final results will be served as a reference for the work of UX design team on the new tab design.

== Timeline ==
Tentative:
* 05/31 - 06/03 Problem defined
* 06/05 - 06/10 Confirm research questions and basic measures
* 06/12 - 06/17 Implementation of both the study and the fancy tab interface
* 06/19 - 06/24 More implementation refinement and testing
* .......

= Process =
== Research Questions ==
# Does the fancy tab slow users down (e.g., by distracting them), or speed them up (e.g., help them find the target site faster)? (time)
# Does the fancy tab discourage breadth in visited sites? (unique sites, frequency, distribution)
# How do users navigate to a website after they open a new tab? (location bar, search bar, top sites, bookmarks, history, etc.)
# Are there users who are more mouse-based and some who are more keyboard-based? How does a fancy tab affect them?

== Survey Question ==
May launch a survey after the new tab study and ask questions explicitly.

== Measures ==
All features and events that we would like to detect and record.

Current implementation without A/B options:
* DB schema (type_double timestamp, type_double tabid, type_int event, type_int method, type_string url)
* EVENTS code:
** START: 0,
** LOAD_PAGE: 1,
** LEAVE: 2
* METHODS code:
** COMMAND_T: 000,
** PLUS_BTN: 001,
** DOUBLE_CLICK: 002,
** MENU: 003,
** BAR_ENTER: 100,
** BAR_GO_BTN: 101,
** BAR_DROP_CLICK: 102,
** BAR_DROP_ENTER: 103,
** SEARCH_ENTER: 110,
** SEARCH_GO_BTN: 111,
** TOP_SITES: 120,
** BOOKMARK_BAR: 121,
** BOOKMARK_MENU: 122,
** HISTORY_MENU: 130,
** BAR_DROP: 199,
** LEAVE: 200,
** CLOSE: 201

== Implementation ==
Probably need to collaborate with UI design team, especially on the fancy tab interface design and implementation.

= Results =
== Analysis ==
== Conclusion ==
= Useful References =
#[http://unbounce.com/support/knowledge-base/running-your-first-a-b-test/ HOW TO: Run Your First A/B Test in 4 Simple Steps]
#[http://www.marketingexperiments.com/improving-website-conversion/ab-split-testing.html Some tips to make a better A/B test]
#[http://techsling.com/2011/06/why-ab-or-multivariate-testing-could-be-the-easiest-way-to-get-more-out-of-your-website/?wpmp_switcher=mobile Why A/B or Multivariate Testing Could Be The Easiest Way To Get More Out Of Your Website]
#[http://www.seomarketing30days.com/webanalytics/multivariate-testing-explained.shtml What Is Multivariate Testing, And Why It Is Superior To A/B Split Tests?]
#[http://www.invesp.com/conversion-optimization-research/a/b-multivariate-testing.html Things you must know before you start A/B & Multivariate testing]
#[http://www.widerfunnel.com/conversion-rate-optimization/ab-split-testing-vs-multivariate-pros-cons some downsides of A/B testing and multivariate testing]
#[http://www.targetmarketingmag.com/article/what-mix-split-run-multivariate-testing-is-best-160022/1 A/B test or multivariate test?]

Labs/Test Pilot/New Tab Study

2011-06-06T23:21:28Z

Diyang: /* Introduction */

= Introduction =

This is a study on the effects of a new tab design on users' browsing behaviors. We will be doing a user study through Test Pilot. The study will first establish a baseline for user behavior, and then the next phase is A/B split testing.

In the A/B split testing phase, participants will be randomly divided into two groups with either '''(A) a blank new tab''' or '''(B) a new tab with certain items listed''' (hereby known as "fancy tab"). The comparison between two groups of users will help us understand which type of new tab design can provide better browsing experience.

== Goal ==
We want to know the benefits and drawbacks of a fancy tab page through full comparison between the blank tab page and the new one. The final results will be served as a reference for the work of UX design team on the new tab design.

== Timeline ==
Tentative:
* 05/31 - 06/03 Problem defined
* 06/05 - 06/10 Confirm research questions and basic measures
* 06/12 - 06/17 Implementation of both the study and the fancy tab interface
* 06/19 - 06/24 More implementation refinement and testing
* .......

= Process =
== Research Questions ==
# Does the fancy tab slow users down (e.g., by distracting them), or speed them up (e.g., help them find the target site faster)? (time)
# Does the fancy tab discourage breadth in visited sites? (unique sites, frequency, distribution)
# How do users navigate to a website after they open a new tab? (location bar, search bar, top sites, bookmarks, history, etc.)
# Are there users who are more mouse-based and some who are more keyboard-based? How does a fancy tab affect them?

== Survey Question ==
May launch a survey after the new tab study and ask questions explicitly.

== Measures ==
All features and events that we would like to detect and record.

Current implementation without A/B options:
* DB schema (type_double timestamp, type_double tabid, type_int event, type_int method, type_string url)
* EVENTS code:
** START: 0,
** LOAD_PAGE: 1,
** LEAVE: 2
* METHODS code:
** COMMAND_T: 000,
** PLUS_BTN: 001,
** DOUBLE_CLICK: 002,
** MENU: 003,
** BAR_ENTER: 100,
** BAR_GO_BTN: 101,
** BAR_DROP_CLICK: 102,
** BAR_DROP_ENTER: 103,
** SEARCH_ENTER: 110,
** SEARCH_GO_BTN: 111,
** TOP_SITES: 120,
** BOOKMARK_BAR: 121,
** BOOKMARK_MENU: 122,
** HISTORY_MENU: 130,
** BAR_DROP: 199,
** LEAVE: 200,
** CLOSE: 201

== Implementation ==
Probably need to collaborate with UI design team, especially on the fancy tab interface design and implementation.

= Results =
== Analysis ==
== Conclusion ==
= Useful References =
#[http://unbounce.com/support/knowledge-base/running-your-first-a-b-test/ HOW TO: Run Your First A/B Test in 4 Simple Steps]
#[http://www.marketingexperiments.com/improving-website-conversion/ab-split-testing.html Some tips to make a better A/B test]
#[http://techsling.com/2011/06/why-ab-or-multivariate-testing-could-be-the-easiest-way-to-get-more-out-of-your-website/?wpmp_switcher=mobile Why A/B or Multivariate Testing Could Be The Easiest Way To Get More Out Of Your Website]
#[http://www.seomarketing30days.com/webanalytics/multivariate-testing-explained.shtml What Is Multivariate Testing, And Why It Is Superior To A/B Split Tests?]
#[http://www.invesp.com/conversion-optimization-research/a/b-multivariate-testing.html Things you must know before you start A/B & Multivariate testing]
#[http://www.widerfunnel.com/conversion-rate-optimization/ab-split-testing-vs-multivariate-pros-cons some downsides of A/B testing and multivariate testing]
#[http://www.targetmarketingmag.com/article/what-mix-split-run-multivariate-testing-is-best-160022/1 A/B test or multivariate test?]

Labs/Test Pilot/New Tab Study

2011-06-06T22:38:41Z

Diyang: /* Research Questions */

= Introduction =
We are going to study the effects of new tab designs on users' browsing behaviors, through a user study by test pilot. The study will be performed as a A/B split testing. Participants will be randomly divided into two groups with either '''(A) a blank new tab''' or '''(B) a new tab with certain items listed''' (let's call it fancy tab). The comparison between two groups of users will help us understand which type of new tab design can provide better browsing experience.

== Goal ==
With a fully comparison between two designs, we should know both the benefits and drawbacks for both designs. The final results will be served as a reference for the work of UI design team on the new tab design.

== Timeline ==
''This is a fake one, let us discuss on it later :-)''
* 05/31 - 06/03 Problem defined
* 06/05 - 06/10 Confirm research questions and basic measures
* 06/12 - 06/17 Implementation of both the study and the fancy tab interface
* 06/19 - 06/24 More implementation refinement and testing
* .......

= Process =
== Research Questions ==
# Does the fancy tab slow users down (e.g., by distracting them), or speed them up (e.g., help them find the target site faster)? (time)
# Does the fancy tab discourage breadth in visited sites? (unique sites, frequency, distribution)
# How do users navigate to a website after they open a new tab? (location bar,
# Are there users who are more mouse-based and some who are more keyboard-based? How does a fancy tab affect them?

== Survey Question ==
May launch a survey after the new tab study and ask questions explicitly.

== Measures ==
All features and events that we would like to detect and record.

Current implementation without A/B options:
* DB schema (type_double timestamp, type_double tabid, type_int event, type_int method, type_string url)
* EVENTS code:
** START: 0,
** LOAD_PAGE: 1,
** LEAVE: 2
* METHODS code:
** COMMAND_T: 000,
** PLUS_BTN: 001,
** DOUBLE_CLICK: 002,
** MENU: 003,
** BAR_ENTER: 100,
** BAR_GO_BTN: 101,
** BAR_DROP_CLICK: 102,
** BAR_DROP_ENTER: 103,
** SEARCH_ENTER: 110,
** SEARCH_GO_BTN: 111,
** TOP_SITES: 120,
** BOOKMARK_BAR: 121,
** BOOKMARK_MENU: 122,
** HISTORY_MENU: 130,
** BAR_DROP: 199,
** LEAVE: 200,
** CLOSE: 201

== Implementation ==
Probably need to collaborate with UI design team, especially on the fancy tab interface design and implementation.

= Results =
== Analysis ==
== Conclusion ==
= Useful References =
#[http://unbounce.com/support/knowledge-base/running-your-first-a-b-test/ HOW TO: Run Your First A/B Test in 4 Simple Steps]
#[http://www.marketingexperiments.com/improving-website-conversion/ab-split-testing.html Some tips to make a better A/B test]
#[http://techsling.com/2011/06/why-ab-or-multivariate-testing-could-be-the-easiest-way-to-get-more-out-of-your-website/?wpmp_switcher=mobile Why A/B or Multivariate Testing Could Be The Easiest Way To Get More Out Of Your Website]
#[http://www.seomarketing30days.com/webanalytics/multivariate-testing-explained.shtml What Is Multivariate Testing, And Why It Is Superior To A/B Split Tests?]
#[http://www.invesp.com/conversion-optimization-research/a/b-multivariate-testing.html Things you must know before you start A/B & Multivariate testing]
#[http://www.widerfunnel.com/conversion-rate-optimization/ab-split-testing-vs-multivariate-pros-cons some downsides of A/B testing and multivariate testing]
#[http://www.targetmarketingmag.com/article/what-mix-split-run-multivariate-testing-is-best-160022/1 A/B test or multivariate test?]