Services/Sync/Getting Started: Difference between revisions
m (source code and debugging info) |
(replaced Source Code section links with direct paths to searchfox) |
||
| (18 intermediate revisions by 6 users not shown) | |||
| Line 1: | Line 1: | ||
= | = Hacking = | ||
== Source Code == | |||
Once you have a copy of the Mozilla source tree (read below for how to obtain a copy), you can find the core Sync source code in https://searchfox.org/firefox-main/source/services/sync | |||
This is just the core JavaScript APIs and logic. Additional Sync code for integration with Firefox lives in https://searchfox.org/firefox-main/source/browser/base/content | |||
Look for files with ''sync'' in their name. Files here define the integration between Firefox and Sync. This includes all the Sync UI. | |||
= Debugging Sync = | Additionally, Firefox Accounts specific code lives in https://searchfox.org/firefox-main/source/services/fxaccounts | ||
== Debugging Sync == | |||
If you are debugging Sync in your browser, the first thing you want to do is crank up the logging. In about:config, set the following preferences: | If you are debugging Sync in your browser, the first thing you want to do is crank up the logging. In about:config, set the following preferences: | ||
# Enable logging to Error Console | # Enable logging to Error Console | ||
services.sync.log.appender.console | services.sync.log.appender.console Trace | ||
# Enable logging to STDOUT | # Enable logging to STDOUT | ||
services.sync.log.appender.dump | services.sync.log.appender.dump Trace | ||
# Log full sync logs on sync success (typically they are only saved on failure) | # Log full sync logs on sync success (typically they are only saved on failure) | ||
services.sync.log.appender.file.logOnSuccess true | services.sync.log.appender.file.logOnSuccess true | ||
# Enable trace logging for engines | |||
services.sync.log.logger.engine Trace | |||
# (optional) Enable trace logging for all of sync (this is very verbose and will include all request bodies) | |||
services.sync.log.logger Trace | |||
Once you've updated those settings, restart Firefox for them to take effect. | Once you've updated those settings, restart Firefox for them to take effect. | ||
If you are logging to STDOUT, you may want to set the environment variable MOZ_QUIET to silence a lot of spew from other parts of Firefox: | If you are logging to STDOUT, you may want to set the environment variable ''MOZ_QUIET'' to silence a lot of spew from other parts of Firefox: | ||
export MOZ_QUIET=1 | export MOZ_QUIET=1 | ||
= | You can view full sync logs by opening '''about:sync-log''' in Firefox. Read more about [[Firefox Sync extended logging]] for fetching successful sync event logfiles. | ||
== Building Sync == | |||
You probably should build using an artifact build, as described [https://firefox-source-docs.mozilla.org/contributing/contribution_quickref.html#bootstrap-a-copy-of-the-firefox-source-code here]. | |||
After setting this up, you'll do `mach build` to perform a build, `mach run` to run Firefox, and `mach xpcshell-test /services/sync/tests/unit` to run the sync unit test suite. There's also a separate end-to-end test suite, TPS, which is documented [https://firefox-source-docs.mozilla.org/testing/tps/index.html here]. (For most changes it's sufficient that you run the unit tests.) | |||
Depending on your OS, most changes will not require a rebuild to take effect, only restarting and rerunning via `mach run`. | |||
= Using Bugzilla = | |||
Every code change starts out as a bug in [https://bugzilla.mozilla.org Bugzilla] where the general approach can be discussed. The bug should eventually be assigned to somebody who will upload one or more patches for review. Code can only be reviewed by module owners and their peers; see [[Services/Process/Code_Review|code review policy]] for more information. If the review has been granted and all review comments have been addressed, the patches may be checked into [https://github.com/mozilla-firefox/firefox mozilla-central]. | |||
You probably also want to get up to speed on [http://bugzilla.mozilla.org Bugzilla] if you're not already. | You probably also want to get up to speed on [http://bugzilla.mozilla.org Bugzilla] if you're not already. | ||
* A good start is to go watch [http://vimeo.com/9205730 Jonath's "Bugzilla for Humans" video]. | * A good start is to go watch [http://vimeo.com/9205730 Jonath's "Bugzilla for Humans" video]. | ||
* | * Sync bugs are found in different places depending on which part of the system they affect. For the service side (syncstorage or tokenserver), bugs will be in [https://github.com/mozilla-services/syncstorage-rs|GitHub]. For the client side, you can find a list of components [CloudServices/Sync#Report_Bugs here]. | ||
* Don't forget to add a Bugzilla ID shortcut string to your Bugzilla [https://bugzilla.mozilla.org/userprefs.cgi?tab=account account preferences]. | * Don't forget to add a Bugzilla ID shortcut string to your Bugzilla [https://bugzilla.mozilla.org/userprefs.cgi?tab=account account preferences]. The current standard practice is to append "<whitespace>[:irc_nick]" to your Real Name field. | ||
* You also want to watch the components relevant to your work so you automatically get emails for all bug changes in those components. The | * You also want to watch the components relevant to your work so you automatically get emails for all bug changes in those components. The expected components where bugs will be filed are listed on [[CloudServices/Sync#Report_Bugs]]. | ||
* A useful Firefox add-on that makes life in Bugzilla a bit easier is [https://addons.mozilla.org/en-US/firefox/addon/bugzillajs/ Bugzilla Tweaks]. Highly recommended! | |||
* A useful Firefox add-on that makes life in Bugzilla a bit easier is [https://addons.mozilla.org/en- | |||
<!-- | |||
= Using Mercurial = | = Using Mercurial = | ||
Note: This section may be outdated. | |||
Mozilla's development process is very much patch driven. [https://developer.mozilla.org/En/Developer_Guide/Source_Code Mozilla uses Mercurial] (as well as git for some projects) as the version control system. [https://developer.mozilla.org/en/Mercurial_queues Mercurial Patch Queues], although a bit awkward to use at times, fit this process rather well. It is recommended you familiarize yourself with them and use them. | Mozilla's development process is very much patch driven. [https://developer.mozilla.org/En/Developer_Guide/Source_Code Mozilla uses Mercurial] (as well as git for some projects) as the version control system. [https://developer.mozilla.org/en/Mercurial_queues Mercurial Patch Queues], although a bit awkward to use at times, fit this process rather well. It is recommended you familiarize yourself with them and use them. | ||
== Configuration == | == Configuration == | ||
| Line 94: | Line 103: | ||
== Landing patches == | == Landing patches == | ||
You have items in a patch queue that you'd like to push to | You have items in a patch queue that you'd like to push to m-c. Here's the thorough set of steps to follow to get them into the tree (assuming you have commit access, of course). It's recommended that you use autoland via mozreview, or flag bugs as having checkin-needed instead. | ||
=== Make sure | === Make sure mozilla-central is open and green === | ||
Check [https:// | Check [https://treeherder.mozilla.org treeherder]. | ||
=== Make sure your tree is up to date === | === Make sure your tree is up to date === | ||
| Line 136: | Line 145: | ||
=== Run tests === | === Run tests === | ||
Now is a great time to run tests, because this is the state in which | Now is a great time to run tests, because this is the state in which mozilla-central will be after you push. If you apply a <tt>tests</tt> patch to re-enable disabled tests, ''make sure you pop it when you're done''. | ||
=== Finish the applied patches === | === Finish the applied patches === | ||
| Line 153: | Line 162: | ||
hg push | hg push | ||
--> | |||
= Using Git = | = Using Git = | ||
Various projects exist as Git repositories | Various projects exist as Git repositories. | ||
== Configuring Git == | == Configuring Git == | ||
| Line 167: | Line 175: | ||
$ git config --global user.name "John Doe" | $ git config --global user.name "John Doe" | ||
$ git config --global user.email "johndoe@mozilla.com" | $ git config --global user.email "johndoe@mozilla.com" | ||
# Enable color output for all commands | # Enable color output for all commands | ||
$ git config --global color.branch auto | $ git config --global color.branch auto | ||
| Line 175: | Line 183: | ||
$ git config --global color.status auto | $ git config --global color.status auto | ||
$ git config --global color.ui auto | $ git config --global color.ui auto | ||
# Highlight whitespace | # Highlight whitespace | ||
$ git config --global core.whitespace "trailing-space,space-before-tab,tab-in-indent" | $ git config --global core.whitespace "trailing-space,space-before-tab,tab-in-indent" | ||
# Define your editor for commits, other tools | # Define your editor for commits, other tools | ||
$ git config --global core.editor vim | $ git config --global core.editor vim | ||
If you find you have a slow git prompt, you may find the instructions [https://gist.github.com/thomcc/4c23eeed3b248394bffa0bff04f5c00b here] beneficial as well. | |||
<!-- | |||
= Repositories = | = Repositories = | ||
Getting a checkout of a large Mercurial repository can be a pain if you're remote. Nobody wants to wait 6 hours while Python drools on its shoes. The answer is '''bundles'''. [https://developer.mozilla.org/en/Mozilla_Source_Code_%28Mercurial%29 Follow the directions]. | Getting a checkout of a large Mercurial repository can be a pain if you're remote. Nobody wants to wait 6 hours while Python drools on its shoes. The answer is '''bundles'''. [https://developer.mozilla.org/en/Mozilla_Source_Code_%28Mercurial%29 Follow the directions]. More information on bundles is available [https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Source_Code/Mercurial/Bundles here]. | ||
[https:// | |||
== mozilla-central == | == mozilla-central == | ||
mozilla-central is the repository for Firefox | mozilla-central is the repository for Firefox. | ||
== Try server == | == Try server == | ||
To push to try, teave your changes as applied mq patches. Then run: | To push to try, teave your changes as applied mq patches. Then run: | ||
| Line 226: | Line 207: | ||
hg push -f ssh://hg.mozilla.org/try/ | hg push -f ssh://hg.mozilla.org/try/ | ||
Alternatively, you can push to try using `mach try`, which works for both `git` and `hg` users (assuming git users are using git cinnabar), and is recommended for both. | |||
--> | |||
= Testing = | |||
[https://developer.mozilla.org/en/Writing_xpcshell-based_unit_tests Writing xpcshell-based unit testing]. | * [https://developer.mozilla.org/en/Writing_xpcshell-based_unit_tests Writing xpcshell-based unit testing]. | ||
* Sync tests are located at [https://searchfox.org/mozilla-central/source/services/sync/tests/unit/ /services/sync/tests/unit] | |||
* [https://firefox-source-docs.mozilla.org/testing/tps/index.html TPS tests] | |||
<!-- | |||
= Collaboration = | = Collaboration = | ||
| Line 255: | Line 241: | ||
} | } | ||
{ | { | ||
comment = "Public channel for | comment = "Public channel for FxA"; | ||
name = "# | name = "#fxa"; | ||
chatnet = "mozilla"; | chatnet = "mozilla"; | ||
} | } | ||
} | } | ||
--> | |||
= Miscellany = | = Miscellany = | ||
Latest revision as of 19:30, 29 June 2026
Hacking
Source Code
Once you have a copy of the Mozilla source tree (read below for how to obtain a copy), you can find the core Sync source code in https://searchfox.org/firefox-main/source/services/sync
This is just the core JavaScript APIs and logic. Additional Sync code for integration with Firefox lives in https://searchfox.org/firefox-main/source/browser/base/content
Look for files with sync in their name. Files here define the integration between Firefox and Sync. This includes all the Sync UI.
Additionally, Firefox Accounts specific code lives in https://searchfox.org/firefox-main/source/services/fxaccounts
Debugging Sync
If you are debugging Sync in your browser, the first thing you want to do is crank up the logging. In about:config, set the following preferences:
# Enable logging to Error Console services.sync.log.appender.console Trace
# Enable logging to STDOUT services.sync.log.appender.dump Trace
# Log full sync logs on sync success (typically they are only saved on failure) services.sync.log.appender.file.logOnSuccess true
# Enable trace logging for engines services.sync.log.logger.engine Trace # (optional) Enable trace logging for all of sync (this is very verbose and will include all request bodies) services.sync.log.logger Trace
Once you've updated those settings, restart Firefox for them to take effect.
If you are logging to STDOUT, you may want to set the environment variable MOZ_QUIET to silence a lot of spew from other parts of Firefox:
export MOZ_QUIET=1
You can view full sync logs by opening about:sync-log in Firefox. Read more about Firefox Sync extended logging for fetching successful sync event logfiles.
Building Sync
You probably should build using an artifact build, as described here.
After setting this up, you'll do `mach build` to perform a build, `mach run` to run Firefox, and `mach xpcshell-test /services/sync/tests/unit` to run the sync unit test suite. There's also a separate end-to-end test suite, TPS, which is documented here. (For most changes it's sufficient that you run the unit tests.)
Depending on your OS, most changes will not require a rebuild to take effect, only restarting and rerunning via `mach run`.
Using Bugzilla
Every code change starts out as a bug in Bugzilla where the general approach can be discussed. The bug should eventually be assigned to somebody who will upload one or more patches for review. Code can only be reviewed by module owners and their peers; see code review policy for more information. If the review has been granted and all review comments have been addressed, the patches may be checked into mozilla-central.
You probably also want to get up to speed on Bugzilla if you're not already.
- A good start is to go watch Jonath's "Bugzilla for Humans" video.
- Sync bugs are found in different places depending on which part of the system they affect. For the service side (syncstorage or tokenserver), bugs will be in [1]. For the client side, you can find a list of components [CloudServices/Sync#Report_Bugs here].
- Don't forget to add a Bugzilla ID shortcut string to your Bugzilla account preferences. The current standard practice is to append "<whitespace>[:irc_nick]" to your Real Name field.
- You also want to watch the components relevant to your work so you automatically get emails for all bug changes in those components. The expected components where bugs will be filed are listed on CloudServices/Sync#Report_Bugs.
- A useful Firefox add-on that makes life in Bugzilla a bit easier is Bugzilla Tweaks. Highly recommended!
Using Git
Various projects exist as Git repositories.
Configuring Git
If this is your first time using Git, you'll need for perform some one-time configuration:
# Configure your global name and email. These will be used for commit info. $ git config --global user.name "John Doe" $ git config --global user.email "johndoe@mozilla.com" # Enable color output for all commands $ git config --global color.branch auto $ git config --global color.diff auto $ git config --global color.grep auto $ git config --global color.interactive auto $ git config --global color.status auto $ git config --global color.ui auto # Highlight whitespace $ git config --global core.whitespace "trailing-space,space-before-tab,tab-in-indent" # Define your editor for commits, other tools $ git config --global core.editor vim
If you find you have a slow git prompt, you may find the instructions here beneficial as well.
Testing
- Writing xpcshell-based unit testing.
- Sync tests are located at /services/sync/tests/unit
- TPS tests
Miscellany
- You also want to grab a Nightly build of Firefox. Everybody in the company should be running a nightly build: it's a great way to find bugs before the code goes out to the general public. If you want to run against different profiles (which is useful for development), you will be interested in two extra command flags: "-P and --no-remote"
- -P forces the Profile Picker (You probably want to have more than one.)
- --no-remote allows multiple versions to run on one machine at the same time.