IT/Production Acceptance/DXR: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
m (I want popup pinning)
(Moving out non-IT issues to another page)
 
(4 intermediate revisions by 2 users not shown)
Line 9: Line 9:
*'''Demo Site:''' http://australia.proximity.on.ca/dxr/
*'''Demo Site:''' http://australia.proximity.on.ca/dxr/
*'''Production Site:''' https://dxr.mozilla.org
*'''Production Site:''' https://dxr.mozilla.org
*'''DXR Future Work Plan:''' [[DXR Future Work Plan]]


*'''Any pre-requisites needed (technology, server capacity, staffing, monitoring, response time, etc)''': Machine is expected to compile Mozilla continuously in order to produce the index, so should have 8gb ram, quadcore cpu.  
*'''Any pre-requisites needed (technology, server capacity, staffing, monitoring, response time, etc)''': Machine is expected to compile Mozilla continuously in order to produce the index, so should have 8gb ram, quadcore cpu.  
Line 23: Line 24:
DXR was written and is being actively developed by David Humphrey.
DXR was written and is being actively developed by David Humphrey.


== Task List ==
Bugs can be filed using Mozilla's Bugzilla with [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=product%3Awebtools+component%3Adxr Product:WebTools and Component:DXR]


===Bugzilla Bugs===
== Mozilla Roll-out Task List ==


* Add DXR bugzilla component - [https://bugzilla.mozilla.org/show_bug.cgi?id=517550 bug 517550]
* DXR Tracking bug - [https://bugzilla.mozilla.org/show_bug.cgi?id=489834 bug 489834]
* Deploy DXR at Mozilla - [https://bugzilla.mozilla.org/show_bug.cgi?id=524725 bug 524725]
* Deploy DXR at Mozilla - [https://bugzilla.mozilla.org/show_bug.cgi?id=524725 bug 524725]
* Switch from C-based xpidl to Python ([https://bugzilla.mozilla.org/show_bug.cgi?id=498440 bug 498440])
* Dave to update DXR hg repo with latest callgraph code
 
* Tweak installation and indexing system for use by Mozilla
===Requests===
* Add a download-db link
* Link to the hg revision of the indexed db(ie a timestamp)
* Treat functions as well as methods
 
====Indexing, HTML Generation, Back-end Work====
 
* <strike>Start doing continuous re-indexing of the tree</strike> Basic code in place, need to evolve and deploy
* <strike>Improve post-processing speed, investigate better parallelism</strike> Completed.
* Get DXR deployed on a Mozilla server (bug [https://bugzilla.mozilla.org/show_bug.cgi?id=524725 524725])
* Add proper IDL data to source code such that clicking types, members, etc. shows a popup with links to implementations, callers, etc.
* Fix C++ snippets in IDL to use cpp position indicators (# line file).  Add any other missing IDL features.
* Look for speed-ups in how analysis builds are done
* Switch python web cgi to use django
* Add links for #include header files
* Add support for C source
* Add support for JS source.  Consider using jshydra to build static HTML.  See js token info in [http://mxr.mozilla.org/mozilla-central/source/js/src/jsscan.h#60 jsscan.h].
* Add Macro decl locations
* Add support for Obj-C/C++ source
* Show compiler warnings
* Integrate callgraph: convert to using treehydra, investigate --with-static-checking in mozilla's build sys, include dwitte's callgraph.js and my dxr.js (include "callgraph.js").
* Tokenize macros so that embedded macros are clickable (e.g., NS_ProcessNextEvent resolves to NS_ProcessNextEvent_P)
* Investigate ways to deal with naming collisions.  For example, where types, methods, or macros share the same name, sometimes we pick the wrong one for purposes of linkifying (e.g., NS_ProcessNextEvent). 
* Make IDL pages, and other decl locations do a better job at providing links
* Investigate strategy for increment re-indexing vs. full clobbers
* Audit web app for security
* Fix srcdir vs. objdir links (e.g., PRInt32)
* Remove .html from source file names (mod_rewrite?)
* Add support for html/xml, perhaps with links to MDC doc pages
* Make dxr scripts path agnostic and more portable (python path stuff)
* Make dxr scripts path agnostic and more portable (python path stuff)
* Fix ctor html linkifying code so Foo::Foo works properly
* Figure out how to deal with code being ifdef'ed out (e.g., debug vs. non-debug build)
* Audit dehydra script for improvements
* Multi-platform indexing
** MSVC++ may be doable with this: [http://msdn.microsoft.com/en-us/library/87x7wc99.aspx]
* Add gcov support
* Add build dependency map info - "what do I have to remake if I change something in content/html/document/src?"
* Add control mechanism for running dxr continuously.  Maybe web based?  Maybe as part of buildbot with waterfall?
====UI Improvements====
=====Search=====
* <strike>Switch to using http get for searches</strike> Completed.
* <strike>Add derived:classname::method query</strike> Completed.
* <strike>Searching for filenames should work for fullnames vs. initial portions (e.g., nsGlobal or nsGlobalWindow vs. nsGlobalWindow.cpp)</strike> Completed.
* Make Users queries differentiate decls/defs
* Add ability to do Users:nsIFrameFrame::GetDocShell
* Add base:type search query
* Show Classname:: as part of member sidebar on the right (for searches)
* Make search results clickable anywhere vs. just on line number and make line number plain text vs. link.
* Make search sidebars links so they can be turned into searches.  For example, members sidebar could be a link that takes you to a member:foo query
* Search UI should encourage using built-in queries, for example, suggesting other keywords (members:) that could be added.
* When searching of nsFoo, display a little summary of the class bases,derived, members
* For Type search results, give a link to do a type:: search to show all members (if there are any) -- nsFoo (class) [members]
* In search results, favour c++ style name ordering (e.g., class nsFoo vs. nsFoo (class) ).  Make the name more prominent.
* In search results, make all types and member names clickable
* Remove side bar from searches, and copy Google Code search results by showing other queries at top of results (Narrow your search: 53 Types, 74 Members, ...)
* In decl/def search results (e.g., member) only show line number once.
* Add counts to all search results (glimpse and otherwise)
* Add pagination to search results
* Limit search nav divs to some lower number (12?) and give a link to see the whole thing.
=====Source Code View=====
* Pin Popup when scrolling (Jeff and jdm want)
* Make source code nav bar narrow if contents are narrower, and expand to a max size (current size).
* When navigating to search result in code for a type or member, sync the source code navigation pane accordingly
* Lazily keep source code nav and source view in sync.  Clicking any stmt should highlight/scroll into view/etc the containing member/class
* Make source code nav panel sortable (alpha, file order)
* Make types clickable in source code nav bar, perhaps open the popup to show type info
* Make types in source code nav bar always clickable, and add icon to take you to decl (should be able to jump to header file from cpp)
* Add hrefs to links in source code dom nodes on hover
* Standardize on look and feel of source code nav bar for members and popups, etc (gray, icons, font)
* Tighten-up look of popup box
* Fix pop-up position so it isn't off the screen
* Fix Users query so it includes uses of the type directly in addition to uses of derived types (e.g., nsIFoo might have direct users if not an idl type)
* Add Callees and Callers searches to all popups keyed on loc
* Add info to popups that indicates that empty popups are bugs in data/dxr or TODOs (maybe with link to this wiki page or bug filing info).
* Collapse Type Info and Bases tabs in popups
* Convert popup to use fewer/no tabs, and dynamic/tree regions to show data like members, bases, etc.
* Make http://dxr.proximity.on.ca/dxr/mozilla-central/xpcom/ds/nsHashtable.h.html#144/Put work

Latest revision as of 15:32, 27 February 2010

Project Information

  • Any pre-requisites needed (technology, server capacity, staffing, monitoring, response time, etc): Machine is expected to compile Mozilla continuously in order to produce the index, so should have 8gb ram, quadcore cpu.
  • External dependencies: None
  • Dev environment specs: No clue what goes here
  • Does this project use any plugins or proprietary technology: No, it's pure awesome.

What is DXR?

DXR is a two things. First, it’s a method for collecting type, member, statement, macro, etc. information about C++, IDL, and soon JavaScript using Mozilla’s static analysis tools (e.g., Dehydra), a hacked build system, and a bunch of scripts. Second, it’s a web-based tool for mapping this information back onto source code, and allowing users to query and look-up this information.

You can read more about it here.

DXR was written and is being actively developed by David Humphrey.

Bugs can be filed using Mozilla's Bugzilla with Product:WebTools and Component:DXR

Mozilla Roll-out Task List

  • Deploy DXR at Mozilla - bug 524725
  • Dave to update DXR hg repo with latest callgraph code
  • Tweak installation and indexing system for use by Mozilla
  • Make dxr scripts path agnostic and more portable (python path stuff)