Support:Search v3: Difference between revisions

Latest revision as of 19:49, 2 December 2009

This document refers to the search rewrite of Q4 2009.

Goals

Improve index time (should be able to index at least once/hour).
- Move from Sphinx 0.9.8 to 0.9.9.
- Replace xmlpipe2 with direct SQL access.
Improve advanced search.
- Implement new UI. [1]
- Meaningful options for both knowledge base and forums.
Improve spelling suggestions.
- Move from SOUNDEX to Aspell.
  - Dramatically improve suggestions.
  - Will hopefully improve performance.

Timeline

Search v3 is the primary goal of SUMO 1.5. Our current schedule is to code freeze on November 24th and release on December 3rd.

Code

The Search v3 branch has been merged into trunk and the branch is closed.

https://svn.mozilla.org/projects/sumo/trunk

The Search v3 code is now up on our normal staging server.

http://support-stage.mozilla.org/

The username/password is "support"/"stage".

Indices

The current sphinx.conf provides the indices, with the indicate attributes:

forum_threads

Returns a threadId (for a thread)

attr name	type	description
forumid	int
author_ord	int	crc32(userName)
status	int	crc32(status)
created	timestamp
last_updated	timestamp
replies	int	number of replies
authors	multi int	crc32(userName) for all posters in the thread

forum_posts

Returns a threadId (for a specific post)

attr name	type	description
threadid	int	threadId of the actual thread (not the post)
author_ord	int	crc32(userName)
status	int	crc32(status)
forumid	int	forum id for the thread
created	timestamp

wiki_pages

Returns a page_id

attr name	type	description
lastmodif	timestamp
locale	int	crc32(lang)
tag	int multi	crc32(tag)
category	int multi	categId

@@ Line 1: / Line 1: @@
-{{DRAFT}}
 This document refers to the search rewrite of Q4 2009.
@@ Line 18: / Line 16: @@
 == Timeline ==
-Search v3 is the primary goal of [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=ALL+product%3Asupport+milestone%3A1.5 SUMO 1.5]. Our current goal is to code freeze on November 24th and release on December 1st.
+Search v3 is the primary goal of [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=ALL+product%3Asupport+milestone%3A1.5 SUMO 1.5]. Our current schedule is to code freeze on November 24th and release on December 3rd.
 == Code ==
-The Search v3 branch is stored in
+The Search v3 branch has been merged into trunk and the branch is closed.
-  https://svn.mozilla.org/projects/sumo/branches/search
+  https://svn.mozilla.org/projects/sumo/trunk
-There is a dedicated staging server running Sphinx 0.9.9 at
+The Search v3 code is now up on our normal staging server.
-  http://sumo-forumux.stage.mozilla.com/
+  http://support-stage.mozilla.org/
 The username/password is "support"/"stage".
+== Indices ==
+The current sphinx.conf provides the indices, with the indicate attributes:
+=== forum_threads ===
+Returns a '''threadId''' (for a thread)
+{|
+!attr name!!type!!description
+|-
+|forumid||int||
+|-
+|author_ord||int||crc32(userName)
+|-
+|status||int||crc32(status)
+|-
+|created||timestamp||
+|-
+|last_updated||timestamp||
+|-
+|replies||int||number of replies
+|-
+|authors||multi int||crc32(userName) for all posters in the thread
+|}
+=== forum_posts ===
+Returns a '''threadId''' (for a specific post)
+{|
+!attr name!!type!!description
+|-
+|threadid||int||threadId of the actual thread (not the post)
+|-
+|author_ord||int||crc32(userName)
+|-
+|status	||int||crc32(status)
+|-
+|forumid||int||forum id for the thread
+|-
+|created||timestamp||
+|}
+=== wiki_pages ===
+Returns a '''page_id'''
+{|
+!attr name!!type!!description
+|-
+|lastmodif||timestamp||
+|-
+|locale||int||crc32(lang)
+|-
+|tag||int multi||crc32(tag)
+|-
+|category||int multi||categId
+|}