Confirmed users
513
edits
Bugzilla Anthropology/2013-01-29: Difference between revisions
Jump to navigation
Jump to search
Bugzilla Anthropology/2013-01-29 (view source)
Revision as of 15:21, 29 January 2013
, 29 January 2013no edit summary
Klahnakoski (talk | contribs) |
Klahnakoski (talk | contribs) No edit summary |
||
| Line 52: | Line 52: | ||
*[https://etherpad.mozilla.org/6FqZHUhcca QA Dashboard Vetting Etherpad] | *[https://etherpad.mozilla.org/6FqZHUhcca QA Dashboard Vetting Etherpad] | ||
=== ElasticSearch (Technical Summary)=== | |||
Despite ES's technical limitations, the current Javascript libraries give us both fast and expressive dash-boarding capability: Scanning 7million documents in sub-second time. | |||
* ES Highlights | |||
** Fast - Automatically indexed, and in memory. | |||
** Scalable - Sharding assumes every document can stand alone | |||
** Extensible - MVEL scripting language allows arbitrary code to be run on the server-side | |||
** Limited Filtering - ES was designed for document search. BI queries require complicated filtering rules across multiple relations. ES' nested filters do not compare. | |||
** Limited Grouping - ES is designed only from simple grouping and document counting | |||
* Enhancments To Date | |||
** Javascript library to convert SQL-like queries to ES/MVEL queries | |||
** Javascript DB implementation to perform the joins and sophisticated calculations on client | |||
* Further Issues | |||
** Poor Stability - Need more human resources to identify and tune the existing ES cluster | |||
** Cluster Too Small - The hardware is 5 years old, and never setup to run production queries | |||
** Not centralized - Other projects are using ES instances, spreading the work over one large cluster will tame the relative usage peaks. | |||