From MozillaWiki
Jump to: navigation, search

A Public ElasticSearch Cluster with Bugzilla Data


Provide the public with an easy-to-query historical view of Bugzilla bugs.


The BMO/ES cluster is important for managing many of Mozilla's projects: It is an active data system that underlies a multitude of dashboards to track various project metrics. It is capable of providing both high level aggregates over the million+ issues, providing detailed historical views into those issues, and it provides that information fast.

Let's Use It!

BMO/ES is a service, which means you can use it right now! You probably already have your browser open, so let's send it queries:


Minimum required to hit ES cluster on Github
Minimum required to pull comments on Github
Simple Bug Count on Github
Can you reach the private cluster? on Github

Basic walk-through


Backend ETL Code:
Frontend Examples:


This project needs your help! If you love data munging and dealing with complexity; and you get satisfaction that people will build atop your hard work every day, then this project is for you!


  • IRC: (in #ateam and #bteam)
  • email:

Good First Bugs

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Big bugs

Full Query
ID Summary Status Resolution Assigned to
962882 Getting *real* bug history is hard NEW
979302 ETL should merge bugs_activity entries, like BZ does [3 of 3] NEW
986508 Alias analysis should use ES as datastore, not file NEW
987706 Inconsistent value fields not handled well enough NEW
993830 Add recorded_ts to help replication slaves keep up to date [2 of 3] NEW
997228 Renaming flags will destroy bug history for those flag values NEW
1067395 Use 'X' instead of 'D' to mark cleared flags NEW
1094366 Mentors field not captured by ETL [2 of 3] NEW
1102884 esFrontLine should track more stats [2 of 3] NEW
1110978 Add permission model to esFrontLine, using Persona [3 of 3] NEW
1125904 Blocked/blocked_by/depends_on is too confusing NEW
1160411 Send alert when ETL stops NEW
1182063 Find home for some daily scripts that use the BMO ES cluster NEW
1183445 Parse emails as lowercase NEW
1197813 [BZ ETL] Tracking flags changed corrupt bug history NEW
1201064 cf_blocking_loop dropped (renamed), not reflected in history NEW
1356329 Private cluster needs https NEW
1429372 bzETL Upgrade to ES version 6 (meta) NEW

18 Total; 18 Open (100%); 0 Resolved (0%); 0 Verified (0%);

Other Reading