AMO:Developers/Hive: Difference between revisions

Jump to navigation Jump to search
no edit summary
No edit summary
No edit summary
Line 1: Line 1:
= AMO HIVE =
= AMO HIVE =


   ssh admin1.research.hadoop.sjc1.mozilla.com
   ssh hm-admin03.scl2.mozilla.com
   hive
   hive
   add jar /usr/lib/hive/lib/hive_contrib.jar;
   add jar /usr/lib/hive/lib/hive_contrib.jar;
Line 13: Line 13:
   SHOW PARTITIONS research_logs;
   SHOW PARTITIONS research_logs;


Sample queries:
=== Sample queries ===
   SELECT COUNT(1) FROM research_logs WHERE ip_address != 'NULL' AND ds = '2010-12-14' AND domain='services.addons.mozilla.org' AND request_url LIKE '%discovery%';
   SELECT COUNT(1) FROM research_logs WHERE ip_address != 'NULL' AND ds = '2010-12-14' AND domain='services.addons.mozilla.org' AND request_url LIKE '%discovery%';


Line 19: Line 19:


   SELECT COUNT(1) FROM research_logs WHERE ip_address != 'NULL' AND ds = '2010-12-14' AND domain='services.addons.mozilla.org' AND request_url LIKE '%api/%/list/featured/%';
   SELECT COUNT(1) FROM research_logs WHERE ip_address != 'NULL' AND ds = '2010-12-14' AND domain='services.addons.mozilla.org' AND request_url LIKE '%api/%/list/featured/%';
== Metadata Pings ==
Daily metdata pings are further broken out into the addons_pings table and parsed into columns. In order to only count daily pings instead of post-install pings, you should only consider requests where the GUID contains the default theme (%7B972ce4c6-7e08-4474-a285-3208198ce6fd%7D)
  SELECT guid, appos, appversion, tmain, tfirstpaint, tsessionrestored FROM addons_pings WHERE ds = '2011-04-10' AND src = 'firefox';
canmove, Confirmed users, Bureaucrats and Sysops emeriti
1,043

edits

Navigation menu