AMO:Developers/Hive

AMO HIVE

 ssh admin1.research.hadoop.sjc1.mozilla.com
 hive
 add jar /usr/lib/hive/lib/hive_contrib.jar;
 [query here]

Or to run a query without using interactive mode:

 hive --auxpath '/usr/lib/hive/lib/hive_contrib.jar' -e "[query here]"

To see the available sources

 SHOW PARTITIONS research_logs;

Sample queries:

 SELECT COUNT(1) FROM research_logs WHERE ip_address != 'NULL' AND ds = '$DATE' AND domain='services.addons.mozilla.org' AND request_url LIKE '%discovery%';

 SELECT empty_string_1, COUNT(1) as num FROM research_logs WHERE ip_address != 'NULL' AND ds = '$DATE' AND (domain='addons.mozilla.org' OR domain='static.addons.mozilla.org') AND request_url LIKE '%/images/addon_icon/1865/%' GROUP BY empty_string_1 ORDER BY num DESC;

 SELECT COUNT(1) FROM research_logs WHERE ip_address != 'NULL' AND ds = '$DATE' AND domain='services.addons.mozilla.org' AND request_url LIKE '%api/%/list/featured/%';