Connected Devices/Projects/Smart Kitchen: Difference between revisions

Latest revision as of 23:15, 2 February 2017

This experiment has concluded. We have retained the content on this page so others can take advantage of these learnings. For the latest on what Mozilla is doing, visit www.mozilla.org.

Project Status

CLOSED

Project SmartKitchen plans to explore what it would be like if you knew exactly what was in your fridge in real time, with little to no effort. Even better, we’d love to help you leverage this information and take your available ingredients to suggest new healthy recipes to try. Our vision is to help everyone with the question, “What’s for dinner?”, so you never have to come up blank again.

Project overview

Project SmartKitchen attempts to help people answer the question "What's for dinner?" in such a way that optimizes ingredients on hand, reduces food wasteage, and offers recipes (eventually) tailored to the user's time, skill, dietary requirements, allergies, likes/dislikes, etc.

Lean Start Up Flow

Vision Statement

SmartKitchen aims to answer the question "What's for dinner?"

Ideas

Use image recognition to identify the inventory of the kitchen
Use barcode to identify and manage the inventory of the kitchen
Use RFID to identify and manage the inventory of the kitchen (entire house, garbagecan)
Use OCR to identify and manage the inventory of the kitchen
Use the inventory of the kitchen to provide recipes
Use an Open Source Cookbook to provide recipes from the community and socially engage/gamify the community in the food area

Leap of Faith Assumptions Being Tested

We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen
We assume that people want recipes that they can make with their existing kitchen inventory

Experiments

We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date.
If run a Facebook Ad describing our product, we expect a 2% response rate
If we create a video that shows our product vision and advertise it, we expect a 2% response rate.

Experiment Details

Project SmartKitchen/ Experiment 1: Image Recognition Prototype
Project SmartKitchen/ Experiment 2: Video Survey
Project SmartKitchen/ Experiment 3: Facebook Ad
Project SmartKitchen/ Experiment 4: Facebook Ad Refactor
Project SmartKitchen/ Experiment 5: User Behavior Survey
Project SmartKitchen/ Experiment 6: Upstream Concierge
Project SmartKitchen/ Experiment 7: Second Image Provider
Project SmartKitchen/ Experiment 8: Optical Flow

Program Status

Milestone	Date	Status	Status Notes
Passed Gate 0	06/08/2016	Done	Gate 0 Pitch
User Research Survey	06/10/2016	Done	user Research Doc
Kick off in London	06/13-17/2016	Done
Prototype Requirements Document	07/13/2016	Done	Prototype Requirements Document
Problem/Product Hypothesis Building	07/07/2016	Done	Problem/Product Hypothesis
Participatory Design	07/12/2016	On Hold	Participatory Design Template
Lean Start Up Training	07/13-14/2016	Done
Experiment #1: Prototype	07/15/2016 - 08/08/2016	Done
Experiment #2: Video	07/15/2016 - 08/12/2016	Done
Experiment #3: Facebook Ad	07/27/2016	Done
Experiment #4: Facebook Refactor	07/28-29/2016	Done
Hypothesis Validation Prototype	08/04/2016	Done	Smart Kitchen Prototype Requirements
Experiment #5: Investigating Current User Behavior Survey	08/05/2016	Done
Experiment #6: Upstream Concierge	08/08/2016-09/06/2016	On Target
Experiment #7: Second Image Provider	08/18/2016-09/06/2016	On Target
Experiment #8: Optical Flow	08/18/2016-09/06/2016	On Target

Status Key

Color	Status	Key
	On Target	The project or deliverable is expected to meet its due date.
	Challenged	The project or deliverable is facing an issue that might cause it to miss its due date, but a “get well” plan has been developed to get it back on track.
	At Risk or Late	The project or deliverable is blocked or facing an issue that might cause it to miss its due date, and there’s no “get well” plan to get it back on track, or it is already late.
	Done	The project or deliverable has been completed.
	On Hold or Not Started	The project or deliverable has either not been started or has been placed on hold.

Sprint Demos

Date	Video Recording	Overview
07/01/16	Sprint 2 Demo	Image recognition with IBM Bluemix and bar code recognition.
07/08/16	Sprint 3 Demo	MySQL Database, checking in the schema, connecting to the data, and identify items user flow.
07/15/16	Sprint 4 Demo	Hardware: LED lights, enclosure and stand, button, Software: integrated server with big oven, can type meals into kikbot and sends 3 ingredients to big oven.
07/22/16	Sprint 5 Demo	Inventory to Recipe flow, Google Analytics and metrics
07/29/16	Sprint 6 Demo	Summary of our findings for the Facebook ad experiment and status update on our video and prototype experiment

Communication

IRC

Join the conversation on irc.mozilla.org, channel #SmartKitchen.

Vidyo

"SmartKitchen" Vidyo Room
Hello, You have been invited to attend a Mozilla Vidyo conference. Please click on the link below to attend: https://v.mozilla.com/flex.html?roomdirect.html&key=JeyRhCk4UtB8ruRc3gK8cdievCA If you do not have a user account, please enter your name in the "Guest Name" field and then click "Join". To join from a telephone, dial one of the following numbers depending on your nearest location: US Toll Free +1 800 707 2533, pin 369, conf 98075 US/CA/Mountain View +1 650 903 0800, extension 92, 98075 US/CA/San Francisco: +1 415 762 5700, extension 92, 98075 US/OR/Portland: +1 971 544 8000, extension 92, 98075 CA/BC/Vancouver: +1 778 785 1540, extension 92, 98075 CA/ON/Toronto: +1 416 848 3114, extension 92, 98075 UK/London: +44 (0)207 855 3000, extension 92, 98075 FR/Paris: +33 (0) 184 883 737, Press 1 for English or 2 for French, extension 92, 98075 DE/Berlin: +49 30 983 333 000, extension 92, 98075 NZ/Auckland: +64 9 555 1100, extension 92, 98075

Bi-Weekly Sync Ups

Project SmartKitchen has open bi-weekly sync ups every Tuesday and Thursday at 11:00AM PST in the SmartKitchen Vidyo room. Instructions for joining the video conference (vidyo) meeting room are above. Meeting notes can be found here.

Project Management (Trello)

Project SmartKitchen is operating on one-week sprints. To follow our actions throughout the gating process, please follow our Project SmartKitchen Trello.
We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific.

References

Team

Tamara Hills- Project Lead/SW Engineer
Russ Nicoletti - SW Engineer
Candice Serran - EPM
Nicole Yee- EPM
David Bialer- Product Manager
Kevin Grandon - SW Engineer Contributor

@@ Line 1: / Line 1: @@
+{{caution|This experiment has concluded.  We have retained the content on this page so others can take advantage of these learnings. For the latest on what Mozilla is doing, visit [https://www.mozilla.org www.mozilla.org].}}
 {{Sidebar <!-- Project Infobox -->
   | navbar = off
   | headingstyle = background-color:#eee;
-  | heading1 = Project Smart Kitchen <!-- Project Title -->
+  | heading1 = Project SmartKitchen <!-- Project Title -->
   | content1 = [[image:Connected-devices.jpg|300px]] <!-- Logo for Connected Devices, not product or team -->
   | heading2 = <!-- Screenshot caption --> <!-- Screenshot caption -->
@@ Line 12: / Line 15: @@
   | content5 = <!-- 2016.05.04 (Pitch Update) --> <!-- Latest Release Date -->
   | heading6 = Innovation Status <!-- Innovation Status -->
-  | content6 = [[Connected_Devices/Product_Innovation_Process#Process Gates|Stage 1 (Validation)]] <!-- Innovation Status -->
+  | content6 = No longer an approved project <!-- Innovation Status -->
   | heading7 = Website <!-- Website -->
   | content7 = https://mzl.la/smartkitchen  <!-- Project Website -->
 }}
+== Project Status ==
+CLOSED
+----
 '''Project SmartKitchen''' plans to explore what it would be like if you knew exactly what was in your fridge in real time, with little to no effort. Even better, we’d love to help you leverage this information and take your available ingredients to suggest new healthy recipes to try.  Our vision is to help everyone with the question, “What’s for dinner?”, so you never have to come up blank again.
@@ Line 57: / Line 64: @@
 * We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen
 * We assume that people want recipes that they can make with their existing kitchen inventory
 === Experiments ===
 * We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date.
@@ Line 62: / Line 70: @@
 * If we create a video that shows our product vision and advertise it, we expect a 2% response rate.
 === Experiment Details ===
-* Details on all experiments can be found [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1110301338 here]
+[[Project SmartKitchen/ Experiment 1: Image Recognition Prototype]]<br>
+[[Project SmartKitchen/ Experiment 2: Video Survey]]<br>
+[[Project SmartKitchen/ Experiment 3: Facebook Ad]]<br>
+[[Project SmartKitchen/ Experiment 4: Facebook Ad Refactor]]<br>
+[[Project SmartKitchen/ Experiment 5: User Behavior Survey]]<br>
+[[Project SmartKitchen/ Experiment 6: Upstream Concierge]]<br>
+[[Project SmartKitchen/ Experiment 7: Second Image Provider]]<br>
+[[Project SmartKitchen/ Experiment 8: Optical Flow]]
 == Program Status ==
@@ Line 109: / Line 123: @@
 | Experiment #1: Prototype
 | 07/15/2016 - 08/08/2016
-! style="background:#00EC00;" | On Target
+! style="background:#00B2FF;" | Done
 | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1110301338 Experiment Details] --->
 |-
 | Experiment #2: Video
 | 07/15/2016 - 08/12/2016
-! style="background:#00EC00;" | On Target
+! style="background:#00B2FF;" | Done
 | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1164719251 Experiment Details] --->
 |-
@@ Line 129: / Line 143: @@
 | Hypothesis Validation Prototype
 | 08/04/2016
+! style="background:#00B2FF;" | Done
+| [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit Smart Kitchen Prototype Requirements]
+|-
+| Experiment #5: Investigating Current User Behavior Survey
+| 08/05/2016
+! style="background:#00B2FF;" | Done
+| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] --->
+|-
+| Experiment #6: Upstream Concierge
+| 08/08/2016-09/06/2016
+! style="background:#00EC00;" | On Target
+| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] --->
+|-
+| Experiment #7: Second Image Provider
+| 08/18/2016-09/06/2016
+! style="background:#00EC00;" | On Target
+| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] --->
+|-
+| Experiment #8: Optical Flow
+| 08/18/2016-09/06/2016
 ! style="background:#00EC00;" | On Target
-| [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit Smart Kitchen Prototype Requirements]
+| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] --->
 |-
 |}
@@ Line 229: / Line 262: @@
 == References ==
 * [https://docs.google.com/presentation/d/13iXSC1PgZSYMa_oNUOqXFBJqnQOlSIZ_b1P8HIeywug/edit#slide=id.gf81a417fb_2_45 Innovation Board pitch deck]
-* [https://drive.google.com/a/mozilla.com/folderview?id=0B4x1onW-07JbUXFuWk9aRmp4aTQ&usp=sharing Google Drive folder]
+<!--- * [https://drive.google.com/a/mozilla.com/folderview?id=0B4x1onW-07JbUXFuWk9aRmp4aTQ&usp=sharing Google Drive folder] --->
 * [https://trello.com/b/b402OoGh/smart-kitchen# Smart Kitchen Trello]
 * [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit SmartKitchen Prototype Design Requirements]