Connected Devices/Projects/Smart Kitchen

Project Smart Kitchen
Author(s)
Mozilla
Released
06.08.16 (Initial Pitch)
Innovation Status
Stage 1 (Validation)
Website
TBD

Smart Kitchen is a project that addresses the need for anyone who needs to eat--which is all of us! Throughout this project, we are exploring what it would be like to know what is in your fridge all the time with little to no effort. Then after knowing the ingredients is in your kitchen, being able take those ingredients and suggest new and healthy recipes to try. To do this we are utilizing image recognition technology to scan food items and bar codes.

Project overview

Smart Kitchen is a project that attempts to help people answer the question "What's for dinner?" in such a way that optimizes ingredients on hand, reduces food wasteage, and offers recipes (eventually) tailored to the user's time, skill, dietary requirements, allergies, likes/dislikes, etc.

Problem Hypothesis

We believe that there are people who are responsible for creating or managing meals for 2+ members of their household
… who have difficulties coming up with ways to combine their existing kitchen inventory for a proper meal because
…they want to sit down as a family and eat a proper dinner together.
We will know this to be true when we see evidence from the research study.

Product Hypothesis

We believe that people who are responsible for creating or managing meals for 2+ members of their household
… are currently addressing it through eating out, and eating frozen meals and cooking the same thing repeatedly
By building the SmartKitchen service that provides meal options based on existing food inventory
…we will provide more options for meals and therefore making it easier for people to have more family dinners.
We will know this to be true when we see feedback from users from a prototype indicating it was helpful.

Initial Prototype

For the initial prototype of the Smart Kitchen project, the goals are the following:

• Understand the capabilities and gaps in the combination of Visual recognition and barcode reading for use in determining a kitchen inventory.
• Using user feedback from testing we want to understand the usefulness of such a service. We also want to drill into the key user barriers to making the service helpful.

Lean Start Up Flow

Vision Statement

SmartKitchen aims to answer the question "What's for dinner?"

Ideas

• Use image recognition to identify the inventory of the kitchen
• Use barcode to identify and manage the inventory of the kitchen
• Use RFID to identify and manage the inventory of the kitchen (entire house, garbagecan)
• Use OCR to identify and manage the inventory of the kitchen
• Use the inventory of the kitchen to provide recipes
• Use an Open Source Cookbook to provide recipes from the community and socially engage/gamify the community in the food area

Leap of Faith Assumptions Being Tested

• We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen
• We assume that people want recipes that they can make with their existing kitchen inventory

Experiments

• We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date.
• If run a Facebook Ad describing our product, we expect a 2% response rate
• If we create a video that shows our product vision and advertise it, we expect a 2% response rate.

Experiment Details

• Details on all experiments can be found here

Program Status

Milestone	Date	Status	Status Notes
Passed Gate 0	06/08/2016	Done	Gate 0 Pitch
User Research Survey	06/10/2016	Done	user Research Doc
Kick off in London	06/13-17/2016	Done
Prototype Requirements Document	07/13/2016	Done	Prototype Requirements Document
Problem/Product Hypothesis Building	07/07/2016	Done	Problem/Product Hypothesis
Participatory Design	07/12/2016	On Hold	Participatory Design Template
Lean Start Up Training	07/13-14/2016	Done
Experiment #1: Prototype	07/15/2016 - 08/08/2016	On Target	Experiment Details
Experiment #2: Video	07/15/2016 - 08/12/2016	On Target	Experiment Details
Experiment #3: Facebook Ad	07/27/2016	Done	Experiment Details
Experiment #4: Facebook Refactor	07/28-29/2016	Done	Experiment Details
Hypothesis Validation Prototype	08/04/2016	On Target	Smart Kitchen Prototype Requirements

Status Key

Color	Status	Key
	On Target	The project or deliverable is expected to meet its due date.
	Challenged	The project or deliverable is facing an issue that might cause it to miss its due date, but a “get well” plan has been developed to get it back on track.
	At Risk or Late	The project or deliverable is blocked or facing an issue that might cause it to miss its due date, and there’s no “get well” plan to get it back on track, or it is already late.
	Done	The project or deliverable has been completed.
	On Hold or Not Started	The project or deliverable has either not been started or has been placed on hold.

Sprint Demos

Date	Video Recording	Overview
07/01/16	Sprint 2 Demo	Image recognition with IBM Bluemix and bar code recognition.
07/08/16	Sprint 3 Demo	MySQL Database, checking in the schema, connecting to the data, and identify items user flow.
07/15/16	Sprint 4 Demo	Hardware: LED lights, enclosure and stand, button, Software: integrated server with big oven, can type meals into kikbot and sends 3 ingredients to big oven.
07/22/16	Sprint 5 Demo	Inventory to Recipe flow, Google Analytics and metrics
07/29/16	Sprint 6 Demo	Summary of our findings for the Facebook ad experiment and status update on our video and prototype experiment

Communication

IRC

Join the conversation on irc.mozilla.org, channel #SmartKitchen.

Vidyo

"SmartKitchen" Vidyo Room

Hello, You have been invited to attend a Mozilla Vidyo conference. Please click on the link below to attend: https://v.mozilla.com/flex.html?roomdirect.html&key=JeyRhCk4UtB8ruRc3gK8cdievCA If you do not have a user account, please enter your name in the "Guest Name" field and then click "Join". To join from a telephone, dial one of the following numbers depending on your nearest location: US Toll Free +1 800 707 2533, pin 369, conf 98075 US/CA/Mountain View +1 650 903 0800, extension 92, 98075 US/CA/San Francisco: +1 415 762 5700, extension 92, 98075 US/OR/Portland: +1 971 544 8000, extension 92, 98075 CA/BC/Vancouver: +1 778 785 1540, extension 92, 98075 CA/ON/Toronto: +1 416 848 3114, extension 92, 98075 UK/London: +44 (0)207 855 3000, extension 92, 98075 FR/Paris: +33 (0) 184 883 737, Press 1 for English or 2 for French, extension 92, 98075 DE/Berlin: +49 30 983 333 000, extension 92, 98075 NZ/Auckland: +64 9 555 1100, extension 92, 98075

Bi-Weekly Sync Ups

The Smart Kitchen has open bi-weekly sync ups every Tuesday and Thursday at 11:00AM PST in the SmartKitchen Vidyo room. Instructions for joining the video conference (vidyo) meeting room are above. Meeting notes can be found here.

Project Management (Trello)

• Smart Kitchen is operating on one-week sprints. To follow our actions throughout the gating process, please follow our Smart Kitchen Trello.
• We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific.

References

• Innovation Board pitch deck
• Google Drive folder
• Smart Kitchen Trello
• SmartKitchen Prototype Design Requirements

Team

• Tamara Hills- Project Lead/SW Engineer
• Russ Nicoletti - SW Engineer
• Candice Serran - EPM
• Nicole Yee- EPM
• David Bialer- Product Manager
• Kevin Grandon - SW Engineer Contributor