Connected Devices/Projects/Smart Kitchen: Difference between revisions
Jump to navigation
Jump to search
This experiment has concluded. We have retained the content on this page so others can take advantage of these learnings. For the latest on what Mozilla is doing, visit www.mozilla.org.
(hiding old product/problem hypothesis and initial prototype) |
(Inserted experiment ended message) |
||
| (16 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
{{caution|This experiment has concluded. We have retained the content on this page so others can take advantage of these learnings. For the latest on what Mozilla is doing, visit [https://www.mozilla.org www.mozilla.org].}} | |||
{{Sidebar <!-- Project Infobox --> | {{Sidebar <!-- Project Infobox --> | ||
| navbar = off | | navbar = off | ||
| headingstyle = background-color:#eee; | | headingstyle = background-color:#eee; | ||
| heading1 = Project | | heading1 = Project SmartKitchen <!-- Project Title --> | ||
| content1 = [[image:Connected-devices.jpg|300px]] <!-- Logo for Connected Devices, not product or team --> | | content1 = [[image:Connected-devices.jpg|300px]] <!-- Logo for Connected Devices, not product or team --> | ||
| heading2 = <!-- Screenshot caption --> <!-- Screenshot caption --> | | heading2 = <!-- Screenshot caption --> <!-- Screenshot caption --> | ||
| Line 12: | Line 15: | ||
| content5 = <!-- 2016.05.04 (Pitch Update) --> <!-- Latest Release Date --> | | content5 = <!-- 2016.05.04 (Pitch Update) --> <!-- Latest Release Date --> | ||
| heading6 = Innovation Status <!-- Innovation Status --> | | heading6 = Innovation Status <!-- Innovation Status --> | ||
| content6 = | | content6 = No longer an approved project <!-- Innovation Status --> | ||
| heading7 = Website <!-- Website --> | | heading7 = Website <!-- Website --> | ||
| content7 = | | content7 = https://mzl.la/smartkitchen <!-- Project Website --> | ||
}} | }} | ||
== Project Status == | |||
CLOSED | |||
---- | |||
'''Project SmartKitchen''' plans to explore what it would be like if you knew exactly what was in your fridge in real time, with little to no effort. Even better, we’d love to help you leverage this information and take your available ingredients to suggest new healthy recipes to try. Our vision is to help everyone with the question, “What’s for dinner?”, so you never have to come up blank again. | |||
== Project overview == | == Project overview == | ||
[[File:Smart kitchen use case.png|500px|right]] | [[File:Smart kitchen use case.png|500px|right]] | ||
Project SmartKitchen attempts to help people answer the question "What's for dinner?" in such a way that optimizes ingredients on hand, reduces food wasteage, and offers recipes (eventually) tailored to the user's time, skill, dietary requirements, allergies, likes/dislikes, etc. | |||
<!--- | <!--- | ||
| Line 39: | Line 46: | ||
===Initial Prototype=== | ===Initial Prototype=== | ||
For the initial prototype of the | For the initial prototype of the Project SmartKitchen, the goals are the following: | ||
* Understand the capabilities and gaps in the combination of Visual recognition and barcode reading for use in determining a kitchen inventory. | * Understand the capabilities and gaps in the combination of Visual recognition and barcode reading for use in determining a kitchen inventory. | ||
* Using user feedback from testing we want to understand the usefulness of such a service. We also want to drill into the key user barriers to making the service helpful. | * Using user feedback from testing we want to understand the usefulness of such a service. We also want to drill into the key user barriers to making the service helpful. | ||
| Line 57: | Line 64: | ||
* We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen | * We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen | ||
* We assume that people want recipes that they can make with their existing kitchen inventory | * We assume that people want recipes that they can make with their existing kitchen inventory | ||
=== Experiments === | === Experiments === | ||
* We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date. | * We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date. | ||
| Line 62: | Line 70: | ||
* If we create a video that shows our product vision and advertise it, we expect a 2% response rate. | * If we create a video that shows our product vision and advertise it, we expect a 2% response rate. | ||
=== Experiment Details === | === Experiment Details === | ||
[[Project SmartKitchen/ Experiment 1: Image Recognition Prototype]]<br> | |||
[[Project SmartKitchen/ Experiment 2: Video Survey]]<br> | |||
[[Project SmartKitchen/ Experiment 3: Facebook Ad]]<br> | |||
[[Project SmartKitchen/ Experiment 4: Facebook Ad Refactor]]<br> | |||
[[Project SmartKitchen/ Experiment 5: User Behavior Survey]]<br> | |||
[[Project SmartKitchen/ Experiment 6: Upstream Concierge]]<br> | |||
[[Project SmartKitchen/ Experiment 7: Second Image Provider]]<br> | |||
[[Project SmartKitchen/ Experiment 8: Optical Flow]] | |||
== Program Status == | == Program Status == | ||
| Line 109: | Line 123: | ||
| Experiment #1: Prototype | | Experiment #1: Prototype | ||
| 07/15/2016 - 08/08/2016 | | 07/15/2016 - 08/08/2016 | ||
! style="background:# | ! style="background:#00B2FF;" | Done | ||
| [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1110301338 Experiment Details] | | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1110301338 Experiment Details] ---> | ||
|- | |- | ||
| Experiment #2: Video | | Experiment #2: Video | ||
| 07/15/2016 - 08/12/2016 | | 07/15/2016 - 08/12/2016 | ||
! style="background:# | ! style="background:#00B2FF;" | Done | ||
| [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1164719251 Experiment Details] | | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1164719251 Experiment Details] ---> | ||
|- | |- | ||
| Experiment #3: Facebook Ad | | Experiment #3: Facebook Ad | ||
| 07/27/2016 | | 07/27/2016 | ||
! style="background:#00B2FF;" | Done | ! style="background:#00B2FF;" | Done | ||
| [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] | | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | ||
|- | |- | ||
| Experiment #4: Facebook Refactor | | Experiment #4: Facebook Refactor | ||
| 07/28-29/2016 | | 07/28-29/2016 | ||
! style="background:#00B2FF;" | Done | ! style="background:#00B2FF;" | Done | ||
| [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=576069453 Experiment Details] | | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=576069453 Experiment Details] ---> | ||
|- | |- | ||
| Hypothesis Validation Prototype | | Hypothesis Validation Prototype | ||
| 08/04/2016 | | 08/04/2016 | ||
! style="background:#00B2FF;" | Done | |||
| [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit Smart Kitchen Prototype Requirements] | |||
|- | |||
| Experiment #5: Investigating Current User Behavior Survey | |||
| 08/05/2016 | |||
! style="background:#00B2FF;" | Done | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | |||
|- | |||
| Experiment #6: Upstream Concierge | |||
| 08/08/2016-09/06/2016 | |||
! style="background:#00EC00;" | On Target | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | |||
|- | |||
| Experiment #7: Second Image Provider | |||
| 08/18/2016-09/06/2016 | |||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| [https://docs.google.com/ | | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | ||
|- | |||
| Experiment #8: Optical Flow | |||
| 08/18/2016-09/06/2016 | |||
! style="background:#00EC00;" | On Target | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | |||
|- | |- | ||
|} | |} | ||
| Line 221: | Line 254: | ||
=== Bi-Weekly Sync Ups === | === Bi-Weekly Sync Ups === | ||
Project SmartKitchen has open bi-weekly sync ups every Tuesday and Thursday at 11:00AM PST in the SmartKitchen Vidyo room. Instructions for joining the video conference (vidyo) meeting room are above. Meeting notes can be found [https://docs.google.com/a/mozilla.com/document/d/1PsgPJN3H1JAona9FydHLIWTaibXdNw9pKMVhCfOedY8/edit?usp=sharing here]. | |||
== Project Management (Trello) == | == Project Management (Trello) == | ||
* | * Project SmartKitchen is operating on one-week sprints. To follow our actions throughout the gating process, please follow our [https://trello.com/b/b402OoGh/smart-kitchen# Project SmartKitchen Trello]. | ||
* We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific. | * We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific. | ||
== References == | == References == | ||
* [https://docs.google.com/presentation/d/13iXSC1PgZSYMa_oNUOqXFBJqnQOlSIZ_b1P8HIeywug/edit#slide=id.gf81a417fb_2_45 Innovation Board pitch deck] | * [https://docs.google.com/presentation/d/13iXSC1PgZSYMa_oNUOqXFBJqnQOlSIZ_b1P8HIeywug/edit#slide=id.gf81a417fb_2_45 Innovation Board pitch deck] | ||
* [https://drive.google.com/a/mozilla.com/folderview?id=0B4x1onW-07JbUXFuWk9aRmp4aTQ&usp=sharing Google Drive folder] | <!--- * [https://drive.google.com/a/mozilla.com/folderview?id=0B4x1onW-07JbUXFuWk9aRmp4aTQ&usp=sharing Google Drive folder] ---> | ||
* [https://trello.com/b/b402OoGh/smart-kitchen# Smart Kitchen Trello] | * [https://trello.com/b/b402OoGh/smart-kitchen# Smart Kitchen Trello] | ||
* [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit SmartKitchen Prototype Design Requirements] | * [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit SmartKitchen Prototype Design Requirements] | ||
* [https://connected.mozilla.org/category/project/smartkitchen/ Our blog category at connected.mozilla.org] | |||
== Team == | == Team == | ||
Latest revision as of 23:15, 2 February 2017
This experiment has concluded. We have retained the content on this page so others can take advantage of these learnings. For the latest on what Mozilla is doing, visit www.mozilla.org.
| Project SmartKitchen |
|---|
 |
| Author(s) |
| Mozilla |
| Released |
| 06.08.16 (Initial Pitch) |
| Innovation Status |
| No longer an approved project |
| Website |
| https://mzl.la/smartkitchen |
Project Status
CLOSED
Project SmartKitchen plans to explore what it would be like if you knew exactly what was in your fridge in real time, with little to no effort. Even better, we’d love to help you leverage this information and take your available ingredients to suggest new healthy recipes to try. Our vision is to help everyone with the question, “What’s for dinner?”, so you never have to come up blank again.
Project overview
Project SmartKitchen attempts to help people answer the question "What's for dinner?" in such a way that optimizes ingredients on hand, reduces food wasteage, and offers recipes (eventually) tailored to the user's time, skill, dietary requirements, allergies, likes/dislikes, etc.
Lean Start Up Flow
Vision Statement
SmartKitchen aims to answer the question "What's for dinner?"
Ideas
- Use image recognition to identify the inventory of the kitchen
- Use barcode to identify and manage the inventory of the kitchen
- Use RFID to identify and manage the inventory of the kitchen (entire house, garbagecan)
- Use OCR to identify and manage the inventory of the kitchen
- Use the inventory of the kitchen to provide recipes
- Use an Open Source Cookbook to provide recipes from the community and socially engage/gamify the community in the food area
Leap of Faith Assumptions Being Tested
- We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen
- We assume that people want recipes that they can make with their existing kitchen inventory
Experiments
- We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date.
- If run a Facebook Ad describing our product, we expect a 2% response rate
- If we create a video that shows our product vision and advertise it, we expect a 2% response rate.
Experiment Details
Project SmartKitchen/ Experiment 1: Image Recognition Prototype
Project SmartKitchen/ Experiment 2: Video Survey
Project SmartKitchen/ Experiment 3: Facebook Ad
Project SmartKitchen/ Experiment 4: Facebook Ad Refactor
Project SmartKitchen/ Experiment 5: User Behavior Survey
Project SmartKitchen/ Experiment 6: Upstream Concierge
Project SmartKitchen/ Experiment 7: Second Image Provider
Project SmartKitchen/ Experiment 8: Optical Flow
Program Status
| Milestone | Date | Status | Status Notes |
|---|---|---|---|
| Passed Gate 0 | 06/08/2016 | Done | Gate 0 Pitch |
| User Research Survey | 06/10/2016 | Done | user Research Doc |
| Kick off in London | 06/13-17/2016 | Done | |
| Prototype Requirements Document | 07/13/2016 | Done | Prototype Requirements Document |
| Problem/Product Hypothesis Building | 07/07/2016 | Done | Problem/Product Hypothesis |
| Participatory Design | 07/12/2016 | On Hold | Participatory Design Template |
| Lean Start Up Training | 07/13-14/2016 | Done | |
| Experiment #1: Prototype | 07/15/2016 - 08/08/2016 | Done | |
| Experiment #2: Video | 07/15/2016 - 08/12/2016 | Done | |
| Experiment #3: Facebook Ad | 07/27/2016 | Done | |
| Experiment #4: Facebook Refactor | 07/28-29/2016 | Done | |
| Hypothesis Validation Prototype | 08/04/2016 | Done | Smart Kitchen Prototype Requirements |
| Experiment #5: Investigating Current User Behavior Survey | 08/05/2016 | Done | |
| Experiment #6: Upstream Concierge | 08/08/2016-09/06/2016 | On Target | |
| Experiment #7: Second Image Provider | 08/18/2016-09/06/2016 | On Target | |
| Experiment #8: Optical Flow | 08/18/2016-09/06/2016 | On Target |
Status Key
| Color | Status | Key |
|---|---|---|
| On Target | The project or deliverable is expected to meet its due date. | |
| Challenged | The project or deliverable is facing an issue that might cause it to miss its due date, but a “get well” plan has been developed to get it back on track. | |
| At Risk or Late | The project or deliverable is blocked or facing an issue that might cause it to miss its due date, and there’s no “get well” plan to get it back on track, or it is already late. | |
| Done | The project or deliverable has been completed. | |
| On Hold or Not Started | The project or deliverable has either not been started or has been placed on hold. |
Sprint Demos
| Date | Video Recording | Overview |
|---|---|---|
| 07/01/16 | Sprint 2 Demo | Image recognition with IBM Bluemix and bar code recognition. |
| 07/08/16 | Sprint 3 Demo | MySQL Database, checking in the schema, connecting to the data, and identify items user flow. |
| 07/15/16 | Sprint 4 Demo | Hardware: LED lights, enclosure and stand, button,
|
| 07/22/16 | Sprint 5 Demo | Inventory to Recipe flow, Google Analytics and metrics |
| 07/29/16 | Sprint 6 Demo | Summary of our findings for the Facebook ad experiment and status update on our video and prototype experiment |
Communication
IRC
Join the conversation on irc.mozilla.org, channel #SmartKitchen.
Vidyo
| "SmartKitchen" Vidyo Room |
|---|
|
Hello,
|
Bi-Weekly Sync Ups
Project SmartKitchen has open bi-weekly sync ups every Tuesday and Thursday at 11:00AM PST in the SmartKitchen Vidyo room. Instructions for joining the video conference (vidyo) meeting room are above. Meeting notes can be found here.
Project Management (Trello)
- Project SmartKitchen is operating on one-week sprints. To follow our actions throughout the gating process, please follow our Project SmartKitchen Trello.
- We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific.
References
- Innovation Board pitch deck
- Smart Kitchen Trello
- SmartKitchen Prototype Design Requirements
- Our blog category at connected.mozilla.org
Team
- Tamara Hills- Project Lead/SW Engineer
- Russ Nicoletti - SW Engineer
- Candice Serran - EPM
- Nicole Yee- EPM
- David Bialer- Product Manager
- Kevin Grandon - SW Engineer Contributor