Connected Devices/Projects/Project Lighthouse
This experiment has concluded. We have retained the content on this page so others can take advantage of these learnings. For the latest on what Mozilla is doing, visit www.mozilla.org.
Contents
Project Overview
Key Facts:
- 285 million people are estimated to be visually impaired worldwide - 39 million are blind and 246 million have low vision1.
- Over 20 million people suffer from vision loss just in the US (10% of the adult population)2.
- 90% of the world’s visually impaired live in a low income setting.
These discoveries have motivated us to kick-start Project Lighthouse.
People who are visually impaired aspire to be more independent & be able to perform their day-to-day tasks like their visually able friends. They are currently managing these challenges in their lives by skipping an experience altogether or through reliance on caretakers, or braille & other accessibility devices & mediums.
Our vision is to enable every person with visual impairment to have equal access to everyday things and lead a more independent & fulfilling lifestyle.
People save memories & relive experiences or adventures by taking pictures, videos, audio recordings. With Project Lighthouse we are extending this natural behavior to create a simple product that would be both easy to use & affordable to own.
The product is equipped with a camera, mic & speaker to provide the visually impaired with the ability to quickly & efficiently tag household items (example: pantry items, clothing, medicines etc.)
These devices are small & portable and can be used both at home & out. Users will simply take a picture/video of the item and then tag it with their voice. The device will save an image or a series of images and tag them with the users voice description.
The next time the user is interested in identifying an item at home, they’d use this device to take a picture, which then uses its smart image matching algorithm to identify the match against a series of images, previously saved & tagged to identify the one they are looking at and automatically plays the custom voice description when it confirms the match.
To better understand, let’s elaborate with a scenario:
Ernie who is blind takes lighthouse when he goes shopping at a local grocery store. Lighthouse is a battery powered & portable device. It is equipped with a camera, mic & speaker. It works completely offline. Ernie picks up a box of cereal, takes an image/video & voice records the product details that are important to him in his local dialect & saves it locally on the device. A few days later, Ernie would like to eat cereal for breakfast. Ernie picks up the item from his pantry, uses lighthouse to take an image/video of the box. Lighthouse uses its image matching algorithm to match it with the image that he took while he was shopping & plays his custom voice description of the product, confirming that it is the cereal.
Additionally, the device requires no setup at all & starts working as soon as you switch it on. It has an optional wifi connectivity step only if you’d like for it to automatically receive software updates as and when they become available.
Product Vision
Our vision is to enable every person with visual impairment to have equal access to everyday things and lead a more independent & fulfilling lifestyle.
Product Target Audience
People with visual impairment.
Opportunity
As stated earlier, there are 285 million people are estimated to be visually impaired worldwide - 39 million are blind and 246 million have low vision1 Our goal is thus to create a portable & affordable device that can help identify several different categories of items. Our goal is to continuously expand this set to make it more beneficial for our target users.
How It Works
TODO: Add Updated Diagram
Technical Documentation
TODO: Add Link
Project Status
| Milestone | Date | Status | Links |
|---|---|---|---|
| Gate 0 approval | 9-28-2016 | Approved | Product Pitch |
| Gate 1 approval | 12-08-2016 | Approved | Gate 1 Presentation |
| Lighthouse App UX Finalized | 01-31-2017 | In Progress | App UX Spec |
| Lighthouse App Ready | 03-31-2017 | In Progress | App Doc |
| Lighthouse Device ID Finalized | 02-31-2017 | Not Started | ID Spec |
| Lighthouse Device Hardware Definition Finalized | 03-31-2017 | Not Started | Hardware Spec |
Meeting Notes
How to Contribute
- Source Code
- IRC Channel: #Lighthouse (Address: irc.mozilla.org)
- Team Email: project-lighthouse-team@mozilla.com
- Looking for Mobile App Developer. Contact hkoka@mozilla.com if you are interested to contribute.
