TPE DOM/Storage

Introduction

Over the years the web has grown various APIs that can be used for storage, e.g. IndexedDB, localStorage, cache API, but it's lack of a means for managing storage across different APIs easily. This project aims at providing a unified architecture for storage on the web so that these APIs could honor the same rule. In addition, this project is to enable applications to more effectively manage their storage.

References:

• Storage whatwg spec
• dev-blink intent-to-implement
• dev-blink intent-to-ship

Main Members

DOM Engineers: Shawn Huang, Tom Tung

UX designer: Mark Liang, Morpheus Chen, Tina Hsieh

FE Engineers: Fischer Liu

EPM: Francis Lee (main contact)

Scope

V1 UX spec

Roadmap

Storage management V1 MVP identified.

UX V1 spec has been finalized except string review by copy writer.

All issues breakdown has been sign-off by dev-team.

• MVP completed rate: 38.71%
• Remaining MVP issues:
  • Platform: 7 bugs
  • Front-end: 12 bugs
  • UX: 1 bug
• Target shipping date: Firefox 56 nightly, 4/17
  • Target all MVP completed date: Firefox 55 nightly, 3/6
    • Softvision should be able to do full test on Firefox 55 nightly
    • Final verification should be proceed on Firefox 56 nightly
    • Ref: Release calendar
• Next check point: 1/23

Some possible ideas about Storage management v2 (this is changing all the time ;) )

• Smart filtering algorithm to decrease pop-up interference
• Integrating storage types into QuotaManager

Risk

Patch review takes much longer than expected. communication has been made with reviewer during Hawaii workweek and the following week. we have highlighted project schedule, priority and slow patch review eventually blocks other issues such as front-end issues. we expected review process will be accelerated.

Project Dashboard

Meta Bugs

Full Query

ID	Summary	Priority	Status
1147820	[meta] Improve Storage	P2	NEW

1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);

Storage V1 Bugs

Full Query

ID	Summary	Status	Target milestone	Resolution	Assigned to
1161553	[UX] Create design spec for local storage permissions, notifications and preferences	RESOLVED	---	FIXED	Mark Liang(:mark_liang)
1267941	Implement Storage API estimate() feature	RESOLVED	mozilla51	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1268804	Enable SecureContext for Storage API	RESOLVED	mozilla55	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1270038	Add permission 'persistent-storage' for StorageManager	RESOLVED	mozilla53	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1281103	Support GetGroupUsageAndQuota in QuotaManagerService or QuotaManager	RESOLVED	mozilla50	FIXED	Tom Tung [:tt, :ttung]
1286312	Add mochitest option to run tests using https	RESOLVED	mozilla53	FIXED	Paul Yang [:pyang] (away)
1286717	Expose persist/persisted method to StorageManager	RESOLVED	mozilla55	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1287701	Expose persisted() method to StorageManager	RESOLVED	---	DUPLICATE	Tom Tung [:tt, :ttung]
1290481	Implement mitigations for opaque response storage in the DOM cache	RESOLVED	mozilla57	FIXED	Tom Tung [:tt, :ttung]
1294400	Implement Storage Pressure event to notify UI	RESOLVED	---	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1296591	Bound persistent storage by total quota	RESOLVED	---	DUPLICATE	Tom Tung [:tt, :ttung]
1298329	Implement persist()/persisted() attributes in QuotaManager and expose it to QuotaManagerService.	RESOLVED	---	FIXED	Tom Tung [:tt, :ttung]
1299779	[meta] Add telemetry for storage api	RESOLVED	---	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1301276	Transfer persistent type to non-persistent	RESOLVED	---	WONTFIX	Tom Tung [:tt, :ttung]
1304966	Enable Storage API only for nightly bulid	RESOLVED	mozilla52	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1309118	[Meta] Implement Storage management	RESOLVED	---	FIXED	Fischer [:Fischer]
1309123	Show persistent-storage permission request notification	RESOLVED	Firefox 55	FIXED	Fischer [:Fischer]
1311057	Remove IsApp flags from the quota manager and DOM cache	RESOLVED	mozilla55	FIXED	Jan Varga [:janv]
1312347	Display persist-storage permission on Control center	RESOLVED	---	DUPLICATE
1312348	Add persist-storage permission into the permission section of the Page info	RESOLVED	---	DUPLICATE
1312349	Hide the section of Offline Web Content and User Data in about:preferences	VERIFIED	Firefox 55	FIXED	Fischer [:Fischer]
1312351	[Meta] Implement the Site Data section for Storage management in about:preferences	RESOLVED	---	FIXED
1312361	Clear all sites data from the Site Data section	RESOLVED	Firefox 53	FIXED	Fischer [:Fischer]
1312372	List sites using storage in Settings of Site Data	RESOLVED	Firefox 53	FIXED	Fischer [:Fischer]
1312374	Search sites listed in Settings of Site Data on host	RESOLVED	Firefox 53	FIXED	Fischer [:Fischer]
1312375	Should be able to switch persistent-storage permission status for site	RESOLVED	---	WONTFIX
1312377	Remove selected site data in Settings of Site Data	RESOLVED	Firefox 54	FIXED	Fischer [:Fischer]
1312380	Should be able to remove data of all sites visible on the list in Settings of Site Data	RESOLVED	Firefox 54	FIXED	Fischer [:Fischer]
1313003	Add Site Data section into Network of Advanced of about:preferences	VERIFIED	Firefox 53	FIXED	Fischer [:Fischer]
1313313	Need persist-storage permission notification icon	RESOLVED	---	FIXED
1313602	Need "Learn More" page for persistent storage permission	RESOLVED	---	FIXED	Joni Chan
1323391	Sort sites listed in Settings of Site Data	RESOLVED	Firefox 53	FIXED	Fischer [:Fischer]
1323395	Show warning when disk space available for firefox is not enough	RESOLVED	Firefox 54	FIXED	Fischer [:Fischer]
1331318	Add learn more link in the Site Data section	RESOLVED	Firefox 53	FIXED	Fischer [:Fischer]
1338036	Switch button label from "Remove All" to "Remove All Shown" when filtering by keyword in about:preferences	RESOLVED	Firefox 54	FIXED	Fischer [:Fischer]
1338402	Add telemetry for storage api doorhanger	NEW	---
1338405	Add telemetry for storage api notification	NEW	---
1338407	Add telemetry for storage api preferences	NEW	---
1338438	Test interfaces on both http and https channels	RESOLVED	mozilla54	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1338757	"Remove All Shown" and button in about:preferences should use its own accesskey	RESOLVED	Firefox 54	FIXED	Fischer [:Fischer]
1339081	QuotaManager: Upgrade storage from 1.0 to 2.0	RESOLVED	mozilla55	FIXED	Jan Varga [:janv]
1339786	Disable Storage API on Android	RESOLVED	mozilla55	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1340618	Don't hardcode Firefox in strings for space disk warning in Preferences	RESOLVED	Firefox 54	FIXED	Fischer [:Fischer]
1340967	"Search" input label in Settings of Site Data is not vertically center-aligned	VERIFIED	Firefox 54	FIXED	Fischer [:Fischer]
1343463	dom/indexedDB/test/test_storage_manager_estimate.html | This test left a service worker registered without cleaning it up	RESOLVED	mozilla55	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1343477	Search label should be a placeholder text in Settings of Site Data	RESOLVED	Firefox 54	FIXED	Fischer [:Fischer]
1348252	Disable buttons and display loading message in Site Data section while loading data	RESOLVED	Firefox 55	FIXED	Fischer [:Fischer]
1348660	Implement a method to retrieve usage data for all origins at once	RESOLVED	mozilla55	FIXED	Jan Varga [:janv]
1348733	List sites using quota storage or appcache in Settings of Site Data	RESOLVED	Firefox 55	FIXED	Fischer [:Fischer]
1348874	Timeout navigator.storage.persist() in sandboxed iframe should reject with TypeError	RESOLVED	mozilla55	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1352374	Unexpectedly search on the pref-off Site Data section in Preferences	VERIFIED	Firefox 55	FIXED	Fischer [:Fischer]
1354530	Update the strings about Storage Manager according to the latest v1 specs	RESOLVED	Firefox 55	FIXED	Fischer [:Fischer]
1372116	'QuotaExceedError' is not thrown for a persisted website	VERIFIED	---	FIXED	Tom Tung [:tt, :ttung]
1372592	Should not display non-persistent-storage sites which stores 0 byte in Preferences Site Data section	VERIFIED	Firefox 57	FIXED	Fischer [:Fischer]
1372612	The Site Data list is not immediately updated	RESOLVED	---	WONTFIX
1375004	Storage permissions are not updated when removed from View Page Info	RESOLVED	---	DUPLICATE
1376444	Full disk warnings are not displayed after clearing data from "Preferences"	VERIFIED	---	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1377104	Should clear all stored site data dynamically	VERIFIED	Firefox 57	FIXED	Fischer [:Fischer]
1377852	Do not display the 2nd storage pressure notification when there is one being displayed	VERIFIED	mozilla57	FIXED	Fischer [:Fischer]
1379654	navigator.storage.persisted() returns "true" after the "persistent storage" permission is cleared from Control Center	RESOLVED	---	INVALID
1384492	Notification bar is not displayed if the stored data is more than 50% of disk space	RESOLVED	mozilla57	FIXED	Shawn Huang [:shawnjohnjr][:shuang] (as a happy gecko contributor)
1385936	The notification bar dissapear if click "Learn More" button from the same tab	RESOLVED	---	WORKSFORME
1390675	Preferences -> Site Data -> Settings cannot be closed with the Escape key	VERIFIED	Firefox 57	FIXED	Fischer [:Fischer]
1399398	Turn on the Storage Management feature	RESOLVED	Firefox 57	FIXED	Fischer [:Fischer]
1399808	Remove the offlineGroup UI in about:preferences	RESOLVED	Firefox 58	FIXED	Fischer [:Fischer]
1401900	Should call nsIQuotaManagerService::clearContentData when clearing all data	RESOLVED	---	INVALID

66 Total; 3 Open (4.55%); 53 Resolved (80.3%); 10 Verified (15.15%);

Meeting Minutes

Storage API/UX discussion

Dom team Weekly Sync-up

Reference

UX Study

London Presentation