Engagement/Developer Engagement/Grab bag/Grab bag pre July2014
Do you want to give a talk and cover a certain product or technology and you are not sure how to? This is a pick'n'mix grab bag of topics, examples of explanations, links to screencasts, products and videos to help you along.
If you have some specific question, contact us either on IRC on #devrel (irc.mozilla.org) or directly via the emails listed on the Developer Engagement page (Mozilla internal).
- 1 HTML5 and other "new" technologies
- 2 Open Web Initiatives
- 3 Mozilla Products
HTML5 and other "new" technologies
HTML5 was the re-boot of web development practices. The old ways of developing web sites didn't fit the need of a fast moving environment that extended past the desktop towards mobiles and tablets and we needed a way to shift more responsibility to the user agent (in most cases the browser). Therefore HTML5 broke a few of the earlier conventions but empowers web developers far beyond what we were able to do in the past.
Key messages about HTML5
- HTML5 is defined in a joint effort by the WHATWG working group (which includes a lot of browser vendors) and the W3C. The WHATWG runs the wild innovation part of HTML5 - not everything that is in their specification will make it into the final one. The W3C effort is more conservative and therefore more interesting for an enterprise market.
- HTML5 is open - you learn by viewing the source code of others. This also means it is up to us to write clean HTML5 to set a good example and base to work from.
- HTML5 is interoperable - products built with it are meant to run on a large variety of hardware. Therefore not all best practices we have on desktop apply to it.
- HTML5 is meant to be backwards compatible - old browsers that do for example not understand the new form elements should offer a normal text field as the means of entering the information.
HTML5 for everybody
One big request from audiences is always "how do I get started with HTML5" and there are a few things you can show/give them.
- HTML5 boilerplate is an HTML template, demo CSS3 files and all the fixes needed to make HTML5 work for legacy browsers. Unzip the provided file, start editing index.html and we are off.
- Dive into HTML5 is a great, free online book on the subject
- HTML5 Doctor is a simple blog with very up-to-date HTML5 information
- HTML5 rocks has documentation and tutorials
- HTML5 readiness shows the support of HTML5 (and other new tech) features in browsers
- Can I use is a great resource that shows the support of new tech features in browsers
The main selling points of CSS3:
- Independence of images - this means fewer HTTP requests (faster loading sites) and simpler redesigns - if the colour scheme of your site changes from green to blue, you don't need to create a lot of images, optimise them and upload them to a CDN.
- Mathematical access to graphics - you can rotate and zoom elements in the page with degrees and zoom levels. That way if you need a text that is 45 degrees turned to change to 37.5 degrees all you need to do is to alter the CSS value.
- Hardware acceleration - CSS animations and transformations and hardware accelerated which is especially effective on mobile devices.
- Responsive design - showing responsive mode in Firefox on Opera's shiny demos, Starbucks
- CSS transform, animation and transition (MP4) showing CSS Cubes, 3D photo rollover and 3Drollover.css
- The Mozilla Dev Derby for June had CSS animation as its main topic - there were some really cool entries as videos, too.
- The Planetarium demo shows how animation can be used to showcase different planets webm ogv mp4
- The HTML5 Dashboard demo has some good examples for all "new tech" implementations. The CSS3 one is very effective when you go through it one by one. webm mp4 ogv
- Ben the body guard is a site advertising an app that uses CSS3 animation and jQuery to do some storytelling. The thing to point out (which is also on the screencast) is that they didn't do a good job of using CSS to improve semantic HTML - the site is just empty DIVs. webm mp4 ogv
- Madmanimation is a showcase of the Animatable tool, which turns an HTML storyboard (check the site in Opera to see the fallback) into a cool animation. This is progressive enhancement as it should be done. webm mp4 ogv
HTML5 forms allow us to build more interactive applications for our users and get rid of a few of the annoyances we had to deal with in the past:
- We have new cool elements:
- Date picker - writing a client-side calendar that localises to different markets is a pain to do - now we don't need that any longer
- Number fields - they render with up/down arrows and allow simple entry. They also come with min and max and step attributes to define the allowed range and make it easy for users to increase by, let's say 0.1 instead of 1
- Email/URL/Phone fields - they don't mean much on a desktop but are a total win on mobile devices as they switch the keyboards around and tie into your history and address books - that way you need to enter a lot less and you don't need to switch from alphanumeric to numeric keyboard.
- Range - renders a slider control - something we never had natively
- Datalist - is a combo box we had in many other GUI frameworks - it allows for open text entry but offers autocomplete for a preset of values. The really cool thing about this one is that it extends an input for backwards compatibility.
The great thing about HTML5 form elements is that they gracefully degrade to a text input on old browsers. The bad thing about them is that they are not well supported across browsers as this comparison grid by Wufoo shows.
HTML5 File APIs
This is a big topic and might be hard to understand for people. I like to show an example screencast of either of the following examples. The main thing to tell people about the File APIs is that they make it much easier for us to build applications without a server and that we use the end user's computer power for our needs. It is a bit like SETI@home, only for humans, not aliens.
- Min.us - this is showing how you can drag and drop an image into the browser and then send it to image hosting sites. Explain how much easier that is than uploading them one by one. webm mp4 ogv
- 64 yourself - this shows how you can drag a file into the browser, convert it and save it back without any server interaction. It also has a cool geek feeling to it :) webm mp4 ogv
- Motivational poster - our own demo, this shows again how to manipulate an image in the browser before uploading it. webm mp4 ogv
HTML5 video was probably the main breakthrough for the new technology. We realised pretty early that the media internet will not stay interesting enough for mass market end users if we keep it strictly text and image based. The benefit of HTML5 video over plugin-based solutions is that the video is just another element in the document. This solved a few issues we had with Flash or Silverlight based video solutions:
- Videos have a native browser control, which means they are keyboard accessible and assistive technology can interact with them
- Videos can be styled with CSS much like any other element in the document, you can zoom them, rotate them, add borders, make them transparent and many more things that weren't possible with a Flash embed
- Videos have a built-in API that allows you to write your own controls, react to the time of the movie, test what video formats are supported and get all kind of information about them that you couldn't get with Flash videos.
- Videos can easily interact with other parts of the page and can even get generated dynamically. A plugin always was a black box of unknown in your document
- Syncing HTML5 video with page content is a demo that shows how to use data- attributes to show and hide content in a page at a certain time webm mp4 ogv — I normally follow this up by explaining and showing Popcorn.js
- This Shell is a clever way of re-using a Canvas+video demo to promote a song. You need to put the video together as a puzzle and when you manage to do it on time you can download the song webm mp4 ogv
- There was a Mozilla Dev Derby on HTML5 video with great examples of what can be done with open video.
Issues with HTML5 video
Of course not everything is rosy about HTML5 video at the moment and the following things are constantly brought up in Q&A sessions with audiences. It is important to make the message clear that there are some issues with it and that sometimes Flash video is the better option (less and less though).
- Different codecs for different browsers — there is a discord among browser vendors when it comes to defining what constitutes HTML5 video. Whilst Microsoft and Apple favour mp4 files with H.264 encoding (which is also the format for Blue Ray discs), Google, Opera and Mozilla went for fully open codec formats like Ogg Video and Web-M. This means a few annoying things:
- If you want to support all HTML5 browsers with your videos, you have to convert them into three formats.
- If you also want to support different mobiles and tablets you will also have to create the video in different resolutions and sizes.
- One simple way to do this is to use online services. Archive.org for example automatically converts hosted videos (which have to be licensed with Creative Commons or Public Domain) you upload to OGG and MP4, so all you need to do is create a WebM version.
- Vid.ly converts videos to 20 formats and provides you with a URL that redirects different browsers, mobiles and consoles to the right format automatically.
- HTML5 video is open, and so is the source file — if people want to offer video in HTML5, then the files will be possible to download. YouTube's HTML5 player goes through a proxy server to prevent this but it can be easily fooled. If people want DRM in their files and prevent users from downloading them they need to use Silverlight or Flash (or host the files on a login-protected server).
Technically HTML5 audio should not be much harder than video but the implementations in browsers right now are not as good as they could be. There are issues with looping sounds for example. One of the issues is that the most used audio format on the web - MP3 - is not an open format.
The benefits of audio are the same as for HTML5 video:
- Native player controls allow for keyboard access
- Simple communication with the rest of the page allows for great experiences of audio with other open technologies
The issues with HTML5 have been discussed in detail by Scott Schiller in his 24 ways article "Probably, Maybe, No": The State of HTML5 Audio.
There are however browser specific APIs to work with audio both by Chrome and Firefox which allows for byte-level access to music and you can do great things with those. Having access on such a granular level means you can do all kind of interesting experiments, from syncing animations with the beats per minute of a song up to generating music and voices programatically.
- Web Audio API - showing Beatdetektor3HD
- Mozilla Audio Data API with lots of demos
- Chrome web Audio demos
- W3C Web Audio working draft
- Wheels of Steel - a fully working DJ mixing deck in CSS and HTML5 (this one uses Flash for audio - if you want scratching)
- A public radio programme that links the transcript with the correct part in the audio recording much like TED does with videos
Canvas is a technology that makes it easy to paint in the browser. You define an area and it literarily becomes your canvas. Instead of being a simple drawing board, HTML5 canvas has a few good things up its sleeve:
- You can move and draw the pencil. By default you can draw points, arcs, bezier curves and rectangles. You start paths and end them and you can fill or stroke them in different styles
- You can generate gradients and different colour fills with named colours, RGB, RGBA, HSLA and hex colours.
- You can transform the canvas coordinate matrix while you draw your elements. This means you can scale and rotate things you paint without having to recalculate your points. Imagine your painting as a transparent sheet over a piece of paper, you can rotate the transparent sheet without affecting the space the paper uses up on the desk.
- You can define the blending mode of elements you plot on the screen. that way elements can overlay, intersect and lighten or darken each other.
- You can export the canvas easily as an image and allow users to save them
- You can easily import images into a canvas and scale and transform them
- You can automatically import frames from videos into a canvas
- If you import video and images (or other canvasses) into a canvas you have byte-level access to the final image. That way you can do colour manipulation, find edges, detect faces and all the other things a good drawing program can do for you.
Of course there are some issues with canvas:
- Not all browsers have hardware acceleration for canvas. The performance of canvas is however very impressive
- The canvas is a drawing board in your document - much like and etch-a-sketch you can paint on it and wipe it. You do not have access to the painting you did though and every path once rendered is gone. If you want vector-based painting in a browser, use SVG instead
- There is no accessibility in canvas solutions. To assistive technology it looks like a big black box
- Canvas screencast (MP4) - showing Browser fountain, Pig particles, Canvas cropper, Canvas Thumbnail generator
- The browser fountain is a particle system in Canvas using browser logos as the particles. webm mp4 ogv
- The three.js demo site has a lot of great demos of both 2D and 3D examples using the library.
- Canvas Rider is a neat little game using Canvas - you can build your own tracks
- Fractal Trees is a simple implementation of a fractal generator in canvas webm mp4 ogv
Issues with WebGL
- Microsoft do not support WebGL and instead have their own ActiveX based rendering system. This might change but to date, IE does not play well with WebGL.
- Programming WebGL is a different skill set from web development and the learning kerb might be a bit high for people. Libraries like three.js make things much easier but it still is a switch from a 2D to a 3D world.
- WebGL screencast(MP4) showing various demos from Alteredqualia
- Ginger is a great example for facial expressions in WebGL webm mp4 ogv
- The Skin renderer in WebGL looks pretty creepy but also very impressive. webm mp4 ogv
- The winners of the Mozilla Demoparty Competition are great examples of what can be done with WebGL
- The three.js demo site has a lot of great demos of both 2D and 3D examples using the library.
- Body Browser - Google took a 3D model of the human body and built a maps-style interface to it in WebGL webm mp4 ogv
- Evan Wallace has some very cool WebGL demos. One of them is a Water simulation webm mp4 ogv and another is a path tracing demo webm mp4 ogv
Local Storage and Session Storage are two new features in HTML5 that (together with offline applications) help us build web apps that can retain their state without a server.
In the past the only thing we could do as developers is to store cookies on the end users' computer. Cookies had a lot of drawbacks:
- Cookies can store 4k of data tops
- The data is stored in a weird string format
- All the cookies of a certain domain are sent with each HTTP request, regardless of what was requested from the server
- As cookies are used for user tracking they got a bad reputation and a lot of companies have a "no cookies" policy.
So cookies were out. Local Storage is in. The main differences are:
- Local Storage can take up to 5MB of data per domain
- The format is a simple key/value store - you set for example with localStorage.setItem( 'browser', 'Firefox' ) and you retrieve with localStorage.getItem( 'browser' ). You can also do a localStorage[ 'browser' ] = 'Firefox' notation.
The sessionStorage interface does the same, but clears the data when you close the tab.
Issues with Local Storage:
- Local Storage takes only text values, so if you want to store JSON you need to use JSON.stringify to store and JSON.parse to read
- There is no clean interface to find out how much local storage you used up - if you exceed the limit, you just get an error
- There is no interface to have expiring storage - the data stays in storage until it gets overwritten. YQL Localcache is a simulation for that though.
Right now we are not building web products like we used to. Not every click means the page gets reloaded and not every button submits a form. This increases usability in many cases but breaks other browser functionality - especially bookmarking and the back and forward buttons.
In the past we hacked around this issue by using the fragment identifier of URLs and hidden iframes to seed the browser history but that solution had all kind of problems.
Now we have the HTML5 history API which allows us in a clean fashion to not reload pages and still offer all the browser functionality.
- GitHub has a great implementation of the History API - simply click through a repository and you see that the page does not reload but the URL bar reflects your changes webm mp4 ogv
- The August 2011 Dev Derby had the History API as its topic and some cool demos
Pretty sites using new web standards (HTML5/CSS/JS)
These are a few sites I like to show when it comes to new technology and how it can be used for pretty sites as nice as Flash/Silverlight:
- Evolution of the web is a showcase celebrating the third birthday of Chrome using SVG to build a beautiful timeline of how the web evolved mp4 ogv webm
- Nike better world - vertically scrolling page with parallax - check the source code to see that it is HTML5 webm mp4 ogv
- Nissan Leaf - site with a 3D interface to the car interior and exterior webm mp4 ogv
- TRON - interactive graphic novel (originally to promote IE9) - the cool story to tell here is that someone like Disney is betting on HTML5.
- 20 things I learned - an e-book in HTML5 by Google - really nicely done
- Angry Birds web - Notice the use of Flash for music. That is a good opportunity to explain that music in HTML5 is still badly supported (no looping)
Open Web Initiatives
Other than web technologies, I like to mention the open web initiatives Mozilla is involved in. Here are some of them.
Many of our interactions on the web involve sharing and exchanging personal data. As we do so, we enable the companies that provide web services to collect, correlate, and sell information about us in ways we can't control.
Mozilla Persona is an initiative aimed at putting users in control of how their personal data is shared and used on the web.
The foundation of Persona is an identity system in which users can sign into web sites using their email address. The protocol underlying this system, BrowserID:
- is easy for web sites to integrate, and automatically gives web sites a verified email address for their users
- provides a superior user experience: users don't have to create a separate user name and password for different sites, and don't have to enter and confirm an email address for each site
By design Persona is a decentralized system: anyone can become an identity provider, so users are not dependent on any particular authority to verify identities. Unlike other single sign on systems such as Facebook Connect or OpenID, Persona does not enable identity providers to track which web sites a user signs into.
In its initial stages, Persona uses a central server (https://login.persona.org) to verify identities, but as email providers add support for the underlying BrowserID protocol this will become less relevant and will eventually be retired.
You can read more about the philosophy behind Mozilla Persona in Mitchell Baker's blog post on user sovereignty for data.
WebFWD Innovation Accelerator
WebFWD ("Web Forward") is Mozilla's Innovation Accelerator and Incubator. We support open web startups which disrupt closed markets, providing participants with mentorship from industry experts, access to the Mozilla global network, infrastructure and other world-class resources. Our teams engage with us for 3 months and are eligible for funding from Mozilla upon successful completion of the program. Our first graduation is September 19, 2012 and our next class starts in October, 2012 > apply now!
Here is some info about Mozilla products that you can use in your talks:
As there was a lot of demand, we put together a "pick and mix" HTML5 Slide deck about this:
You can see the deck at: http://codepo8.github.io/mozilla-presentation-templates/html5/firefox-os-pick-and-mix.html
You can get the deck at: https://github.com/codepo8/mozilla-presentation-templates
[TO BE FILLED]
Add-ons is an all-encompasing term that includes:
- Extensions (like AdBlock Plus and NoScript)
- Plugins (like Adobe Flash Player)
- Dictionaries and Language Packs (see Language Tools)
- Search Engine Providers (like DuckDuckGo)
Add-ons can usually work on all platforms, and can even work on multiple applications (Firefox, Mobile Firefox, Thunderbird, etc.).
You can learn about add-on development and the Add-ons SDK in the Mozilla Add-ons Developer Hub.
The goal with WebAPI is to provide a basic HTML5 phone experience and bridge the gap between the Open Web and native apps, and offer consistent APIs that will work in all web browsers, no matter the operating system.
Examples of APIs are:
- Dialer: Telephony & Messaging API, Contacts API
- Address Book: Contacts API
- SMS: Telephony & Messaging API, Contacts API
- Camera: Camera API, Filesystem API
- Gallery: Filesystem API (could possibly be FileReader & FileWriter in conjunction)
- Settings: Device Status API, Settings API
- Games: Accelerometer API, Mouse Lock API
- Maps: Geolocation API, Contacts API
A lot of people ask about the WebAPI effort and how it stands in relation to the W3C DAP and WAC, and the answer is that WebAPI offers a way for Mozilla to experiment and prototype ideas and suggestions, and then create a proposal and bring it to working groups like W3C DAP, WAC and WHATWG.
More details and good questions and discussions can be found in the posts at Mozilla Hacks:
- Introducing WebAPI
- More details about the WebAPI effort
- Are We Mobile Yet? Detailing the status of each WebAPI effort
In today's development world, browsers have evolved from being simple tools to display web content to being fully-fledged read and write development tools. Modern in-built tools allow developers to not only see the source code, but also modify it live in the browser, measure what is being shown and seeing the impact their work has in the browser in terms of performance.
Debugging our web code has evolved from trial and error to live code editing, measuring the impact we have and being able to inject code to try out changes without having to re-build the site and risk breaking the experience of our end users during development.
Mozilla was the pioneer in this area, with Firebug being the extension to Firefox that made it a developer browser rather than just a way to display the web. All other browsers copied that model and created in-build developer tools that allow all kind of interaction and measuring.
The Firefox Developer Tools differ slightly from the tools shipped with Safari, Chrome or Internet Explorer as they are not a single "debugging suite" but consist of several components that each do one job and one job well, to be turned on and off on demand by developers depending what they are currently trying to achieve.
The different parts of the developer tools are explained in detail with screencasts and usage examples on their Wiki page, but here is a quick reminder what each of them mean:
- Page Inspector is the main tool to inspect what is on the screen, you can see the HTML, which CSS has been applied and what the browser did to render the element. You also get insight into all the available properties and can edit all of them live in the browser. If you don't know why something does not display correctly, this will give you the information you need.
- Style Editor - is the main tool to manipulate the style sheets loaded into the document. You can turn them on or off and modify them without a page rebuild or reload.
- Network Monitor gives you insight into everything that happened during loading of the current document and what subsequently goes in and out. A great insight to find out why the page isn't coming in as snappy as it should.
- Shader Editor allows you to debug WebGL shaders live in the browser
- Remote Debugging allows you to debug sessions on a mobile device and taking advantage of the more convenient interfaces on your desktop. Tap on things on the phone, measure what happened on the desktop.
- Firefox OS Simulator is a fully-fledged simulation of a FirefoxOS device on your desktop. Not all WebAPIs are available in the simulator but it should get you going quickly.
- Responsive Design View is a great way to see your product in different screen resolutions without having to resize the browser. You still have the whole screen size to see the debugging tools whilst seeing what end users would see on a smaller device.
- Browser Console - is similar to the Web Console but also gives you insight into the inner workings of Firefox. This is useful for Firefox debugging.
- Developer Toolbar is a command line interface to all the other development tools. You can interact with them on a code level which is great for plain keyboard users and automated scripting.
- 3D View is a three dimensional representation of the depth of the DOM of the current document. Great to detect if your HTML is too complex.
- Paint Flashing Tool shows you when the browser is re-painting an element. As repaints are a big performance hit, this tool helps you to un-jank your code.
- Debugging Firefox JS Code allows you to debug the code of the browser itself.
Up-to-date information about Developer Tools can always be found in the Release notes
- Jason Weathersby: Debugging and optimising Canvas performance with Firefox Devtools
Boot to Gecko
Boot to Gecko is a new initiative of Mozilla that is very much in its first steps. It is a direct competitor to closed platforms for development of mobile and desktop applications with the goal to make building applications with open web technology as easy if not much more appealing to developers.