Automationeers Assemble is a regular gathering featuring a guest and topic relevant to automation engineering.
- 1 How to attend
- 2 Keeping in touch
- 3 Upcoming events
- 4 Past events
- 4.1 Wikipedia Quality of Experience
- 4.2 ActiveData
- 4.3 Interoperability Testing for Firefox
- 4.4 Optimizing with Webhint
- 4.5 Performance Testing in Chrome
- 4.6 Customizing your pytest test suite
- 4.7 Task Configuration at Scale
- 4.8 Accessibility Testing with Bubo Eye
- 4.9 Adventures in Android Device Testing
- 4.10 Performance at Wikimedia
- 4.11 OpenWPM
- 4.12 Raptor
- 4.13 Iris
How to attend
Many gatherings are live streamed on YouTube
Invitations are sent to the automationeers-assemble Google Group.
Keeping in touch
- IRC: #automationeers on irc.mozilla.org
- Slack: #automationeers
- Group: automationeers-assemble
- Email: email@example.com
Cross Device Automation
📅 May, 2020
Wikipedia Quality of Experience
Gilles Duboc will be joining us from the Wikimedia Foundation to talk about his involvement in a large-scale study of Wikipedia users' quality of experience.
The ActiveData service, is a public-facing centralized query service for Mozilla data that is generally gathered from Taskcluster. It includes various data points on things like code coverage, performance metrics, test failure classifications, and the list goes on. Although multiple implementation possibilities exist for a centralized database, they each have their pros & cons, and ActiveData takes advantage of these. In this talk, the components that make up the ActiveData service, why they were chosen, and how they work together will be discussed. The data format and the ActiveData query language will then be presented, as well as some examples of what ActiveData is capable of. Finally, some points on the future directions of this service will be highlighted.
Interoperability Testing for Firefox
Kimblerly Sereduck joined us to share details on an infrastructure she's developing to automate the detection of crashes in Firefox caused by third-party software, such as antivirus programs.
Optimizing with Webhint
Brendyn Alexander and John Jansen join us from Microsoft to provide a brief history and overview of webhint focusing on how it can help web developers at various points in the develop-debug-deliver pipeline optimize the sites and apps they build.
Performance Testing in Chrome
Annie Sullivan joins us to provide an overview of Chrome's performance testing framework and tooling.
Customizing your pytest test suite
Raphael provides an introduction into automated testing in Python with pytest, a popular testing framework developed and maintained by a thriving community of volunteers. After looking into how to develop automated tests with pytest, he dives into writing plugins for pytest and explore ideas for potential test suite customizations, that help you and your team manage a growing test suite.
Task Configuration at Scale
Learn about the taskgraph module and how Mozilla tries to keep task configuration flexible, maintainable and easy to use at a large scale.
Accessibility Testing with Bubo Eye
Bubo Eye is a WIP Firefox extension that will improve and automate image content accessibility for screen reader users. Screen readers can access the brief blurb that describes an image with the use of the alt attribute. Bubo Eye will check for text in memes, diagrams, comics, documents, scan it and make that content available to the screen reader user.
Adventures in Android Device Testing
Chris Hartjes shares his experiences in evaluating and prototyping testing designed to replace a manual testing process for verifying features of Mozilla's push notification service.
Performance at Wikimedia
Peter is the author of the web performance tool sitespeed.io. He’s a huge fan of open source, and works on the performance team at the Wikimedia Foundation. He’ll be sharing with us the work they’re doing, what they aim for, how they improved finding regressions, and where they want to be in the next year. Peter is also looking forward to answering your questions.
OpenWPM is currently a Princeton University project in the process of being migrated to Mozilla. Source and docs are available here.
Raptor is a new Firefox performance test framework currently under development. It will be used for the next generation of desktop page-load and benchmark tests, and is based on a browser web extension which is cross-browser compatible. Raptor is currently running on mozilla-central as tier 3 on both Firefox and Google Chrome.
Iris is a new tool that solves some traditional problems in testing UI-driven applications. It uses on-screen bitmap pattern matching, combined with mouse/keyboard input, to create complex interactions normally performed by manual testers. This, along with a simplified test writing model, aims to rapidly automate potentially thousands of test cases that might otherwise not be automatable.
The project is currently in a pre-beta state, but has over 50 test cases. A projected launch of a 1.0 project is slated before the end of the year. The repo and docs are currently under development, but will be contributor-friendly by launch time.