View source for Automationeers Assemble

Automationeers Assemble is a regular gathering featuring a guest and topic relevant to automation engineering.

== How to attend ==
Many gatherings are live streamed [https://www.youtube.com/user/Mozilla/search?query=Automationeers+Assemble on YouTube]

You can also join our Zoom room: [https://mozilla.zoom.us/j/487987164 487-987-164] or dial-in using your [https://zoom.us/u/ac1Q06D5cd local number]

Invitations are sent to the [https://groups.google.com/a/mozilla.com/forum/#!forum/automationeers-assemble automationeers-assemble] Google Group.

== Keeping in touch ==
* Matrix: [https://chat.mozilla.org/#/room/#automationeers:mozilla.org #automationeers]
* Group: [https://groups.google.com/a/mozilla.com/forum/#!forum/automationeers-assemble automationeers-assemble]
* Email: [mailto:automationeers-assemble@mozilla.com automationeers-assemble@mozilla.com]

== Upcoming events ==

== Past events ==

=== Cross Device Automation ===
[[File:irios.png|thumb|140px|left|[https://people.mozilla.org/p/isabelrios Isabel Rios]]]
📅 [https://arewemeetingyet.com/UTC/2020-07-16/12:00/Automationeers%20Assemble:%20Cross%20Device%20Automation July 16th, 2020 (12:00 UTC)]

🎥 [https://www.youtube.com/watch?v=EPStqXsBM2A watch the video]

Isabel will be joining us to share the importance of automated end-to-end functional testing across multiple devices.

<br clear=all>

=== Device Lab Management ===
[[File:Sakarirautainen.jpg|thumb|140px|left|[https://github.com/srautiai Sakari Rautiainen]]]

📅 [https://arewemeetingyet.com/UTC/2020-05-14/18:00/Automationeers%20Assemble:%20Device%20Lab%20Management May 14th, 2020 (18:00 UTC)]

🎥 [https://www.youtube.com/watch?v=qIfL5_IJuAQ watch the video]

Sakari joined us from [https://bitbar.com/ BitBar] to share the challenges of maintaining a comprehensive mobile device lab. He covered a number of topics such as the space requirements and racking, network connectivity, device batteries and charging, monitoring device health, and remote access.

<br clear=all>

=== WebPageTest ===
[[File:Pmeenan.jpg|thumb|140px|left|[https://www.webpagetest.org/ Patrick Meenan]]]
📅 [https://arewemeetingyet.com/UTC/2020-04-16/18:00/Automationeers%20Assemble:%20WebPageTest April 16th, 2020 (18:00 UTC)]

🎥 [https://www.youtube.com/watch?v=hgKsaIGGfMc watch the video]

Patrick provided a walkthrough of WebPageTest.

<br clear=all>

=== Your Tests Lack Vision ===
[[File:Angie Jones.jpg|thumb|140px|left|[http://angiejones.tech/ Angie Jones]]]
📅 [https://arewemeetingyet.com/UTC/2020-03-18/18:00/Automationeers%20Assemble:%20Your%20Tests%20Lack%20Vision March 18th, 2020 (18:00 UTC)]

🎥 [https://www.youtube.com/watch?v=lPz6ZwcmpOw watch the video]

Automation has come a long way in assisting with regression testing efforts. Teams worldwide are successfully running hundreds of functional regression tests at every check-in. While this provides a great source of confidence, critical regression bugs are still missed using this approach. That’s because these tests can only assert on what their human programmer asks them to. Additional errors with functionality, UX, and usability often go uncaught using today’s most common test automation techniques. 

For this reason, the top companies in all sectors of the industry are turning to visual validation. Visual validation is a relatively new concept that can be used to enhance existing automated tests and provide an easy way to perform those difficult checks for things like UX, localization, usability, responsive design, and cross-device testing.

In this talk, you’ll learn how visual validation works, see a live integration into an existing test code base, and discuss the pros and cons of using various visual validation techniques.

<br clear=all>

=== Wikipedia Quality of Experience ===
[[File:Anonavatar.png|thumb|140px|left|Gilles Duboc]]
📅 [https://arewemeetingyet.com/London/2019-09-12/16:00/Automationeers%20Assemble:%20Wikipedia%20Quality%20of%20Experience September 12th, 2019 (15:00 UTC)]

🎥 [https://www.youtube.com/watch?v=KtfOC3zBy3w watch the video]

Gilles joined us from the Wikimedia Foundation to talk about his involvement in a large-scale study of Wikipedia users' quality of experience.

<br clear=all>

=== ActiveData ===
[[File:Klahnakoski.png|thumb|140px|left|Kyle Lahnakoski]]
📅 [https://arewemeetingyet.com/London/2019-08-29/20:00/Automationeers%20Assemble:%20ActiveData August 29th, 2019 (19:00 UTC)]

🎥 [https://www.youtube.com/watch?v=QOhnRK1aTWA watch the video]

The [[EngineeringProductivity/Projects/ActiveData|ActiveData]] service, is a public-facing centralized query service for Mozilla data that is generally gathered from Taskcluster. It includes various data points on things like code coverage, performance metrics, test failure classifications, and the list goes on. Although multiple implementation possibilities exist for a centralized database, they each have their pros & cons, and ActiveData takes advantage of these. In this talk, the components that make up the ActiveData service, why they were chosen, and how they work together will be discussed. The data format and the ActiveData query language will then be presented, as well as some examples of what ActiveData is capable of. Finally, some points on the future directions of this service will be highlighted.

<br clear=all>

=== Interoperability Testing for Firefox ===
[[File:Ksereduck.jpg|thumb|140px|left|[http://kimberlythegeek.com/ Kimberly Sereduck]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Interoperability+Testing+for+Firefox&iso=20190718T13&p1=3773&ah=1 July 18th, 2019 (19:00 UTC)]

🎥 [https://youtu.be/cJ__Ur9Ub9A?t=517 watch the video]

Kimblerly Sereduck joined us to share details on an infrastructure she's developing to automate the detection of crashes in Firefox caused by third-party software, such as antivirus programs.

<br clear=all>

=== Optimizing with Webhint ===
[[File:Brendyn Alexander.png|thumb|140px|left|[https://www.linkedin.com/in/brendynalexander/ Brendyn Alexander]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble:+Optimizing+with+Webhint&iso=20190509T13&p1=234&ah=1 May 9th, 2019 (20:00 UTC)]

🎥 [https://www.youtube.com/watch?v=MRR5HhOMPDQ watch the video]

Brendyn Alexander and John Jansen join us from Microsoft to provide a brief history and overview of webhint focusing on how it can help web developers at various points in the develop-debug-deliver pipeline optimize the sites and apps they build.

<br clear=all>

=== Performance Testing in Chrome ===
[[File:Asullivan.png|thumb|140px|left|[https://anniesullie.com/ Annie Sullivan]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble:+Performance+Testing+in+Chrome&iso=20190425T15&p1=179&ah=1 April 25th, 2019 (19:00 UTC)]

🎥 [https://www.youtube.com/watch?v=KBk15oyr3xQ watch the video]

Annie Sullivan joins us to provide an overview of Chrome's performance testing framework and tooling.

<br clear=all>

=== Customizing your pytest test suite ===
[[File:Rpierzina.png|thumb|140px|left|[https://raphael.codes/ Raphael Pierzina]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Customizing+your+pytest+test+suite&iso=20190312T16&p1=37&ah=1 March 12th, 2019 (15:00 UTC)]

🎥 [https://mzl.la/automationeers-2019-03-12 watch the video]

📝 [https://github.com/hackebrot/earth guest resources]

Raphael provides an introduction into automated testing in Python with [https://irccloud.mozilla.com/pytest pytest], a popular testing framework developed and maintained by a thriving community of volunteers. After looking into how to develop automated tests with pytest, he dives into writing plugins for pytest and explore ideas for potential test suite customizations, that help you and your team manage a growing test suite.

<br clear=all>

=== Task Configuration at Scale ===
[[File:Ahalberstadt.png|thumb|140px|left|[https://ahal.ca/ Andrew Halberstadt]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Task+Configuration+at+Scale&iso=20190214T15&p1=1184&ah=1 February 14th, 2019 (20:00 UTC)]

🎥 [https://onlinexperiences.com/Launch/Event.htm?ShowKey=44908&DisplayItem=E319470 watch the video]

📝 [https://slides.com/ahal/taskgraph guest resources]

Learn about the '''taskgraph''' module and how Mozilla tries to keep task configuration flexible, maintainable and easy to use at a large scale.

<br clear=all>

=== Accessibility Testing with Bubo Eye ===
[[File:Hvilla.png|thumb|140px|left|[https://github.com/hamletv/ Hamlet Villa]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Accessibility+Testing+with+Bubo+Eye&iso=20190117T15&p1=179&ah=1 January 17th, 2019 (20:00 UTC)]

🎥 [https://onlinexperiences.com/Launch/Event.htm?ShowKey=44908&DisplayItem=E317932 watch the video]

'''Bubo Eye''' is a WIP Firefox extension that will improve and automate image content accessibility for screen reader users. Screen readers can access the brief blurb that describes an image with the use of the alt attribute. Bubo Eye will check for text in memes, diagrams, comics, documents, scan it and make that content available to the screen reader user. 

<br clear=all>

=== Adventures in Android Device Testing ===
[[File:Chartjes.png|thumb|140px|left|[https://www.grumpy-learning.com/ Chris Hartjes]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Adventures+in+Android+device+testing&iso=20181114T09&p1=1243&ah=1 November 14th, 2018 (16:00 UTC)]

🎥 [https://mzl.la/auto-assemble-2018-11-14 watch the video]

Chris Hartjes shares his experiences in evaluating and prototyping testing designed to replace a manual testing process for verifying features of Mozilla's push notification service. 

<br clear=all>

=== Performance at Wikimedia ===
[[File:Phedenskog.png|thumb|140px|left|[https://www.peterhedenskog.com/ Peter Hedenskog]]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Peter+Hedenskog&iso=20181025T22&p1=239&ah=1 October 25th, 2018 (20:00 UTC)]

🎥 [https://mzl.la/automationeers20181025 watch the video]

📝 [https://etherpad.wikimedia.org/p/automationeers-assemble guest resources]

Peter is the author of the web performance tool [https://www.sitespeed.io/ sitespeed.io]. He’s a huge fan of open source, and works on the performance team at the [https://wikimediafoundation.org/ Wikimedia Foundation]. He’ll be sharing with us the work they’re doing, what they aim for, how they improved finding regressions, and where they want to be in the next year. Peter is also looking forward to answering your questions. 

<br clear=all>

=== OpenWPM ===
[[File:Senglehardt.png|thumb|140px|left|Steven Englehardt]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Project+OpenWPM&iso=20180913T11&p1=861&ah=1 September 13th, 2018 (15:00 UTC)]

🎥 [https://onlinexperiences.com/Launch/Event.htm?ShowKey=44908&DisplayItem=E301422 watch the video]

'''OpenWPM''' is a web privacy measurement framework which makes it easy to collect data for privacy studies on a scale of thousands to millions of websites. OpenWPM is built on top of Firefox, with automation provided by Selenium. It includes deep instrumentation hooks within a Firefox extension to record HTTP request and response data, Javascript calls, and browser storage access.

OpenWPM is currently a Princeton University project in the process of being migrated to Mozilla. Source and docs are available [https://github.com/citp/OpenWPM here].

<br clear=all>

=== Raptor ===
[[File:Rwood.jpg|thumb|140px|left|Rob Wood]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Project+OpenWPM&iso=20180913T11&p1=861&ah=1 September 13th, 2018 (15:00 UTC)]

🎥 [https://onlinexperiences.com/Launch/Event.htm?ShowKey=44908&DisplayItem=E301422 watch the video]

[[File:Raptor.png|frameless|right]]
'''Raptor''' is a new Firefox performance test framework currently under development. It will be used for the next generation of desktop page-load and benchmark tests, and is based on a browser web extension which is cross-browser compatible. Raptor is currently running on mozilla-central as tier 3 on both Firefox and Google Chrome.

<br clear=all>

=== Iris ===
[[File:Mwobensmith.png|thumb|140px|left|Matt Wobensmith]]
📅 [https://www.timeanddate.com/worldclock/fixedtime.html?msg=Automationeers+Assemble%3A+Project+Iris&iso=20180719T11&p1=1241&ah=1 July 19th, 2018 (18:00 UTC)]

📝 [https://github.com/mozilla/iris guest resources]

'''Iris''' is a new tool that solves some traditional problems in testing UI-driven applications. It uses on-screen bitmap pattern matching, combined with mouse/keyboard input, to create complex interactions normally performed by manual testers. This, along with a simplified test writing model, aims to rapidly automate potentially thousands of test cases that might otherwise not be automatable.

The project is currently in a pre-beta state, but has over 50 test cases. A projected launch of a 1.0 project is slated before the end of the year. The repo and docs are currently under development, but will be contributor-friendly by launch time.