Auto-tools/Projects: Difference between revisions

Jump to navigation Jump to search

Auto-tools/Projects (view source)

Revision as of 19:29, 31 October 2013

2,271 bytes removed ,  31 October 2013
no edit summary
No edit summary
No edit summary
Line 1: Line 1:
= Automation and Tools Projects =
Welcome to the Automation and Tools Projects Page.


Our projects can be broken up as follows:
We are the people who write the code that enables all our automated test systems (correctness, performance etc) to run. We are continually expanding, upgrading, and inventing new and better ways to do automated quality analysis at Mozilla. Most of our systems run on a per-checkin basis, and at the time of this writing we do roughly 300 checkins a day, and we run hundreds of thousands of tests per checkin, so you can imagine how many times our code gets run.  If you like the idea of that kind of a challenge, we could use your help on some of the projects below. If you don't know how to get started, feel free to hop on irc (irc.mozilla.org), into the channel #ateam and ask some questions.


*Performance - Projects surrounding measurement of performance
== The Goals ==
*Web Tools - Projects to build web tools and web UIs for automation frameworks
Every calendar quarter, we figure out how best to support Mozilla's efforts and translate that into a set of goals. Most of our goals these days have tracking bugs. So if you want to directly help us the most, look through those tracking bugs and find a bug you can start hacking on. Ask in #ateam if you need help.
*Automation - Projects to automate some process or create automation frameworks
=== 2013 ===
*Tool Infrastructure - Tool "building blocks" from which we can make other tools
* '''Current Quarter: ''' [[Auto-tools/Goals/2013Q4|2013 Q4]]
* [[Auto-tools/Goals/2013Q3|2013 Q3]]
* [[Auto-tools/Goals/2013Q2|2013 Q2]]
* [[Auto-tools/Goals/2013Q1|2013 Q1]]


Please fill out this table with your best estimates for the projects you are involved in. An explanation of the fields:
== Other Projects ==
Every quarter there are more things we'd like to do than we have time for. Below are some of these projects, broken down by areas and technologies so that you can find something that makes you excited.


*Area - one of the four project areas
=== Firefox OS ===
*Project Name - the project name, and should be a wiki link to a project details page at Auto-tools/Projects/<projectname> (See Project Foo below for an example)
The Firefox OS (aka B2G) project is to create an OS for a mobile phone based on the web platform. Our job is to automate that OS so we can ensure a very high quality bar. Building and working with an OS is not for the feint of heart, it is a moving platform where many things change all the time. It's helpful to have very good debugging skills, deep knowledge of JavaScript, working knowledge of Python and some C++/build system internals.
*Owner - The one (or rarely, two) people that own this project.
* [https://wiki.mozilla.org/Auto-tools/Projects/B2G_Automation#Future_milestones Future work we would like to get a jump on]


We have our own [[Auto-tools/Projects/Template|template]] for new projects.
=== Firefox for Android ===
The Firefox for Android project is a continual expansion of our test harnesses to better support the android platform. Currently we only release Firefox on that platform (aka Fennec) but we might also begin testing web apps there in the near future. Familiarity with Android and a great knowledge of python is very useful here.
* Attempt to run our automated tests using the awesome work creating Android emulators in {{bug|910092}}
* Help expand our reach to x86 Android systems by aiding us in debugging and fixing test failures on that platform see the collection of bugs beneath {{bug|891959}}


= Quarterly Goals and Plans =
=== Firefox Desktop and General Automation Support ===
The desktop web browser Firefox continues to be our flagship product and there is always ongoing work needed to ensure that we continue to support the new features that land in Firefox over time. Many of the bugs here are more tractable simply because the test harnesses and tests involved are older code. This is a good spot for first time contributors. These will involve python knowledge and some javascript, depending on the bug.
* [https://bugzilla.mozilla.org/show_bug.cgi?id=916295 Complete the fixes required to deploy Structured Logging]
* [Auto-tools/Automation_Development/Projects/Mozmill_Automation Expanding our QA automation infrastructure to test about-to-release and localized versions of Firefox]


We track our work on SmartSheet in [http://publish.smartsheet.com/3c2af38b8cd9432cb408914049f0a677 one summary sheet] and divided according to our [[Auto-tools/Goals/2012Q4|current goals]]:
=== Performance ===
We also maintain all the systems and the code that perform per-checkin testing on performance. There are many performance automation systems at Mozilla, and one of our current efforts is to pull them under one high level dashboard. Performance will demand a working knowledge of the web, Python, JavaScript, statistics and a great skill at debugging.
* [https://bugzilla.mozilla.org/show_bug.cgi?id=919619 Help out with creating that dashboard.]


* [http://publish.smartsheet.com/c7d781b4221c4bd5aba666a5e3449440 Ensure B2G has all test automation available] to prepare for launch.
=== Dashboards ===
* [http://publish.smartsheet.com/7c69e078ea36494ab14efd2f5becc0e5 Expand and stabilize Test Automation] on new and existing device platforms for NEON and ARMv6 support.
We also create web based tools and dashboards to help illustrate how our automation is doing. [http://datazilla.mozilla.org Datazilla] is a performance dashboarding system, and [http://tbpl.mozilla.org TBPL] surfaces the status of our automation runs.
* [http://publish.smartsheet.com/abc0e42ad2ad41f6bcb372040437095d Create and deploy performance automation] for desktop, fennec, and B2G product benchmarks.
* [https://www.pivotaltracker.com/s/projects/749519 Help create the next version of TBPL, code named Treeherder]
* [http://publish.smartsheet.com/3de1073d2a5a483bb88a8e8b34c009a1 Update our bugzilla instance to 4.2] providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla..
* [https://bugzilla.mozilla.org/show_bug.cgi?id=913726 Help us out with these Datazilla UI papercuts]
* [http://publish.smartsheet.com/a627c3cd949b43e198af6ef5eda18d2e Make the process of sheriffing easier] by updating TBPL and helping make it easier to handle the intermittent test problem.
* [http://publish.smartsheet.com/4be71722fafd4cddacce9b9ca12a8482 Expand and modernize the QA Automation framework] as well as make it easier and more clear how to write automated tests for QA.


= The Projects  =
=== Mentored Bugs ===
 
These bugs are things that we have identified as great starter bugs. Each bug contains a focused technology that is required and a mentor who has volunteered to help out people starting to work on the issue. If you've done a few mentored bugs, talk to your mentors about becoming a mentor yourself!
== General Tools and Automation Frameworks ==
 
{| style="width: 950px" class="fullwidth-table sortable"
|-
| style="font-weight: bold; background: #DDD; width: 100px" | Area
| style="font-weight: bold; background: #DDD; width: 100px" | Project
| style="font-weight: bold; background: #DDD; width: 150px" | Primary Owner
|-
| Performance Measurements
| [[Auto-tools/Projects/Signal_From_Noise|Signal From Noise]]
| jmaher
|-
| Performance Measurements
| [[Auto-tools/Projects/JetPerf|TJetpack]]
| jhammel
|-
| Performance Measurements
| [[Project Eideticker|Eideticker]]
| wlach
|-
| Performance Measurements
| [[Auto-tools/Projects/SpeedTests|Speed Test Framework]]
| mcote
|-
| Web Tools
| [http://datazilla.readthedocs.org Datazilla]
| jeads
|-
| Web Tools
| [http://spade.readthedocs.org Spade (Mobile Evangelism Site-Scraper)]
| ctalbert
|-
| Web Tools
| [[BMO/Pulse|Bugzilla Pulse & Tool Integration]]
| glob
|-
| Web Tools
| [[QA/MozTrap|MozTrap]]
| camd
|-
| Web Tools
| [[Auto-tools/Projects/WarOnOrange|OrangeFactor]]
| edmorley
|-
| Web Tools
| [[Auto-tools/Projects/PublicES|Publicize ElasticSearch]]
| ekyle
|-
| Web Tools
| [[BMO/ChangeNotificationSystem|Bugzilla Change Notification Service]]
| mcote
|-
| Automation
| [[Auto-tools/Projects/Mozmill/Mozmill_2.0|Mozmill 2.0]]
| whimboo
|-
| Automation
| [[Auto-tools/Projects/Robocop|Robocop]]
| jmaher
|-
| Tool Infrastructure
| [[Auto-tools/Projects/Mozbase|Mozbase]]
| wlach, jhammel
|-
| Tool Infrastructure
| [[Auto-tools/Projects/WebUXPlatform|Templeton (Web UX Platform)]]
| mcote
|-
| Tool Infrastructure
| [[Auto-tools/Projects/Marionette|Marionette]]
| jgriffin, mdas
|-
| Tool Infrastructure
| [[Auto-tools/Projects/SUTAgent|SUTAgent]]
| mcote (C++), jmaher (Java)
|-
| Tool Infrastructure
| [[Auto-tools/Projects/AutoPhone|Autophone]]
| mcote
|-
| Tool Infrastructure
| [[Auto-tools/Projects/MozPool|Mozpool]]/[[Auto-tools/Projects/Lifeguard|Lifeguard]]
| mcote
|-
| Tool Infrastructure
| [[Auto-tools/Projects/Pulse|Pulse]]
| jgriffin
|-
| Tool Infrastructure
| [[Auto-tools/Projects/Mochi_Bisector|Mochitest Bisector]]
| ??
|-
| Tool Infrastructure
| [[Auto-tools/Projects/Bisect_in_the_cloud|Bisect In The Cloud]]
| dburns (AutomatedTester)
|-
| Community
| [[Auto-tools/Projects/Powerball|Powerball]]
| dburns/jmaher
|}
 
== Automation Development ==
{{:Auto-tools/Automation_Development/Projects}}
 
= Proposed  =
 
* [[Auto-tools/Projects/Automation Papercuts|Automation Papercuts]]
* [[Auto-tools/Projects/TBPL Autolog|TBPL Autolog]]
 
= \o/ Completed \o/  =
 
*<strike>[[Auto-tools/Projects/BugStats|Bug Stats Websites]]</strike> (existing sites no longer appropriate since switching to release-train process)
*<strike>[[QA/MozTrap|MozTrap]]</strike> (version 1.1 completed and released)
*<strike>JS Reftest suite</strike>
*<strike>Mozmill 1.4</strike>
*<strike>QA Companion Tool </strike>
*<strike>OOPP test infrastructure and NPAPI test suite creation </strike>
*<strike>[[Auto-tools/Projects/Halreftest|GrafxBot]]</strike>
*<strike>[[Auto-tools/Projects/CrossWeave|Crossweave v1]]</strike>
*<strike>Mozmill 1.5</strike>
*<strike>Android Mochitest, Reftest, Js Reftest, Crashtest, Talos</strike>
*<strike>Bug Hunter Initial Rollout</strike>
*<strike>[[Auto-tools/Projects/FennecPT|Fennec Profile Manager]]</strike>
*<strike>[[Auto-tools/Projects/ProfileManager|Desktop Profile Manager Replacement]]</strike>
*<strike>SpeedTest v1 Framework</strike>
*<strike>[http://brasstacks.mozilla.com/toolbox Toolbox]</strike>
*<strike>[[BMO/Updated_Guided_Bug_Entry|Updated Guided Bug Entry]]</strike>
*<strike>[[Auto-tools/Projects/XTalos|Xperf Talos]]</strike>
*<strike>[[BMO/InstantSearch|"Instant" Quick Search]]</strike>
*<strike>[[Auto-tools/Projects/Autolog|AutoLog]]</strike>
*<strike>[[Auto-tools/Projects/BugHunter|Bug Hunter]]</strike>
*<strike>[[Services/Sync/FxSync/Crossweave2|TPS (Crossweave 2)]</strike>
*<strike>[[Auto-tools/Projects/Robocop|Robocop]]</strike>
*<strike>[https://github.com/mozilla/mozdownload mozdownload]</strike>
*<strike>[[Auto-tools/Projects/ManifestDestiny|Manifest Destiny]]</strike>
*<strike>[[Auto-tools/Projects/SpecialPowers Migration|SpecialPowers]]</strike>
*<strike>[[Auto-tools/Projects/RegressionHunter|Mozregression (Regression Hunter)]]</strike>
*<strike>[[BMO#Current_Projects|Bugzilla Native REST API]]</strike>
 
= Big Dreams =
A collection of cool projects that are larger in scope but really awesome ideas [[https://wiki.mozilla.org/Auto-tools/Goals/BigDreams Big Dreams]]
 
= On hold / Quasi-abandoned =
* User Responsiveness
* [[Auto-tools/Projects/AddonStartupPerf|Addon Talos Testing]]
* [[Auto-tools/Projects/W3C CSS Test Mirroring|W3C Test Mirroring]]
* [[Auto-tools/Projects/HTTP Record Replay|HTTP Record/Replay]]
* [[Auto-tools/Projects/TegraPool|TegraPool]]
* [[Auto-tools/Projects/peptest|Peptest]]
Ctalbert
Confirmed users
3,816

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/746972"

Navigation menu