Auto-tools/Projects/Mozregression

mozregression

Introduction

mozregression is an interactive regression range finder for Mozilla nightly and inbound builds. It uses a binary search algorithm for quickly determining a changeset range corresponding to when a problem was introduced. It is widely use by Mozilla developers and other community members to help find regressions.

To get a feel for how mozregression works, see the video on codefirefox.com: http://codefirefox.com/video/mozregression

Homepage: http://mozilla.github.io/mozregression/

Active contributors

These people are actively working on mozregression and good people to ask questions of (or for review):

• William Lachance
• Julien Pagès

How to setup for development

See https://github.com/mozilla/mozregression.

Issue / feature tracking

We track mozregression bugs and feature requests inside bugzilla, in the Testing / mozregression component.

Full Query

ID	Summary	Priority	Status
997395	Allow installing addons from a nightly location	--	NEW
1084189	Cannot use IME on Nightly builds which are launched by mozregression	--	NEW
1192488	mozregression GUI installer needs admin privileges	--	NEW
1197106	Add some non regression tests for mozregression	--	NEW
1210046	Android builds should always behave the same way when doing A/B testing	--	NEW
1217443	using the skip feature is quite confusing	--	NEW
1231950	Ship (or use Desktop Fx) Android ADB with mozregression	--	NEW
1232037	Output results in machine-readable format (json?)	--	NEW
1232877	Option to check a date range prior to a certain build	--	NEW
1233339	We may need a panel to show which build has been downloaded	--	NEW
1233909	mozregression should go back further than one year for some 64-bit debug js shells	--	NEW
1234029	use debug builds from archives.m.o	--	NEW
1235020	[gui] final result log output worthless	--	NEW
1235127	[gui] Mozregression sometimes fails to continue bisection in mozilla-inbound builds	--	UNCONFIRMED
1235260	[gui] Mozregression incorrectly sets day if I paste date string after selecting text from end to beginning	--	REOPENED
1236101	[meta] Bugs that block autoBisect from using mozregression	--	NEW
1237057	Have a link to the mozregression-gui.exe binary on the mozregression homepage	P3	NEW
1239150	Support dynamic extend reproduce range	--	UNCONFIRMED
1241358	[gui] remember "bits" choose, or take the default value ​​from the configuration file	--	NEW
1241365	[gui] show ~* steps left on interface	--	NEW
1241376	[gui] Progress list should scroll to the last item when it overflows	--	NEW
1241380	[GUI] be able to load and display a previous run	--	NEW
1241919	HTTP proxy support	--	NEW
1245283	mozregression and mozregression-gui aren't using the requested profile on windows 10	--	NEW
1245587	Make Android API changes simpler for mozregression to handle	--	NEW
1246086	[gui] Preselect profiles folder when you click on 'browse'	--	NEW
1246142	The --pref command line parameter goes silently ignored in some cases	--	NEW
1246383	[gui] Mark downloaded package on Build verdict window ('skip' action)	--	NEW
1246891	[gui] Allow set days of ApproxPersistChooser in Run a single build	--	NEW
1246903	Add a 'go to build...' action to other menu	--	UNCONFIRMED
1247061	Reusing connections to improve performance	P5	UNCONFIRMED
1248138	[gui] Allow redownload if download is interrupted or "ERROR : Unable to install"	--	NEW
1248239	[GUI] allow to check the builds of the initial range, as we do in the CLI	--	NEW
1248636	[gui] Options description is hard to find in Global preferences	--	NEW
1248690	[gui] View the parameters in "Bisecting on" details	--	UNCONFIRMED
1248767	[gui] Current build closes after 3 minutes if I restart browser (in different e10s state or with add-ons disabled/enabled)	--	NEW
1249737	Mozregression lost when a build fails to start	--	NEW
1256317	Error while trying to bisect fennec builds	--	NEW
1256379	Automatic bug number selection chose the wrong bug from an inbound range with a backout	--	NEW
1256445	mozregression does not allow to execute other mach commands	--	NEW
1258166	[gui] Support save as default and clear button to custom preferences and custom addons	--	UNCONFIRMED
1258688	[gui] Mozregression doesn't store values of some fields ("profile", "search for fix") when I switch back and forth between forms	--	NEW
1258831	[gui] Mozregression displays crash error when I try to close single build (clone-first) using X button	--	NEW
1260985	Update Linux debug jsshell earliest known working builds to 2015-07-31	--	NEW
1263361	Exception in thread when hitting error ResourceNotFound 404	--	REOPENED
1270893	mozregression "To resume, run..." command goes nuts if it finds nested double/single quotes	--	NEW
1275499	TypeError: unsupported operand type(s) for -: 'datetime.date' and 'datetime.datetime'	--	NEW
1277888	mozregression --build-type fennec doesn't work	--	NEW
1281790	mozregression shouldn't output bug numbers when there are too many possibilities	--	NEW
1306661	doesn't recover from temporary interruptions to Internet connection	--	UNCONFIRMED
1308028	out of disk space not handled well (ambiguous error, no way to recover or retry)	--	UNCONFIRMED
1308417	Mozregression drops bookend integration revisions on the floor	--	NEW
1311474	Mozregression fails to run with pkg_resources.DistributionNotFound: colorama	--	NEW
1320322	mozregression should know about earliest Thunderbird build	--	NEW
1323445	Mozregression should not identify a specific commit if there are multiple commits in the final range	--	NEW
1327383	Mozregression GUI doesn't withstand disabling internet connection with background downloads enabled	--	NEW
1327595	Mozregression GUI somehow can't subtract date from buildID during bisection	--	NEW
1327668	[gui] If I doubleclick on "Bad" button in Mozregression - it marks BOTH builds as bad	--	NEW
1327669	[gui] It's possible to accidentally start background download after quick cancellation	--	NEW
1334853	mozregression --launch BUILDID used near-build instead of exact	--	UNCONFIRMED
1334856	mozregression can't handle restarted firefox	--	UNCONFIRMED
1339492	Mozregression fails to launch OSX builds older than 2016-07-12	--	NEW
1350527	DownloadInterrupt should be processed	--	NEW
1350530	'Retest' button on past items	--	NEW
1351290	Bisecting mozilla-release with dates 2016-03-19 -> 2017-03-19 doesn't seem to work on (at least) win32	--	NEW
1362127	Add option for just getting commit range for two dates without downloading / testing builds	--	NEW
1365479	[gui] List recent used downloaded builds for Run a single build	--	NEW
1366570	mozregression installers and executables for windows and mac are not signed	--	NEW
1381319	[gui] Unreadable text depending on system theme	--	UNCONFIRMED
1394911	Add option to not launch Firefox	--	NEW
1394919	Add option to download binaries from final release	--	NEW
1395905	Allow reusing builds which were used recently	--	NEW
1398903	Provide standalone APK version of mozregression GUI and mozregression for Android	--	NEW
1401503	Launcher error in mozregression GUI 0.9.13	--	NEW
1407089	Add support for reading prefs from a JS file	--	NEW
1407430	Unable to find regression range between two specific date	--	NEW
1408696	mozregression can't verify the revisions it itself produced	--	NEW
1427371	mozregression just ran entirely the wrong build for me!	--	NEW
1439887	On small initial window, input verification is skipped	--	NEW
1458834	Retrying a build takes ages	--	NEW
1460596	[gui] Ability to save bisection session & log	--	NEW
1465145	bisecting API 11 fennec on API15 Android devices isn't working	--	UNCONFIRMED
1470495	Clean up obsolete branches and add some other ones	--	NEW
1477781	Incorrect regression range points to wrong bug	--	ASSIGNED
1477784	"Bisection informations" should say "Bisection information"	--	NEW
1478217	Bisection stuck in infinite loop	--	NEW
1484531	mozregression cannot find/use OpenSSL (libssl.so.1.0.0)	--	UNCONFIRMED
1484533	Provide virtualenv for cli	--	UNCONFIRMED
1485981	Mozregression for x86 devices	--	NEW
1487262	mozregression only outputs the topmost commit in a push.	--	NEW
1488907	Unexplained long pause before launching a Firefox instance	--	NEW
1499595	add option for downloading in background	--	NEW
1502956	Test changeset for regression	--	NEW
1503358	mozregression-gui crash: LookupError: no codec search functions registered: can't find encoding	--	NEW
1504259	Trying to use mozregression with Fennec results in "Permission denied" error	--	NEW
1519138	mozregression-gui: revise the last decision	--	UNCONFIRMED
1520789	Binary path is not getting escaped	--	NEW
1524066	--profile-persistence={clone-first,reuse} do not work on Android	--	NEW
1525283	Please make it possible to resume failed downloads	--	UNCONFIRMED
1536324	Errors running mozregression on Windows	P3	NEW
1544735	Firefox is crashing with builds from around the 2017-07-19	P3	NEW
1548014	mozgregression --arg doesn't work with --app=jsshell	P3	NEW
1550806	"Unable to start the application" when attempting a bisection when parent.lock in profile	P3	REOPENED
1556042	Support Fenix as an app in mozregression	P3	NEW
1558462	jsshell doesn't support testing functions	P3	NEW
1568086	Provide switch to pull only nightly builds/official signed builds	--	NEW
1570650	mozregression should work with esr branches	--	ASSIGNED
1580625	`mach mozregression` should install mozregression into its own dedicated virtualenv	P3	NEW
1604963	Attach mozregression log to related bug	--	NEW
1604965	Allow mozregression to select the range based on a bug in Bugzilla	--	NEW
1604967	Mozregression could set the 'Regressed By' field if a specific commit was found	--	NEW
1604969	mozregression could run test cases added to bugs	--	NEW
1610427	Mozregression should not look for taskcluster builds more than 1 year old	P3	NEW
1615667	mozregression buries its actionable output behind pages of warning-spew, for ranges that are too old for intermediate taskcluster builds	P3	NEW
1622953	mozregression warns about soupsieve not being installed on startup	P3	NEW
1622958	Add a way to specify environment variables on Android	--	NEW
1627626	mozregression cannot be installed on mac os 10.12	P3	NEW
1631163	Updated notification is wrong when mozregression runs from repo	P4	UNCONFIRMED
1631167	mozregression GUI does not sanity check user-specified good/bad builds	P4	UNCONFIRMED
1635680	No option to disable blinking cursor in Mozregression GUI for Mac	--	NEW
1639571	Prevent selecting date before 2004-12	P4	NEW
1647533	mozregression-gui.exe detected as Trojan:Win32/Zpevdo.B	--	NEW
1648260	mozregression should provide a way to intelligently prune my downloaded-builds-cache	--	NEW
1666469	mozregression fails with: OSError: [Errno 30] Read-only file system: '$HOME' on macOS	--	NEW
1680160	Mozregression won't copy my profile	--	NEW
1681265	moregression gui does not work firefox-l10n ja build	--	NEW
1689850	mozregression incorrectly refuses to use profile where lock file exists	--	NEW
1701318	Mozregression GUI: Fontconfig and other issues	--	UNCONFIRMED
1701671	DPI problems with mozregression on Win10	--	ASSIGNED
1713539	mozregression --addon startpage causes: error: Expecting property name enclosed in double quotes	P3	UNCONFIRMED
1714246	Mozregression rejects user-selected dates without warning	P3	UNCONFIRMED
1714682	regression range incorrectly narrowed due to cached builds colliding	P3	NEW
1718280	Release mozregression-gui binary segfaults on start	P3	UNCONFIRMED
1718288	Use uic/rcc instead of pyside2-uic/rcc	--	UNCONFIRMED
1719424	mozregression-gui mostly unreadable in Mac dark mode	P3	NEW
1720277	Improve the documentation how to pass multiple prefs	--	NEW
1720580	Mozregression does not open builds from 2014 or 2015	--	UNCONFIRMED
1731648	Versions are off-by-one	P4	NEW
1731835	mozregression-gui does show icons for minimize, maximize, and close buttons on Linux Ubuntu 20.04	P3	NEW
1736614	regression range incorrectly narrowed to later nightly on same day	P3	UNCONFIRMED
1737729	mozregression fails to used cached build that's not available for download anymore	P4	NEW
1738298	mozregression can't close Firefox on my machine | ERROR: Unable to stop the application (error: kill() got an unexpected keyword argument 'timeout')	--	NEW
1746919	Investigate suspiciously low mach numbers for Linux and Windows	--	NEW
1748456	Support --arg for --app gve	--	UNCONFIRMED
1749215	mozregression problem on Ubuntu 21.10	P3	NEW
1755112	Installing mozregression requirements results in conflict	--	NEW
1755399	Crashes when choosing date for "Last known good/bad build."	--	UNCONFIRMED
1758171	Release list is breaking chronological order	P3	NEW
1759587	mozregression-gui is broken with Qt 5.15.3	--	UNCONFIRMED
1760467	[mozregression] --addon has no effect for WebExtensions without applications.gecko.id in manifest.json	--	UNCONFIRMED
1760826	Support thunderbird-l10n in mozregression	--	NEW
1763188	Make mozregression work with snap builds	--	NEW
1767534	Add Python version to telemetry	--	NEW
1767535	Drop Python 3.6 support	--	NEW
1771121	mozregression cannot launch older Beta builds	P3	NEW
1771664	[mozregression] "ERROR: Unable to install None" after retry	P3	UNCONFIRMED
1773343	Consider using a fallback mechanism to determine source of files	--	NEW
1777554	Add an option to control whether update is disabled	P3	NEW
1780012	dependabot version updates not guessing Python version correctly	P3	NEW
1780781	Add an option to bisect preferences	--	NEW
1781111	[macOS 13] Mozregression can't run any build on macOS ("Firefox Nightly" is damaged and can't be opened)	P3	NEW
1781813	Investigate using alternate method to modify policies before launch	P3	NEW
1782252	Upgrade to PySide6	P2	NEW
1782774	Add Python 3.10 to tests/CI	--	NEW
1783863	Upgrade pytest to fix TypeError when running tests on Python 3.10	--	NEW
1784493	Raspberry Pi4: Mozregression tries to download linux64-opt and fails (linux64-aarch64-opt would be correct)	--	NEW
1785066	automate PyPI releases	--	NEW
1785084	add helper commands to set up local dev environments	--	NEW

168 Total; 168 Open (100%); 0 Resolved (0%); 0 Verified (0%);

Submitting patches

If a bug is not open already corresponding to the bug you want to fix (or the feature you want to add), please file one. After that, please open a github pull request with your code change, and set a flag in bugzilla for it to be reviewed, as described here:

http://ateam-bootcamp.readthedocs.org/en/latest/guide/development_process.html#git-and-github

Please make sure your patch conforms to PEP8 before submitting it.