QA/Translation

From MozillaWiki
< QA
Jump to: navigation, search
Feature Status Target Dev Lead QA Lead Other Testers QA Status
Translation Infobar Firefox 34 Florian Quèze Bogdan Maris lizzard, madamezou N/A

Intro

New Translation feature provides users from all over the world the ability to translate the webpages from the original language to a specific chosen language. For now Translation infobar supports only Bulgarian, Chinese, Czech, Dutch, English, French, German, Japanese, Korean, Norwegian, Polish, Portuguese, Russian, Spanish, Turkish, Vietnamese as target and source languages.

References:

Testing Approach

For Translation we are testing each language in order to see if the webpages are translated properly. Change the languages to translate to and watch for inconsistency in the translation and functionality of translation options.

  • The translation infobar should be an infobar with the following features:


It displays the webpage's language in a language drop-down, pre-selected to the language detected. Has a Translate and Not Now buttons, and an Options menu-popup button

Translation infobar3.png


Allows the user to correct this detection by choosing another language from the drop-down.

Choose language original language3.gif


Doesn't go away when Translate is clicked. Instead, it switches to "Translating webpage" and triggers the translation service.

Translation in action3.gif


Displays success or error information on completion

Translated page3.png Translation error3.png


  • We wanted to promote the translation feature for users, to make it more likely to be found and understand so we added a new doorhanger that pops the first time translation infobar is activated. Clicking on 'Learn More.' you will be redirected to SUMO webpage where you can find out more about this feature.

Here is a image showing the doorhanger:

Learn More Translation.png

  • For now only a few languages are supported for detected languages:
    • Bulgarian, Chinese, Czech, Dutch, English, French, German, Japanese, Korean, Norwegian, Polish, Portuguese, Russian, Spanish, Turkish, Vietnamese.
  • The languages that we translate into:
    • Bulgarian, Chinese, Czech, Dutch, English, French, German, Japanese, Korean, Norwegian, Polish, Portuguese, Russian, Spanish, Turkish, Vietnamese.

Requirements

On Nightly (36) there will be required two prefs in order for translation to work:

Open about:config and click on "I'll be careful, I promise!" button

  • Set:
    • browser.translation.detectLanguage to true
    • browser.translation.ui.show to true
  • Create:
    • browser.translation.bing.apiKeyOverride (right click -> New -> String) set to J5dY1fzkZwQP2Mq56ssXFF/G0dwrscNmCjSgaxl0CNE=
    • browser.translation.bing.clientIdOverride (right click -> New -> String) set to TestFirefox

One and Done tasks

One and Done tasks currently is a link to MozTrap and is set up for people to test on Aurora. https://oneanddone.mozilla.org/en-US/tasks/55/

MozTrap tests

Automated tests are available here

Bug work

  • All bugs:
Full Query
ID Summary Priority Status
971043 Implement document walker to grab webpage's text content and format it for translation service -- VERIFIED
971044 Implement translation infobar -- NEW
971045 Breakdown: Translation infobar styling for all 3 OSes -- VERIFIED
971047 Import the CLD language detection library -- VERIFIED
971048 Run language detection on webpages and display infobar when language is not the current UI locale -- VERIFIED
971052 Cache detected language on SS data to avoid re-running detection -- RESOLVED
971053 Get required strings for translation pilot -- RESOLVED
971054 Create translation module -- VERIFIED
973282 Option to close Translation Infobar -- VERIFIED
973283 Option to correct wrongly detected language upon initial page load -- VERIFIED
973284 Option to change the language to translate to from my default language -- VERIFIED
973285 Option to select “translate” -- VERIFIED
973286 Option to “not translate” -- VERIFIED
973434 Feature Breakdown - Bug 973294 -- VERIFIED
973435 Feature Breakdown - Bug 973293 -- VERIFIED
973437 Feature Breakdown - Bug 973292 -- VERIFIED
974460 Add translation icon to URL bar structure -- VERIFIED
974461 Display translation icon at the same time as the translation infobar -- VERIFIED
974477 Ensure that QA has access to translation metrics -- RESOLVED
974521 Create Translation icon(s) -- VERIFIED
974527 Clicking translation icon in URL bar shows translation infobar -- VERIFIED
974538 Create "Error Translating" infobar for Automatic Translation -- VERIFIED
974587 Create "Translation in Progress" infobar for Automatic Translation -- VERIFIED
974591 Calculate status of Translation in Progress for Automatic Translation -- RESOLVED
976542 Create "Translated" state infobar for Automatic Translation -- VERIFIED
976545 Implement dropdowns with language list in Translation Infobar -- VERIFIED
976552 Add "View Original" content toggle button to "Translated" state infobar for Automatic Translation -- VERIFIED
976554 Replace content of webpage's text nodes with translation content (or back to original) -- VERIFIED
976556 Parse translation results back into our data structure -- VERIFIED
976557 Fade translation/original text when replacing it -- NEW
976571 Translation infobar option to report language detection problem -- RESOLVED
976573 Implement "Options" dropdown in translation infobar -- VERIFIED
976574 Implement "Translation Preferences" option in infobar -- VERIFIED
976751 Spec the UI and functionality for Infobar error state -- VERIFIED
977730 Count total pages visited by all test users -- VERIFIED
977768 Story Breakdown - Count total pages visited by all test users -- VERIFIED
977770 Count the times users manually adjust the offered translation pair -- VERIFIED
977774 Count the number of times a user opts out of Instant Translation -- RESOLVED
977806 Story Breakdown - Trial audiences for translation add-on -- VERIFIED
977807 Story Breakdown - Control audiences for translation add-on -- VERIFIED
977808 Story Breakdown - End of trial period for translation add-on -- VERIFIED
977813 Verify if FHR Already Collects the Data -- VERIFIED
978158 Set up client FHR reporting for Translation project -- VERIFIED
979424 Implement structure and state switching for translation infobar -- VERIFIED
980513 [translation] Determine best method to serve translation to a fraction of Beta audiences -- VERIFIED
980514 [Translation] Develop remote way to disable translation pilot -- VERIFIED
980516 Implement best method to serve translation add-on to fraction of Beta population -- RESOLVED
987522 Improve localizability of translation infobar -- VERIFIED
988275 Choosing the same language in Translation Infobar will attempt to translate -- VERIFIED
988297 Language is changed if up/down arrow keys are used while translation infobar displays the error message -- VERIFIED
988336 Firefox attempts to translate again the webpage when hitting enter key even if no button is highlighted -- VERIFIED
988478 [UX] Create Translation Infobar styled for Windows -- VERIFIED
988479 [UX] Create Translation Infobar styled for Linux -- VERIFIED
989310 Provide Web authors a way to disable the translation bar entirely or partially -- NEW
989321 Detect available translations using <link rel="alternate" hreflang="x"> instead of showing machine translation -- NEW
990633 Implement arrow pointing from the translation info bar to the URL bar icon -- NEW
994037 Translation infobar can be placed in the wrong tab -- VERIFIED
997806 Language not detected if the content is in subframes -- NEW
997818 Infobar is not displayed as long as the throbber is still present in the tab -- NEW
1003117 verify if the omni.ja size increase due to cld.js and cld.js.mem causes startup performance issues -- VERIFIED
1003118 check the impact of running language detection on page load times -- VERIFIED
1003120 measure resident memory use of CLD after startup -- VERIFIED
1003125 compare the size of the emscripten'ed CLD with the native binary -- VERIFIED
1006379 JS error in language detection code when closing a tab that's still loading -- VERIFIED
1008195 Clicking on the notification icon should toggle the translation infobar -- VERIFIED
1008224 Implement translation infobar tweaks to allow for better display in smaller browser windows -- ASSIGNED
1009481 add a preference to completely hide the translation feature -- RESOLVED
1009832 Breakdown - Fade translation/original text when replacing it -- NEW
1011588 [UX] Create animated translation icon for "Translation in Progress" infobar -- VERIFIED
1012519 Re-translation should use original content instead of newly translated content -- VERIFIED
1012522 Split TranslationItem in chunks if necessary -- NEW
1012530 Reorder child nodes when swapping document state -- VERIFIED
1012532 Replace translation engine usage of RESTRequest with Http.jsm -- RESOLVED
1012533 Translation root inside root shouldn't be stringfied twice -- VERIFIED
1012535 Handle "service unavailable" errors -- VERIFIED
1012938 Translation code throws error if pref is enabled and you're using a build without translation -- RESOLVED
1013374 Optimize display timing of translation infobar and icon -- NEW
1013537 Implement animated translation icon for "Translation in Progress" infobar -- VERIFIED
1013861 Implement runtime switch to disable translation UI -- VERIFIED
1013891 Move pref and message-manager strings to constants -- RESOLVED
1013915 Clean up module imports/ dependencies and use lazy getters where possible -- VERIFIED
1013963 Changing language to translate to does not automatically translate after a previous translation was made -- RESOLVED
1013992 Show Original language is changed after translating once and retranslating into another -- RESOLVED
1014007 Error of translation is thrown after about 10 minutes -- VERIFIED
1014022 Hang after selecting more languages to translate to and toggle Show Original/Show Translation -- VERIFIED
1014367 API key support for translation -- VERIFIED
1014562 make the native CLD work well enough to compare memory use in realistic scenarios -- NEW
1014598 Some words can be multiplied upon translation -- VERIFIED
1014672 & character translated to &amp; -- VERIFIED
1015521 Make translation provider use available API key -- VERIFIED
1015525 Translation FHR should record the state of the translation prefs -- VERIFIED
1015527 Back/Forward navigation shouldn't break the Translation UI -- VERIFIED
1015535 Comment nodes shouldn't be considered for translation -- VERIFIED
1015933 Improve translation tests -- NEW
1016342 build translation by default -- VERIFIED
1016355 [UX] Create Translation Infobar styled for Mac (Chameleon) -- RESOLVED
1016367 Package @2x translation icons on Windows and Linux -- VERIFIED
1017560 Choosing the same language will modify the state of Show Translation button -- VERIFIED
1018976 'Translating page content...' info placed wrong in the infobar -- VERIFIED
1018981 Language to translate to box has the same colour as the infobar and up/down arrows are missing -- VERIFIED
1019731 Write test to ensure values are passed as expected to the provider used by TranslationHealthReport -- RESOLVED
1021650 Investigate if tweaking the asm.js heap size can actually save some of the memory used by cld-worker.js -- REOPENED
1021921 Story Breakdown - [Translation] Launch pre-trial of instant translation -- VERIFIED
1022405 Not enough padding on OSX translation infobar -- VERIFIED
1022411 Build Telemetry Experiment for German translation trial -- VERIFIED
1022413 Update list of languages supported by automatic translation -- RESOLVED
1022640 the Translation UI disappears when tearing off a tab -- VERIFIED
1022725 Create a mock httpd.js Translation provider for tests -- RESOLVED
1022729 Tests for the translation engine -- NEW
1022856 implement translation provider attribution -- VERIFIED
1023247 Same page translated multiple times in the same session does not output accurate translation -- RESOLVED
1023311 translation.manifest needs to be packaged -- VERIFIED
1024366 Extra Show Translation button in translation infobar -- RESOLVED
1024757 Translation opportunity FHR should include languages not in the supported list -- VERIFIED
1025485 Translation feature does not work at all -- RESOLVED
1025873 Strange behavior after wrapping elements into a dropdown box -- NEW
1027024 Never translate 'language' disappears when close/open translation infobar using a expired key -- VERIFIED
1028370 I cannot change Default target language . I want to translation default target language different from Firefox UI language. -- RESOLVED
1028942 The 'Translate' button's border looks blurry on Mac -- VERIFIED
1029363 browser_translation_fhr.js fails if it runs on its own -- RESOLVED
1029486 "TypeError: can't access dead object" at TranslationContentHandler.jsm:91 -- RESOLVED
1030074 Intermittent browser_translation_fhr.js | 1 == 2 - JS frame :: .../browser_translation_fhr.js :: MetricsChecker.checkAdditions< :: line 62 P3 NEW
1030739 [hidpi] translation provider image is cut on the bottom -- NEW
1031683 Implement design changes to translation provider attribution in options menu -- NEW
1031684 Implement design changes to translation provider attribution in preferences -- NEW
1032139 Make the 'Translations by' string localizable -- VERIFIED
1035333 Build Telemetry Experiment for Vi/Pl/Tr translation trial on beta -- RESOLVED
1035337 Measure number of times infobar is hidden due to "Never translate this language/site" -- VERIFIED
1036385 Dropdown elements don`t always stick back to infobar on a touch device -- NEW
1038493 Translation experiment should wait 5 days before activating treatment group -- RESOLVED
1041314 translation bar will block other tips -- NEW
1041598 QA experiment for Vi/Tr/Po translation trial on beta -- VERIFIED
1041643 There has been an error translating this page embedded translator -- RESOLVED
1041826 Intermittent browser_translation_fhr.js | This test exceeded the timeout threshold. It should be rewritten or split up. -- RESOLVED
1042728 [Translation Experiment] container string and telemetry toolbar not translated for vi -- NEW
1045682 automate translation quota tracking -- RESOLVED
1046142 Empty language to translate to drop down on localized builds -- VERIFIED
1046143 Non-localized infobar on Vi Firefox 32 beta build -- VERIFIED
1046785 Infobar does not get trigger -- RESOLVED
1046788 error while translating the content -- RESOLVED
1051135 Intermittent browser_translation_fhr.js | Uncaught exception at .../browser_translation_fhr.js:12 - Error: Getting metrics around midnight may fail sometimes and another -- RESOLVED
1057458 Submit buttons and input placeholders aren't translated -- NEW
1060692 https://www.google.fr does not trigger the infobar -- RESOLVED
1060713 No "charactersTranslatedCount" found in Mozrtrap testcase 14014 for the "Test the translation infobar in Nightly" -- NEW
1063735 "This page has been translated from" message does not behave consistently -- RESOLVED
1065043 Translation module only translates headlines -- RESOLVED
1066170 Translating a page always shows error -- RESOLVED
1067011 [Translation][i18n] label="&translateWebPages.label;." have an unnecessary point -- NEW
1071252 translation component fails in new tabs in Aurora -- RESOLVED
1072740 Translation - Implement doorhanger for in-product promotion -- VERIFIED
1072741 Build Telemetry Experiment for Spain/Argentina translation trial on beta -- RESOLVED
1072742 Add more language targets for translation -- VERIFIED
1072743 Get Es/Vi/Pl/Tr strings for bug 1072740 -- RESOLVED
1079559 consider adding an FHR probe for the value of the welcomeMessageShown preference -- RESOLVED
1081296 Translation - Add sumo link for promotional doorhanger -- VERIFIED
1082207 QA experiment for es-ES/es-AR translation trial on beta -- VERIFIED
1090529 Error handling should handle lack-of-valid-key error as Service Unavailable -- RESOLVED
1093574 browser.translation.ui.show should be available as a button in the translation toolbar -- UNCONFIRMED
1109496 Do not take the correct spell of the mozilla P5 RESOLVED
1118474 Intermittent browser_translation_exceptions.js | application timed out after 330 seconds with no output P3 NEW
1129056 Implement Yandex translation engine -- RESOLVED
1153509 Translation notification bar pushes Navbar/FindBar tool button when open Sidebar -- RESOLVED
1157478 translation exceptions dialog has duplicate ids -- NEW
1174468 Firefox shows Microsoft logo in preferences with Yandex set as translation engine -- RESOLVED
1191306 Various translation tests are going to permafail when Gecko 42 merges to Aurora -- VERIFIED
1214345 The translation "notification" anchor should focus its infobar when used -- NEW
1246369 Intermittent e10s browser_translation_telemetry.js | This test exceeded the timeout threshold. It should be rewritten or split up. P5 NEW
1248501 Allow fuller use of the CLD2 API from LanguageDetector.detectLanguage -- RESOLVED
1255292 Intermittent e10s browser_translation_yandex.js | application timed out after 330 seconds with no output P5 NEW
1273073 Intermittent browser_translation_infobar.js | application timed out after 330 seconds with no output P3 NEW
1281585 Intermittent browser/components/translation/test/browser_translation_telemetry.js | application timed out after 330 seconds with no output P2 RESOLVED
1282645 Intermittent browser/components/translation/test/browser_translation_exceptions.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. - P2 RESOLVED
1282646 Intermittent browser/components/translation/test/browser_translation_telemetry.js | Test timed out - P2 RESOLVED
1308021 cld2 uses wrong Hebrew ISO 639-1 code -- RESOLVED
1311349 Enable eslint of browser/components/translation/ -- RESOLVED
1316953 Intermittent browser/components/translation/test/browser_translation_infobar.js | timeout waiting for the info bar to reappear - -- NEW
1342587 Intermittent browser/components/translation/test/browser_translation_exceptions.js | A promise chain failed to handle a rejection: - The operation was aborted. -- RESOLVED
1374446 Intermittent browser/components/translation/test/browser_translation_yandex.js | A promise chain failed to handle a rejection: can't access dead object P5 NEW
1374472 Intermittent browser_translation_yandex.js | A promise chain failed to handle a rejection: can't access dead object -- RESOLVED
1377729 Intermittent browser/components/translation/test/browser_translation_exceptions.js | Unexpected Exception: TypeError: PopupNotifications.getNotification(...) is null - -- RESOLVED
1387666 Intermittent browser/components/translation/test/browser_translation_exceptions.js | Test timed out - P5 RESOLVED
1411181 Intermittent browser/components/translation/test/browser_translation_telemetry.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. - P5 NEW
1450571 Remove translation code -- RESOLVED
1450812 Convert translation-infobar.xml to a JS module P2 RESOLVED
1476513 add moz.yaml and license to vendored cld2 library P5 NEW
1479190 Intermittent browser/components/translation/test/browser_translation_exceptions.js | Unexpected Exception: TypeError: notif._getAnonElt is not a function - P5 RESOLVED
1486157 Translation image broken in preferences -- RESOLVED
1488232 Add support for using the Google Translation API -- RESOLVED
1495843 Intermittent browser/components/translation/test/browser_translation_exceptions.js | Test timed out - P5 RESOLVED
1496403 [meta] Translation Shield study -- NEW
1501440 Value of "browser.translation.engine" is case sensitive -- RESOLVED
1504731 BingTranslator.jsm refers to an outdated API endpoint P5 NEW
1508933 Add support for using the Baidu Translation API P5 NEW
1519697 Page translation function not works after version FX 63 (Not add-ons) -- RESOLVED
1544306 Update UI to match new PopupNotification spec P3 NEW
1579740 translate webcontent does not work -- UNCONFIRMED

196 Total; 42 Open (21.43%); 62 Resolved (31.63%); 92 Verified (46.94%);

  • Fixed; may need verification:.
Full Query
ID Summary Qa contact Status Resolution Qa whiteboard
977774 Count the number of times a user opts out of Instant Translation RESOLVED FIXED [qa-]
980516 Implement best method to serve translation add-on to fraction of Beta population RESOLVED FIXED No cf_qa_whiteboard
1012532 Replace translation engine usage of RESTRequest with Http.jsm RESOLVED FIXED No cf_qa_whiteboard
1019731 Write test to ensure values are passed as expected to the provider used by TranslationHealthReport RESOLVED FIXED No cf_qa_whiteboard
1022413 Update list of languages supported by automatic translation RESOLVED FIXED No cf_qa_whiteboard
1022725 Create a mock httpd.js Translation provider for tests RESOLVED FIXED No cf_qa_whiteboard
1029363 browser_translation_fhr.js fails if it runs on its own RESOLVED FIXED [qa-]
1029486 "TypeError: can't access dead object" at TranslationContentHandler.jsm:91 RESOLVED FIXED No cf_qa_whiteboard
1035333 Build Telemetry Experiment for Vi/Pl/Tr translation trial on beta RESOLVED FIXED [qa-]
1045682 automate translation quota tracking RESOLVED FIXED [qa-]
1072741 Build Telemetry Experiment for Spain/Argentina translation trial on beta Bogdan Maris [:bogdan_maris], Release Desktop QA RESOLVED FIXED No cf_qa_whiteboard
1072743 Get Es/Vi/Pl/Tr strings for bug 1072740 RESOLVED FIXED No cf_qa_whiteboard
1090529 Error handling should handle lack-of-valid-key error as Service Unavailable RESOLVED FIXED No cf_qa_whiteboard
1129056 Implement Yandex translation engine RESOLVED FIXED No cf_qa_whiteboard
1153509 Translation notification bar pushes Navbar/FindBar tool button when open Sidebar RESOLVED FIXED [good first verify]
1174468 Firefox shows Microsoft logo in preferences with Yandex set as translation engine RESOLVED FIXED No cf_qa_whiteboard
1248501 Allow fuller use of the CLD2 API from LanguageDetector.detectLanguage RESOLVED FIXED No cf_qa_whiteboard
1308021 cld2 uses wrong Hebrew ISO 639-1 code RESOLVED FIXED No cf_qa_whiteboard
1311349 Enable eslint of browser/components/translation/ RESOLVED FIXED No cf_qa_whiteboard
1387666 Intermittent browser/components/translation/test/browser_translation_exceptions.js | Test timed out - RESOLVED FIXED No cf_qa_whiteboard
1486157 Translation image broken in preferences RESOLVED FIXED [good first verify]
1488232 Add support for using the Google Translation API RESOLVED FIXED No cf_qa_whiteboard

22 Total; 0 Open (0%); 22 Resolved (100%); 0 Verified (0%);

  • Unconfirmed bugs:
Full Query
ID Summary Qa contact Status Resolution Qa whiteboard
1093574 browser.translation.ui.show should be available as a button in the translation toolbar UNCONFIRMED No cf_qa_whiteboard
1579740 translate webcontent does not work UNCONFIRMED No cf_qa_whiteboard

2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);

Sign-offs

Beta.png Beta sign-offs

Release.png Release sign-offs