Page MenuHomePhabricator
Create Task
Maniphest T337669

Enable MinT, Content and Section Translation for a 2nd group of 10 languages previously lacking machine translation
Closed, ResolvedPublic
Actions

Description

As machine translation becomes available in more languages with MinT and NLLB-200 models, we want to expose the improved translation tools more broadly to facilitate the creation of content for those communities.

This ticket selects a second set of languages, after T337290, that had no machine translation services available before. This ticket proposes to enable machine transition using MinT, set Content Translation as a default tool, and enable the mobile experience with Section Translation.

As part of this process, we'll generate the template parameter alignments (T221211) for these languages, enable access to the tool in test wiki, and communicate with the different communities to inform them about the changes.

These are the languages selected for this task:

  1. Crimean Tatar (crh/crh_Latn)
  2. Faroese (fo/fao_Latn)
  3. Friulian (fur/fur_Latn)
  4. Ligurian (lij/lij_Latn)
  5. Limburgish (li/lim_Latn)
  6. Lombard (lmo/lmo_Latn)
  7. Silesian (szl/szl_Latn)
  8. Shan (shn/shn_Mymr)
  9. Venetian (vec/vec_Latn)
  10. Waray (war/war_Latn)

Steps:

  • Enable MinT for the selected languages.
  • Enable selected wikis on Test Wikipedia.
  • Enable Section Translation in the selected Wikipedias.
    • Crimean Tatar (crh/crh_Latn)
    • Faroese (fo/fao_Latn)
    • Friulian (fur/fur_Latn)
    • Ligurian (lij/lij_Latn)
    • Limburgish (li/lim_Latn)
    • Lombard (lmo/lmo_Latn)
    • Silesian (szl/szl_Latn)
    • Shan (shn/shn_Mymr)
    • Venetian (vec/vec_Latn)
    • Waray (war/war_Latn)

Next group of languages to enable:
T337834: Enable MinT, Content and Section Translation for a 3rd group of 10 languages previously lacking machine translation

Details

SubjectRepoBranchLines /-
Enable Content and Section translation in Ligurian Wikipediaoperations/mediawiki-configmaster 2 -2
Enable Content and Section Translation for a 2nd group of 9 languages previously lacking machine translationoperations/mediawiki-configmaster 10 -9
Update cxserver to 2023-06-07-044025-productionoperations/deployment-chartsmaster 1 -1
Add template parameter alignments for 17 language pairsmediawiki/services/cxservermaster 0 -0
Remove unused domain mapping for crhmediawiki/extensions/ContentTranslationmaster 0 -1
Update language code for Crimean Tatarmediawiki/services/cxservermaster 1 -3
testwiki: Enable Section Translation for 10 Wikipediasoperations/mediawiki-configmaster 1 -1
Add mapping for crh (Crimean Tatar)mediawiki/services/machinetranslationmaster 1 -0
Update cxserver to 2023-06-01-041016-productionoperations/deployment-chartsmaster 1 -1
Enable MinT for a 2nd group of 10 languages previously lacking machine translationmediawiki/services/cxservermaster 10 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Pginer-WMF triaged this task as Medium priority.May 29 2023, 9:00 AM
Pginer-WMF created this task.
Pginer-WMF moved this task from Needs Triage to MT on the ContentTranslation board.
Pginer-WMF moved this task from Quarter Backlog to Priority: Unified Content & Section Translation on the Language-Team (Language-2023-April-June) board.
Pginer-WMF added a parent task: T330066: Enable Content and Section translation on Wikipedias for languages to be supported by NLLB in the future.
Pginer-WMF mentioned this in T326578: Enable NLLB-200 for languages lacking other Machine Translation options.May 29 2023, 9:02 AM
Pginer-WMF mentioned this in T330066: Enable Content and Section translation on Wikipedias for languages to be supported by NLLB in the future.May 29 2023, 9:08 AM
Pginer-WMF mentioned this in T337290: Enable MinT, Content and Section Translation for 10 languages previously lacking machine translation.
Pginer-WMF moved this task from Backlog to Adding languages on the MinT board.May 29 2023, 1:20 PM
Pginer-WMF mentioned this in T337834: Enable MinT, Content and Section Translation for a 3rd group of 10 languages previously lacking machine translation.May 31 2023, 10:07 AM
Pginer-WMF updated the task description. (Show Details)May 31 2023, 10:11 AM
Pginer-WMF updated the task description. (Show Details)May 31 2023, 10:33 AM
KartikMistry claimed this task.May 31 2023, 11:21 AM
gerritbot added a comment.May 31 2023, 11:28 AM

Change 924913 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/cxserver@master] Enable MinT for a 2nd group of 10 languages previously lacking machine translation

https://gerrit.wikimedia.org/r/924913

gerritbot added a project: Patch-For-Review.May 31 2023, 11:28 AM
KartikMistry moved this task from Priority: Unified Content & Section Translation to In Progress on the Language-Team (Language-2023-April-June) board.May 31 2023, 11:29 AM
gerritbot added a comment.Jun 1 2023, 4:09 AM

Change 924913 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Enable MinT for a 2nd group of 10 languages previously lacking machine translation

https://gerrit.wikimedia.org/r/924913

Maintenance_bot removed a project: Patch-For-Review.Jun 1 2023, 4:10 AM
gerritbot added a comment.Jun 1 2023, 4:47 AM

Change 925298 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2023-06-01-041016-production

https://gerrit.wikimedia.org/r/925298

gerritbot added a project: Patch-For-Review.Jun 1 2023, 4:47 AM
gerritbot added a comment.Jun 1 2023, 5:22 AM

Change 925298 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2023-06-01-041016-production

https://gerrit.wikimedia.org/r/925298

Maintenance_bot removed a project: Patch-For-Review.Jun 1 2023, 5:30 AM
Stashbot added a comment.Jun 1 2023, 5:39 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-01T05:39:50Z] <kart_> Updated cxserver to 2023-06-01-041016-production (T337669)

KartikMistry updated the task description. (Show Details)Jun 1 2023, 5:57 AM
gerritbot added a comment.Jun 1 2023, 6:15 AM

Change 925390 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/machinetranslation@master] Add mapping for crh (Crimean Tatar)

https://gerrit.wikimedia.org/r/925390

gerritbot added a project: Patch-For-Review.Jun 1 2023, 6:15 AM
gerritbot added a comment.Jun 5 2023, 5:00 AM

Change 926833 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] testwiki: Enable Section Translation for 10 Wikipedias

https://gerrit.wikimedia.org/r/926833

gerritbot added a comment.Jun 5 2023, 6:32 AM

Change 925390 abandoned by KartikMistry:

[mediawiki/services/machinetranslation@master] Add mapping for crh (Crimean Tatar)

Reason:

This should be fix in cxserver, not in MinT.

https://gerrit.wikimedia.org/r/925390

gerritbot added a comment.Jun 5 2023, 6:38 AM

Change 927024 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/cxserver@master] Update language code for Crimean Tatar

https://gerrit.wikimedia.org/r/927024

gerritbot added a comment.Jun 5 2023, 7:28 AM

Change 926833 merged by jenkins-bot:

[operations/mediawiki-config@master] testwiki: Enable Section Translation for 10 Wikipedias

https://gerrit.wikimedia.org/r/926833

Stashbot added a comment.Jun 5 2023, 7:28 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-05T07:28:23Z] <kartik@deploy1002> Started scap: Backport for [[gerrit:926833|testwiki: Enable Section Translation for 10 Wikipedias (T337669)]]

Stashbot added a comment.Jun 5 2023, 7:30 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-05T07:30:02Z] <kartik@deploy1002> kartik: Backport for [[gerrit:926833|testwiki: Enable Section Translation for 10 Wikipedias (T337669)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet

Stashbot added a comment.Jun 5 2023, 7:38 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-05T07:38:22Z] <kartik@deploy1002> Finished scap: Backport for [[gerrit:926833|testwiki: Enable Section Translation for 10 Wikipedias (T337669)]] (duration: 09m 58s)

KartikMistry updated the task description. (Show Details)Jun 5 2023, 8:04 AM
gerritbot added a comment.Jun 5 2023, 9:22 AM

Change 927024 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Update language code for Crimean Tatar

https://gerrit.wikimedia.org/r/927024

Maintenance_bot removed a project: Patch-For-Review.Jun 5 2023, 9:30 AM
gerritbot added a comment.Jun 5 2023, 11:11 AM

Change 927144 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/extensions/ContentTranslation@master] Remove unused domain mapping for crh

https://gerrit.wikimedia.org/r/927144

gerritbot added a project: Patch-For-Review.Jun 5 2023, 11:11 AM
UOzurumba updated the task description. (Show Details)Jun 5 2023, 9:35 PM
KartikMistry updated the task description. (Show Details)Jun 6 2023, 1:58 AM
KartikMistry updated the task description. (Show Details)Jun 6 2023, 2:07 AM
KartikMistry added a comment.Jun 6 2023, 4:56 AM

Result of template parameter alignment script run:

sqlite> select count(*) from templates where source_lang='en' and target_lang='crh';
5
sqlite> select count(*) from templates where source_lang='en' and target_lang='fo';
76
sqlite> select count(*) from templates where source_lang='en' and target_lang='fur';
3
sqlite> select count(*) from templates where source_lang='en' and target_lang='li';
3
sqlite> select count(*) from templates where source_lang='en' and target_lang='lij';
8
sqlite> select count(*) from templates where source_lang='en' and target_lang='lmo';
8
sqlite> select count(*) from templates where source_lang='en' and target_lang='szl';
11
sqlite> select count(*) from templates where source_lang='en' and target_lang='vec';
6
sqlite> select count(*) from templates where source_lang='en' and target_lang='war';
9
sqlite> select count(*) from templates where source_lang='crh' and target_lang='en';
4
sqlite> select count(*) from templates where source_lang='fo' and target_lang='en';
7
sqlite> select count(*) from templates where source_lang='fur' and target_lang='en';
0
sqlite> select count(*) from templates where source_lang='li' and target_lang='en';
1
sqlite> select count(*) from templates where source_lang='lij' and target_lang='en';
6
sqlite> select count(*) from templates where source_lang='lmo' and target_lang='en';
0
sqlite> select count(*) from templates where source_lang='szl' and target_lang='en';
4
sqlite> select count(*) from templates where source_lang='vec' and target_lang='en';
4
sqlite> select count(*) from templates where source_lang='war' and target_lang='en';
0
gerritbot added a comment.Jun 6 2023, 4:58 AM

Change 927325 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/cxserver@master] Add template parameter alignments for 17 language pairs

https://gerrit.wikimedia.org/r/927325

gerritbot added a comment.Jun 6 2023, 4:13 PM

Change 927144 merged by KartikMistry:

[mediawiki/extensions/ContentTranslation@master] Remove unused domain mapping for crh

https://gerrit.wikimedia.org/r/927144

ReleaseTaggerBot added a project: MW-1.41-notes (1.41.0-wmf.13; 2023-06-13).Jun 6 2023, 6:00 PM
gerritbot added a comment.Jun 7 2023, 4:39 AM

Change 927325 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Add template parameter alignments for 17 language pairs

https://gerrit.wikimedia.org/r/927325

gerritbot added a comment.Jun 7 2023, 4:48 AM

Change 927812 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2023-06-07-044025-production

https://gerrit.wikimedia.org/r/927812

gerritbot added a comment.Jun 7 2023, 5:13 AM

Change 927812 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2023-06-07-044025-production

https://gerrit.wikimedia.org/r/927812

Stashbot added a comment.Jun 7 2023, 5:28 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-07T05:28:33Z] <kart_> Updated cxserver to 2023-06-07-044025-production (T337290, T337669, T337834)

KartikMistry updated the task description. (Show Details)Jun 7 2023, 5:29 AM
Maintenance_bot removed a project: Patch-For-Review.Jun 7 2023, 5:30 AM
UOzurumba updated the task description. (Show Details)Jun 12 2023, 4:14 AM
KartikMistry updated the task description. (Show Details)Jun 12 2023, 5:17 AM
UOzurumba added a comment.Jun 12 2023, 5:34 AM

Hello @KartikMistry, the communication for the marked Wikis are completed except for Ligurian, I am still communicating with them. Thank you!

gerritbot added a comment.Jun 13 2023, 3:58 PM

Change 929741 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] Enable Content and Section Translation for a 2nd group of 9 languages previously lacking machine translation

https://gerrit.wikimedia.org/r/929741

gerritbot added a project: Patch-For-Review.Jun 13 2023, 3:58 PM
gerritbot added a comment.Jun 14 2023, 7:03 AM

Change 929741 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable Content and Section Translation for a 2nd group of 9 languages previously lacking machine translation

https://gerrit.wikimedia.org/r/929741

Stashbot added a comment.Jun 14 2023, 7:04 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-14T07:04:36Z] <kartik@deploy1002> Started scap: Backport for [[gerrit:929741|Enable Content and Section Translation for a 2nd group of 9 languages previously lacking machine translation (T337669)]]

Stashbot added a comment.Jun 14 2023, 7:06 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-14T07:06:13Z] <kartik@deploy1002> kartik: Backport for [[gerrit:929741|Enable Content and Section Translation for a 2nd group of 9 languages previously lacking machine translation (T337669)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet

Maintenance_bot removed a project: Patch-For-Review.Jun 14 2023, 7:10 AM
Stashbot added a comment.Jun 14 2023, 7:18 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-14T07:18:12Z] <kartik@deploy1002> Finished scap: Backport for [[gerrit:929741|Enable Content and Section Translation for a 2nd group of 9 languages previously lacking machine translation (T337669)]] (duration: 13m 35s)

KartikMistry updated the task description. (Show Details)Jun 14 2023, 7:22 AM
Pginer-WMF added a comment.Jun 14 2023, 4:23 PM

When trying to access Section translation on mobile for Crimean Tatar (https://crh.m.wikipedia.org/wiki/Special:ContentTranslation) the browser redirects me to Amharic Wikipedia instead.

KartikMistry added a comment.Jun 26 2023, 6:45 AM
In T337669#8932253, @Pginer-WMF wrote:

When trying to access Section translation on mobile for Crimean Tatar (https://crh.m.wikipedia.org/wiki/Special:ContentTranslation) the browser redirects me to Amharic Wikipedia instead.

Can you try again if this is still happening? Working fine for me.

Pginer-WMF added a comment.Jun 26 2023, 7:31 AM
In T337669#8962980, @KartikMistry wrote:
In T337669#8932253, @Pginer-WMF wrote:

When trying to access Section translation on mobile for Crimean Tatar (https://crh.m.wikipedia.org/wiki/Special:ContentTranslation) the browser redirects me to Amharic Wikipedia instead.

Can you try again if this is still happening? Working fine for me.

This is no longer happening. Accessing the link now leads to Crimean Tatar without further redirects, as expected.
Thanks!

Pginer-WMF edited projects, added Language-Team (Language-2023-July-September); removed Language-Team (Language-2023-April-June).Jun 30 2023, 11:46 AM
Pginer-WMF moved this task from Quarter Backlog to In Progress on the Language-Team (Language-2023-July-September) board.
KartikMistry mentioned this in T343211: Enable Content and Section translation on 7 Wikipedias.Aug 8 2023, 6:34 AM
KartikMistry moved this task from In Progress to Blocked on the Language-Team (Language-2023-July-September) board.Aug 18 2023, 2:47 AM
UOzurumba updated the task description. (Show Details)Aug 28 2023, 8:43 AM
KartikMistry changed the task status from Open to In Progress.Aug 28 2023, 12:04 PM
KartikMistry moved this task from Blocked to In Progress on the Language-Team (Language-2023-July-September) board.
gerritbot added a comment.Aug 28 2023, 12:09 PM

Change 952846 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] Enable Content and Section translation in Ligurian Wikipedia

https://gerrit.wikimedia.org/r/952846

gerritbot added a project: Patch-For-Review.Aug 28 2023, 12:09 PM
gerritbot added a comment.Aug 29 2023, 7:03 AM

Change 952846 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable Content and Section translation in Ligurian Wikipedia

https://gerrit.wikimedia.org/r/952846

Stashbot added a comment.Aug 29 2023, 7:03 AM

Mentioned in SAL (#wikimedia-operations) [2023-08-29T07:03:43Z] <kartik@deploy1002> Started scap: Backport for [[gerrit:952846|Enable Content and Section translation in Ligurian Wikipedia (T337669)]]

Stashbot added a comment.Aug 29 2023, 7:07 AM

Mentioned in SAL (#wikimedia-operations) [2023-08-29T07:07:38Z] <kartik@deploy1002> kartik: Backport for [[gerrit:952846|Enable Content and Section translation in Ligurian Wikipedia (T337669)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Maintenance_bot removed a project: Patch-For-Review.Aug 29 2023, 7:10 AM
Stashbot added a comment.Aug 29 2023, 7:24 AM

Mentioned in SAL (#wikimedia-operations) [2023-08-29T07:24:46Z] <kartik@deploy1002> Finished scap: Backport for [[gerrit:952846|Enable Content and Section translation in Ligurian Wikipedia (T337669)]] (duration: 21m 02s)

KartikMistry updated the task description. (Show Details)Aug 29 2023, 7:26 AM
KartikMistry moved this task from In Progress to Done on the Language-Team (Language-2023-July-September) board.
Pginer-WMF closed this task as Resolved.Aug 29 2023, 7:40 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits