This is the mail archive of the
libc-alpha@sourceware.org
mailing list for the glibc project.
Re: [PING^8][PATCH v12] Locales: Cyrillic -> ASCII transliteration [BZ #2872]
- From: Marko Myllynen <myllynen at redhat dot com>
- To: Rafal Luzynski <digitalfreak at lingonborough dot com>, "Diego (Egor) Kobylkin" <egor at kobylkin dot com>, Carlos O'Donell <codonell at redhat dot com>, "libc-alpha at sourceware dot org" <libc-alpha at sourceware dot org>, "libc-locales at sourceware dot org" <libc-locales at sourceware dot org>, Siddhesh Poyarekar <siddhesh at gotplt dot org>
- Cc: Mike Fabian <mfabian at redhat dot com>
- Date: Thu, 6 Jun 2019 12:42:37 +0300
- Subject: Re: [PING^8][PATCH v12] Locales: Cyrillic -> ASCII transliteration [BZ #2872]
- References: <DDiRMB942zU2NTs_1xTsb-zTgRD2L6AOaaJW-a0-0YJ3O5voZt2GeTjQJQ0c_hExTwcJKvBMiXIeyHsdieM2Q1m61oOpU27Msj09zowycVM=@kobylkin.com> <2030695416.914859.1559778544120@poczta.nazwa.pl>
- Reply-to: Marko Myllynen <myllynen at redhat dot com>
Hi,
On 06/06/2019 02.49, Rafal Luzynski wrote:
> 5.06.2019 08:47 "Diego (Egor) Kobylkin" <egor@kobylkin.com> wrote:
>>
>> ping
>
> I second these pings. Marko, Carlos, Siddhesh, Mike, is there anything
> else I can do here?
My understanding of the overall situation here is that for 2.30 we try
to have Cyrillic->ASCII transliteration added into the built-in C locale
and after that we would discuss more about translit rules used by other
locales, and that this C locale patch is pending on Carlos to complete
his verification efforts.
Does the above sound correct to you?
> Since the questions may sound overwhelming, I'd like to focus on
> a single issue:
Yes, the subject becomes overwhelming if considering everything related
at the same time so this sounds like a good approach, however are there
other notable open questions left around the C locale rules in addition
to this? (Ignoring the more generic tranlit rules or other locales for
the time being.)
> How should we handle the upper/lower case when a single Cyrillic letter
> is transliterated to a Latin digraph (trigraph, etc.)?
>
> Possible answers (Cyrillic -> Latin Extended -> ASCII):
>
> 1. "Ш" -> "Š" -> "SH"
>
> e.g.: "Шема" -> "Šema" -> "SHema"
> "Схема" ----------> "Shema"
>
> 2. "Ш" -> "Š" -> "Sh"
>
> e.g.: "Шема" -> "Šema" -> "Shema"
> "Схема" ----------> "Shema"
>
> Personally I don't like the answer 1. because "SHema" looks weird
> to me. Egor in turn does not like the answer 2. because the output
> string becomes ambiguous.
>
> Should we maybe have a smart algorithm which would select the title
> case or the upper case of the output characters depending on the
> context in the word? Note that it would not resolve the problem of
> the output text being ambiguous.
It seems clear that there is no one right/wrong answer but it's a matter
of preference, especially the way this currently works. It might be an
improvement to output (for instance) SH instead of Sh if all the other
letters of a word are upper-case as well but not sure what would help
with the result being unambiguous.
Thanks,
--
Marko Myllynen