From patchwork Mon Jan 31 05:34:40 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Carlos O'Donell X-Patchwork-Id: 50581 Return-Path: X-Original-To: patchwork@sourceware.org Delivered-To: patchwork@sourceware.org Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 07DCF385843B for ; Mon, 31 Jan 2022 05:35:13 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 07DCF385843B DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1643607313; bh=/sEzw4XzwgyuwQ7ybgz7qsdxTRzwB1U8pAj7xyuuyS4=; h=To:Subject:Date:List-Id:List-Unsubscribe:List-Archive:List-Post: List-Help:List-Subscribe:From:Reply-To:From; b=GsWACv8776kUHgcmzzsTSn7jxnUX0XhVWV/DUcTCLT1OFiT5et/HgbRWpEi8ARkZn pFY0q9shFQzFZvngEig7ZmCpVHaYcwUz19bd+ARfmIOUVJUtzSG1DqKJwrVGamp8Nc iakpTgjKKj2lYHLmzZVC/KvuptL+gXjtDHfU37KI= X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by sourceware.org (Postfix) with ESMTPS id 7994E3858D28 for ; Mon, 31 Jan 2022 05:34:52 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 7994E3858D28 Received: from mail-qt1-f200.google.com (mail-qt1-f200.google.com [209.85.160.200]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-340-JBck3-MBM5SLVj7FezNYOg-1; Mon, 31 Jan 2022 00:34:50 -0500 X-MC-Unique: JBck3-MBM5SLVj7FezNYOg-1 Received: by mail-qt1-f200.google.com with SMTP id 4-20020ac85744000000b002b2f329efc2so9471292qtx.12 for ; Sun, 30 Jan 2022 21:34:50 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=/sEzw4XzwgyuwQ7ybgz7qsdxTRzwB1U8pAj7xyuuyS4=; b=Wl7+21HGDMiS2h3ZHB2RmDAcdeqzmf+MeMDEk0wMbxQz/243999HdOCO1Ktww1YqsT L3KRdJZlrrE3n1jVFqeLHDk/Q9vPXbaCSmPuE09i8rAHDAO85pipKQQg2TBFPA2w0zfT sALWYfOprF16CqKS3uMphCAit6YrK5YsR6saUc3qphaORpVTViNnuPpVdo1bzT4fRaQM Gmr7J9MBIvPewVT9H7Z4ldg6tsr1320PRoBrX+flG6tZJxPly9qUCoDVT2jf+5Z374OK k0krMdQxl05fMcTiCpGNNMJa8OI6M6ZVkn4Gn/Z6K1/K34o1mtvbRrpqqRvbmZ04n95G deuA== X-Gm-Message-State: AOAM5322SS3pjakxYSfkkiazJLBK82u4uzc+YU9s2fkI1RTRkBGT0v5/ fEe2lrQLk2uNjZdKN0VAsnqdq3f29Jn8zu0IzfkAr25R+V6KJUIkNtnf/7ooyOQtIMziM3aB6w3 Pvgw7/Y/CBDULlVbsEeUXEAuw3fwXDXYtUHEcZY+xI6gUSdIRtM6h5N/ie9M4ChHH5ht+BA== X-Received: by 2002:a05:6214:2482:: with SMTP id gi2mr16132833qvb.75.1643607290068; Sun, 30 Jan 2022 21:34:50 -0800 (PST) X-Google-Smtp-Source: ABdhPJzkmNpZ/SaLv2s1aNqtGFH/vAO1sLaW6/rKdcl2WJfLZguHI/NAxvw4iyIlzQ1ZD3YJHkj/Nw== X-Received: by 2002:a05:6214:2482:: with SMTP id gi2mr16132816qvb.75.1643607289783; Sun, 30 Jan 2022 21:34:49 -0800 (PST) Received: from athas.redhat.com (135-23-175-80.cpe.pppoe.ca. [135.23.175.80]) by smtp.gmail.com with ESMTPSA id 18sm7261884qka.126.2022.01.30.21.34.48 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 30 Jan 2022 21:34:49 -0800 (PST) To: libc-alpha@sourceware.org, fweimer@redhat.com, michael.hudson@canonical.com Subject: [PATCH 0/2] Make C/POSIX and C.UTF-8 consistent. Date: Mon, 31 Jan 2022 00:34:40 -0500 Message-Id: <20220131053442.3995804-1-carlos@redhat.com> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com X-Spam-Status: No, score=-5.8 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, RCVD_IN_DNSWL_LOW, SPF_HELO_NONE, SPF_NONE, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Carlos O'Donell via Libc-alpha From: Carlos O'Donell Reply-To: Carlos O'Donell Errors-To: libc-alpha-bounces+patchwork=sourceware.org@sourceware.org Sender: "Libc-alpha" We had a recent report from Michael Hudson-Doyle that he had seen a problem with C.UTF-8 when running tests for rrdtool. The report prompted Florian to place this on the glibc 2.35 blocker for review. Upon review I decided to haromize C.UTF-8 closer to C/POSIX and I worked with Florian to fix the discrepancies between the C.UTF-8 locale and the builtin C/POSIX locale. The work uncoverd a problem in the parsing of LC_MONETARY by localedef which needed fixing in order to make C/POSIX and C.UTF-8 consistent. The first commit fixes the mon_decimal_point handling in localedef parsing, while the second commit fixes C.UTF-8 and adds a new test to check for consistency beween C/POSIX and C.UTF-8. The test is based on work that Florian Weimer did to help me identify the inconsistencies between the locales. Carlos O'Donell (2): localedef: Fix handling of empty mon_decimal_point localedata: Adjust C.UTF-8 to align with C/POSIX. locale/programs/ld-monetary.c | 4 +- localedata/Makefile | 30 +- localedata/locales/C | 22 +- localedata/tst-c-utf8-consistency.c | 539 ++++++++++++++++++++++++++++ 4 files changed, 579 insertions(+), 16 deletions(-) create mode 100644 localedata/tst-c-utf8-consistency.c