From patchwork Thu Mar 23 11:44:33 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Wilco Dijkstra X-Patchwork-Id: 66797 Return-Path: X-Original-To: patchwork@sourceware.org Delivered-To: patchwork@sourceware.org Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 2E680385043E for ; Thu, 23 Mar 2023 11:45:11 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 2E680385043E DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1679571911; bh=6jqSjd8aOHOTLuV9P7Tkg9n7Z2j3COFocSgy1vZYbGs=; h=To:Subject:Date:List-Id:List-Unsubscribe:List-Archive:List-Post: List-Help:List-Subscribe:From:Reply-To:From; b=qRy7Qkvk9PaUrBi0iJCJ5QRUTI7DE2LMjSi0VSND4qBVPwV0Up/upNVCTyE2lX2mH Yjp5MBQ53f6dzxY0KYzkh6IsqA5E7T63cwN9BTd/rK62h2S60snWf82EytTe7tfnLM rS0yPUmHE2I9rOwlmGZfwtyIImenAMbHLG1MgIw8= X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from EUR03-AM7-obe.outbound.protection.outlook.com (mail-am7eur03on2080.outbound.protection.outlook.com [40.107.105.80]) by sourceware.org (Postfix) with ESMTPS id 4C2B23858C20 for ; Thu, 23 Mar 2023 11:44:47 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 4C2B23858C20 Received: from AS8PR07CA0028.eurprd07.prod.outlook.com (2603:10a6:20b:451::34) by GVXPR08MB8236.eurprd08.prod.outlook.com (2603:10a6:150::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.37; Thu, 23 Mar 2023 11:44:43 +0000 Received: from AM7EUR03FT057.eop-EUR03.prod.protection.outlook.com (2603:10a6:20b:451:cafe::60) by AS8PR07CA0028.outlook.office365.com (2603:10a6:20b:451::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6254.6 via Frontend Transport; Thu, 23 Mar 2023 11:44:43 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dmarc=pass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; pr=C Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by AM7EUR03FT057.mail.protection.outlook.com (100.127.140.117) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6222.17 via Frontend Transport; Thu, 23 Mar 2023 11:44:42 +0000 Received: ("Tessian outbound f2a8d6d66d12:v135"); Thu, 23 Mar 2023 11:44:42 +0000 X-CheckRecipientChecked: true X-CR-MTA-CID: ef28f6ea561655b7 X-CR-MTA-TID: 64aa7808 Received: from 0b865abce61b.1 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 1EE43BA8-FD61-49DF-B272-FA6A62381844.1; Thu, 23 Mar 2023 11:44:36 +0000 Received: from EUR02-AM0-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 0b865abce61b.1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Thu, 23 Mar 2023 11:44:36 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cEFsfgDPeiZpKfS/RcsRvwej4/NIe6lDfxNXcTFKhOr8vaVV1nEIgEz+IcGeBGEnp49oh8x5j1dcQ67i/7esGC55cyv8yh/DHGpwFYyl0MgcBZYA1TxqmcwzD9VlnDFdwbtKKUWkM74ZzPKLCSGZNHdJiypQXTOKPfRMM5scvWzqBvqC1NW5ygptgDBxf+GZAzkTOHCqbN03Ae/LDK8cIxiGZ20Y84aRhM1/zeL8M3f9tb8STMMsgdMhmm/OUrRihT7dboVs5Hfl3YsiSjwysqGtxFMhFAbOFUqJTp1bGmQqA7rUR0R/Fu9TEQBWyKeGtVv9JmyuwdF5XuNzGetOIg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=6jqSjd8aOHOTLuV9P7Tkg9n7Z2j3COFocSgy1vZYbGs=; b=AG7jS6AD5r7T96t1d3cMVFCl7MDXAbHm8edYPj74bRWNig/ZBrJZm9nLpO9AVwxO/53VomPgwyuCCRVE0+K0BXKKE18P8mS3QN2QR5pCU34I0a+1Y9ZkrHrH3T6UHfXtqupH1KcKzSjWLq5rhdXcVeigq+yJPTygRwWCtM8Bz8fi4ErkwfMzbCVwBmhfv7Dn7MPTmj58EchlRNlP8Px3Z6oqy6hsUy+NdbnHzf+uwmgIdr0WntiwarzyPPxVKSe26c4M1lZYx/amArYSBgJHW3Oqx80RU/wCxhGEVYkC1pb21M1yN4nRx01rwHHDE3iIeMm2+DzQV3QG98RENKKgww== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none Received: from PAWPR08MB8982.eurprd08.prod.outlook.com (2603:10a6:102:33f::20) by PAXPR08MB7600.eurprd08.prod.outlook.com (2603:10a6:102:23f::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.37; Thu, 23 Mar 2023 11:44:33 +0000 Received: from PAWPR08MB8982.eurprd08.prod.outlook.com ([fe80::dc17:8fa2:cce5:3573]) by PAWPR08MB8982.eurprd08.prod.outlook.com ([fe80::dc17:8fa2:cce5:3573%8]) with mapi id 15.20.6178.037; Thu, 23 Mar 2023 11:44:33 +0000 To: 'GNU C Library' Subject: [PATCH] Benchtests: Adjust timing Thread-Topic: [PATCH] Benchtests: Adjust timing Thread-Index: AQHZXXyL/OB1DLdf30i1aHEV36CPOA== Date: Thu, 23 Mar 2023 11:44:33 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: Authentication-Results-Original: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com; x-ms-traffictypediagnostic: PAWPR08MB8982:EE_|PAXPR08MB7600:EE_|AM7EUR03FT057:EE_|GVXPR08MB8236:EE_ X-MS-Office365-Filtering-Correlation-Id: 170dc919-7e24-421f-ecb4-08db2b93fe44 x-checkrecipientrouted: true nodisclaimer: true X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: r2OXAdnz/s8gulmZ1lKCDPIp6e7JmhfW0DtbKWqbV3SvTGV8YOa7ZZbHaNiIQv+hbuPKXQpfSede/zPQdivxZg155Wj7OEtEKofG6rPmHdbvY/iTvKnqJzP/C1zOgqOGgA/Y108B0EVy6UeTySMJEHOR+gG8jk8/+tsrJs7ZWwj1J06hfzIA1P18IVArnT8Gf9Nx0vC1f4pavGZrjYlfwbobKqLThgYN4X81OyElzZxckytaZtPXrUJxs4Z7RbREXjmm614n9Fl4/1UDS5bJu++kQCeuc7ivQs3Fy3qj4lPAI4xYErLZL3gzaX9MdUEOhpGrFvkV7fRHzOwqps8W2SK2vCrAH7aHUsQaq7bnAk4wDezEmn806M6ZAYSww19N6WpAVKVE1ysFMAlx7tv69nZ+LHCgf7l+kD4FG4sO+CbTPcA0AysQ33nsSyOYlsStemo5MIoaZ5i3DkbtHlkxO/9X/R0TGxaPDO/cMpnQrUKbivalxA70wruz1MpuSU4hWsJ83WXzCH6jumWhcLLb3cr3efkNG6RI+aPbyh7CNgbtHlUq3by0bfLVdYITsDPOi15JNUx0CSCP+WBSFRbzPIOROcOG7FqumJ0QUAXCdSs4QUJ8yECG27lrKQW87Aag6+k+bo/iFAVfXqupuRVGsUG3mVyh86iwNocBd3b7vq9emU+ynweA6gOoxeK8ZfufzbZdQbl5BDTx3Setjto1JQ== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PAWPR08MB8982.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(4636009)(136003)(346002)(396003)(39860400002)(376002)(366004)(451199018)(41300700001)(8936002)(52536014)(2906002)(6916009)(66446008)(66946007)(66556008)(76116006)(91956017)(66476007)(64756008)(5660300002)(8676002)(316002)(86362001)(478600001)(71200400001)(26005)(33656002)(6506007)(186003)(55016003)(7696005)(122000001)(38100700002)(38070700005)(9686003); DIR:OUT; SFP:1101; MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAXPR08MB7600 Original-Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: AM7EUR03FT057.eop-EUR03.prod.protection.outlook.com X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id-Prvs: e05ef66b-9081-4bd6-02a5-08db2b93f88c X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: D12FPd9Ns5uzbx1ODOeRoZuA5/lCiS7JygkVtgy0KP2EGR+lWFC//VQ0L81QZb8ZSUrIgRotaaXI3xdGysCmaWe34yD/Z6wZenUEDwZrd1WtlFytH2lGxhaZFGLsJbZYuKdnHv9OIlVdeT4wa8btn5489G/TAbx3r/0LXnEtV+X9saZ6vAzJSD81QmOy+Cx50l/ysCc2BbWiyIMaQ3pcl3qPHFs7aVu9IpuC8WXWMplZaQq83d+hFnMwDmrQc8fl5pGV6ItMEZ5r0Y2JGtGFfVeD++rq+O8VZCA3QvgB/TIso1Qvltcrzria7E4DuZbbHF3oyzIc4kl0HSghln17nx/2vOfJ6nT7RVKE3k6A+c/XjMQMve2xxlTda1AwHLiSc75L0wfEOTqbd/NRndFFH9P+6LheTjc8f3NLVtNi9f/D3FmNbPxuRqFbs9MCefiTrBp+EhclxZn7tW6EWSQyPxhqvdsbLOw70RTmrLJEs1NRzZgeZxuCXt9Oz8DuCXn4Rgbp9sNSDV3odadtdQLCGPm+rsRSLxJjJKuPcs/ENIhrJ/+boGBUEVPAa8yrA96GuvzklBPpwqBMYWGq1iA9OWUgS+t6Su89zR7oA1pw8dir8Z/ltzRXdKclfmn5AgpGhZIxFpEVd8oSpZsUHbF/stqK3/v6QzKMUm3tZj5W6NfVP21QCkRpPDXh3q9hfWfMzztE5SmDhWaWp3vGVbHJPg== X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFS:(13230025)(4636009)(136003)(376002)(39860400002)(396003)(346002)(451199018)(36840700001)(46966006)(40470700004)(336012)(356005)(26005)(6506007)(186003)(9686003)(47076005)(40460700003)(82740400003)(8936002)(7696005)(2906002)(86362001)(81166007)(82310400005)(478600001)(55016003)(8676002)(36860700001)(316002)(40480700001)(33656002)(52536014)(70586007)(6916009)(5660300002)(70206006)(41300700001); DIR:OUT; SFP:1101; X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Mar 2023 11:44:42.8392 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 170dc919-7e24-421f-ecb4-08db2b93fe44 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: AM7EUR03FT057.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: GVXPR08MB8236 X-Spam-Status: No, score=-11.3 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, FORGED_SPF_HELO, GIT_PATCH_0, KAM_DMARC_NONE, KAM_LOTSOFHASH, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_NONE, TXREP, UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Wilco Dijkstra via Libc-alpha From: Wilco Dijkstra Reply-To: Wilco Dijkstra Errors-To: libc-alpha-bounces+patchwork=sourceware.org@sourceware.org Sender: "Libc-alpha" Adjust iteration counts so benchmarks don't run too slowly or quickly. Ensure benchmarks take less than 10 seconds on older, slower cores and more than 0.5 seconds on fast cores. Reviewed-by: Adhemerval Zanella diff --git a/benchtests/bench-bzero.c b/benchtests/bench-bzero.c index 7ff04f2d2fcea7d32c45ef4cf032032031773065..5e891ce87549d017587df4fc2a4cdaba788b4093 100644 --- a/benchtests/bench-bzero.c +++ b/benchtests/bench-bzero.c @@ -51,7 +51,7 @@ IMPL (memset_zero, 0) static void do_one_test (json_ctx_t *json_ctx, impl_t *impl, CHAR *s, size_t n) { - size_t i, iters = INNER_LOOP_ITERS_LARGE; + size_t i, iters = INNER_LOOP_ITERS8; timing_t start, stop, cur; TIMING_NOW (start); diff --git a/benchtests/bench-hash-funcs.c b/benchtests/bench-hash-funcs.c index 5e7e5022307cf58058f76b64ab3fb4ee84462438..4a6858c0217bc3932da665ae9c74427beb7b8836 100644 --- a/benchtests/bench-hash-funcs.c +++ b/benchtests/bench-hash-funcs.c @@ -42,7 +42,7 @@ enum { NFIXED_ITERS = 1048576, NRAND_BUFS = 16384, - NRAND_ITERS = 2048, + NRAND_ITERS = 256, RAND_BENCH_MAX_LEN = 128 }; diff --git a/benchtests/bench-memccpy.c b/benchtests/bench-memccpy.c index 51ed8dad2f5033fc337a7b7422272c48480b2e93..a26ed7eee2374d12d6bef5e721f941d9c5ddcc6a 100644 --- a/benchtests/bench-memccpy.c +++ b/benchtests/bench-memccpy.c @@ -41,7 +41,7 @@ static void do_one_test (impl_t *impl, void *dst, const void *src, int c, size_t len, size_t n) { - size_t i, iters = INNER_LOOP_ITERS_LARGE; + size_t i, iters = INNER_LOOP_ITERS_LARGE * 4; timing_t start, stop, cur; TIMING_NOW (start); diff --git a/benchtests/bench-memchr.c b/benchtests/bench-memchr.c index 90bd3879e32e81950c633cf7f2d4f3f6a92d2311..1a9bf511188f8ec511b10e92632b5ed1dbd3e445 100644 --- a/benchtests/bench-memchr.c +++ b/benchtests/bench-memchr.c @@ -51,7 +51,7 @@ static void do_one_test (json_ctx_t *json_ctx, impl_t *impl, const CHAR *s, int c, size_t n) { - size_t i, iters = INNER_LOOP_ITERS; + size_t i, iters = INNER_LOOP_ITERS8 / 2; timing_t start, stop, cur; TIMING_NOW (start); diff --git a/benchtests/bench-memcpy-random.c b/benchtests/bench-memcpy-random.c index a0753b60e02c677f50de1220c785f4f7214d6bb0..48cb64d533c5e5867226552ee5d9a84da256ef2f 100644 --- a/benchtests/bench-memcpy-random.c +++ b/benchtests/bench-memcpy-random.c @@ -127,7 +127,7 @@ do_one_test (json_ctx_t *json_ctx, impl_t *impl, char *dst, char *src, copy_t *copy, size_t n) { timing_t start, stop, cur; - size_t iters = INNER_LOOP_ITERS_MEDIUM; + size_t iters = INNER_LOOP_ITERS_MEDIUM / 2; for (int j = 0; j < n; j++) CALL (impl, dst + copy[j].dst, src + copy[j].src, copy[j].len); diff --git a/benchtests/bench-memcpy.c b/benchtests/bench-memcpy.c index 1fd41c035fe4fae74d576f38db78ad2eadb8748a..5be09966e0eace1aed1d4625df5f24f4cbc07214 100644 --- a/benchtests/bench-memcpy.c +++ b/benchtests/bench-memcpy.c @@ -38,7 +38,7 @@ static void do_one_test (json_ctx_t *json_ctx, impl_t *impl, char *dst, const char *src, size_t len) { - size_t i, iters = INNER_LOOP_ITERS; + size_t i, iters = INNER_LOOP_ITERS / 2; timing_t start, stop, cur; for (i = 0; i < iters / 64; ++i) { diff --git a/benchtests/bench-memset.c b/benchtests/bench-memset.c index 1e785e6c8f6411aa34d205a219abd8b5d29a7f4e..e68b14201e097678847a9fba2bad76fb20970491 100644 --- a/benchtests/bench-memset.c +++ b/benchtests/bench-memset.c @@ -43,7 +43,7 @@ static void do_one_test (json_ctx_t *json_ctx, impl_t *impl, CHAR *s, int c __attribute ((unused)), size_t n) { - size_t i, iters = INNER_LOOP_ITERS_LARGE; + size_t i, iters = INNER_LOOP_ITERS; timing_t start, stop, cur; TIMING_NOW (start); diff --git a/benchtests/bench-strcat.c b/benchtests/bench-strcat.c index 96383ce06a5aa88d0ca1bbd20b3b2826e40f14f2..08a19e53c9fc4208c59f5d2bade64594e2005bcd 100644 --- a/benchtests/bench-strcat.c +++ b/benchtests/bench-strcat.c @@ -52,7 +52,7 @@ IMPL (generic_strcat, 0) static void do_one_test (json_ctx_t *json_ctx, impl_t *impl, CHAR *dst, const CHAR *src) { - size_t k = STRLEN (dst), i, iters = INNER_LOOP_ITERS_LARGE; + size_t k = STRLEN (dst), i, iters = INNER_LOOP_ITERS_LARGE / CHARBYTES; timing_t start, stop, cur; if (CALL (impl, dst, src) != dst) diff --git a/benchtests/bench-strcmp.c b/benchtests/bench-strcmp.c index 65fd04b43a2aeaab85ee4996f083333a32d7b29f..f696f074fcc7d56e967eabbf3b5c48600e8fc0f5 100644 --- a/benchtests/bench-strcmp.c +++ b/benchtests/bench-strcmp.c @@ -50,7 +50,7 @@ do_one_test (json_ctx_t *json_ctx, impl_t *impl, const CHAR *s1, const CHAR *s2, int exp_result) { - size_t i, iters = INNER_LOOP_ITERS; + size_t i, iters = INNER_LOOP_ITERS8 / 2; timing_t start, stop, cur; TIMING_NOW (start); diff --git a/benchtests/bench-strlen.c b/benchtests/bench-strlen.c index 9b91f8a10ef0621cf2bc8310d8f08bd978b6d898..cae88dd6ec1794709fdf36a373896dd2d9d285dd 100644 --- a/benchtests/bench-strlen.c +++ b/benchtests/bench-strlen.c @@ -48,7 +48,7 @@ IMPL (STRLEN, 1) static void do_one_test (json_ctx_t *json_ctx, impl_t *impl, const CHAR *s, size_t exp_len) { - size_t len = CALL (impl, s), i, iters = INNER_LOOP_ITERS8; + size_t len = CALL (impl, s), i, iters = INNER_LOOP_ITERS_LARGE; timing_t start, stop, cur; if (len != exp_len) diff --git a/benchtests/bench-strncpy.c b/benchtests/bench-strncpy.c index 83a88f658318f16a13c476a3a0bd685ee0e4d889..d90e3c55e28c1ce88ae660a74972bc4374c142f2 100644 --- a/benchtests/bench-strncpy.c +++ b/benchtests/bench-strncpy.c @@ -57,7 +57,7 @@ static void do_one_test (json_ctx_t *json_ctx, impl_t *impl, CHAR *dst, const CHAR *src, size_t len, size_t n) { - size_t i, iters = INNER_LOOP_ITERS_LARGE * (4 / CHARBYTES); + size_t i, iters = INNER_LOOP_ITERS_LARGE / CHARBYTES; timing_t start, stop, cur; if (CALL (impl, dst, src, n) != STRNCPY_RESULT (dst, len, n))