From patchwork Sat Mar 20 19:20:30 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "H.J. Lu" X-Patchwork-Id: 42729 Return-Path: X-Original-To: patchwork@sourceware.org Delivered-To: patchwork@sourceware.org Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 1E1283858028; Sat, 20 Mar 2021 19:20:42 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 1E1283858028 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1616268042; bh=xchcVNHcXA/sKfplvQc1tKPyZ6lvrOt6EIHpKZ9Fwko=; h=To:Subject:Date:In-Reply-To:References:List-Id:List-Unsubscribe: List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:Cc: From; b=pY8okwc5LLQr42YL9QJCQvceNMcQSDy2kXpAuabmCRcCw/weC3mnpBVixxv32Izdf xe9TwVULJvQzvkUhdJfanVlwt4tVYfX80ZtJnV/DLV8nmWjpSpzz1vZ1jkhyVBTEnJ RAcSRUrQGNr+SK6V7c7+EZlZWZeErQko9/7uyeRo= X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from mail-pf1-x42c.google.com (mail-pf1-x42c.google.com [IPv6:2607:f8b0:4864:20::42c]) by sourceware.org (Postfix) with ESMTPS id EBBAB3858028 for ; Sat, 20 Mar 2021 19:20:35 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org EBBAB3858028 Received: by mail-pf1-x42c.google.com with SMTP id h3so8212311pfr.12 for ; Sat, 20 Mar 2021 12:20:35 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=xchcVNHcXA/sKfplvQc1tKPyZ6lvrOt6EIHpKZ9Fwko=; b=Yf31p8cdNKUSHmZfV1J38vVducZTM0WcO+X9WF5foZcdyN1S2QPsVvai1v61HztIoV xpcUyXKHJiLJA0xKOPKU11iCHUg9wDSHCERPG1/4xRJX0d53OYtZf0sAa2VyFskHDx6j BAJ12F4m9sybmMnG6js+i0XAVzR9O+qTzYIn709vjprKdul7++fweMg0hvQc9jGTEOpZ PnRBlRCbdQudlHO0ahADnKi09k/WwqEZGEksq6B/s/Ju32XPNKr1P9Vr8w4wNkSzvMMD goO2RgzwzMIi3q4172tRJEa2MwE0nKD4dLE9pqDhowk/5NVtH/sLKHSDdLpzC2HS8DR1 cR8g== X-Gm-Message-State: AOAM532J9Xy1V+t1idGQFCJp85/tX7ZyGgXvqQEgQh6XyzCWxx3zv/5F vVt2oUbxlReuznivDdyUOe8= X-Google-Smtp-Source: ABdhPJwTeW9pEd/mL9nq+Jo+2syJKi02EyJcdLZFGWpPoTjsC72sQyUnxQz2SSvpub/ZDoLJfkeVHA== X-Received: by 2002:a62:5bc4:0:b029:1fe:86f7:3a66 with SMTP id p187-20020a625bc40000b02901fe86f73a66mr14661577pfb.42.1616268034644; Sat, 20 Mar 2021 12:20:34 -0700 (PDT) Received: from gnu-cfl-2.localdomain ([172.56.38.37]) by smtp.gmail.com with ESMTPSA id 8sm9297186pjj.53.2021.03.20.12.20.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 20 Mar 2021 12:20:33 -0700 (PDT) Received: from gnu-cfl-2.?040none?041 (localhost [IPv6:::1]) by gnu-cfl-2.localdomain (Postfix) with ESMTP id 46C3B1A06F3; Sat, 20 Mar 2021 12:20:32 -0700 (PDT) To: libc-alpha@sourceware.org Subject: RFC [PATCH v3 1/2] : An API for tagged address Date: Sat, 20 Mar 2021 12:20:30 -0700 Message-Id: <20210320192031.713194-2-hjl.tools@gmail.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20210320192031.713194-1-hjl.tools@gmail.com> References: <20210320192031.713194-1-hjl.tools@gmail.com> MIME-Version: 1.0 X-Spam-Status: No, score=-3036.4 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, GIT_PATCH_0, KAM_SHORT, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: "H.J. Lu via Libc-alpha" From: "H.J. Lu" Reply-To: "H.J. Lu" Cc: Florian Weimer , Szabolcs Nagy , "Kirill A . Shutemov" , Joseph Myers , Vedvyas Shanbhogue Errors-To: libc-alpha-bounces@sourceware.org Sender: "Libc-alpha" By default, the number of the address bits used in address translation is the number of address bits. But it can be changed by ARM Top-byte Ignore (TBI) or Intel Linear Address Masking (LAM). provides an API for tagged address manipulation: /* Get the current address bits used in address translation. */ extern unsigned int get_tagged_address_bits (void); /* Get the current mask for address bits used in address translation. */ extern uintptr_t get_tagged_address_mask (void); /* Set the mask for address bits used in address translation. Return 0 on success. Return -1 on error. */ extern int set_tagged_address_mask (uintptr_t __mask); /* Return the tagged address of __ADDR with the tag value __TAG. */ extern void *tag_address (void *__addr, unsigned int __tag); /* Return the untagged address of __ADDR. */ extern void *untag_address (void *__addr); /* TRUE if constant address BITS is a valid tagged address bits. */ #define TAGGED_ADDRESS_VALID_BITS(BITS) /* A mask for constant address BITS used in address translation. */ #define TAGGED_ADDRESS_MASK(BITS) 1. set_tagged_address_mask should be called as early as possible. 2. set_tagged_address_mask shouldn't be allowed after main is called. 3. After set_tagged_address_mask is called, don't allow it to be called again to change the tagged address mask. Otherwise, the previously tagged addresses may not work anymore. --- NEWS | 2 + bits/tagged-address.h | 28 +++++++++ csu/libc-start.c | 3 + elf/dl-support.c | 5 ++ include/sys/tagged-address.h | 9 +++ manual/Makefile | 3 +- manual/ctype.texi | 2 +- manual/memory.texi | 2 +- manual/tagged-address.texi | 58 +++++++++++++++++++ misc/Makefile | 33 +++++++++-- misc/Versions | 7 +++ misc/set-tagged-address-mask.c | 41 +++++++++++++ misc/sys/tagged-address.h | 56 ++++++++++++++++++ misc/tagged-address.c | 55 ++++++++++++++++++ misc/tst-tagged-address-1-static.c | 1 + misc/tst-tagged-address-1.c | 53 +++++++++++++++++ misc/tst-tagged-address-2-static.c | 1 + misc/tst-tagged-address-2.c | 44 ++++++++++++++ misc/tst-tagged-address-3-static.c | 1 + misc/tst-tagged-address-3.c | 48 +++++++++++++++ misc/tst-tagged-address-4-static.c | 1 + misc/tst-tagged-address-4.c | 35 +++++++++++ misc/tst-tagged-address-5.c | 25 ++++++++ misc/tst-tagged-address-6.c | 34 +++++++++++ misc/tst-tagged-address-7.c | 40 +++++++++++++ misc/tst-tagged-address-mod-5.c | 45 ++++++++++++++ misc/tst-tagged-address-mod-6.c | 34 +++++++++++ misc/tst-tagged-address-mod-7.c | 34 +++++++++++ sysdeps/generic/inline-tagged-address.h | 43 ++++++++++++++ sysdeps/generic/ldsodefs.h | 4 ++ sysdeps/unix/sysv/linux/i386/libc.abilist | 5 ++ .../unix/sysv/linux/x86_64/64/libc.abilist | 5 ++ .../unix/sysv/linux/x86_64/x32/libc.abilist | 5 ++ 33 files changed, 754 insertions(+), 8 deletions(-) create mode 100644 bits/tagged-address.h create mode 100644 include/sys/tagged-address.h create mode 100644 manual/tagged-address.texi create mode 100644 misc/set-tagged-address-mask.c create mode 100644 misc/sys/tagged-address.h create mode 100644 misc/tagged-address.c create mode 100644 misc/tst-tagged-address-1-static.c create mode 100644 misc/tst-tagged-address-1.c create mode 100644 misc/tst-tagged-address-2-static.c create mode 100644 misc/tst-tagged-address-2.c create mode 100644 misc/tst-tagged-address-3-static.c create mode 100644 misc/tst-tagged-address-3.c create mode 100644 misc/tst-tagged-address-4-static.c create mode 100644 misc/tst-tagged-address-4.c create mode 100644 misc/tst-tagged-address-5.c create mode 100644 misc/tst-tagged-address-6.c create mode 100644 misc/tst-tagged-address-7.c create mode 100644 misc/tst-tagged-address-mod-5.c create mode 100644 misc/tst-tagged-address-mod-6.c create mode 100644 misc/tst-tagged-address-mod-7.c create mode 100644 sysdeps/generic/inline-tagged-address.h diff --git a/NEWS b/NEWS index aa0f10a891..4b7f252b33 100644 --- a/NEWS +++ b/NEWS @@ -9,6 +9,8 @@ Version 2.34 Major new features: +* Add to provide an API for tagged address. + * Add _SC_MINSIGSTKSZ and _SC_SIGSTKSZ. When _SC_SIGSTKSZ_SOURCE or _GNU_SOURCE are defined, MINSIGSTKSZ and SIGSTKSZ are no longer constant on Linux. MINSIGSTKSZ is redefined to sysconf(_SC_MINSIGSTKSZ) diff --git a/bits/tagged-address.h b/bits/tagged-address.h new file mode 100644 index 0000000000..ecd8a2942d --- /dev/null +++ b/bits/tagged-address.h @@ -0,0 +1,28 @@ +/* Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#ifndef _BITS_TAGGED_ADDRESS_H +#define _BITS_TAGGED_ADDRESS_H 1 + +#ifndef _SYS_TAGGED_ADDRESS_H +# error "Never include this file directly. Use instead" +#endif + +/* Non-zero if constant address BITS is a valid tagged address bits. */ +#define TAGGED_ADDRESS_VALID_BITS(BITS) 0 + +#endif /* */ diff --git a/csu/libc-start.c b/csu/libc-start.c index 05ff7afddf..03161c939e 100644 --- a/csu/libc-start.c +++ b/csu/libc-start.c @@ -410,6 +410,9 @@ LIBC_START_MAIN (int (*main) (int, char **, char ** MAIN_AUXVEC_DECL), GLRO(dl_debug_printf) ("\ntransferring control: %s\n\n", argv[0]); #endif + /* set_tagged_address_mask can only be called before main. */ + GL(dl_tagged_address_mask_locked) = 1; + #ifndef SHARED _dl_debug_initialize (0, LM_ID_BASE); #endif diff --git a/elf/dl-support.c b/elf/dl-support.c index 7fc2ee78e2..ed72720330 100644 --- a/elf/dl-support.c +++ b/elf/dl-support.c @@ -213,6 +213,11 @@ struct link_map *_dl_sysinfo_map; # include "get-dynamic-info.h" #endif + +/* If nonzero, the mask for address bits used in address translation + is locked. */ +int _dl_tagged_address_mask_locked; + #include "setup-vdso.h" /* Define the vDSO function pointers. */ #include diff --git a/include/sys/tagged-address.h b/include/sys/tagged-address.h new file mode 100644 index 0000000000..2e902f72b2 --- /dev/null +++ b/include/sys/tagged-address.h @@ -0,0 +1,9 @@ +#include + +#ifndef _ISOMAC +# include +# define get_tagged_address_bits() __get_tagged_address_bits () +# define get_tagged_address_mask() __get_tagged_address_mask () +# define tag_address(addr, tag) __tag_address ((addr), (tag)) +# define untag_address(addr) __untag_address ((addr)) +#endif diff --git a/manual/Makefile b/manual/Makefile index e83444341e..08df2daa6b 100644 --- a/manual/Makefile +++ b/manual/Makefile @@ -34,7 +34,8 @@ info: $(objpfx)libc.info endif chapters = $(addsuffix .texi, \ - intro errno memory ctype string charset locale \ + intro errno memory tagged-address ctype string \ + charset locale \ message search pattern io stdio llio filesys \ pipe socket terminal syslog math arith time \ resource setjmp signal startup process ipc job \ diff --git a/manual/ctype.texi b/manual/ctype.texi index d0618c5c38..28af73ff0e 100644 --- a/manual/ctype.texi +++ b/manual/ctype.texi @@ -1,4 +1,4 @@ -@node Character Handling, String and Array Utilities, Memory, Top +@node Character Handling, String and Array Utilities, Tagged Address, Top @c %MENU% Character testing and conversion functions @chapter Character Handling diff --git a/manual/memory.texi b/manual/memory.texi index b2cc65228a..4791c7c464 100644 --- a/manual/memory.texi +++ b/manual/memory.texi @@ -1,4 +1,4 @@ -@node Memory, Character Handling, Error Reporting, Top +@node Memory, Tagged Address, Error Reporting, Top @chapter Virtual Memory Allocation And Paging @c %MENU% Allocating virtual memory and controlling paging @cindex memory allocation diff --git a/manual/tagged-address.texi b/manual/tagged-address.texi new file mode 100644 index 0000000000..b0b576c94e --- /dev/null +++ b/manual/tagged-address.texi @@ -0,0 +1,58 @@ +@node Tagged Address, Character Handling, Memory, Top +@c %MENU% Tagged address functions and macros +@chapter Tagged Address + +By default, the number of the address bits used in address translation +is the number of address bits. But it can be changed by ARM Top-byte +Ignore (TBI) or Intel Linear Address Masking (LAM). + +@Theglibc{} provides several functions and macros in the header file +@file{sys/tagged-address.h} to manipulate tagged address bits, which is +the number of the address bits used in address translation. +@pindex sys/tagged-address.h + +@deftypefun {unsigned int} get_tagged_address_bits (void) +@standards{GNU, sys/tagged-address.h} +@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}} +Get the current address bits used in address translation. +@end deftypefun + +@deftypefun uintptr_t get_tagged_address_mask (void) +@standards{GNU, sys/tagged-address.h} +@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}} +Get the current mask for address bits used in address translation. +@end deftypefun + +@deftypefun int set_tagged_address_mask (uintptr_t @var{mask}) +@standards{GNU, sys/tagged-address.h} +@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}} +Set the mask for address bits used in address translation to @var{mask}. +The return value is @code{0} on success and @code{-1} on failure. This +function can be called only once before @code{main}. The possible +@code{errno} error conditions are @code{ENODEV}, @code{EPERM}, +@code{EINVAL}, and @code{ENOSYS}. +@end deftypefun + +@deftypefun {void *} tag_address (void *@var{addr}, unsigned int @var{tag}) +@standards{GNU, sys/tagged-address.h} +@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}} +Return the address of @var{addr} with the tag value @var{tag} stored +in the untranslated bits. Overflow of @var{tag} in the untranslated +bits are ignored. +@end deftypefun + +@deftypefun {void *} untag_address (void *@var{addr}) +@standards{GNU, sys/tagged-address.h} +@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}} +Return the address of @var{addr} with all zero untranslated bits. +@end deftypefun + +@deftypefn Macro int TAGGED_ADDRESS_VALID_BITS (@var{bits}) +This macro returns a nonzero value (true) if @var{bits} a valid tagged +address bits. +@end deftypefn + +@deftypefn Macro {const uintptr_t} TAGGED_ADDRESS_MASK (@var{bits}) +This macro returns a mask for constant address @var{bits} used in address +translation. +@end deftypefn diff --git a/misc/Makefile b/misc/Makefile index cfc15355d6..36dcd20a04 100644 --- a/misc/Makefile +++ b/misc/Makefile @@ -38,7 +38,8 @@ headers := sys/uio.h bits/uio-ext.h bits/uio_lim.h \ bits/select2.h bits/hwcap.h sys/auxv.h \ sys/sysmacros.h bits/sysmacros.h bits/types/struct_iovec.h \ bits/err-ldbl.h bits/error-ldbl.h \ - sys/single_threaded.h + sys/single_threaded.h \ + sys/tagged-address.h bits/tagged-address.h routines := brk sbrk sstk ioctl \ readv writev preadv preadv64 pwritev pwritev64 \ @@ -73,7 +74,8 @@ routines := brk sbrk sstk ioctl \ fgetxattr flistxattr fremovexattr fsetxattr getxattr \ listxattr lgetxattr llistxattr lremovexattr lsetxattr \ removexattr setxattr getauxval ifunc-impl-list makedev \ - allocate_once fd_to_filename single_threaded unwind-link + allocate_once fd_to_filename single_threaded unwind-link \ + tagged-address set-tagged-address-mask generated += tst-error1.mtrace tst-error1-mem.out \ tst-allocate_once.mtrace tst-allocate_once-mem.out @@ -88,15 +90,30 @@ tests := tst-dirname tst-tsearch tst-fdset tst-mntent tst-hsearch \ tst-preadvwritev tst-preadvwritev64 tst-makedev tst-empty \ tst-preadvwritev2 tst-preadvwritev64v2 tst-warn-wide \ tst-ldbl-warn tst-ldbl-error tst-dbl-efgcvt tst-ldbl-efgcvt \ - tst-mntent-autofs tst-syscalls tst-mntent-escape + tst-mntent-autofs tst-syscalls tst-mntent-escape \ + tst-tagged-address-1 tst-tagged-address-1-static \ + tst-tagged-address-2 tst-tagged-address-2-static \ + tst-tagged-address-3 tst-tagged-address-3-static \ + tst-tagged-address-4 tst-tagged-address-4-static # Tests which need libdl. ifeq (yes,$(build-shared)) -tests += tst-gethostid +tests += tst-gethostid \ + tst-tagged-address-5 \ + tst-tagged-address-6 \ + tst-tagged-address-7 +modules-names += \ + tst-tagged-address-mod-5 \ + tst-tagged-address-mod-6 \ + tst-tagged-address-mod-7 endif tests-internal := tst-atomic tst-atomic-long tst-allocate_once -tests-static := tst-empty +tests-static := tst-empty \ + tst-tagged-address-1-static \ + tst-tagged-address-2-static \ + tst-tagged-address-3-static \ + tst-tagged-address-4-static # Test for the internal, non-exported __fd_to_filename function. tests-internal += tst-fd_to_filename @@ -160,3 +177,9 @@ $(objpfx)tst-allocate_once-mem.out: $(objpfx)tst-allocate_once.out $(evaluate-test) $(objpfx)tst-gethostid: $(libdl) + +$(objpfx)tst-tagged-address-2: $(shared-thread-library) +$(objpfx)tst-tagged-address-2-static: $(static-thread-library) +$(objpfx)tst-tagged-address-7: $(libdl) +$(objpfx)tst-tagged-address-7.out: $(objpfx)tst-tagged-address-mod-7.so +$(objpfx)tst-tagged-address-mod-7.so: $(libsupport) diff --git a/misc/Versions b/misc/Versions index d5b348e83a..ceb8b0084a 100644 --- a/misc/Versions +++ b/misc/Versions @@ -164,6 +164,13 @@ libc { GLIBC_2.32 { __libc_single_threaded; } + GLIBC_2.34 { + get_tagged_address_bits; + get_tagged_address_mask; + set_tagged_address_mask; + tag_address; + untag_address; + } GLIBC_PRIVATE { __madvise; __mktemp; diff --git a/misc/set-tagged-address-mask.c b/misc/set-tagged-address-mask.c new file mode 100644 index 0000000000..2e1e2f2343 --- /dev/null +++ b/misc/set-tagged-address-mask.c @@ -0,0 +1,41 @@ +/* Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include + +/* Set the mask for address bits used in address translation. Return 0 + on success. Return -1 on error. */ + +int +set_tagged_address_mask (uintptr_t mask) +{ + if (GL(dl_tagged_address_mask_locked) != 0) + __set_errno (EPERM); + else + { + /* set_tagged_address_mask can only be called once. */ + GL(dl_tagged_address_mask_locked) = 1; + + /* Only NOP is allowed. */ + if (mask == __get_tagged_address_mask ()) + return 0; + + __set_errno (ENOSYS); + } + return -1; +} diff --git a/misc/sys/tagged-address.h b/misc/sys/tagged-address.h new file mode 100644 index 0000000000..c8c1417306 --- /dev/null +++ b/misc/sys/tagged-address.h @@ -0,0 +1,56 @@ +/* Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#ifndef _SYS_TAGGED_ADDRESS_H +#define _SYS_TAGGED_ADDRESS_H 1 + +#include +#include +#include + +#ifdef __GNUC__ +/* A mask for constant address BITS used in address translation. */ +# define TAGGED_ADDRESS_MASK(BITS) \ + (__extension__ \ + ({ \ + _Static_assert (TAGGED_ADDRESS_VALID_BITS (BITS), \ + "Tagged address bits must be valid"); \ + (((uintptr_t) 1) << (BITS)) - 1; \ + })) +#endif + +__BEGIN_DECLS + +/* Get the current address bits used in address translation. */ +extern unsigned int get_tagged_address_bits (void); + +/* Get the current mask for address bits used in address translation. */ +extern uintptr_t get_tagged_address_mask (void); + +/* Set the mask for address bits used in address translation. Return 0 + on success. Return -1 on error. */ +extern int set_tagged_address_mask (uintptr_t __mask); + +/* Return the tagged address of __ADDR with the tag value __TAG. */ +extern void *tag_address (void *__addr, unsigned int __tag); + +/* Return the untagged address of __ADDR. */ +extern void *untag_address (void *__addr); + +__END_DECLS + +#endif /* */ diff --git a/misc/tagged-address.c b/misc/tagged-address.c new file mode 100644 index 0000000000..df474f3d0b --- /dev/null +++ b/misc/tagged-address.c @@ -0,0 +1,55 @@ +/* Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include + +#undef get_tagged_address_bits +#undef get_tagged_address_mask +#undef tag_address +#undef untag_address + +/* Get the current address bits used in address translation. */ + +unsigned int +get_tagged_address_bits (void) +{ + return __get_tagged_address_bits (); +} + +/* Get the current mask for address bits used in address translation. */ + +uintptr_t +get_tagged_address_mask (void) +{ + return __get_tagged_address_mask (); +} + +/* Return the tagged address of ADDR with the tag value TAG. */ + +void * +tag_address (void *addr, unsigned int tag) +{ + return __tag_address (addr, tag); +} + +/* Return the untagged address of ADDR. */ + +void * +untag_address (void *addr) +{ + return __untag_address (addr); +} diff --git a/misc/tst-tagged-address-1-static.c b/misc/tst-tagged-address-1-static.c new file mode 100644 index 0000000000..3ed71a66c2 --- /dev/null +++ b/misc/tst-tagged-address-1-static.c @@ -0,0 +1 @@ +#include diff --git a/misc/tst-tagged-address-1.c b/misc/tst-tagged-address-1.c new file mode 100644 index 0000000000..0bbc214a2f --- /dev/null +++ b/misc/tst-tagged-address-1.c @@ -0,0 +1,53 @@ +/* Tests for set_tagged_address_mask. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include +#include + +static void +init_0 (void) +{ + if (set_tagged_address_mask (get_tagged_address_mask ()) != 0) + FAIL_EXIT1 ("set_tagged_address_mask failed: %m"); +} + +static void +init_1 (void) +{ + if (set_tagged_address_mask (get_tagged_address_mask ()) == 0) + FAIL_EXIT1 ("set_tagged_address_mask should fail"); + + if (errno != EPERM) + FAIL_EXIT1 ("set_tagged_address_mask: errno (%m) != EPERM"); +} + +static void (*init_array []) (void) + __attribute__ ((used, section (".init_array"), aligned (sizeof (void *)))) = +{ + &init_0, + &init_1 +}; + +static int +do_test (void) +{ + return 0; +} + +#include diff --git a/misc/tst-tagged-address-2-static.c b/misc/tst-tagged-address-2-static.c new file mode 100644 index 0000000000..ac0d95e6c0 --- /dev/null +++ b/misc/tst-tagged-address-2-static.c @@ -0,0 +1 @@ +#include diff --git a/misc/tst-tagged-address-2.c b/misc/tst-tagged-address-2.c new file mode 100644 index 0000000000..76caae4053 --- /dev/null +++ b/misc/tst-tagged-address-2.c @@ -0,0 +1,44 @@ +/* Test for set_tagged_address_mask with pthread. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include +#include +#include + +static void * +tf (void *arg) +{ + if (set_tagged_address_mask (get_tagged_address_mask ()) == 0) + FAIL_EXIT1 ("set_tagged_address_mask should fail"); + + if (errno != EPERM) + FAIL_EXIT1 ("set_tagged_address_mask: errno (%m) != EPERM"); + + return NULL; +} + +static int +do_test (void) +{ + pthread_t thr = xpthread_create (NULL, tf, NULL); + xpthread_join (thr); + return 0; +} + +#include diff --git a/misc/tst-tagged-address-3-static.c b/misc/tst-tagged-address-3-static.c new file mode 100644 index 0000000000..1e3591e0d6 --- /dev/null +++ b/misc/tst-tagged-address-3-static.c @@ -0,0 +1 @@ +#include diff --git a/misc/tst-tagged-address-3.c b/misc/tst-tagged-address-3.c new file mode 100644 index 0000000000..e241950959 --- /dev/null +++ b/misc/tst-tagged-address-3.c @@ -0,0 +1,48 @@ +/* Tests for set_tagged_address_mask to turn off tagged address. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include + +static void +init (void) +{ + uintptr_t mask = (uintptr_t) -1; + if (set_tagged_address_mask (mask) != 0) + FAIL_EXIT1 ("set_tagged_address_mask failed: %m"); +} + +static void (*init_array []) (void) + __attribute__ ((used, section (".init_array"), aligned (sizeof (void *)))) = +{ + &init +}; + +static int +do_test (void) +{ + uintptr_t mask = (uintptr_t) -1; + uintptr_t curent_mask = get_tagged_address_mask (); + if (curent_mask != mask) + FAIL_EXIT1 ("get_tagged_address_mask failed: %p != %p", + (void *) curent_mask, (void *) mask); + + return 0; +} + +#include diff --git a/misc/tst-tagged-address-4-static.c b/misc/tst-tagged-address-4-static.c new file mode 100644 index 0000000000..b0681f6f9b --- /dev/null +++ b/misc/tst-tagged-address-4-static.c @@ -0,0 +1 @@ +#include diff --git a/misc/tst-tagged-address-4.c b/misc/tst-tagged-address-4.c new file mode 100644 index 0000000000..9843f780af --- /dev/null +++ b/misc/tst-tagged-address-4.c @@ -0,0 +1,35 @@ +/* Tests for set_tagged_address_mask. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include +#include + +static int +do_test (void) +{ + if (set_tagged_address_mask (get_tagged_address_mask ()) == 0) + FAIL_EXIT1 ("set_tagged_address_mask should fail"); + + if (errno != EPERM) + FAIL_EXIT1 ("set_tagged_address_mask: errno (%m) != EPERM"); + + return 0; +} + +#include diff --git a/misc/tst-tagged-address-5.c b/misc/tst-tagged-address-5.c new file mode 100644 index 0000000000..e00679a2cb --- /dev/null +++ b/misc/tst-tagged-address-5.c @@ -0,0 +1,25 @@ +/* Tests for set_tagged_address_mask. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +static int +do_test (void) +{ + return 0; +} + +#include diff --git a/misc/tst-tagged-address-6.c b/misc/tst-tagged-address-6.c new file mode 100644 index 0000000000..5fdceb1fb4 --- /dev/null +++ b/misc/tst-tagged-address-6.c @@ -0,0 +1,34 @@ +/* Tests for set_tagged_address_mask to turn off tagged address. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include + +static int +do_test (void) +{ + uintptr_t mask = (uintptr_t) -1; + uintptr_t curent_mask = get_tagged_address_mask (); + if (curent_mask != mask) + FAIL_EXIT1 ("get_tagged_address_mask failed: %p != %p", + (void *) curent_mask, (void *) mask); + + return 0; +} + +#include diff --git a/misc/tst-tagged-address-7.c b/misc/tst-tagged-address-7.c new file mode 100644 index 0000000000..f0a078188d --- /dev/null +++ b/misc/tst-tagged-address-7.c @@ -0,0 +1,40 @@ +/* Tests for set_tagged_address_mask. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include +#include + +static int +do_test (void) +{ + const char *modname = "$ORIGIN/tst-tagged-address-mod-7.so"; + void *h = dlopen (modname, RTLD_LAZY); + + if (h == NULL) + { + const char *err = dlerror (); + FAIL_EXIT1 ("cannot open '%s': %s\n", modname, err); + } + + dlclose (h); + + return 0; +} + +#include diff --git a/misc/tst-tagged-address-mod-5.c b/misc/tst-tagged-address-mod-5.c new file mode 100644 index 0000000000..275ecc406d --- /dev/null +++ b/misc/tst-tagged-address-mod-5.c @@ -0,0 +1,45 @@ +/* Tests for set_tagged_address_mask. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include +#include + +static void +init_0 (void) +{ + if (set_tagged_address_mask (get_tagged_address_mask ()) != 0) + FAIL_EXIT1 ("set_tagged_address_mask failed: %m"); +} + +static void +init_1 (void) +{ + if (set_tagged_address_mask (get_tagged_address_mask ()) == 0) + FAIL_EXIT1 ("set_tagged_address_mask should fail"); + + if (errno != EPERM) + FAIL_EXIT1 ("set_tagged_address_mask: errno (%m) != EPERM"); +} + +static void (*init_array []) (void) + __attribute__ ((used, section (".init_array"), aligned (sizeof (void *)))) = +{ + &init_0, + &init_1 +}; diff --git a/misc/tst-tagged-address-mod-6.c b/misc/tst-tagged-address-mod-6.c new file mode 100644 index 0000000000..75dfe8e8d2 --- /dev/null +++ b/misc/tst-tagged-address-mod-6.c @@ -0,0 +1,34 @@ +/* Tests for set_tagged_address_mask to turn off tagged address. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include + +static void +init (void) +{ + uintptr_t mask = (uintptr_t) -1; + if (set_tagged_address_mask (mask) != 0) + FAIL_EXIT1 ("set_tagged_address_mask failed: %m"); +} + +static void (*init_array []) (void) + __attribute__ ((used, section (".init_array"), aligned (sizeof (void *)))) = +{ + &init +}; diff --git a/misc/tst-tagged-address-mod-7.c b/misc/tst-tagged-address-mod-7.c new file mode 100644 index 0000000000..c902a4e55e --- /dev/null +++ b/misc/tst-tagged-address-mod-7.c @@ -0,0 +1,34 @@ +/* Tests for set_tagged_address_mask to turn off tagged address. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include +#include + +static void +init (void) +{ + uintptr_t mask = (uintptr_t) -1; + if (set_tagged_address_mask (mask) == 0) + FAIL_EXIT1 ("set_tagged_address_mask should have failed"); +} + +static void (*init_array []) (void) + __attribute__ ((used, section (".init_array"), aligned (sizeof (void *)))) = +{ + &init +}; diff --git a/sysdeps/generic/inline-tagged-address.h b/sysdeps/generic/inline-tagged-address.h new file mode 100644 index 0000000000..a016b16f21 --- /dev/null +++ b/sysdeps/generic/inline-tagged-address.h @@ -0,0 +1,43 @@ +/* Inline tagged address functions. Generic version. + Copyright (C) 2021 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#include + +static inline unsigned int +__get_tagged_address_bits (void) +{ + return sizeof (uintptr_t) * 8; +} + +static inline uintptr_t +__get_tagged_address_mask (void) +{ + return (uintptr_t) -1; +} + +static inline void * +__tag_address (void *addr, unsigned int tag) +{ + return addr; +} + +static inline void * +__untag_address (void *addr) +{ + return addr; +} diff --git a/sysdeps/generic/ldsodefs.h b/sysdeps/generic/ldsodefs.h index ea3f7a69d0..ed1d01d88d 100644 --- a/sysdeps/generic/ldsodefs.h +++ b/sysdeps/generic/ldsodefs.h @@ -484,6 +484,10 @@ struct rtld_global #else EXTERN int _dl_thread_gscope_count; #endif + + /* If nonzero, the mask for address bits used in address translation + is locked. */ + EXTERN int _dl_tagged_address_mask_locked; #ifdef SHARED }; # define __rtld_global_attribute__ diff --git a/sysdeps/unix/sysv/linux/i386/libc.abilist b/sysdeps/unix/sysv/linux/i386/libc.abilist index 943331f01e..17ab833c9d 100644 --- a/sysdeps/unix/sysv/linux/i386/libc.abilist +++ b/sysdeps/unix/sysv/linux/i386/libc.abilist @@ -2242,6 +2242,11 @@ GLIBC_2.33 mknodat F GLIBC_2.33 stat F GLIBC_2.33 stat64 F GLIBC_2.34 __libc_start_main F +GLIBC_2.34 get_tagged_address_bits F +GLIBC_2.34 get_tagged_address_mask F +GLIBC_2.34 set_tagged_address_mask F +GLIBC_2.34 tag_address F +GLIBC_2.34 untag_address F GLIBC_2.4 __confstr_chk F GLIBC_2.4 __fgets_chk F GLIBC_2.4 __fgets_unlocked_chk F diff --git a/sysdeps/unix/sysv/linux/x86_64/64/libc.abilist b/sysdeps/unix/sysv/linux/x86_64/64/libc.abilist index 17ce5dfd58..297e3d9136 100644 --- a/sysdeps/unix/sysv/linux/x86_64/64/libc.abilist +++ b/sysdeps/unix/sysv/linux/x86_64/64/libc.abilist @@ -2089,6 +2089,11 @@ GLIBC_2.33 mknodat F GLIBC_2.33 stat F GLIBC_2.33 stat64 F GLIBC_2.34 __libc_start_main F +GLIBC_2.34 get_tagged_address_bits F +GLIBC_2.34 get_tagged_address_mask F +GLIBC_2.34 set_tagged_address_mask F +GLIBC_2.34 tag_address F +GLIBC_2.34 untag_address F GLIBC_2.4 __confstr_chk F GLIBC_2.4 __fgets_chk F GLIBC_2.4 __fgets_unlocked_chk F diff --git a/sysdeps/unix/sysv/linux/x86_64/x32/libc.abilist b/sysdeps/unix/sysv/linux/x86_64/x32/libc.abilist index 17a1c83903..14a4dce255 100644 --- a/sysdeps/unix/sysv/linux/x86_64/x32/libc.abilist +++ b/sysdeps/unix/sysv/linux/x86_64/x32/libc.abilist @@ -2186,3 +2186,8 @@ GLIBC_2.33 mknodat F GLIBC_2.33 stat F GLIBC_2.33 stat64 F GLIBC_2.34 __libc_start_main F +GLIBC_2.34 get_tagged_address_bits F +GLIBC_2.34 get_tagged_address_mask F +GLIBC_2.34 set_tagged_address_mask F +GLIBC_2.34 tag_address F +GLIBC_2.34 untag_address F