From patchwork Thu Jul 25 17:14:05 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Eric W. Biederman" X-Patchwork-Id: 33797 Received: (qmail 126717 invoked by alias); 25 Jul 2019 17:14:20 -0000 Mailing-List: contact libc-alpha-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: libc-alpha-owner@sourceware.org Delivered-To: mailing list libc-alpha@sourceware.org Received: (qmail 126697 invoked by uid 89); 25 Jul 2019 17:14:20 -0000 Authentication-Results: sourceware.org; auth=none X-Spam-SWARE-Status: No, score=-17.6 required=5.0 tests=AWL, BAYES_00, GIT_PATCH_0, GIT_PATCH_1, GIT_PATCH_2, GIT_PATCH_3, RCVD_IN_DNSWL_LOW, SPF_PASS autolearn=ham version=3.3.1 spammy=credits, adapt X-HELO: out03.mta.xmission.com From: ebiederm@xmission.com (Eric W. Biederman) To: Arnd Bergmann Cc: Rich Felker , Alistair Francis , Christian Brauner , Linus Torvalds , Alistair Francis , GNU C Library , Adhemerval Zanella , Florian Weimer , Palmer Dabbelt , macro@wdc.com, Zong Li , Andrew Morton , Al Viro , "H. Peter Anvin" References: <87muh79yt2.fsf@xmission.com> <87blxn83sk.fsf@xmission.com> <20190721232336.GA30851@brightrain.aerifal.cx> <87k1c962ml.fsf@xmission.com> <20190723082857.kf2go2vfvnu7q7zd@brauner.io> <20190725044009.GJ1506@brightrain.aerifal.cx> Date: Thu, 25 Jul 2019 12:14:05 -0500 In-Reply-To: (Arnd Bergmann's message of "Thu, 25 Jul 2019 15:15:35 +0200") Message-ID: <8736iuujdu.fsf@xmission.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.1 (gnu/linux) MIME-Version: 1.0 X-XM-SPF: eid=1hqhJk-0002ot-2g; ; ; mid=<8736iuujdu.fsf@xmission.com>; ; ; hst=in01.mta.xmission.com; ; ; ip=68.227.160.95; ; ; frm=ebiederm@xmission.com; ; ; spf=neutral X-XM-AID: U2FsdGVkX1/epApTIrNUeJuHSK0GivkhPJ2IAL+8Cl8= X-SA-Exim-Connect-IP: 68.227.160.95 X-SA-Exim-Mail-From: ebiederm@xmission.com X-Spam-DCC: XMission; sa06 1397; Body=1 Fuz1=1 Fuz2=1 X-Spam-Combo: ;Arnd Bergmann X-Spam-Relay-Country: X-Spam-Timing: total 706 ms - load_scoreonly_sql: 0.04 (0.0%), signal_user_changed: 4.4 (0.6%), b_tie_ro: 3.2 (0.5%), parse: 0.92 (0.1%), extract_message_metadata: 20 (2.9%), get_uri_detail_list: 3.1 (0.4%), tests_pri_-1000: 22 (3.1%), tests_pri_-950: 1.28 (0.2%), tests_pri_-900: 1.13 (0.2%), tests_pri_-90: 35 (5.0%), check_bayes: 34 (4.8%), b_tokenize: 12 (1.7%), b_tok_get_all: 12 (1.7%), b_comp_prob: 3.4 (0.5%), b_tok_touch_all: 4.2 (0.6%), b_finish: 0.60 (0.1%), tests_pri_0: 607 (86.0%), check_dkim_signature: 0.55 (0.1%), check_dkim_adsp: 3.0 (0.4%), poll_dns_idle: 0.30 (0.0%), tests_pri_10: 2.3 (0.3%), tests_pri_500: 8 (1.1%), rewrite_mail: 0.00 (0.0%) Subject: Re: [RFC v3 03/23] sysdeps/wait: Use waitid if avaliable X-SA-Exim-Version: 4.2.1 (built Thu, 05 May 2016 13:38:54 -0600) X-SA-Exim-Scanned: Yes (on in01.mta.xmission.com) Arnd Bergmann writes: > On Thu, Jul 25, 2019 at 6:40 AM Rich Felker wrote: >> On Wed, Jul 24, 2019 at 05:04:53PM -0700, Alistair Francis wrote: >> > On Tue, Jul 23, 2019 at 1:45 AM Arnd Bergmann wrote: >> > > >> > > Sounds good to me, the debate over what rusage to use should not hold >> > > up the review of the rest of that syscall. >> > >> > I'm unclear what the final decision is here. What is the solution are >> > we going to have wait4() or add P_PROCESS_PGID to waitid()? >> > >> > As well as that what is the solution to current implementations? If we >> > add wait4() then there isn't an issue (and I can drop this patch) but >> > if we add P_PROCESS_PGID then we will need a way to handle kernels >> > with waitid() but no P_PROCESS_PGID. Although my new plan is to only >> > use the waitid syscall if we don't have waitpid or wait4 so it seems >> > like this will only affect RV32 for the time being. >> >> I would really like some indication which solution will be taken, >> since it impacts choices that will need to be made in musl very soon. >> My favorite outcome would be bringing back wait4 for rv32 (and >> no-time32 archs in general) *and* adding P_PROCESS_PGID. In the short >> term, just using wait4 would be the simplest and cleanest for us (same >> as all other archs, no extra case to deal with), but in the long term >> there may be value in having rusage that can represent more than 68 >> cpu-years spent by a process (seems plausible with large numbers of >> cores). > > Based on the feedback from Linus and Eric, the most likely outcome > at the moment seems to be an extension of waitid() to allow > P_PGID with id=0 like BSD does, and not bring back wait4() or > add P_PROCESS_PGID. > > So far, I don't think anyone has proposed an actual kernel patch. > I was hoping that Eric would do it, but I could also send it if he's > otherwise busy. So here is what I am looking at. It still needs to be tested and the description needs to be improved so that it properly credits everyone. However I think I have the major stroeks correct. From: "Eric W. Biederman" Date: Tue, 23 Jul 2019 07:44:46 -0500 Subject: [PATCH] waitid: Add support for waiting for the current process group It was recently discovered that the linux version of waitid is not a superset of the other wait functions because it does not include support for waiting for the current process group. This has two downsides. An extra system call is needed to get the current process group, and a signal could come in between the system call that retrieved the process gorup and the call to waitid that changes the current process group. Allow userspace to avoid both of those issues by defining idtype == P_PGID and id == 0 to mean wait for the caller's process group at the time of the call. Arguments can be made for using a different choice of idtype and id for this case but the BSDs already use this P_PGID and 0 to indicate waiting for the current process's process group. So be nice to user space programmers and don't introduce an unnecessary incompatibility. Some people have noted that the posix description is that waitpid will wait for the current process group, and that in the presence of pthreads that process group can change. To get clarity on this issue I looked at XNU, FreeBSD, and Luminos. All of those flavors of unix waited for the current process group at the time of call and as written could not adapt to the process group changing after the call. At one point Linux did adapt to the current process group changing but that stopped in 161550d74c07 ("pid: sys_wait... fixes"). It has been over 11 years since Linux has that behavior, no programs that fail with the change in behavior have been reported, and I could not find any other unix that does this. So I think it is safe to clarify the definition of current process group, to current process group at the time of the wait function. Signed-off-by: "Eric W. Biederman" --- kernel/exit.c | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/kernel/exit.c b/kernel/exit.c index a75b6a7f458a..3d86930f035e 100644 --- a/kernel/exit.c +++ b/kernel/exit.c @@ -1577,14 +1577,16 @@ static long kernel_waitid(int which, pid_t upid, struct waitid_info *infop, break; case P_PGID: type = PIDTYPE_PGID; - if (upid <= 0) + if (upid < 0) return -EINVAL; + if (upid == 0) + pid = get_pid(task_pgrp(current)); break; default: return -EINVAL; } - if (type < PIDTYPE_MAX) + if ((type < PIDTYPE_MAX) && !pid) pid = find_get_pid(upid); wo.wo_type = type;