build-many-glibcs.py: Use --depth 1 in Git checkout
Commit Message
The history is not used by build-many-glibcs.py itself.
--replace-sources deletes an existing source tree before switching
the version.
This works around networking and Git server performance issues to some
degree.
-----
scripts/build-many-glibcs.py | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
Comments
On Fri, 28 Feb 2020, Florian Weimer wrote:
> The history is not used by build-many-glibcs.py itself.
> --replace-sources deletes an existing source tree before switching
> the version.
>
> This works around networking and Git server performance issues to some
> degree.
I think making a shallow clone is unhelpful in practice since it's
routinely useful to revert to previous versions when finding where a
problem appeared.
* Joseph Myers:
> On Fri, 28 Feb 2020, Florian Weimer wrote:
>
>> The history is not used by build-many-glibcs.py itself.
>> --replace-sources deletes an existing source tree before switching
>> the version.
>>
>> This works around networking and Git server performance issues to some
>> degree.
>
> I think making a shallow clone is unhelpful in practice since it's
> routinely useful to revert to previous versions when finding where a
> problem appeared.
Would it be too cumbersome to run git fetch --unshallow in this case,
before starting the investigation?
It really reduces checkout time, particularly if sourceware.org is under
load.
Thanks,
Florian
On Fri, 28 Feb 2020, Florian Weimer wrote:
> Would it be too cumbersome to run git fetch --unshallow in this case,
> before starting the investigation?
>
> It really reduces checkout time, particularly if sourceware.org is under
> load.
Once the new sourceware is up and running, maybe we should work with
overseers on (a) ensuring all active repositories have repack.writeBitmaps
set to true, (b) doing repacks of repositories using suitable aggressive
very-large-repository settings as used for GCC (git repack --window=1250
--depth=250 -b -AdFfi) and (c) setting up cron jobs to do a more
lightweight packing with bitmaps (Richard Earnshaw says git repack
--window-memory=500m --window=250 --depth=50 -b -A -d -i) on all
repositories, say weekly. The effect of such better packing of
repositories with bitmaps should be to speed up checkouts.
On Feb 28 2020, Florian Weimer wrote:
> It really reduces checkout time, particularly if sourceware.org is under
> load.
Why can't you just use a local mirror?
Andreas.
* Andreas Schwab:
> On Feb 28 2020, Florian Weimer wrote:
>
>> It really reduces checkout time, particularly if sourceware.org is under
>> load.
>
> Why can't you just use a local mirror?
I was trying to push builds out to a cluster of machines, and I don't
know where local is for each machine.
Thanks,
Florian
On Mär 03 2020, Florian Weimer wrote:
> * Andreas Schwab:
>
>> On Feb 28 2020, Florian Weimer wrote:
>>
>>> It really reduces checkout time, particularly if sourceware.org is under
>>> load.
>>
>> Why can't you just use a local mirror?
>
> I was trying to push builds out to a cluster of machines, and I don't
> know where local is for each machine.
You can make it anywhere you like.
Andreas.
* Andreas Schwab:
> On Mär 03 2020, Florian Weimer wrote:
>
>> * Andreas Schwab:
>>
>>> On Feb 28 2020, Florian Weimer wrote:
>>>
>>>> It really reduces checkout time, particularly if sourceware.org is under
>>>> load.
>>>
>>> Why can't you just use a local mirror?
>>
>> I was trying to push builds out to a cluster of machines, and I don't
>> know where local is for each machine.
>
> You can make it anywhere you like.
Sure, and with --shallow, it's a little bit faster even.
Thanks,
Florian
@@ -852,7 +852,8 @@ class Context(object):
subprocess.run(['git', 'pull', '-q'],
cwd=self.component_srcdir(component), check=True)
else:
- subprocess.run(['git', 'clone', '-q', '-b', git_branch, git_url,
+ subprocess.run(['git', 'clone', '-q', '-b', git_branch,
+ '--depth', '1', git_url,
self.component_srcdir(component)], check=True)
r = subprocess.run(['git', 'rev-parse', 'HEAD'],
cwd=self.component_srcdir(component),