Project

Profile

Help

Issue #7212

closed

Adjust download concurrency

Added by bmbouter over 3 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Category:
-
Sprint/Milestone:
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 79
Quarter:

Description

There are reports that the download concurrency is too high, like this one: https://pulp.plan.io/issues/7186#note-4

So we should lower the concurrency limit. We need to balance the stability gained from a lower concurrency against the lost speeds from parallel fetching.

Can someone measure the runtime of a policy=immediate sync with the following download_concurrency values:

20, 15, 10, 7, 5, 3

Pulp2 had a value of 5. Other download softwares like bandersnatch have a value of 3, so one of those is the most likely choice. We should understand how the performance degrades though so running this test would be nice.


Related issues

Related to RPM Support - Issue #7186: Immediate syncing of some CentOS 6 and 7 repos failingCLOSED - DUPLICATEActions
Related to Pulp - Issue #8878: default Download Concurrency is too high for many centos mirrorsCLOSED - DUPLICATEdalleyActions

Also available in: Atom PDF