Issue #5236: Collections sync doesn't fetch metadata in parallel - Pulp

Send by e-mail

Issue #5236

Collections sync doesn't fetch metadata in parallel

Added by bmbouter almost 2 years ago. Updated about 1 year ago.

Status:

CLOSED - CURRENTRELEASE

Priority:

Normal

Assignee:

Category:

Sprint/Milestone:

3.0.0

Start date:

Due date:

Estimated time:

Severity:

2. Medium

Version:

Platform Release:

OS:

Triaged:

Yes

Groomed:

Sprint Candidate:

Tags:

Performance

Sprint:

Sprint 57

Quarter:

Description

The current sync implementation schedules a single coroutine and waits for it to return, this effectively schedules a single downloader. When you have to make thousands of requests (as this sync does) we should parallelize it.

Associated revisions

Revision be614270 View on GitHub
Added by Fabricio Aguiar almost 2 years ago

Optimize collections sync

closes #5236

History

#1 Updated by bmbouter almost 2 years ago

Tracker changed from Task to Issue
Subject changed from Update Collections sync to be parallelized to Collections sync doesn't fetch metadata in parallel
Severity set to 2. Medium
Triaged set to Yes
Sprint set to Sprint 57