Actions
Issue #3814
closedFile Support - Issue #3770: Pulp 3 is about 2x slower than pulp 2 in syncing a large file repo
RemositoryVersion's add_content and remove_content does not perform bulk operations
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Performance
Sprint:
Quarter:
Description
Motivation¶
A cprofile report shows that a lot of time is being spent in RepositoryVersion.add_content() which interacts with the database on a unit-by-unit level. This is taking a long time. We need to improve the interface to perform add_content and remove_content via bulk operations.
Solution¶
1. Create a test in python that adds/removes X number of content units to a repo version
2. Benchmark the test
3. Update add_content and remove_content to support lists of content
4. Benchmark the change
I'll probably use different values of X starting with 1,000 and increasing up by factors of 10.
Actions
Using querysets for add/remove_content methods
fixes #3814 https://pulp.plan.io/issues/3814