Project

Profile

Help

Issue #596

closed

Multiple unit_types in association call causes to fetch everything from source repo

Added by tkopecek@redhat.com over 9 years ago. Updated over 4 years ago.

Status:
CLOSED - WONTFIX
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
2.3
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

When I run two almost same copy calls it has very different impact on performance. First (a) is creating correct query on all-content repo. It means it contains filters. If I call second one (b), pulp somehow leave out filters and queries everything in all-content. It fetches all and then call file by file queries. As in my repo is quite a lot of files, apache soon eats all memory (30GB) and crashes. Difference is just in querying more unit types in one call. Of course there is a workaround to split it to more calls, but in first place it is not expected behaviour.

This behaviour is present in 2.3 release, not sure if it is fixed in newer releases.

from pulp_rpm.common.ids import UNIT_KEY_RPM
filters = {'checksum': {'$in': ['abc', 'def', ghi']}, 'checksumtype': 'sha256'}
fields = list(UNIT_KEY_RPM) + ['filename', 'signature']
a = repo_unit_api.copy('all-content', 'test-rpm', type_ids = ['rpm'], filters=filters, fields=fields).response_body.task_id
b = repo_unit_api.copy('all-content', 'test-rpm', type_ids = ['rpm', 'iso'], filters=filters, fields=fields).response_body.task_id

Description:

Packages to be added:

Comps group:

Default:

Mandatory:

Visible:

Multi-lib:

Need to be present for arches:

Description of problem:

Version-Release number of selected component (if applicable):

How reproducible:

Steps to Reproduce:
1.
2.
3.

Actual results:

Expected results:

Additional info:

+ This bug was cloned from Bugzilla Bug #1158545 +


Related issues

Has duplicate Pulp - Issue #105: repo unit association does not always use generators, leading to OOMsCLOSED - DUPLICATEActions

Also available in: Atom PDF