Issue #6387
closedmodular applicability profiles are not cleaned up properly
Description
GenerateApplicability performance seems to be worse in 2.18. Part of the diagnosis routine is to check the 2 collections and note if there was a significant size difference:
db.repo_profile_applicability db.consumers
I've checked with an older customer 2.16 database and get the following counts:
> db.repo_profile_applicability.find().size()
61526
> db.consumers.find().size()
54726
>
Checking with another customer with similar sized database on 2.18 shows a greater than 10x ratio which was causing performance issues in older versions:
> db.repo_profile_applicability.find().size()
863830
> db.consumers.find().size()
66891
>
I checked and the montly maintenance is being ran and running it manually returns very quickly (5 seconds):
celery.worker.strategy:INFO: Received task: pulp.server.maintenance.monthly.queue_monthly_maintenance[5a5aefbd-dd52-42b5-8d38-2c3b65053f27]
celery.worker.strategy:INFO: Received task: pulp.server.maintenance.monthly.monthly_maintenance[7c4e5227-9572-439d-99e0-9ad938c9fc9c]
celery.app.trace:INFO: [5a5aefbd] Task pulp.server.maintenance.monthly.queue_monthly_maintenance[5a5aefbd-dd52-42b5-8d38-2c3b65053f27] succeeded in 0.0373372323811s: None
pulp.server.managers.consumer.applicability:INFO: [7c4e5227] Orphaned consumer profiles to process: 2253
pulp.server.managers.consumer.applicability:INFO: [7c4e5227] Orphaned consumer profiles processed: 2253
celery.app.trace:INFO: [7c4e5227] Task pulp.server.maintenance.monthly.monthly_maintenance[7c4e5227-9572-439d-99e0-9ad938c9fc9c] succeeded in 5.05477944389s: None
yet the size of repo_profile_applicability remains large.
Most of the applicability profiles are empty modular profiles.
Updated by ttereshc over 4 years ago
- Status changed from NEW to ASSIGNED
- Sprint set to Sprint 71
Added by ttereshc over 4 years ago
Updated by ttereshc over 4 years ago
- Project changed from RPM Support to Pulp
- Status changed from ASSIGNED to POST
- Tags Pulp 2 added
Updated by ttereshc over 4 years ago
- Status changed from POST to MODIFIED
Applied in changeset pulp|8d8b0b7c20af3db88e28c6ff7e05e71a1a07cd8e.
Added by ttereshc over 4 years ago
Revision 0016f7ba | View on GitHub
Handle emtpy consumer profiles properly
No longer create an applicability profile for empty consumer profiles. Remove applicability profiles which refer to an empty consumer profile.
closes #6387 https://pulp.plan.io/issues/6387
(cherry picked from commit 8d8b0b7c20af3db88e28c6ff7e05e71a1a07cd8e)
Updated by ttereshc over 4 years ago
Applied in changeset pulp|0016f7ba16e1e3eae983527f98c6a662132894dd.
Updated by dalley over 4 years ago
- Status changed from 5 to CLOSED - CURRENTRELEASE
Handle emtpy consumer profiles properly
No longer create an applicability profile for empty consumer profiles. Remove applicability profiles which refer to an empty consumer profile.
closes #6387 https://pulp.plan.io/issues/6387