Project

Profile

Help

Issue #6387

closed

modular applicability profiles are not cleaned up properly

Added by ttereshc about 4 years ago. Updated almost 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
2.21.2
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 71
Quarter:

Description

GenerateApplicability performance seems to be worse in 2.18. Part of the diagnosis routine is to check the 2 collections and note if there was a significant size difference:

db.repo_profile_applicability db.consumers

I've checked with an older customer 2.16 database and get the following counts:

> db.repo_profile_applicability.find().size()
61526
>  db.consumers.find().size()
54726
>

Checking with another customer with similar sized database on 2.18 shows a greater than 10x ratio which was causing performance issues in older versions:

> db.repo_profile_applicability.find().size()
863830
>  db.consumers.find().size()
66891
>

I checked and the montly maintenance is being ran and running it manually returns very quickly (5 seconds):

 celery.worker.strategy:INFO: Received task: pulp.server.maintenance.monthly.queue_monthly_maintenance[5a5aefbd-dd52-42b5-8d38-2c3b65053f27]
 celery.worker.strategy:INFO: Received task: pulp.server.maintenance.monthly.monthly_maintenance[7c4e5227-9572-439d-99e0-9ad938c9fc9c]
 celery.app.trace:INFO: [5a5aefbd] Task pulp.server.maintenance.monthly.queue_monthly_maintenance[5a5aefbd-dd52-42b5-8d38-2c3b65053f27] succeeded in 0.0373372323811s: None
 pulp.server.managers.consumer.applicability:INFO: [7c4e5227] Orphaned consumer profiles to process: 2253
 pulp.server.managers.consumer.applicability:INFO: [7c4e5227] Orphaned consumer profiles processed: 2253
 celery.app.trace:INFO: [7c4e5227] Task pulp.server.maintenance.monthly.monthly_maintenance[7c4e5227-9572-439d-99e0-9ad938c9fc9c] succeeded in 5.05477944389s: None

yet the size of repo_profile_applicability remains large.

Most of the applicability profiles are empty modular profiles.

Actions #1

Updated by ttereshc about 4 years ago

  • Description updated (diff)
Actions #2

Updated by ttereshc about 4 years ago

  • Triaged changed from No to Yes
Actions #3

Updated by ttereshc almost 4 years ago

  • Status changed from NEW to ASSIGNED
  • Sprint set to Sprint 71
Actions #4

Updated by ttereshc almost 4 years ago

  • Assignee set to ttereshc

Added by ttereshc almost 4 years ago

Revision 8d8b0b7c | View on GitHub

Handle emtpy consumer profiles properly

No longer create an applicability profile for empty consumer profiles. Remove applicability profiles which refer to an empty consumer profile.

closes #6387 https://pulp.plan.io/issues/6387

Actions #5

Updated by ttereshc almost 4 years ago

  • Project changed from RPM Support to Pulp
  • Status changed from ASSIGNED to POST
  • Tags Pulp 2 added
Actions #6

Updated by ttereshc almost 4 years ago

  • Status changed from POST to MODIFIED
Actions #7

Updated by dalley almost 4 years ago

  • Platform Release set to 2.21.2

Added by ttereshc almost 4 years ago

Revision 0016f7ba | View on GitHub

Handle emtpy consumer profiles properly

No longer create an applicability profile for empty consumer profiles. Remove applicability profiles which refer to an empty consumer profile.

closes #6387 https://pulp.plan.io/issues/6387

(cherry picked from commit 8d8b0b7c20af3db88e28c6ff7e05e71a1a07cd8e)

Actions #9

Updated by dalley almost 4 years ago

  • Status changed from MODIFIED to 5
Actions #10

Updated by dalley almost 4 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE

Also available in: Atom PDF