Project

Profile

Help

Issue #6334

closed

Low applicability performance for large setups due to inefficient query of repo content

Added by ttereshc over 4 years ago. Updated over 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
2.21.2
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

Regenerate applicability (both for a repo or for a consumer) requests from mongo repo_content_units data that are not required for the calculation. This has very evident negative performance impact, as

  • it puts mongo under higher load
  • the task keeps redundant data in a map

Restricting the search to return just required fields only improves task performance.

Avoid checking the pkglist of the errata in other repos when calculating the applicability for a repo in the majority of cases. The collections get updated every time the repo is synced. Katello is always calculating the applicability against the synced repos only. For very old content or for copied repos there should be a fallback logic.

Added by ttereshc over 4 years ago

Revision ab402e2e | View on GitHub

Query only required set of fields for calculating applicability.

The patch from Pavel Moravec.

re #6334 https://pulp.plan.io/issues/6334

Added by ttereshc over 4 years ago

Revision 32763d4f | View on GitHub

Query only specified set of fields

Used for calculating applicability. The patch from Pavel Moravec.

re #6334 https://pulp.plan.io/issues/6334

Actions #1

Updated by ttereshc over 4 years ago

  • Description updated (diff)

Added by hyu over 4 years ago

Revision 9f144f94 | View on GitHub

Improve the performance of calculating applicable errata

closes #6334 https://pulp.plan.io/issues/6334

Actions #2

Updated by hyu over 4 years ago

  • Status changed from NEW to MODIFIED

Added by hyu over 4 years ago

Revision f3eaf8c0 | View on GitHub

Speed up the erratum pkglists query by adding a repo_id index

re #6334 https://pulp.plan.io/issues/6334

Actions #3

Updated by dalley over 4 years ago

  • Sprint/Milestone set to Pulp RPM 3.3.0
Actions #4

Updated by dalley over 4 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Actions #5

Updated by ttereshc over 4 years ago

  • Sprint/Milestone deleted (Pulp RPM 3.3.0)
  • Tags Pulp 2 added
Actions #6

Updated by ttereshc over 4 years ago

  • Status changed from CLOSED - CURRENTRELEASE to MODIFIED

Added by hyu over 4 years ago

Revision dab8f761 | View on GitHub

Improve the performance of calculating applicable errata

closes #6334 https://pulp.plan.io/issues/6334

(cherry picked from commit 9f144f94064b8803b2a145f729470583ad36b308)

Actions #7

Updated by hyu over 4 years ago

Added by hyu over 4 years ago

Revision f7592994 | View on GitHub

Improve the performance of calculating applicable errata

closes #6334 https://pulp.plan.io/issues/6334

(cherry picked from commit 9f144f94064b8803b2a145f729470583ad36b308)

Actions #8

Updated by hyu over 4 years ago

Actions #9

Updated by ttereshc over 4 years ago

  • Platform Release set to 2.21.2
Actions #10

Updated by dalley over 4 years ago

  • Status changed from MODIFIED to 5
Actions #11

Updated by dalley over 4 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE

Also available in: Atom PDF