Project

Profile

Help

Issue #2681

Store errata package lists in a separate collection

Added by dkliban@redhat.com almost 5 years ago. Updated almost 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
2.13.3
OS:
Triaged:
Yes
Groomed:
Yes
Sprint Candidate:
Yes
Tags:
Pulp 2
Sprint:
Sprint 20
Quarter:

Description

This story has 5 deliverables.

1. New model for storing errata package lists. This model needs at least three fields: repo_id, errata_id, package_list.
2. Update yum importer to use the new model when storing errata package lists.
3. Update yum distributor to use the new model when publishing errata.
4. Migration that will take all the package lists stored inside each document in the units_erratum collection and move them into the new errata_package_lists collection.
5. Update yum profiler to use the new model when calculating applicability for errata.

Search and some API calls which select units from db may expect pkglist to be present. We need to check with Katello if they use errata pkglist anywhere or not. Solved, no API change.

Associated revisions

Revision 630193fc View on GitHub
Added by ttereshc over 4 years ago

Support for storing units in multiple collections

The following is added:

  • load of auxiliary models
  • post-delete method during orphan removal
  • serialization in profiler to have all the data in a proper shape for applicability calculation

Also migration progress logging util is added

re #2681 https://pulp.plan.io/issues/2681

Revision 167e3148 View on GitHub
Added by ttereshc over 4 years ago

Store erratum pkglist in a separate collection

closes #2681 https://pulp.plan.io/issues/2681

Revision e7717059 View on GitHub
Added by ttereshc over 4 years ago

Support for storing units in multiple collections

The following is added:

  • load of auxiliary models
  • post-delete method during orphan removal
  • serialization in profiler to have all the data in a proper shape for applicability calculation

Also migration progress logging util is added

re #2681 https://pulp.plan.io/issues/2681

(cherry picked from commit 630193fc1c63f573fbd15f1885ce14e72c90896e)

Revision ffb39387 View on GitHub
Added by ttereshc over 4 years ago

Store erratum pkglist in a separate collection

closes #2681 https://pulp.plan.io/issues/2681

(cherry picked from commit 167e314853b1fb2a132ab7f18253c13c0b890d4f)

History

#2 Updated by ttereshc almost 5 years ago

Issue #2568 is different, just the error message would be the same.

#3 Updated by dkliban@redhat.com almost 5 years ago

  • Tracker changed from Issue to Story
  • Subject changed from Orphan cleanup does not handle errata package lists correctly to Store errata package lists in a separate collection
  • Description updated (diff)
  • % Done set to 0

#5 Updated by ttereshc almost 5 years ago

  • Description updated (diff)

#6 Updated by mhrivnak almost 5 years ago

If we can think of any way that the new collection could be pre-populated while Pulp is up and running, to reduce the downtime required to migrate, that could be very valuable. But not a requirement.

#7 Updated by mhrivnak almost 5 years ago

  • Groomed changed from No to Yes
  • Sprint Candidate changed from No to Yes

#8 Updated by mhrivnak almost 5 years ago

  • Sprint/Milestone set to 37

#9 Updated by ttereshc almost 5 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to ttereshc

#10 Updated by ttereshc almost 5 years ago

I think we can still make errata pkglist available via API. So I suggest to ignore checklist item at least for now.

#12 Updated by jortel@redhat.com over 4 years ago

  • Sprint/Milestone changed from 37 to 38

#13 Updated by ttereshc over 4 years ago

  • Status changed from ASSIGNED to POST

#14 Updated by ttereshc over 4 years ago

  • Description updated (diff)

#15 Updated by ttereshc over 4 years ago

To test PRs:
- check out both, plugin PR depends on platform one.
- do not forget to re-install Pulp becasue new entrypoint was added

Affected parts worth checking:
- erratum sync
- erratum upload
- erratum publish
- incremental export of erratum
- errata applicability (hint: behavior preserved by using serializer)
- search API (hint: behavior preserved by using serializer)
- orphan removal (check that pkglists related to erratum are deleted from their mongo collection when erratum itself is cleaned up)
- migration can be re-run multiple times (only first run is noticeable in terms of running time, all the subsequent ones should be very fast, no db writes at all)

I do not think any specific smash issue needed.
If all general tests which include mentioned affected parts are passed, then everything is ok.

#16 Updated by mhrivnak over 4 years ago

  • Sprint/Milestone changed from 38 to 39

#18 Updated by ttereshc over 4 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

#19 Updated by ttereshc over 4 years ago

  • Platform Release set to 2.14.0

#21 Updated by pcreech over 4 years ago

  • Tracker changed from Story to Issue
  • Severity set to 2. Medium
  • Platform Release changed from 2.14.0 to 2.13.3
  • Triaged set to No

#22 Updated by pcreech over 4 years ago

  • Triaged changed from No to Yes

#23 Updated by ttereshc over 4 years ago

#24 Updated by pcreech over 4 years ago

  • Status changed from MODIFIED to 5

#25 Updated by pcreech over 4 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE

#26 Updated by bmbouter almost 4 years ago

  • Sprint set to Sprint 20

#27 Updated by bmbouter almost 4 years ago

  • Sprint/Milestone deleted (39)

#28 Updated by bmbouter almost 3 years ago

  • Tags Pulp 2 added

Also available in: Atom PDF