Issue #2568
closed
DocumentTooLarge error during merge of errata pkglists
Description
In certain cases new collections are added to the erratum pkglist with every sync, so at some point pkglist becomes so long that the BSON document size limit is reached.
Conditions to end up in this situation:
- an erratum synced with Pulp < 2.8.5
- upgrade to Pulp >= 2.8.5 (errata merge implemented)
- pkglist for the same erratum changed upstream before the first operational sync (after Pulp upgrade) was performed
- any operational sync at this point will add one more collection to erratum
It may sound like a rare case but according to BZ it is not, probably because pkglists were changed for errata in EPEL7 repo which a lot of users have in their Pulp.
For example, pkglist for erratum FEDORA-EPEL-2016-f057025262 was changed.
Related issues
Updated by ttereshc almost 8 years ago
- Status changed from NEW to ASSIGNED
- Assignee set to ttereshc
Updated by mhrivnak almost 8 years ago
- Severity changed from 2. Medium to 3. High
- Triaged changed from No to Yes
Updated by ttereshc almost 8 years ago
- Status changed from ASSIGNED to POST
Added by ttereshc almost 8 years ago
Updated by ttereshc almost 8 years ago
- Status changed from POST to MODIFIED
Applied in changeset 03517e026f9f414fad74e805b41dd733fc081f89.
Updated by demter@atix.de almost 8 years ago
I have tested your changes against several katello instances running pulp-server-2.9.3-1.el7.noarch
they all seem to be running fine - syncing and content view publish works as expected again.
for the record - I simply used the changes in your pr. I ran pulp-manage-db --test
to not mess up the mongodb for future migrations and deleted the migration after I was done.
Thanks!
Updated by ttereshc almost 8 years ago
- Related to Issue #2599: Deprecation warning in the logs during errata migration added
Updated by bizhang almost 8 years ago
- Status changed from 5 to CLOSED - CURRENTRELEASE
Updated by ttereshc over 7 years ago
- Has duplicate Issue #2738: Errata package list exceed mongod 16MB document size limit. added
.
Fix the errata merge logic
Pkglists should no longer be extended with the collections for the same repository. Migration is introduced to clean up duplicates in the affected pkglists.
closes #2568 https://pulp.plan.io/issues/2568