Project

Profile

Help

Issue #2568

closed

DocumentTooLarge error during merge of errata pkglists

Added by ttereshc about 7 years ago. Updated almost 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
3. High
Version:
Platform Release:
2.12.1
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 15
Quarter:

Description

In certain cases new collections are added to the erratum pkglist with every sync, so at some point pkglist becomes so long that the BSON document size limit is reached.

Conditions to end up in this situation:

  • an erratum synced with Pulp < 2.8.5
  • upgrade to Pulp >= 2.8.5 (errata merge implemented)
  • pkglist for the same erratum changed upstream before the first operational sync (after Pulp upgrade) was performed
  • any operational sync at this point will add one more collection to erratum

It may sound like a rare case but according to BZ it is not, probably because pkglists were changed for errata in EPEL7 repo which a lot of users have in their Pulp.
For example, pkglist for erratum FEDORA-EPEL-2016-f057025262 was changed.


Related issues

Related to RPM Support - Issue #2599: Deprecation warning in the logs during errata migrationCLOSED - CURRENTRELEASEttereshcActions
Has duplicate RPM Support - Issue #2738: Errata package list exceed mongod 16MB document size limit.CLOSED - DUPLICATEActions
Actions #1

Updated by ttereshc about 7 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to ttereshc
Actions #2

Updated by mhrivnak about 7 years ago

  • Severity changed from 2. Medium to 3. High
  • Triaged changed from No to Yes
Actions #3

Updated by mhrivnak about 7 years ago

  • Sprint/Milestone set to 33
Actions #4

Updated by ttereshc about 7 years ago

  • Status changed from ASSIGNED to POST

Added by ttereshc about 7 years ago

Revision 03517e02 | View on GitHub

Fix the errata merge logic

Pkglists should no longer be extended with the collections for the same repository. Migration is introduced to clean up duplicates in the affected pkglists.

closes #2568 https://pulp.plan.io/issues/2568

Actions #5

Updated by ttereshc about 7 years ago

  • Status changed from POST to MODIFIED
Actions #7

Updated by bizhang about 7 years ago

  • Platform Release set to 2.12.1
Actions #8

Updated by bizhang about 7 years ago

  • Status changed from MODIFIED to 5
Actions #9

Updated by bizhang about 7 years ago

  • Version set to 2.12.1
Actions #10

Updated by demter@atix.de about 7 years ago

I have tested your changes against several katello instances running pulp-server-2.9.3-1.el7.noarch

they all seem to be running fine - syncing and content view publish works as expected again.

for the record - I simply used the changes in your pr. I ran pulp-manage-db --test
to not mess up the mongodb for future migrations and deleted the migration after I was done.

Thanks!

Actions #11

Updated by bizhang about 7 years ago

  • Version deleted (2.12.1)
Actions #12

Updated by ttereshc about 7 years ago

  • Related to Issue #2599: Deprecation warning in the logs during errata migration added
Actions #13

Updated by bizhang about 7 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE
Actions #15

Updated by ttereshc almost 7 years ago

  • Has duplicate Issue #2738: Errata package list exceed mongod 16MB document size limit. added
Actions #16

Updated by bmbouter about 6 years ago

  • Sprint set to Sprint 15
Actions #17

Updated by bmbouter about 6 years ago

  • Sprint/Milestone deleted (33)
Actions #18

Updated by bmbouter almost 5 years ago

  • Tags Pulp 2 added

Also available in: Atom PDF