Project

Profile

Help

Issue #3893

pulp.server.maintenance.monthly fails if applicability collection is too large

Added by ttereshc about 3 years ago. Updated over 2 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
2.17.1
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 41
Quarter:

Description

Jul 31 16:04:24 pulp: celery.worker.job:INFO: Task pulp.server.maintenance.monthly.queue_monthly_maintenance[d00b6ddf-6f3a-42dc-8b72-690513c7ce5a] succeeded in 0.293885109015s: None

Jul 31 16:04:29 pulp: celery.worker.job:ERROR: (28015-45440) Task pulp.server.maintenance.monthly.monthly_maintenance[8de6e9ec-b998-4581-acf8-29d3810c0f3f] raised unexpected:
OperationFailure(u"command SON ([('distinct', u'repo_profile_applicability'), ('key', 'profile_hash')]) on namespace pulp_database.$cmd failed: exception: distinct too big, 16mb cap",)

Jul 31 16:04:29 chlp2550341a pulp: celery.worker.job:ERROR: (28015-45440) File "/usr/lib/python2.7/site-packages/pulp/server/maintenance/monthly.py", line 22, in monthly_maintenance

Associated revisions

Revision 8a043dbd View on GitHub
Added by ttereshc about 3 years ago

Use aggregation pipeline to avoid BSON 16MB size limit

Results are written into a separate collection which is reused every time the cleanup is run. If there are millions of orphaned applicability profiles, it's easy to exceed 16MB.

closes #3893 https://pulp.plan.io/issues/3893

Revision cbbe5faf View on GitHub
Added by ttereshc about 3 years ago

Use aggregation pipeline to avoid BSON 16MB size limit

Results are written into a separate collection which is reused every time the cleanup is run. If there are millions of orphaned applicability profiles, it's easy to exceed 16MB.

closes #3893 https://pulp.plan.io/issues/3893

(cherry picked from commit 8a043dbd10e418f3460e7fa3bd97651d71517050)

History

#2 Updated by CodeHeeler about 3 years ago

  • Triaged changed from No to Yes
  • Sprint set to Sprint 41

#4 Updated by ttereshc about 3 years ago

  • Status changed from ASSIGNED to MODIFIED

#5 Updated by dkliban@redhat.com about 3 years ago

  • Platform Release set to 2.17.1

#7 Updated by ttereshc about 3 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

#8 Updated by bmbouter over 2 years ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF