Project

Profile

Help

Issue #3886

CursorNotFound while queueing applicability tasks

Added by ttereshc over 3 years ago. Updated almost 2 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
2.16.3
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 40
Quarter:

Description

Previously the repo_id index was added to applicability collection. That solved the problem in most cases but not in all of them. When many (e.g. 70K) consumer profiles are associated with the requested repos, cursor still may timeout.

 Traceback (most recent call last):
   File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 112, in get_response
     response = wrapped_callback(request, *callback_args, **callback_kwargs)
   File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 69, in view
     return self.dispatch(request, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 87, in dispatch
     return handler(request, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 241, in _auth_decorator
     return _verify_auth(self, operation, super_user_only, method, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 195, in _verify_auth
     value = method(self, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/util.py", line 130, in wrapper
     return func(*args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/repositories.py", line 913, in post
     queue_regenerate_applicability_for_repos(repo_criteria.as_dict())
   File "/usr/lib/python2.7/site-packages/pulp/server/managers/consumer/applicability.py", line 167, in queue_regenerate_applicability_for_repos
     for batch in paginate(profile_hashes, 10):
   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/misc.py", line 33, in paginate
     page = tuple(itertools.islice(generator, 0, page_size))
   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/misc.py", line 31, in <genexpr>
   File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
     if len(self.__data) or self._refresh():
   File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1039, in _refresh
   File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 903, in __send_message
     codec_options=self.__codec_options)
   File "/usr/lib64/python2.7/site-packages/pymongo/helpers.py", line 114, in _unpack_response
     raise CursorNotFound(msg, 43, errobj)
 CursorNotFound: Cursor not found, cursor id: 138030585475

Related issues

Copied from Pulp - Issue #3133: CursorNotFound while queueing applicability tasksCLOSED - CURRENTRELEASE<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

Associated revisions

Revision b1bbca8c View on GitHub
Added by ttereshc over 3 years ago

Add batch_size for querying applicability profiles

closes #3886 https://pulp.plan.io/issues/3886

History

#1 Updated by ttereshc over 3 years ago

  • Copied from Issue #3133: CursorNotFound while queueing applicability tasks added

#2 Updated by ttereshc over 3 years ago

  • Status changed from NEW to MODIFIED

#4 Updated by bmbouter over 2 years ago

  • Tags Pulp 2 added

#5 Updated by dkliban@redhat.com over 2 years ago

  • Platform Release changed from 2.16.3 to 2.19.1

#6 Updated by dkliban@redhat.com over 2 years ago

  • Sprint/Milestone set to 2.19.1

#7 Updated by dkliban@redhat.com over 2 years ago

  • Sprint/Milestone deleted (2.19.1)
  • Platform Release changed from 2.19.1 to 2.16.3

#8 Updated by ttereshc almost 2 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Please register to edit this issue

Also available in: Atom PDF