Pulp

Previously the repo_id index was added to applicability collection. That solved the problem in most cases but not in all of them. When many (e.g. 70K) consumer profiles are associated with the requested repos, cursor still may timeout.

 Traceback (most recent call last):
   File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 112, in get_response
     response = wrapped_callback(request, *callback_args, **callback_kwargs)
   File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 69, in view
     return self.dispatch(request, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 87, in dispatch
     return handler(request, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 241, in _auth_decorator
     return _verify_auth(self, operation, super_user_only, method, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 195, in _verify_auth
     value = method(self, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/util.py", line 130, in wrapper
     return func(*args, **kwargs)
   File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/repositories.py", line 913, in post
     queue_regenerate_applicability_for_repos(repo_criteria.as_dict())
   File "/usr/lib/python2.7/site-packages/pulp/server/managers/consumer/applicability.py", line 167, in queue_regenerate_applicability_for_repos
     for batch in paginate(profile_hashes, 10):
   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/misc.py", line 33, in paginate
     page = tuple(itertools.islice(generator, 0, page_size))
   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/misc.py", line 31, in <genexpr>
   File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
     if len(self.__data) or self._refresh():
   File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1039, in _refresh
   File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 903, in __send_message
     codec_options=self.__codec_options)
   File "/usr/lib64/python2.7/site-packages/pymongo/helpers.py", line 114, in _unpack_response
     raise CursorNotFound(msg, 43, errobj)
 CursorNotFound: Cursor not found, cursor id: 138030585475