Issue #528: Node sync is failing with unexpected error repo_id=None

Issue #528

Description of problem: 
 Fresh default installation of pulp-server acting as a node to another default pulp-server both RHEL 7.  
 Followed instructions: http://pulp-user-guide.readthedocs.org/en/latest/installation.html 
 http://pulp-user-guide.readthedocs.org/en/latest/nodes.html 

 Default certs and verify_ssl=False 

 Consumer Client works on the node server and can use yum. 
 pulp-admin and pulp-consumer works on both servers. 

 pulp-admin node sync run --node-id repo fails every time, tried every thing including fresh installations with same result. 

 Also tried pulp-consumer update --keys and restarting goferd - same results. 
 
 Version-Release number of selected component (if applicable): 


 How reproducible: 

 Always 

 Steps to Reproduce: 
 1. Install two RHEL 7 Servers with default installation of pulp-server and create a repo on one. 
 2. Configure one as a node to the other using current documentation and try to sync the repo. 
 3. 

 Actual results: 

 Node sync failure 

 Expected results: 

 Node sync success 

 Additional info: 

 Log from messages: 

 <pre> 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR: Pulp exception occurred: AuthenticationFailed 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR: Traceback (most recent call last): 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/middleware/exception.py", line 44, in __call__ 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return self.app(environ, start_response) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/middleware/postponed.py", line 42, in __call__ 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return self.app(environ, start_response) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 279, in wsgi 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       result = self.handle_with_processors() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 29, in _handle_with_processors 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return process(self.processors) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in process 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 566, in processor 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return handler() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in <lambda> 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in process 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 581, in processor 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       result = handler() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in <lambda> 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 28, in process 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return self.handle() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 230, in handle 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return self._delegate(fn, self.fvars, args) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 422, in _delegate 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return f() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 430, in <lambda> 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       f = lambda: self._delegate_sub_application(pat, what) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 455, in _delegate_sub_application 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return app.handle_with_processors() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 29, in _handle_with_processors 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return process(self.processors) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in process 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 566, in processor 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return handler() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in <lambda> 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in process 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 581, in processor 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       result = handler() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 26, in <lambda> 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return p(lambda: process(processors)) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/application.py", line 28, in process 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return self.handle() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 230, in handle 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return self._delegate(fn, self.fvars, args) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 420, in _delegate 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return handle_class(cls) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/web/application.py", line 396, in handle_class 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       return tocall(*args) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/controllers/decorators.py", line 192, in _auth_decorator 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       userid, is_consumer = authenticate_user() 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:     File "/usr/lib/python2.7/site-packages/pulp/server/webservices/controllers/decorators.py", line 111, in oauth_authentication 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR:       raise AuthenticationFailed(auth_utils.CODE_INVALID_SSL_CERT) 
 Sep 15 10:42:05 repo pulp: pulp.server.webservices.middleware.exception:ERROR: AuthenticationFailed: Pulp exception occurred: AuthenticationFailed 
 Sep 15 10:42:05 repo goferd: [ERROR][worker-0] pulp_node.handlers.strategies:129 - synchronization failed 
 Sep 15 10:42:05 repo goferd: [ERROR][worker-0] pulp_node.handlers.strategies:129 - Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/pulp_node/handlers/strategies.py", line 116, in synchronize validator.validate(request.bindings) File "/usr/lib/python2.7/site-packages/pulp_node/handlers/validation.py", line 54, in validate self.report.errors.extend(self._validate_plugins(bindings)) File "/usr/lib/python2.7/site-packages/pulp_node/handlers/validation.py", line 70, in _validate_plugins child = ChildServer() File "/usr/lib/python2.7/site-packages/pulp_node/handlers/validation.py", line 88, in __init__ self.importers = self._importers() File "/usr/lib/python2.7/site-packages/pulp_node/handlers/validation.py", line 99, in _importers http = bindings.server_info.get_importers() File "/usr/lib/python2.7/site-packages/pulp/bindings/server_info.py", line 43, in get_importers return self.server.GET(path) File "/usr/lib/python2.7/site-packages/pulp/bindings/server.py", line 93, in GET return self._request('GET', path, queries) File "/usr/lib/python2.7/site-packages/pulp/bindings/server.py", line 151, in _request self._handle_exceptions(response_code, response_body) File "/usr/lib/python2.7/site-packages/pulp/bindings/server.py", line 192, in _handle_exceptions raise code_class_mappings[response_code](response_body) PermissionsException: RequestException: GET request on /pulp/api/v2/plugins/importers/ failed with 401 - Pulp exception occurred: AuthenticationFailed 
 Sep 15 10:42:05 repo goferd: [ERROR][worker-0] pulp_node.handlers.handler:111 - An unexpected error occurred.    repo_id=None 
 Sep 15 10:42:05 repo goferd: [INFO][worker-0] gofer.agent.rmi:149 - sn=7b3315f2-ec18-4ced-be8b-2d714ae0b73b processed in: 114 (ms) 
 </pre> 

 + This bug was cloned from "Bugzilla Bug #1142273":https://bugzilla.redhat.com/show_bug.cgi?id=1142273 +
Back
Project

Profile

Help

Pulp

Issue #528
