Issue #5352
Updated by kersom about 5 years ago
This issue was identified when attempting to write a at test for "5036":https://pulp.plan.io/issues/5036. Step 5 from previous issue - Create distribution that is associated with the publication and the content guard. <pre><code class="text"> {'_created': '2019-08-26T18:47:15.979945Z', '_href': '/pulp/api/v3/distributions/file/file/e0af98c8-4021-4cac-8ad5-f5f22b0e3a2f/', 'base_path': '5a5c0aa7-5fad-4ccd-98d0-1ccd3018fde3', 'base_url': '192.168.122.20:24816/pulp/content/5a5c0aa7-5fad-4ccd-98d0-1ccd3018fde3', 'content_guard': '/pulp/api/v3/contentguards/certguard/x509/2f0bebd8-7bdc-4246-908e-df1c81c86446/', 'name': '7f68db57-dbf9-4206-9d2a-0a576a88f7ef', 'publication': '/pulp/api/v3/publications/file/file/61088b19-d532-4654-952e-3aae03791904/'} </code></pre> Step 7 - Create a remote that has a URL pointing at the Distribution from step 5 and uses the client certificate for the content guard <pre><code class="text"> {'_created': '2019-08-26T18:47:18.151877Z', '_href': '/pulp/api/v3/remotes/file/file/cd59f8e8-bcfc-4ccc-bf7f-c1283dbb5980/', '_last_updated': '2019-08-26T18:47:18.151893Z', '_type': 'file.file', 'download_concurrency': 20, 'name': 'e1701534-cd9c-490f-8bd9-09ba09d6aa87', 'policy': 'immediate', 'proxy_url': None, 'ssl_ca_certificate': None, 'ssl_client_certificate': '01778bb586f4ab226ea42d2b4ae61f14bb907907c970f9ee4abce87598d0070e', 'ssl_client_key': '1e6a65695ff54b2fc6713dea7aa779e77819a39bba525af234ed965b2ff553b7', 'ssl_validation': True, 'url': 'http://192.168.122.20:24816/pulp/content/5a5c0aa7-5fad-4ccd-98d0-1ccd3018fde3/PULP_MANIFEST'} </code></pre> h3. First case scenario - ssl_client_certificate, and ssl_client_key line characters not escaped. Create another repository, and attempt to sync using the previous remote. Traceback: <pre><code class="text"> ('Task report /pulp/api/v3/tasks/84688488-9894-4267-8c15-f633e473c6fa/ ' "contains a error: {'code': None, 'description': '[SSL] PEM lib " "(_ssl.c:3824)', 'traceback': ' File " '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, ' 'in perform_job\\n rv = job.perform()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in ' 'perform\\n self._result = self._execute()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in ' '_execute\\n return self.func(*self.args, **self.kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 45, in synchronize\\n dv.create()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py", ' 'line 169, in create\\n loop.run_until_complete(pipeline)\\n File ' '"/usr/lib64/python3.7/asyncio/base_events.py", line 584, in ' 'run_until_complete\\n return future.result()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 209, in create_pipeline\\n await asyncio.gather(*futures)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 43, in __call__\\n await self.run()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 72, in run\\n downloader = ' 'self.remote.get_downloader(url=self.remote.url)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/models/remote.py", ' 'line 88, in get_downloader\\n return self.download_factory.build(url, ' '**kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/models/remote.py", ' 'line 46, in download_factory\\n self._download_factory = ' 'DownloaderFactory(self)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/factory.py", ' 'line 67, in __init__\\n self._session = ' 'self._make_aiohttp_session_from_remote()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/factory.py", ' "line 96, in _make_aiohttp_session_from_remote\\n key_file.name\\n'}\n" "Full task report: {'_href': " "'/pulp/api/v3/tasks/84688488-9894-4267-8c15-f633e473c6fa/', '_created': " "'2019-08-26T18:48:55.120887Z', 'state': 'failed', 'name': " "'pulp_file.app.tasks.synchronizing.synchronize', 'started_at': " "'2019-08-26T18:48:55.222028Z', 'finished_at': '2019-08-26T18:48:55.344024Z', " "'non_fatal_errors': [], 'error': {'code': None, 'description': '[SSL] PEM " "lib (_ssl.c:3824)', 'traceback': ' File " '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, ' 'in perform_job\\n rv = job.perform()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in ' 'perform\\n self._result = self._execute()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in ' '_execute\\n return self.func(*self.args, **self.kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 45, in synchronize\\n dv.create()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py", ' 'line 169, in create\\n loop.run_until_complete(pipeline)\\n File ' '"/usr/lib64/python3.7/asyncio/base_events.py", line 584, in ' 'run_until_complete\\n return future.result()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 209, in create_pipeline\\n await asyncio.gather(*futures)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 43, in __call__\\n await self.run()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 72, in run\\n downloader = ' 'self.remote.get_downloader(url=self.remote.url)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/models/remote.py", ' 'line 88, in get_downloader\\n return self.download_factory.build(url, ' '**kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/models/remote.py", ' 'line 46, in download_factory\\n self._download_factory = ' 'DownloaderFactory(self)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/factory.py", ' 'line 67, in __init__\\n self._session = ' 'self._make_aiohttp_session_from_remote()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/factory.py", ' "line 96, in _make_aiohttp_session_from_remote\\n key_file.name\\n'}, " "'worker': '/pulp/api/v3/workers/96dd332f-92d4-4ef7-b29e-d6c868da254e/', " "'parent': None, 'spawned_tasks': [], 'progress_reports': [{'message': " "'Downloading Metadata', 'state': 'failed', 'total': None, 'done': 0, " "'suffix': None}, {'message': 'Downloading Artifacts', 'state': 'canceled', " "'total': None, 'done': 0, 'suffix': None}, {'message': 'Associating " "Content', 'state': 'canceled', 'total': None, 'done': 0, 'suffix': None}], " "'created_resources': [], 'reserved_resources_record': " "['/pulp/api/v3/remotes/file/file/cd59f8e8-bcfc-4ccc-bf7f-c1283dbb5980/', " "'/pulp/api/v3/repositories/c1fa9bae-7a17-41bc-b142-156c6ed2a69a/']}", {'_created': '2019-08-26T18:48:55.120887Z', '_href': '/pulp/api/v3/tasks/84688488-9894-4267-8c15-f633e473c6fa/', 'created_resources': [], 'error': {'code': None, 'description': '[SSL] PEM lib (_ssl.c:3824)', 'traceback': ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", ' 'line 822, in perform_job\n' ' rv = job.perform()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", ' 'line 605, in perform\n' ' self._result = self._execute()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", ' 'line 611, in _execute\n' ' return self.func(*self.args, **self.kwargs)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 45, in synchronize\n' ' dv.create()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py", ' 'line 169, in create\n' ' loop.run_until_complete(pipeline)\n' ' File ' '"/usr/lib64/python3.7/asyncio/base_events.py", line ' '584, in run_until_complete\n' ' return future.result()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 209, in create_pipeline\n' ' await asyncio.gather(*futures)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 43, in __call__\n' ' await self.run()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 72, in run\n' ' downloader = ' 'self.remote.get_downloader(url=self.remote.url)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/models/remote.py", ' 'line 88, in get_downloader\n' ' return self.download_factory.build(url, ' '**kwargs)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/models/remote.py", ' 'line 46, in download_factory\n' ' self._download_factory = ' 'DownloaderFactory(self)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/factory.py", ' 'line 67, in __init__\n' ' self._session = ' 'self._make_aiohttp_session_from_remote()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/factory.py", ' 'line 96, in _make_aiohttp_session_from_remote\n' ' key_file.name\n'}, 'finished_at': '2019-08-26T18:48:55.344024Z', 'name': 'pulp_file.app.tasks.synchronizing.synchronize', 'non_fatal_errors': [], 'parent': None, 'progress_reports': [{'done': 0, 'message': 'Downloading Metadata', 'state': 'failed', 'suffix': None, 'total': None}, {'done': 0, 'message': 'Downloading Artifacts', 'state': 'canceled', 'suffix': None, 'total': None}, {'done': 0, 'message': 'Associating Content', 'state': 'canceled', 'suffix': None, 'total': None}], 'reserved_resources_record': ['/pulp/api/v3/remotes/file/file/cd59f8e8-bcfc-4ccc-bf7f-c1283dbb5980/', '/pulp/api/v3/repositories/c1fa9bae-7a17-41bc-b142-156c6ed2a69a/'], 'spawned_tasks': [], 'started_at': '2019-08-26T18:48:55.222028Z', 'state': 'failed', 'worker': '/pulp/api/v3/workers/96dd332f-92d4-4ef7-b29e-d6c868da254e/'}) </code></pre> h3. Second case scenario - ssl_client_certificate, and ssl_client_key line characters escaped. Traceback: <pre> ('Task report /pulp/api/v3/tasks/a5cda2f6-7717-402a-9440-120f8c6926a8/ ' "contains a error: {'code': None, 'description': '403, message=\\'\\'HTTP " 'header "SSL-CLIENT-CERTIFICATE" not found.\\\'\\\'\', \'traceback\': \' ' 'File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line ' '822, in perform_job\\n rv = job.perform()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in ' 'perform\\n self._result = self._execute()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in ' '_execute\\n return self.func(*self.args, **self.kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 45, in synchronize\\n dv.create()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py", ' 'line 169, in create\\n loop.run_until_complete(pipeline)\\n File ' '"/usr/lib64/python3.7/asyncio/base_events.py", line 584, in ' 'run_until_complete\\n return future.result()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 209, in create_pipeline\\n await asyncio.gather(*futures)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 43, in __call__\\n await self.run()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 73, in run\\n result = await downloader.run()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/base.py", ' 'line 212, in run\\n return await self._run(extra_data=extra_data)\\n ' 'File "/usr/local/lib/pulp/lib64/python3.7/site-packages/backoff/_async.py", ' 'line 131, in retry\\n ret = await target(*args, **kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/http.py", ' 'line 183, in _run\\n response.raise_for_status()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/client_reqrep.py", ' "line 942, in raise_for_status\\n headers=self.headers)\\n'}\n" "Full task report: {'_href': " "'/pulp/api/v3/tasks/a5cda2f6-7717-402a-9440-120f8c6926a8/', '_created': " "'2019-08-26T18:53:33.784600Z', 'state': 'failed', 'name': " "'pulp_file.app.tasks.synchronizing.synchronize', 'started_at': " "'2019-08-26T18:53:33.890968Z', 'finished_at': '2019-08-26T18:53:34.022794Z', " "'non_fatal_errors': [], 'error': {'code': None, 'description': '403, " 'message=\\\'\\\'HTTP header "SSL-CLIENT-CERTIFICATE" not found.\\\'\\\'\', ' "'traceback': ' File " '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, ' 'in perform_job\\n rv = job.perform()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in ' 'perform\\n self._result = self._execute()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in ' '_execute\\n return self.func(*self.args, **self.kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 45, in synchronize\\n dv.create()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py", ' 'line 169, in create\\n loop.run_until_complete(pipeline)\\n File ' '"/usr/lib64/python3.7/asyncio/base_events.py", line 584, in ' 'run_until_complete\\n return future.result()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 209, in create_pipeline\\n await asyncio.gather(*futures)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 43, in __call__\\n await self.run()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 73, in run\\n result = await downloader.run()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/base.py", ' 'line 212, in run\\n return await self._run(extra_data=extra_data)\\n ' 'File "/usr/local/lib/pulp/lib64/python3.7/site-packages/backoff/_async.py", ' 'line 131, in retry\\n ret = await target(*args, **kwargs)\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/http.py", ' 'line 183, in _run\\n response.raise_for_status()\\n File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/client_reqrep.py", ' "line 942, in raise_for_status\\n headers=self.headers)\\n'}, 'worker': " "'/pulp/api/v3/workers/9b793a30-2911-46f8-95e6-e35f19650c03/', 'parent': " "None, 'spawned_tasks': [], 'progress_reports': [{'message': 'Downloading " "Metadata', 'state': 'failed', 'total': None, 'done': 0, 'suffix': None}, " "{'message': 'Downloading Artifacts', 'state': 'canceled', 'total': None, " "'done': 0, 'suffix': None}, {'message': 'Associating Content', 'state': " "'canceled', 'total': None, 'done': 0, 'suffix': None}], 'created_resources': " "[], 'reserved_resources_record': " "['/pulp/api/v3/repositories/53654e44-790d-482d-b07a-ef5192a921e1/', " "'/pulp/api/v3/remotes/file/file/022b9887-e8c9-4e71-9750-68769e847372/']}", {'_created': '2019-08-26T18:53:33.784600Z', '_href': '/pulp/api/v3/tasks/a5cda2f6-7717-402a-9440-120f8c6926a8/', 'created_resources': [], 'error': {'code': None, 'description': "403, message=''HTTP header " '"SSL-CLIENT-CERTIFICATE" not found.\'\'', 'traceback': ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", ' 'line 822, in perform_job\n' ' rv = job.perform()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", ' 'line 605, in perform\n' ' self._result = self._execute()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", ' 'line 611, in _execute\n' ' return self.func(*self.args, **self.kwargs)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 45, in synchronize\n' ' dv.create()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py", ' 'line 169, in create\n' ' loop.run_until_complete(pipeline)\n' ' File ' '"/usr/lib64/python3.7/asyncio/base_events.py", line ' '584, in run_until_complete\n' ' return future.result()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 209, in create_pipeline\n' ' await asyncio.gather(*futures)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py", ' 'line 43, in __call__\n' ' await self.run()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulp_file/app/tasks/synchronizing.py", ' 'line 73, in run\n' ' result = await downloader.run()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/base.py", ' 'line 212, in run\n' ' return await self._run(extra_data=extra_data)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/backoff/_async.py", ' 'line 131, in retry\n' ' ret = await target(*args, **kwargs)\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/pulpcore/plugin/download/http.py", ' 'line 183, in _run\n' ' response.raise_for_status()\n' ' File ' '"/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/client_reqrep.py", ' 'line 942, in raise_for_status\n' ' headers=self.headers)\n'}, 'finished_at': '2019-08-26T18:53:34.022794Z', 'name': 'pulp_file.app.tasks.synchronizing.synchronize', 'non_fatal_errors': [], 'parent': None, 'progress_reports': [{'done': 0, 'message': 'Downloading Metadata', 'state': 'failed', 'suffix': None, 'total': None}, {'done': 0, 'message': 'Downloading Artifacts', 'state': 'canceled', 'suffix': None, 'total': None}, {'done': 0, 'message': 'Associating Content', 'state': 'canceled', 'suffix': None, 'total': None}], 'reserved_resources_record': ['/pulp/api/v3/repositories/53654e44-790d-482d-b07a-ef5192a921e1/', '/pulp/api/v3/remotes/file/file/022b9887-e8c9-4e71-9750-68769e847372/'], 'spawned_tasks': [], 'started_at': '2019-08-26T18:53:33.890968Z', 'state': 'failed', 'worker': '/pulp/api/v3/workers/9b793a30-2911-46f8-95e6-e35f19650c03/'}) </pre> Pulp installation from source August/26. <pre><code class="text"> (pulp) [root@localhost ~]# pip list | grep pulp pulp-ansible 0.2.0b3.dev0 pulp-certguard 0.1.0rc1 pulp-docker 4.0.0b6.dev0 pulp-file 0.1.0b2.dev0 pulp-rpm 3.0.0b5.dev0 pulpcore 3.0.0rc5.dev0 pulpcore-plugin 0.1.0rc5.dev0 </code></pre> Code used to create those resources: https://git.io/fjAwx
.