Actions
Issue #2439
closedNo data available in publish step (OSError: [Errno 61] No data available)
Status:
CLOSED - CURRENTRELEASE
Priority:
Urgent
Assignee:
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
4. Urgent
Version:
2.10.2
Platform Release:
2.11.1
OS:
CentOS 7
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 11
Quarter:
Description
Hi, I'm getting this error for some repozitories, not sure what's the reason If update to 2.10.2 or any issue on Artifactory side (as seems that affected are only these repos, at least most of them). Can you please help/show direction why this happened ?
pulp-admin rpm repo sync run --repo-id=custom-repo-7-x86_64-live
+----------------------------------------------------------------------+
Synchronizing Repository [custom-repo-7-x86_64-live]
+----------------------------------------------------------------------+
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[\]
... completed
Downloading repository content...
[-]
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed
Importing errata...
[-]
... completed
Importing package groups/categories...
[-]
... completed
Cleaning duplicate packages...
[/]
... completed
Task Succeeded
Task Failed
[Errno 61] No data available
Log:
<pre>
Nov 23 12:29:01 pulp-server pulp[10516]: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading 0 RPMs.
Nov 23 12:29:03 pulp-server pulp[10516]: pulp_rpm.plugins.importers.yum.repomd.alternate:INFO: The content container reported: {'downloads': {}, 'total_sources': 0} for base URL: https://artifactory-master.custom/artifactory/yum-local/custom-repo/7/x86_64/
Nov 23 12:29:03 pulp-server pulp[10516]: pulp_rpm.plugins.importers.yum.purge:INFO: Removing missing units.
Nov 23 12:29:04 pulp-server pulp[10516]: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading additional units.
Nov 23 12:29:04 pulp-server pulp[10516]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): artifactory-master.custom
Nov 23 12:29:05 pulp-server pulp[10516]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): artifactory-master.custom
Nov 23 12:29:25 pulp-server pulp[10516]: pulp_rpm.plugins.importers.yum.sync:INFO: Sync complete.
Nov 23 12:29:25 pulp-server pulp[10337]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[6fe1befa-19dc-46da-91c9-a875bb0e78e9]
Nov 23 12:29:25 pulp-server pulp[10375]: celery.worker.job:INFO: Task pulp.server.managers.repo.sync.sync[e83473e0-4aaf-4ed0-93a5-bf9d619147c4] succeeded in 37.9289886756s: <pulp.server.async.tasks.TaskResult object at 0x4377850>
Nov 23 12:29:25 pulp-server pulp[10375]: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[275a1307-c7f4-40b5-bf7b-5e2b5da00086] succeeded in 0.0216982029378s: None
Nov 23 12:29:25 pulp-server pulp[10375]: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[11aae4e6-88aa-46f2-93b0-0581da1847c3]
Nov 23 12:29:25 pulp-server pulp[10337]: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[6fe1befa-19dc-46da-91c9-a875bb0e78e9] succeeded in 0.0661013638601s: None
Nov 23 12:29:25 pulp-server pulp[10375]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[10467dd3-7761-4cdb-89ce-43f0a6647b8f]
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) Exception caught from plugin during publish for repo [custom-repo-7-x86_64-live]
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) Traceback (most recent call last):
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1115, in _do_publish
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) publish_report = publish_repo(transfer_repo, conduit, call_config)
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 673, in wrap_f
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) return f(*args, **kwargs)
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) return self._publisher.process_lifecycle()
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 566, in process_lifecycle
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) super(PluginStep, self).process_lifecycle()
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) step.process()
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 253, in process
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) self._process_block()
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 297, in _process_block
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) self.process_main()
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 906, in process_main
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) selinux.restorecon(timestamp_master_dir.encode('utf-8'), recursive=True)
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) File "/usr/lib64/python2.7/site-packages/selinux/__init__.py", line 88, in restorecon
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) status, oldcontext = lgetfilecon(path)
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.controllers.repository:ERROR: (10516-16608) OSError: [Errno 61] No data available
Nov 23 12:29:26 pulp-server pulp[10516]: pulp.server.async.tasks:INFO: Task failed : [11aae4e6-88aa-46f2-93b0-0581da1847c3]
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) Task pulp.server.managers.repo.publish.publish[11aae4e6-88aa-46f2-93b0-0581da1847c3] raised unexpected: OSError(61, 'No data available')
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) Traceback (most recent call last):
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) R = retval = fun(*args, **kwargs)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 488, in __call__
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) return super(Task, self).__call__(*args, **kwargs)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 103, in __call__
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) return super(PulpTask, self).__call__(*args, **kwargs)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) return self.run(*args, **kwargs)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 971, in publish
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1063, in check_publish
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1115, in _do_publish
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) publish_report = publish_repo(transfer_repo, conduit, call_config)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 673, in wrap_f
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) return f(*args, **kwargs)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) return self._publisher.process_lifecycle()
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 566, in process_lifecycle
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) super(PluginStep, self).process_lifecycle()
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) step.process()
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 253, in process
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) self._process_block()
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 297, in _process_block
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) self.process_main()
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 906, in process_main
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) selinux.restorecon(timestamp_master_dir.encode('utf-8'), recursive=True)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) File "/usr/lib64/python2.7/site-packages/selinux/__init__.py", line 88, in restorecon
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) status, oldcontext = lgetfilecon(path)
Nov 23 12:29:26 pulp-server pulp[10375]: celery.worker.job:ERROR: (10375-16608) OSError: [Errno 61] No data available
Actions
Adds exception handling for when SELinux is disabled on EL7
On EL7, restorecon calls out to lgetfilecon which raises an exception when SELinux security context labels are not available.
https://www.gnu.org/software/gnulib/manual/html_node/lgetfilecon.html
closes #2439 https://pulp.plan.io/issues/2439