Issue #702
closed
raised unexpected: IOError('NOT FOUND',) when synchronizing non-existing docker image
Description
Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1193663.
Description of problem:
Synchronizing a Docker-based repository for a non-existing image generates a scary looking stacktrace in the backend. I feel that the stacktrace could be handled a bit better and that maybe we should handle this a bit differently and in a way that it is more useful to the end user?
Version-Release number of selected component (if applicable):
- apr-util-ldap-1.3.9-3.el6_0.1.x86_64
- candlepin-0.9.42-1.el6.noarch
- candlepin-common-1.0.21-1.el6.noarch
- candlepin-selinux-0.9.42-1.el6.noarch
- candlepin-tomcat6-0.9.42-1.el6.noarch
- elasticsearch-0.90.10-7.el6.noarch
- foreman-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-compute-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-debug-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-gce-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-libvirt-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-ovirt-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-postgresql-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-proxy-1.8.0-0.develop.201502121459git0207401.el6.noarch
- foreman-release-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- foreman-selinux-1.8.0-0.develop.201412151103gite2863e4.el6.noarch
- foreman-vmware-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
- katello-2.2.0-1.201502171650git5cf9de7.el6.noarch
- katello-certs-tools-2.0.1-1.el6.noarch
- katello-common-2.2.0-1.201502171650git5cf9de7.el6.noarch
- katello-default-ca-1.0-1.noarch
- katello-installer-2.2.0-1.201502160627gite8ff373.el6.noarch
- katello-installer-base-2.2.0-1.201502160627gite8ff373.el6.noarch
- katello-repos-2.1.1-1.el6.noarch
- katello-server-ca-1.0-1.noarch
- openldap-2.4.39-8.el6.x86_64
- pulp-docker-plugins-0.2.2-1.el6.noarch
- pulp-katello-0.3-3.el6.noarch
- pulp-nodes-common-2.6.0-0.7.beta.el6.noarch
- pulp-nodes-parent-2.6.0-0.7.beta.el6.noarch
- pulp-puppet-plugins-2.6.0-0.7.beta.el6.noarch
- pulp-puppet-tools-2.6.0-0.7.beta.el6.noarch
- pulp-rpm-plugins-2.6.0-0.7.beta.el6.noarch
- pulp-selinux-2.6.0-0.7.beta.el6.noarch
- pulp-server-2.6.0-0.7.beta.el6.noarch
- python-ldap-2.3.10-1.el6.x86_64
- ruby193-rubygem-ldap_fluff-0.3.3-1.el6.noarch
- ruby193-rubygem-net-ldap-0.10.0-1.el6.noarch
- ruby193-rubygem-runcible-1.3.1-1.el6.noarch
- rubygem-hammer_cli-0.1.4-1.201502121207git0ab2866.el6.noarch
- rubygem-hammer_cli_foreman-0.1.4-1.201501221305git706b057.el6.noarch
- rubygem-hammer_cli_foreman_bootdisk-0.1.2-1.el6.noarch
- rubygem-hammer_cli_foreman_tasks-0.0.3-2.201409091410gitc96619d.git.0.37f3704.el6.noarch
- rubygem-hammer_cli_gutterball-0.0.1-1.201501072024git01fe139.git.0.06e884f.el6.noarch
- rubygem-hammer_cli_import-0.10.4-1.el6.noarch
- rubygem-hammer_cli_katello-0.0.7-1.201502061831git68a34d6.git.0.9c4412d.el6.noarch
- sssd-ldap-1.11.6-30.el6.x86_64
How reproducible:
Steps to Reproduce:
2. Create a custom docker-based repository for mongodb (the upstream name should be mongodb and you should point to https://registry.hub.docker.com)
3. Sync it
Actual results:
Stacktrace shows up in /var/log/messages
Expected results:
Additional info:
+ This bug was cloned from Bugzilla Bug #1193674 +
Files
Updated by daviddavis almost 10 years ago
Relevant part of the log:
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) Exception caught from plugin during sync for repo [default_organization-foo-foo]
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) Traceback (most recent call last):
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in do_sync
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) sync_report = sync_repo(transfer_repo, conduit, call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) return f(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) return self.sync_step.sync()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self.process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) super(PluginStep, self).process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) step.process()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self._process_block()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self.process_main()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 132, in process_main
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) available_images = self.parent.index_repository.get_image_ids()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 100, in get_image_ids
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) raw_data = self._get_single_path(path)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 67, in _get_single_path
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) raise IOError(report.error_msg)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) IOError: NOT FOUND
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) Task pulp.server.managers.repo.sync.sync[7ef0bfb2-ad43-42d5-959e-9278934f59b4] raised unexpected: IOError('NOT FOUND',)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) Traceback (most recent call last):
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) R = retval = fun(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 328, incall_
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return super(Task, self).__call__(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in protected_call
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return self.run(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 110, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in _do_sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) sync_report = sync_repo(transfer_repo, conduit, call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return f(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return self.sync_step.sync()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self.process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) super(PluginStep, self).process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) step.process()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self._process_block()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self.process_main()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 132, in process_main
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) available_images = self.parent.index_repository.get_image_ids()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 100, in get_image_ids
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) raw_data = self._get_single_path(path)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 67, in _get_single_path
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) raise IOError(report.error_msg)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) IOError: NOT FOUND
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[9f4560e1-5207-488b-9826-e2599480f2a8] succeeded in 0.00897213400003s: None
+ This comment was cloned from Bugzilla #1193674 comment 1 +
Updated by daviddavis almost 10 years ago
Log in txt format
Here's the log in txt format as well which may be easier to read.
+ This comment was cloned from Bugzilla #1193674 comment 2 +
Updated by mhrivnak over 9 years ago
- Status changed from NEW to ASSIGNED
- Assignee set to mhrivnak
Added by mhrivnak over 9 years ago
Added by mhrivnak over 9 years ago
Updated by mhrivnak over 9 years ago
- Status changed from ASSIGNED to POST
- Platform Release set to 2.7.0
Updated by mhrivnak over 9 years ago
- Project changed from Pulp to Docker Support
- Category deleted (
14) - Version changed from 2.5 to 1.0.0
- Target Release - Docker set to 1.0.1
Added by mhrivnak over 9 years ago
Added by mhrivnak over 9 years ago
Added by mhrivnak over 9 years ago
Added by mhrivnak over 9 years ago
Updated by mhrivnak over 9 years ago
- Status changed from POST to MODIFIED
- % Done changed from 0 to 100
Applied in changeset 2cbd4f578e5c668e962f192940af3b45c611369f.
Updated by mhrivnak over 9 years ago
- Target Release - Docker changed from 1.0.1 to 1.1.0
Updated by bmbouter over 9 years ago
- Version deleted (
1.0.0) - Version - Docker set to 1.0.0
Updated by rbarlow almost 9 years ago
- Target Release - Docker changed from 1.1.0 to 2.0.0
Updated by semyers over 8 years ago
- Status changed from 5 to CLOSED - CURRENTRELEASE
- Platform Release set to 2.7.0
.
Task failures of known types no longer log tracebacks.
This goes along with additional changes to plugins so they can take advantage of smarter error reporting. This includes the use of the unittest2 module for testing that error reporting.
refs #652 refs #702