Project

Profile

Help

Issue #702

raised unexpected: IOError('NOT FOUND',) when synchronizing non-existing docker image

Added by daviddavis over 6 years ago. Updated about 2 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Start date:
Due date:
Estimated time:
Severity:
3. High
Version - Docker:
1.0.0
Platform Release:
2.7.0
Target Release - Docker:
2.0.0
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1193663.

Description of problem:

Synchronizing a Docker-based repository for a non-existing image generates a scary looking stacktrace in the backend. I feel that the stacktrace could be handled a bit better and that maybe we should handle this a bit differently and in a way that it is more useful to the end user?

Version-Release number of selected component (if applicable):

  • apr-util-ldap-1.3.9-3.el6_0.1.x86_64
  • candlepin-0.9.42-1.el6.noarch
  • candlepin-common-1.0.21-1.el6.noarch
  • candlepin-selinux-0.9.42-1.el6.noarch
  • candlepin-tomcat6-0.9.42-1.el6.noarch
  • elasticsearch-0.90.10-7.el6.noarch
  • foreman-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-compute-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-debug-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-gce-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-libvirt-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-ovirt-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-postgresql-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-proxy-1.8.0-0.develop.201502121459git0207401.el6.noarch
  • foreman-release-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-selinux-1.8.0-0.develop.201412151103gite2863e4.el6.noarch
  • foreman-vmware-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • katello-2.2.0-1.201502171650git5cf9de7.el6.noarch
  • katello-certs-tools-2.0.1-1.el6.noarch
  • katello-common-2.2.0-1.201502171650git5cf9de7.el6.noarch
  • katello-default-ca-1.0-1.noarch
  • katello-installer-2.2.0-1.201502160627gite8ff373.el6.noarch
  • katello-installer-base-2.2.0-1.201502160627gite8ff373.el6.noarch
  • katello-repos-2.1.1-1.el6.noarch
  • katello-server-ca-1.0-1.noarch
  • openldap-2.4.39-8.el6.x86_64
  • pulp-docker-plugins-0.2.2-1.el6.noarch
  • pulp-katello-0.3-3.el6.noarch
  • pulp-nodes-common-2.6.0-0.7.beta.el6.noarch
  • pulp-nodes-parent-2.6.0-0.7.beta.el6.noarch
  • pulp-puppet-plugins-2.6.0-0.7.beta.el6.noarch
  • pulp-puppet-tools-2.6.0-0.7.beta.el6.noarch
  • pulp-rpm-plugins-2.6.0-0.7.beta.el6.noarch
  • pulp-selinux-2.6.0-0.7.beta.el6.noarch
  • pulp-server-2.6.0-0.7.beta.el6.noarch
  • python-ldap-2.3.10-1.el6.x86_64
  • ruby193-rubygem-ldap_fluff-0.3.3-1.el6.noarch
  • ruby193-rubygem-net-ldap-0.10.0-1.el6.noarch
  • ruby193-rubygem-runcible-1.3.1-1.el6.noarch
  • rubygem-hammer_cli-0.1.4-1.201502121207git0ab2866.el6.noarch
  • rubygem-hammer_cli_foreman-0.1.4-1.201501221305git706b057.el6.noarch
  • rubygem-hammer_cli_foreman_bootdisk-0.1.2-1.el6.noarch
  • rubygem-hammer_cli_foreman_tasks-0.0.3-2.201409091410gitc96619d.git.0.37f3704.el6.noarch
  • rubygem-hammer_cli_gutterball-0.0.1-1.201501072024git01fe139.git.0.06e884f.el6.noarch
  • rubygem-hammer_cli_import-0.10.4-1.el6.noarch
  • rubygem-hammer_cli_katello-0.0.7-1.201502061831git68a34d6.git.0.9c4412d.el6.noarch
  • sssd-ldap-1.11.6-30.el6.x86_64

How reproducible:

Steps to Reproduce:
2. Create a custom docker-based repository for mongodb (the upstream name should be mongodb and you should point to https://registry.hub.docker.com)
3. Sync it

Actual results:

Stacktrace shows up in /var/log/messages

Expected results:

Additional info:

+ This bug was cloned from Bugzilla Bug #1193674 +

ba6383d0ad5f5924573b93f4877fe8aa (8.48 KB) ba6383d0ad5f5924573b93f4877fe8aa daviddavis, 03/01/2015 12:24 AM

Associated revisions

Revision 2622a471 View on GitHub
Added by mhrivnak about 6 years ago

Task failures of known types no longer log tracebacks.

This goes along with additional changes to plugins so they can take advantage of smarter error reporting. This includes the use of the unittest2 module for testing that error reporting.

refs #652 refs #702

Revision 2622a471 View on GitHub
Added by mhrivnak about 6 years ago

Task failures of known types no longer log tracebacks.

This goes along with additional changes to plugins so they can take advantage of smarter error reporting. This includes the use of the unittest2 module for testing that error reporting.

refs #652 refs #702

Revision 2cbd4f57 View on GitHub
Added by mhrivnak about 6 years ago

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

Revision 2cbd4f57 View on GitHub
Added by mhrivnak about 6 years ago

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

Revision 2cbd4f57 View on GitHub
Added by mhrivnak about 6 years ago

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

Revision 2cbd4f57 View on GitHub
Added by mhrivnak about 6 years ago

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

History

#1 Updated by daviddavis over 6 years ago

Relevant part of the log:

Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) Exception caught from plugin during sync for repo [default_organization-foo-foo]
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) Traceback (most recent call last):
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in do_sync
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) sync_report = sync_repo(transfer_repo, conduit, call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) return f(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) return self.sync_step.sync()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self.process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) super(PluginStep, self).process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) step.process()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self._process_block()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self.process_main()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 132, in process_main
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) available_images = self.parent.index_repository.get_image_ids()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 100, in get_image_ids
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) raw_data = self._get_single_path(path)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 67, in _get_single_path
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) raise IOError(report.error_msg)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) IOError: NOT FOUND
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) Task pulp.server.managers.repo.sync.sync[7ef0bfb2-ad43-42d5-959e-9278934f59b4] raised unexpected: IOError('NOT FOUND',)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) Traceback (most recent call last):
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) R = retval = fun(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 328, incall
_
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return super(Task, self).__call__(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in protected_call
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return self.run(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 110, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in _do_sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) sync_report = sync_repo(transfer_repo, conduit, call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return f(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return self.sync_step.sync()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self.process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) super(PluginStep, self).process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) step.process()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self._process_block()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self.process_main()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 132, in process_main
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) available_images = self.parent.index_repository.get_image_ids()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 100, in get_image_ids
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) raw_data = self._get_single_path(path)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 67, in _get_single_path
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) raise IOError(report.error_msg)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) IOError: NOT FOUND
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[9f4560e1-5207-488b-9826-e2599480f2a8] succeeded in 0.00897213400003s: None

+ This comment was cloned from Bugzilla #1193674 comment 1 +

#2 Updated by daviddavis over 6 years ago

Log in txt format

Here's the log in txt format as well which may be easier to read.

+ This comment was cloned from Bugzilla #1193674 comment 2 +

#4 Updated by bmbouter about 6 years ago

  • Severity changed from High to 3. High

#5 Updated by mhrivnak about 6 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to mhrivnak

#7 Updated by mhrivnak about 6 years ago

  • Project changed from Pulp to Docker Support
  • Category deleted (14)
  • Version changed from 2.5 to 1.0.0
  • Target Release - Docker set to 1.0.1

#8 Updated by mhrivnak about 6 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

#9 Updated by mhrivnak about 6 years ago

  • Target Release - Docker changed from 1.0.1 to 1.1.0

#10 Updated by bmbouter about 6 years ago

  • Version deleted (1.0.0)
  • Version - Docker set to 1.0.0

#11 Updated by rbarlow over 5 years ago

  • Target Release - Docker changed from 1.1.0 to 2.0.0

#12 Updated by rbarlow over 5 years ago

  • Status changed from MODIFIED to 5

#14 Updated by semyers about 5 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE
  • Platform Release set to 2.7.0

#15 Updated by bmbouter about 2 years ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF