Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #702

closed

raised unexpected: IOError('NOT FOUND',) when synchronizing non-existing docker image

Added by daviddavis about 9 years ago. Updated about 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
mhrivnak
Start date:
Due date:
Estimated time:
Severity:
3. High
Version - Docker:
1.0.0
Platform Release:
2.7.0
Target Release - Docker:
2.0.0
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1193663.

Description of problem:

Synchronizing a Docker-based repository for a non-existing image generates a scary looking stacktrace in the backend. I feel that the stacktrace could be handled a bit better and that maybe we should handle this a bit differently and in a way that it is more useful to the end user?

Version-Release number of selected component (if applicable):

  • apr-util-ldap-1.3.9-3.el6_0.1.x86_64
  • candlepin-0.9.42-1.el6.noarch
  • candlepin-common-1.0.21-1.el6.noarch
  • candlepin-selinux-0.9.42-1.el6.noarch
  • candlepin-tomcat6-0.9.42-1.el6.noarch
  • elasticsearch-0.90.10-7.el6.noarch
  • foreman-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-compute-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-debug-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-gce-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-libvirt-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-ovirt-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-postgresql-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-proxy-1.8.0-0.develop.201502121459git0207401.el6.noarch
  • foreman-release-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • foreman-selinux-1.8.0-0.develop.201412151103gite2863e4.el6.noarch
  • foreman-vmware-1.8.0-0.develop.201502121510git9edf91b.el6.noarch
  • katello-2.2.0-1.201502171650git5cf9de7.el6.noarch
  • katello-certs-tools-2.0.1-1.el6.noarch
  • katello-common-2.2.0-1.201502171650git5cf9de7.el6.noarch
  • katello-default-ca-1.0-1.noarch
  • katello-installer-2.2.0-1.201502160627gite8ff373.el6.noarch
  • katello-installer-base-2.2.0-1.201502160627gite8ff373.el6.noarch
  • katello-repos-2.1.1-1.el6.noarch
  • katello-server-ca-1.0-1.noarch
  • openldap-2.4.39-8.el6.x86_64
  • pulp-docker-plugins-0.2.2-1.el6.noarch
  • pulp-katello-0.3-3.el6.noarch
  • pulp-nodes-common-2.6.0-0.7.beta.el6.noarch
  • pulp-nodes-parent-2.6.0-0.7.beta.el6.noarch
  • pulp-puppet-plugins-2.6.0-0.7.beta.el6.noarch
  • pulp-puppet-tools-2.6.0-0.7.beta.el6.noarch
  • pulp-rpm-plugins-2.6.0-0.7.beta.el6.noarch
  • pulp-selinux-2.6.0-0.7.beta.el6.noarch
  • pulp-server-2.6.0-0.7.beta.el6.noarch
  • python-ldap-2.3.10-1.el6.x86_64
  • ruby193-rubygem-ldap_fluff-0.3.3-1.el6.noarch
  • ruby193-rubygem-net-ldap-0.10.0-1.el6.noarch
  • ruby193-rubygem-runcible-1.3.1-1.el6.noarch
  • rubygem-hammer_cli-0.1.4-1.201502121207git0ab2866.el6.noarch
  • rubygem-hammer_cli_foreman-0.1.4-1.201501221305git706b057.el6.noarch
  • rubygem-hammer_cli_foreman_bootdisk-0.1.2-1.el6.noarch
  • rubygem-hammer_cli_foreman_tasks-0.0.3-2.201409091410gitc96619d.git.0.37f3704.el6.noarch
  • rubygem-hammer_cli_gutterball-0.0.1-1.201501072024git01fe139.git.0.06e884f.el6.noarch
  • rubygem-hammer_cli_import-0.10.4-1.el6.noarch
  • rubygem-hammer_cli_katello-0.0.7-1.201502061831git68a34d6.git.0.9c4412d.el6.noarch
  • sssd-ldap-1.11.6-30.el6.x86_64

How reproducible:

Steps to Reproduce:
2. Create a custom docker-based repository for mongodb (the upstream name should be mongodb and you should point to https://registry.hub.docker.com)
3. Sync it

Actual results:

Stacktrace shows up in /var/log/messages

Expected results:

Additional info:

+ This bug was cloned from Bugzilla Bug #1193674 +

Files

ba6383d0ad5f5924573b93f4877fe8aa (8.48 KB) ba6383d0ad5f5924573b93f4877fe8aa daviddavis, 03/01/2015 12:24 AM
Actions
Copy link
 #1

Updated by daviddavis about 9 years ago

Relevant part of the log:

Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) Exception caught from plugin during sync for repo [default_organization-foo-foo]
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) Traceback (most recent call last):
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in do_sync
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) sync_report = sync_repo(transfer_repo, conduit, call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) return f(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) return self.sync_step.sync()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self.process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) super(PluginStep, self).process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) step.process()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self._process_block()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) self.process_main()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 132, in process_main
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) available_images = self.parent.index_repository.get_image_ids()
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 100, in get_image_ids
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) raw_data = self._get_single_path(path)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 67, in _get_single_path
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) raise IOError(report.error_msg)
Feb 17 15:24:48 cloud-qe-18 pulp: pulp.server.managers.repo.sync:ERROR: (13829-86432) IOError: NOT FOUND
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) Task pulp.server.managers.repo.sync.sync[7ef0bfb2-ad43-42d5-959e-9278934f59b4] raised unexpected: IOError('NOT FOUND',)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) Traceback (most recent call last):
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) R = retval = fun(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 328, incall_
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return super(Task, self).__call__(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in protected_call
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return self.run(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 110, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in _do_sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) sync_report = sync_repo(transfer_repo, conduit, call_config)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return f(*args, **kwargs)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) return self.sync_step.sync()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self.process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) super(PluginStep, self).process_lifecycle()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) step.process()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self._process_block()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) self.process_main()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 132, in process_main
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) available_images = self.parent.index_repository.get_image_ids()
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 100, in get_image_ids
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) raw_data = self._get_single_path(path)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 67, in _get_single_path
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) raise IOError(report.error_msg)
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:ERROR: (13786-86432) IOError: NOT FOUND
Feb 17 15:24:48 cloud-qe-18 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[9f4560e1-5207-488b-9826-e2599480f2a8] succeeded in 0.00897213400003s: None

+ This comment was cloned from Bugzilla #1193674 comment 1 +

Actions
Copy link
 #2

Updated by daviddavis about 9 years ago

Log in txt format

Here's the log in txt format as well which may be easier to read.

+ This comment was cloned from Bugzilla #1193674 comment 2 +

Actions
Copy link
 #4

Updated by bmbouter about 9 years ago

  • Severity changed from High to 3. High
Actions
Copy link
 #5

Updated by mhrivnak about 9 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to mhrivnak

Added by mhrivnak about 9 years ago

Revision 2622a471 | View on GitHub

Task failures of known types no longer log tracebacks.

This goes along with additional changes to plugins so they can take advantage of smarter error reporting. This includes the use of the unittest2 module for testing that error reporting.

refs #652 refs #702

Added by mhrivnak about 9 years ago

Revision 2622a471 | View on GitHub

Task failures of known types no longer log tracebacks.

This goes along with additional changes to plugins so they can take advantage of smarter error reporting. This includes the use of the unittest2 module for testing that error reporting.

refs #652 refs #702

Actions
Copy link
 #7

Updated by mhrivnak about 9 years ago

  • Project changed from Pulp to Docker Support
  • Category deleted (14)
  • Version changed from 2.5 to 1.0.0
  • Target Release - Docker set to 1.0.1

Added by mhrivnak about 9 years ago

Revision 2cbd4f57 | View on GitHub

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

Added by mhrivnak about 9 years ago

Revision 2cbd4f57 | View on GitHub

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

Added by mhrivnak about 9 years ago

Revision 2cbd4f57 | View on GitHub

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

Added by mhrivnak about 9 years ago

Revision 2cbd4f57 | View on GitHub

Failure to sync no longer logs tracebacks, also reports a more helpful message.

This depends on changes in pulp that better-handle PulpCodedException reporting.

fixes #702 refs #652

Actions
Copy link
 #8

Updated by mhrivnak about 9 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100
Actions
Copy link
 #9

Updated by mhrivnak about 9 years ago

  • Target Release - Docker changed from 1.0.1 to 1.1.0
Actions
Copy link
 #10

Updated by bmbouter almost 9 years ago

  • Version deleted (1.0.0)
  • Version - Docker set to 1.0.0
Actions
Copy link
 #11

Updated by rbarlow about 8 years ago

  • Target Release - Docker changed from 1.1.0 to 2.0.0
Actions
Copy link
 #12

Updated by rbarlow about 8 years ago

  • Status changed from MODIFIED to 5
Actions
Copy link
 #14

Updated by semyers almost 8 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE
  • Platform Release set to 2.7.0
Actions
Copy link
 #15

Updated by bmbouter about 5 years ago

  • Tags Pulp 2 added
Actions
Send by e-mail Copy link

Also available in: Atom PDF