Issue #2015
Updated by pthomas@redhat.com almost 8 years ago
Description Description of problem: Publishing errata is failing with fails with "Incorrect length of data produced" error Version-Release number of selected component (if applicable): 2.9 How reproducible: Always Steps to Reproduce: 1.Create a rhel repo with feed 2. pulp-admin rpm repo sync run --repo-id=<repo-name> Actual results: <pre> [root@ibm-x3550m3-11 ~]# pulp-admin rpm repo create --repo-id rhel5-os --feed http://cdn.rcm-internal.redhat.com/content/dist/rhel/rhui/server/5/5.11/x86_64/os/ --download-policy on_demand Successfully created repository [rhel5-os] [root@ibm-x3550m3-11 ~]# pulp-admin rpm repo sync run --repo-id rhel5-os +----------------------------------------------------------------------+ Synchronizing Repository [rhel5-os] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [|] ... completed Downloading repository content... [-] [==================================================] 100% RPMs: 13745/13745 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 0/0 items ... completed Importing errata... [\] ... completed Importing package groups/categories... [\] ... completed Cleaning duplicate packages... [\] ... completed Task Succeeded Initializing repo metadata [-] ... completed Publishing Distribution files [-] ... completed Publishing RPMs [==================================================] 100% 17117 of 17117 items ... completed Publishing Delta RPMs ... skipped Publishing Errata [==== ] 9% 298 of 3135 items Task Failed Incorrect length of data produced Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: py.warnings:WARNING: (32465-35008) /usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py:1109: DeprecationWarning: save is deprecated. Use insert_one or replace_one instead Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: py.warnings:WARNING: (32465-35008) publish_result_coll.save(result) Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: py.warnings:WARNING: (32465-35008) Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) Exception caught from plugin during publish for repo [rhel5-os] Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) Traceback (most recent call last): Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1090, in _do_publish Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) publish_report = publish_repo(transfer_repo, conduit, call_config) Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 658, in wrap_f Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) return f(*args, **kwargs) Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) return self._publisher.process_lifecycle() Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 562, in process_lifecycle Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) super(PluginStep, self).process_lifecycle() Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 159, in process_lifecycle Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) step.process() Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 256, in process Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) self.finalize() Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 608, in finalize Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) self.context.checksum) Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 114, in add_metadata_file_metadata Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) content = file_handle.read() Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib64/python2.7/gzip.py", line 254, in read Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) self._read(readsize) Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib64/python2.7/gzip.py", line 325, in _read Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) self._read_eof() Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) File "/usr/lib64/python2.7/gzip.py", line 349, in _read_eof Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) raise IOError, "Incorrect length of data produced" Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) IOError: Incorrect length of data produced Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.async.tasks:INFO: Task failed : [1895b633-025d-4d26-987d-f3b900e4dfc3] Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) Task pulp.server.managers.repo.publish.publish[1895b633-025d-4d26-987d-f3b900e4dfc3] raised unexpected: IOError('Incorrect length of data produced',) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) Traceback (most recent call last): Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) R = retval = fun(*args, **kwargs) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 473, in __call__ Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) return super(Task, self).__call__(*args, **kwargs) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 103, in __call__ Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) return super(PulpTask, self).__call__(*args, **kwargs) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__ Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) return self.run(*args, **kwargs) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 971, in publish Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1038, in check_publish Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1090, in _do_publish Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) publish_report = publish_repo(transfer_repo, conduit, call_config) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 658, in wrap_f Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) return f(*args, **kwargs) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) return self._publisher.process_lifecycle() Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 562, in process_lifecycle Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) super(PluginStep, self).process_lifecycle() Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 159, in process_lifecycle Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) step.process() Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 256, in process Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) self.finalize() Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 608, in finalize Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) self.context.checksum) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 114, in add_metadata_file_metadata Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) content = file_handle.read() Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib64/python2.7/gzip.py", line 254, in read Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) self._read(readsize) Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib64/python2.7/gzip.py", line 325, in _read Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) self._read_eof() Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) File "/usr/lib64/python2.7/gzip.py", line 349, in _read_eof Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) raise IOError, "Incorrect length of data produced" Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) IOError: Incorrect length of data produced Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[646e9d1f-434c-4235-80c2-c8ebd0673483] succeeded in 0.00690435299475s: None </pre> [root@ibm-x3550m3-11 ~]# rpm -qa |grep pulp python-pulp-common-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch python-kombu-3.0.33-5.pulp.el7.noarch python-pulp-docker-common-2.0.2-0.2.beta.git.48.0bab9ff.el7.noarch pulp-selinux-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch pulp-docker-plugins-2.0.2-0.2.beta.git.48.0bab9ff.el7.noarch python-pulp-client-lib-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch pulp-rpm-admin-extensions-2.9.0-0.1.beta.git.221.e93f53d.el7.noarch pulp-python-admin-extensions-1.1.2-0.1.beta.git.12.7790d4a.el7.noarch python-isodate-0.5.0-4.pulp.el7.noarch python-pulp-puppet-common-2.9.0-0.1.beta.git.86.20ca773.el7.noarch python-pulp-rpm-common-2.9.0-0.1.beta.git.221.e93f53d.el7.noarch python-pulp-oid_validation-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch pulp-server-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch pulp-puppet-plugins-2.9.0-0.1.beta.git.86.20ca773.el7.noarch python-pulp-bindings-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch pulp-puppet-admin-extensions-2.9.0-0.1.beta.git.86.20ca773.el7.noarch pulp-docker-admin-extensions-2.0.2-0.2.beta.git.48.0bab9ff.el7.noarch pulp-ostree-plugins-1.1.2-0.1.beta.git.11.9227383.el7.noarch python-pulp-python-common-1.1.2-0.1.beta.git.12.7790d4a.el7.noarch pulp-python-plugins-1.1.2-0.1.beta.git.12.7790d4a.el7.noarch python-pulp-streamer-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch python-pulp-repoauth-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch pulp-rpm-plugins-2.9.0-0.1.beta.git.221.e93f53d.el7.noarch pulp-admin-client-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch python-pulp-ostree-common-1.1.2-0.1.beta.git.11.9227383.el7.noarch pulp-ostree-admin-extensions-1.1.2-0.1.beta.git.11.9227383.el7.noarch [root@ibm-x3550m3-11 ~]#
.