Project

Profile

Help

Issue #647

closed

rpm repo publish fails with "Incorrect length of data produced" error

Added by bryce.pier@capella.edu about 9 years ago. Updated almost 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
3. High
Version:
2.5
Platform Release:
2.6.0
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

Description of problem:
Prior to and after upgrading from 2.5.0 to 2.5.1 (and now also after applying the 2.5.2-0.0.beta packages), I've been unable to publish both feed-url and upload rpm repos. The issue appears to affect all of my repos.

Version-Release number of selected component (if applicable):
2.5.0
2.5.1
2.5.2-0.0.beta

How reproducible:
Always

Steps to Reproduce:
1. pulp-admin rpm repo publish run --repo-id=<repo name>
OR
pulp-admin rpm repo sync run --repo-id=<repo-name>
2.
3.

Actual results:

  1. pulp-admin rpm repo publish run --repo-id=rhel-6-x86_64-os
    --------------------------------------------------------------------
    Publishing Repository [rhel-6-x86_64-os]
    --------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[====================== ] 45%
6605 of 14365 items
... failed
Incorrect length of data produced

Task Failed

Incorrect length of data produced

  1. pulp-admin rpm repo sync run --repo-id=rhel-6-x86_64-os
    --------------------------------------------------------------------
    Synchronizing Repository [rhel-6-x86_64-os]
    --------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[\]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 113/113 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[-]
... completed

Importing package groups/categories...
[\]
... completed

Task Succeeded

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[====================== ] 45%
6643 of 14478 items
... failed
Incorrect length of data produced

Task Failed

Incorrect length of data produced

Expected results:
Successfully publishing repos for use via yum.

Additional info:

Current package version (although this was failing prior to upgrading to this version):
yum list installed |grep pulp
grinder.noarch 0.1.16-1.el6 @pulp-v2-stable
m2crypto.x86_64 0.21.1.pulp-8.el6 @pulp-v2-stable
mod_wsgi.x86_64 3.4-2.pulp.el6 @pulp-v2-stable
pulp-admin-client.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
pulp-puppet-admin-extensions.noarch
2.5.2-0.0.beta.el6 @pulp-v2-beta
pulp-puppet-plugins.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
pulp-rpm-admin-extensions.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
pulp-rpm-plugins.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
pulp-selinux.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
pulp-server.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
python-amqp.noarch 1.4.5-1.el6 @pulp-v2-stable
python-anyjson.noarch 0.3.3-4.el6 @pulp-v2-stable
python-billiard.x86_64 1:3.3.0.17-1.el6 @pulp-v2-stable
python-celery.noarch 3.1.11-1.el6 @pulp-v2-stable
python-gofer.noarch 1.3.1-1.el6 @pulp-v2-stable
python-gofer-qpid.noarch 1.3.1-1.el6 @pulp-v2-stable
python-isodate.noarch 0.5.0-4.pulp.el6 @pulp-v2-stable
python-kombu.noarch 1:3.0.15-12.pulp.el6 @pulp-v2-stable
python-nectar.noarch 1.3.1-1.el6 @pulp-v2-stable
python-pulp-bindings.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
python-pulp-client-lib.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
python-pulp-common.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
python-pulp-puppet-common.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
python-pulp-rpm-common.noarch 2.5.2-0.0.beta.el6 @pulp-v2-beta
python-qpid.noarch 0.26-2.el6 @pulp-v2-stable
python-qpid-common.noarch 0.26-2.el6 @pulp-v2-stable
python-qpid-qmf.x86_64 0.26-2.el6 @pulp-v2-stable
python-requests.noarch 2.2.1-1.el6 @pulp-v2-stable
python-semantic-version.noarch 2.2.0-3.el6 @pulp-v2-stable
qpid-cpp-client.x86_64 0.26-9.el6 @pulp-v2-beta
qpid-cpp-server.x86_64 0.26-9.el6 @pulp-v2-beta
qpid-cpp-server-store.x86_64 0.26-9.el6 @pulp-v2-beta
qpid-qmf.x86_64 0.26-2.el6 @pulp-v2-stable

Trace from /var/log/messages:
Dec 22 14:57:51 dvpuap02 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._reserve_resource[831267ce-98eb-41c3-9dad-0b0e32035ec0]
Dec 22 14:57:51 dvpuap02 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._reserve_resource[831267ce-98eb-41c3-9dad-0b0e32035ec0] succeeded in 0.031
6150639992s: u''
Dec 22 14:57:52 dvpuap02 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[7003450d-2b88-45a5-b05b-f5a92cfbba67]
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: Exception caught from plugin during publish for repo [epel6]
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: Traceback (most recent call last):
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 1
26, in do_publish
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: publish_report = publish_repo(transfer_repo, conduit, call_config)
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 470, in wra
p_f
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: return f(*args, **kwargs)
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor
.py", line 143, in publish_repo
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: return self._publisher.publish()
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 507, in publish
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: return self.process_lifecycle()
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 456, in process_lifecycle
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: super(PluginStep, self).process_lifecycle()
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 121, in process_lifecycle
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: step.process()
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 185, in process
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: self.finalize()
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 414, in finalize
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: self.other_context.checksum)
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 115, in add_metadata_file_metadata
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: content = file_handle.read()
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib64/python2.6/gzip.py", line 212, in read
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: self._read(readsize)
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib64/python2.6/gzip.py", line 284, in _read
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: self._read_eof()
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: File "/usr/lib64/python2.6/gzip.py", line 306, in _read_eof
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: raise IOError, "Incorrect length of data produced"
Dec 22 14:57:58 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: IOError: Incorrect length of data produced
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: Task pulp.server.managers.repo.publish.publish[7003450d-2b88-45a5-b05b-f5a92cfbba67] raised unexpected: IOError('Incorrect length of data produced',)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: Traceback (most recent call last):
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: R = retval = fun(*args, **kwargs)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 315, incall
_
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: return super(Task, self).__call__(*args, **kwargs)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in protected_call
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: return self.run(*args, **kwargs)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 98, in publish
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: transfer_repo, conduit, call_config)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 126, in _do_publish
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: publish_report = publish_repo(transfer_repo, conduit, call_config)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 470, in wrap_f
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: return f(*args, **kwargs)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 143, in publish_repo
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: return self._publisher.publish()
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 507, in publish
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: return self.process_lifecycle()
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 456, in process_lifecycle
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: super(PluginStep, self).process_lifecycle()
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 121, in process_lifecycle
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: step.process()
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 185, in process
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: self.finalize()
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 414, in finalize
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: self.other_context.checksum)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 115, in add_metadata_file_metadata
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: content = file_handle.read()
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib64/python2.6/gzip.py", line 212, in read
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: self._read(readsize)
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib64/python2.6/gzip.py", line 284, in _read
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: self._read_eof()
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: File "/usr/lib64/python2.6/gzip.py", line 306, in _read_eof
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: raise IOError, "Incorrect length of data produced"
Dec 22 14:57:58 dvpuap02 pulp: celery.worker.job:ERROR: IOError: Incorrect length of data produced

+ This bug was cloned from Bugzilla Bug #1176698 +


Related issues

Blocks RPM Support - Issue #512: Pulp cannot sync an EPEL 5 repository that was published by PulpCLOSED - CURRENTRELEASEmhrivnakActions

Also available in: Atom PDF