Pulp

Description

Description of problem:
Publishing errata is failing with fails with "Incorrect length of data produced" error

Version-Release number of selected component (if applicable):
2.9

How reproducible:
Always

Steps to Reproduce:

1.Create a rhel repo with feed

2. pulp-admin rpm repo sync run --repo-id=<repo-name>

Actual results:

[root@ibm-x3550m3-11 ~]# pulp-admin rpm repo create --repo-id rhel5-os --feed http://cdn.rcm-internal.redhat.com/content/dist/rhel/rhui/server/5/5.11/x86_64/os/ --download-policy on_demand
Successfully created repository [rhel5-os]

[root@ibm-x3550m3-11 ~]# pulp-admin rpm repo sync run --repo-id rhel5-os
+----------------------------------------------------------------------+
                  Synchronizing Repository [rhel5-os]
+----------------------------------------------------------------------+

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[|]
... completed

Downloading repository content...
[-]
[==================================================] 100%
RPMs:       13745/13745 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[\]
... completed

Importing package groups/categories...
[\]
... completed

Cleaning duplicate packages...
[\]
... completed

Task Succeeded

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[==================================================] 100%
17117 of 17117 items
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[====                                              ] 9%
298 of 3135 items

Task Failed

Incorrect length of data produced

Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: py.warnings:WARNING: (32465-35008) /usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py:1109: DeprecationWarning: save is deprecated. Use insert_one or replace_one instead
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: py.warnings:WARNING: (32465-35008)   publish_result_coll.save(result)
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: py.warnings:WARNING: (32465-35008)
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) Exception caught from plugin during publish for repo [rhel5-os]
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) Traceback (most recent call last):
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1090, in _do_publish
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     publish_report = publish_repo(transfer_repo, conduit, call_config)
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 658, in wrap_f
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     return f(*args, **kwargs)
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     return self._publisher.process_lifecycle()
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 562, in process_lifecycle
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     super(PluginStep, self).process_lifecycle()
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 159, in process_lifecycle
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     step.process()
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 256, in process
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     self.finalize()
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 608, in finalize
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     self.context.checksum)
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 114, in add_metadata_file_metadata
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     content = file_handle.read()
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib64/python2.7/gzip.py", line 254, in read
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     self._read(readsize)
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib64/python2.7/gzip.py", line 325, in _read
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     self._read_eof()
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)   File "/usr/lib64/python2.7/gzip.py", line 349, in _read_eof
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008)     raise IOError, "Incorrect length of data produced"
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.controllers.repository:ERROR: (32465-35008) IOError: Incorrect length of data produced
Jun 15 16:36:03 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32465]: pulp.server.async.tasks:INFO: Task failed : [1895b633-025d-4d26-987d-f3b900e4dfc3]
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) Task pulp.server.managers.repo.publish.publish[1895b633-025d-4d26-987d-f3b900e4dfc3] raised unexpected: IOError('Incorrect length of data produced',)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) Traceback (most recent call last):
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     R = retval = fun(*args, **kwargs)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 473, in __call__
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     return super(Task, self).__call__(*args, **kwargs)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 103, in __call__
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     return super(PulpTask, self).__call__(*args, **kwargs)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     return self.run(*args, **kwargs)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 971, in publish
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1038, in check_publish
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1090, in _do_publish
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     publish_report = publish_repo(transfer_repo, conduit, call_config)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 658, in wrap_f
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     return f(*args, **kwargs)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     return self._publisher.process_lifecycle()
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 562, in process_lifecycle
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     super(PluginStep, self).process_lifecycle()
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 159, in process_lifecycle
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     step.process()
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 256, in process
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     self.finalize()
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 608, in finalize
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     self.context.checksum)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 114, in add_metadata_file_metadata
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     content = file_handle.read()
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib64/python2.7/gzip.py", line 254, in read
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     self._read(readsize)
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib64/python2.7/gzip.py", line 325, in _read
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     self._read_eof()
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)   File "/usr/lib64/python2.7/gzip.py", line 349, in _read_eof
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008)     raise IOError, "Incorrect length of data produced"
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:ERROR: (32098-35008) IOError: Incorrect length of data produced
Jun 15 16:36:04 ibm-x3550m3-11.lab.eng.brq.redhat.com pulp[32098]: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[646e9d1f-434c-4235-80c2-c8ebd0673483] succeeded in 0.00690435299475s: None

[root@ibm-x3550m3-11 ~]# rpm -qa |grep pulp
python-pulp-common-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
python-kombu-3.0.33-5.pulp.el7.noarch
python-pulp-docker-common-2.0.2-0.2.beta.git.48.0bab9ff.el7.noarch
pulp-selinux-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
pulp-docker-plugins-2.0.2-0.2.beta.git.48.0bab9ff.el7.noarch
python-pulp-client-lib-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
pulp-rpm-admin-extensions-2.9.0-0.1.beta.git.221.e93f53d.el7.noarch
pulp-python-admin-extensions-1.1.2-0.1.beta.git.12.7790d4a.el7.noarch
python-isodate-0.5.0-4.pulp.el7.noarch
python-pulp-puppet-common-2.9.0-0.1.beta.git.86.20ca773.el7.noarch
python-pulp-rpm-common-2.9.0-0.1.beta.git.221.e93f53d.el7.noarch
python-pulp-oid_validation-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
pulp-server-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
pulp-puppet-plugins-2.9.0-0.1.beta.git.86.20ca773.el7.noarch
python-pulp-bindings-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
pulp-puppet-admin-extensions-2.9.0-0.1.beta.git.86.20ca773.el7.noarch
pulp-docker-admin-extensions-2.0.2-0.2.beta.git.48.0bab9ff.el7.noarch
pulp-ostree-plugins-1.1.2-0.1.beta.git.11.9227383.el7.noarch
python-pulp-python-common-1.1.2-0.1.beta.git.12.7790d4a.el7.noarch
pulp-python-plugins-1.1.2-0.1.beta.git.12.7790d4a.el7.noarch
python-pulp-streamer-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
python-pulp-repoauth-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
pulp-rpm-plugins-2.9.0-0.1.beta.git.221.e93f53d.el7.noarch
pulp-admin-client-2.9.0-0.1.beta.git.286.fa65b74.el7.noarch
python-pulp-ostree-common-1.1.2-0.1.beta.git.11.9227383.el7.noarch
pulp-ostree-admin-extensions-1.1.2-0.1.beta.git.11.9227383.el7.noarch
[root@ibm-x3550m3-11 ~]#