Actions
Issue #5032
closedPulp2 doesn't like the manifest generated by Pulp3
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:
Description
Notice:
https://repos.fedorapeople.org/pulp/pulp/fixtures/file/PULP_MANIFEST
1.iso,f551cf01f10b52febaa827b71f3d7433e8284568ea86e3994b67d8361728ec90,1024
2.iso,fa8f8ea76c7dd93f122cb1ef8a2474d3e3e3d34342d194ddab8c892d3b14058f,1024
3.iso,20b9e53f915532ec09328cd48a2959f3333fb7130af96599ed42601262659efd,1024
Now sync that repo in pulp3 and generate the manifest file and check the same manifest file again
1.iso, f551cf01f10b52febaa827b71f3d7433e8284568ea86e3994b67d8361728ec90, 1024
2.iso, fa8f8ea76c7dd93f122cb1ef8a2474d3e3e3d34342d194ddab8c892d3b14058f, 1024
3.iso, 20b9e53f915532ec09328cd48a2959f3333fb7130af96599ed42601262659efd, 1024
Notice the "space" between each item in the generated manifest. Pulp2 has trouble syncing this and puts an error that looks like
--
pulp_tasks:
- exception:
task_type: pulp.server.managers.repo.sync.sync
_href: "/pulp/api/v2/tasks/0858f323-5083-4360-82be-095634095aa1/"
task_id: '0858f323-5083-4360-82be-095634095aa1'
tags:
- pulp:repository:4d089f3a-81f2-495b-b1b0-67878da2cbaf
- pulp:action:sync
finish_time: '2019-06-25T03:08:36Z'
_ns: task_status
start_time: '2019-06-25T03:08:34Z'
traceback: |
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
return super(Task, self).__call__(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
return super(PulpTask, self).__call__(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
return self.run(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 770, in sync
sync_report = sync_repo(transfer_repo, conduit, call_config)
File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 737, in wrap_f
return f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/iso/importer.py", line 103, in sync_repo
report = self.iso_sync.perform_sync()
File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/iso/sync.py", line 265, in perform_sync
self.progress_report.state = self.progress_report.STATE_COMPLETE
File "/usr/lib/python2.7/site-packages/pulp_rpm/common/progress.py", line 307, in _set_state
raise Exception(self.iso_error_messages)
Exception: [{'name': u'3.iso', 'error': 'Downloading <3.iso> failed checksum validation. The manifest specified the checksum to be 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da, but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.'}, {'name': u'1.iso', 'error': 'Downloading <1.iso> failed checksum validation. The manifest specified the checksum to be a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983, but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.'}, {'name': u'2.iso', 'error': 'Downloading <2.iso> failed checksum validation. The manifest specified the checksum to be b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8, but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.'}]
spawned_tasks: []
progress_report:
iso_importer:
error_message:
traceback:
finished_bytes: 3072
num_isos: 3
state: isos_failed
total_bytes: 3072
state_times:
not_started: '2019-06-25T03:08:34'
manifest_in_progress: '2019-06-25T03:08:34'
isos_failed: '2019-06-25T03:08:36'
isos_in_progress: '2019-06-25T03:08:35'
num_isos_finished: 0
iso_error_messages:
- name: 3.iso
error: Downloading <3.iso> failed checksum validation. The manifest specified
the checksum to be 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da,
but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.
- name: 1.iso
error: Downloading <1.iso> failed checksum validation. The manifest specified
the checksum to be a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983,
but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.
- name: 2.iso
error: Downloading <2.iso> failed checksum validation. The manifest specified
the checksum to be b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8,
but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.
queue: reserved_resource_worker-0@zeta-proxy-devel.partello.example.com.dq2
state: error
worker_name: reserved_resource_worker-0@zeta-proxy-devel.partello.example.com
result:
error:
code: PLP0000
data: {}
description: "[{'name': u'3.iso', 'error': 'Downloading <3.iso> failed checksum
validation. The manifest specified the checksum to be 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da,
but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.'},
{'name': u'1.iso', 'error': 'Downloading <1.iso> failed checksum validation.
The manifest specified the checksum to be a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983,
but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.'},
{'name': u'2.iso', 'error': 'Downloading <2.iso> failed checksum validation.
The manifest specified the checksum to be b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8,
but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.'}]"
sub_errors: []
_id:
"$oid": 5d119027d1d5b8f16501f0b5
id: 5d119027d1d5b8f16501f0b5
poll_attempts:
total: 10
failed: 1
Error:
Katello::Errors::PulpError
PLP0000: [{'name': u'3.iso', 'error': 'Downloading <3.iso> failed checksum validation. The manifest specified the checksum to be 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da, but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.'}, {'name': u'1.iso', 'error': 'Downloading <1.iso> failed checksum validation. The manifest specified the checksum to be a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983, but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.'}, {'name': u'2.iso', 'error': 'Downloading <2.iso> failed checksum validation. The manifest specified the checksum to be b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8, but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.'}]
---
Actions
Remove space after commas in manifests
fixes #5032 https://pulp.plan.io/issues/5032