Project

Profile

Help

Issue #5032

closed

Pulp2 doesn't like the manifest generated by Pulp3

Added by paji@redhat.com over 5 years ago. Updated over 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Sprint/Milestone:
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

Notice:
https://repos.fedorapeople.org/pulp/pulp/fixtures/file/PULP_MANIFEST

1.iso,f551cf01f10b52febaa827b71f3d7433e8284568ea86e3994b67d8361728ec90,1024
2.iso,fa8f8ea76c7dd93f122cb1ef8a2474d3e3e3d34342d194ddab8c892d3b14058f,1024
3.iso,20b9e53f915532ec09328cd48a2959f3333fb7130af96599ed42601262659efd,1024

Now sync that repo in pulp3 and generate the manifest file and check the same manifest file again

1.iso, f551cf01f10b52febaa827b71f3d7433e8284568ea86e3994b67d8361728ec90, 1024
2.iso, fa8f8ea76c7dd93f122cb1ef8a2474d3e3e3d34342d194ddab8c892d3b14058f, 1024
3.iso, 20b9e53f915532ec09328cd48a2959f3333fb7130af96599ed42601262659efd, 1024

Notice the "space" between each item in the generated manifest. Pulp2 has trouble syncing this and puts an error that looks like

--
pulp_tasks:
- exception: 
  task_type: pulp.server.managers.repo.sync.sync
  _href: "/pulp/api/v2/tasks/0858f323-5083-4360-82be-095634095aa1/"
  task_id: '0858f323-5083-4360-82be-095634095aa1'
  tags:
  - pulp:repository:4d089f3a-81f2-495b-b1b0-67878da2cbaf
  - pulp:action:sync
  finish_time: '2019-06-25T03:08:36Z'
  _ns: task_status
  start_time: '2019-06-25T03:08:34Z'
  traceback: |
    Traceback (most recent call last):
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
        R = retval = fun(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
        return super(Task, self).__call__(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
        return super(PulpTask, self).__call__(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
        return self.run(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 770, in sync
        sync_report = sync_repo(transfer_repo, conduit, call_config)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 737, in wrap_f
        return f(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/iso/importer.py", line 103, in sync_repo
        report = self.iso_sync.perform_sync()
      File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/iso/sync.py", line 265, in perform_sync
        self.progress_report.state = self.progress_report.STATE_COMPLETE
      File "/usr/lib/python2.7/site-packages/pulp_rpm/common/progress.py", line 307, in _set_state
        raise Exception(self.iso_error_messages)
    Exception: [{'name': u'3.iso', 'error': 'Downloading <3.iso> failed checksum validation. The manifest specified the checksum to be  1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da, but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.'}, {'name': u'1.iso', 'error': 'Downloading <1.iso> failed checksum validation. The manifest specified the checksum to be  a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983, but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.'}, {'name': u'2.iso', 'error': 'Downloading <2.iso> failed checksum validation. The manifest specified the checksum to be  b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8, but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.'}]
  spawned_tasks: []
  progress_report:
    iso_importer:
      error_message: 
      traceback: 
      finished_bytes: 3072
      num_isos: 3
      state: isos_failed
      total_bytes: 3072
      state_times:
        not_started: '2019-06-25T03:08:34'
        manifest_in_progress: '2019-06-25T03:08:34'
        isos_failed: '2019-06-25T03:08:36'
        isos_in_progress: '2019-06-25T03:08:35'
      num_isos_finished: 0
      iso_error_messages:
      - name: 3.iso
        error: Downloading <3.iso> failed checksum validation. The manifest specified
          the checksum to be  1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da,
          but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.
      - name: 1.iso
        error: Downloading <1.iso> failed checksum validation. The manifest specified
          the checksum to be  a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983,
          but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.
      - name: 2.iso
        error: Downloading <2.iso> failed checksum validation. The manifest specified
          the checksum to be  b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8,
          but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.
  queue: reserved_resource_worker-0@zeta-proxy-devel.partello.example.com.dq2
  state: error
  worker_name: reserved_resource_worker-0@zeta-proxy-devel.partello.example.com
  result: 
  error:
    code: PLP0000
    data: {}
    description: "[{'name': u'3.iso', 'error': 'Downloading <3.iso> failed checksum
      validation. The manifest specified the checksum to be  1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da,
      but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.'},
      {'name': u'1.iso', 'error': 'Downloading <1.iso> failed checksum validation.
      The manifest specified the checksum to be  a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983,
      but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.'},
      {'name': u'2.iso', 'error': 'Downloading <2.iso> failed checksum validation.
      The manifest specified the checksum to be  b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8,
      but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.'}]"
    sub_errors: []
  _id:
    "$oid": 5d119027d1d5b8f16501f0b5
  id: 5d119027d1d5b8f16501f0b5
poll_attempts:
  total: 10
  failed: 1
Error:

Katello::Errors::PulpError

PLP0000: [{'name': u'3.iso', 'error': 'Downloading <3.iso> failed checksum validation. The manifest specified the checksum to be 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da, but it was 1d7e85343d88da30fa418c129b8bb50eb2ef9d386c425ed005ded01c0c1197da.'}, {'name': u'1.iso', 'error': 'Downloading <1.iso> failed checksum validation. The manifest specified the checksum to be a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983, but it was a94f9b4d37c648b50ffaadb590da9538c4b01296baaa1492e00fdec52a7f1983.'}, {'name': u'2.iso', 'error': 'Downloading <2.iso> failed checksum validation. The manifest specified the checksum to be b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8, but it was b9313efa697cf4e348a22cfa786b1b65116d0acfaba84bd5787efcf5ecccabc8.'}]

---

Added by David Davis over 5 years ago

Revision 96675294 | View on GitHub

Remove space after commas in manifests

fixes #5032 https://pulp.plan.io/issues/5032

Actions #1

Updated by Anonymous over 5 years ago

  • Status changed from NEW to MODIFIED
Actions #2

Updated by daviddavis over 5 years ago

  • Status changed from MODIFIED to POST
Actions #3

Updated by daviddavis over 5 years ago

  • Assignee set to daviddavis

Added by David Davis over 5 years ago

Revision 3e14f38e | View on GitHub

Remove space after commas in manifests

fixes #5032 https://pulp.plan.io/issues/5032

Actions #4

Updated by Anonymous over 5 years ago

  • Status changed from POST to MODIFIED
Actions #5

Updated by bmbouter about 5 years ago

  • Sprint/Milestone set to 0.1.0
Actions #6

Updated by bmbouter about 5 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF