Project

Profile

Help

Backport #8819

closed

Backport to 2.2: schema conversion adds an empty blob in the manifest but it is not present on the fs

Added by ipanova@redhat.com over 3 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Sprint/Milestone:
Start date:
Due date:
% Done:

100%

Estimated time:
Triaged:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 97
Quarter:

Description

https://pulp.plan.io/issues/8631

This leads to pulp3 to pulp2 sync failure. In the converted manifest an empty blob with digest sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 is present and pulp2 trys to fetch it unsuccessfully because pulp3 does not have it on the fs

Error: DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9
fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.
DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-library-composite-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.
DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-library-component_1-test_product-foremanbusybox/blobs/sha256:a3ed95ca
eb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.


when i try to curl one of these, i get:

{"errors":[{"code":"BLOB_UNKNOWN","message":"Blob not found.","detail":{"digest":"sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4"}}]}

and on the pulp2 box: Apr 27 00:22:33  pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://kangae.example.com/v2/test_org
anizationupgrade1-library-composite-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed with code 404: Not Found

https://github.com/pulp/pulp_container/blob/master/pulp_container/app/schema_convert.py#L173

use this details to sync a repo

            "upstream_name": "foreman/busybox-test",                                                                                                                                                                                  
            "url": "https://quay.io/",  

Related issues

Copied from Container Support - Backport #8699: Backport to 2.5: schema conversion adds an empty blob in the manifest but it is not present on the fsCLOSED - CURRENTRELEASEmdellweg

Actions
Actions #1

Updated by ipanova@redhat.com over 3 years ago

  • Copied from Backport #8699: Backport to 2.5: schema conversion adds an empty blob in the manifest but it is not present on the fs added
Actions #2

Updated by ipanova@redhat.com over 3 years ago

  • Sprint/Milestone set to 2.2.2
Actions #3

Updated by ipanova@redhat.com over 3 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee changed from mdellweg to ipanova@redhat.com
  • Sprint changed from Sprint 96 to Sprint 97
Actions #4

Updated by pulpbot over 3 years ago

  • Status changed from ASSIGNED to POST

Added by ipanova@redhat.com over 3 years ago

Revision ed67bb33 | View on GitHub

Create and return empty blob on the fly.

backports #8631 closes #8819

(cherry picked from commit c16e10f7d7e680821f48a5c55f2818cb55383b7f)

Added by ipanova@redhat.com over 3 years ago

Revision ed67bb33 | View on GitHub

Create and return empty blob on the fly.

backports #8631 closes #8819

(cherry picked from commit c16e10f7d7e680821f48a5c55f2818cb55383b7f)

Actions #5

Updated by ipanova@redhat.com over 3 years ago

  • Status changed from POST to MODIFIED
Actions #6

Updated by pulpbot over 3 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF