Project

Profile

Help

Backport #8699

Backport to 2.5: schema conversion adds an empty blob in the manifest but it is not present on the fs

Added by ipanova@redhat.com 6 months ago. Updated 5 months ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Sprint/Milestone:
Start date:
Due date:
% Done:

100%

Estimated time:
Triaged:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 96
Quarter:

Description

This leads to pulp3 to pulp2 sync failure. In the converted manifest an empty blob with digest sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 is present and pulp2 trys to fetch it unsuccessfully because pulp3 does not have it on the fs

Error: DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9
fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.
DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-library-composite-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.
DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-library-component_1-test_product-foremanbusybox/blobs/sha256:a3ed95ca
eb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.


when i try to curl one of these, i get:

{"errors":[{"code":"BLOB_UNKNOWN","message":"Blob not found.","detail":{"digest":"sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4"}}]}

and on the pulp2 box: Apr 27 00:22:33  pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://kangae.example.com/v2/test_org
anizationupgrade1-library-composite-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed with code 404: Not Found

https://github.com/pulp/pulp_container/blob/master/pulp_container/app/schema_convert.py#L173

use this details to sync a repo

            "upstream_name": "foreman/busybox-test",                                                                                                                                                                                  
            "url": "https://quay.io/",  

Related issues

Copied from Container Support - Issue #8631: schema conversion adds an empty blob in the manifest but it is not present on the fsCLOSED - CURRENTRELEASE<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Copied to Container Support - Backport #8819: Backport to 2.2: schema conversion adds an empty blob in the manifest but it is not present on the fsCLOSED - CURRENTRELEASE

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

Associated revisions

Revision 638dc340 View on GitHub
Added by mdellweg 6 months ago

Create and return empty blob on the fly.

backports #8631

fixes #8699

(cherry picked from commit c16e10f7d7e680821f48a5c55f2818cb55383b7f)

Revision 638dc340 View on GitHub
Added by mdellweg 6 months ago

Create and return empty blob on the fly.

backports #8631

fixes #8699

(cherry picked from commit c16e10f7d7e680821f48a5c55f2818cb55383b7f)

History

#1 Updated by ipanova@redhat.com 6 months ago

  • Copied from Issue #8631: schema conversion adds an empty blob in the manifest but it is not present on the fs added

#2 Updated by mdellweg 6 months ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to mdellweg

#3 Updated by pulpbot 6 months ago

  • Status changed from ASSIGNED to POST

#4 Updated by mdellweg 6 months ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

#5 Updated by pulpbot 5 months ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

#6 Updated by ipanova@redhat.com 5 months ago

  • Copied to Backport #8819: Backport to 2.2: schema conversion adds an empty blob in the manifest but it is not present on the fs added

Please register to edit this issue

Also available in: Atom PDF