Project

Profile

Help

Backport #8654

closed

Backport to 2.1.: schema conversion adds an empty blob in the manifest but it is not present on the fs

Added by ipanova@redhat.com over 3 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Sprint/Milestone:
Start date:
Due date:
% Done:

100%

Estimated time:
Triaged:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 96
Quarter:

Description

This leads to pulp3 to pulp2 sync failure. In the converted manifest an empty blob with digest sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 is present and pulp2 trys to fetch it unsuccessfully because pulp3 does not have it on the fs

Error: DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9
fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.
DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-library-composite-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.
DKR1020: Image download(s) from https://kangae.example.com/v2/test_organizationupgrade1-library-component_1-test_product-foremanbusybox/blobs/sha256:a3ed95ca
eb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed. Sync task has failed to prevent a corrupted repository.


when i try to curl one of these, i get:

{"errors":[{"code":"BLOB_UNKNOWN","message":"Blob not found.","detail":{"digest":"sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4"}}]}

and on the pulp2 box: Apr 27 00:22:33  pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://kangae.example.com/v2/test_org
anizationupgrade1-library-composite-test_product-foremanbusybox/blobs/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 failed with code 404: Not Found

https://github.com/pulp/pulp_container/blob/master/pulp_container/app/schema_convert.py#L173

use this details to sync a repo

            "upstream_name": "foreman/busybox-test",                                                                                                                                                                                  
            "url": "https://quay.io/",  

Related issues

Copied from Container Support - Issue #8631: schema conversion adds an empty blob in the manifest but it is not present on the fsCLOSED - CURRENTRELEASEipanova@redhat.comActions
Actions #1

Updated by ipanova@redhat.com over 3 years ago

  • Copied from Issue #8631: schema conversion adds an empty blob in the manifest but it is not present on the fs added
Actions #3

Updated by ipanova@redhat.com over 3 years ago

  • Sprint set to Sprint 95
Actions #4

Updated by ipanova@redhat.com over 3 years ago

  • Subject changed from Backport to 2.2.: schema conversion adds an empty blob in the manifest but it is not present on the fs to Backport to 2.1.: schema conversion adds an empty blob in the manifest but it is not present on the fs
Actions #5

Updated by ipanova@redhat.com over 3 years ago

  • Tracker changed from Issue to Backport
  • % Done set to 0
  • Severity deleted (2. Medium)
  • Groomed deleted (No)
Actions #6

Updated by ipanova@redhat.com over 3 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to ipanova@redhat.com
Actions #7

Updated by rchan over 3 years ago

  • Sprint changed from Sprint 95 to Sprint 96
Actions #8

Updated by pulpbot over 3 years ago

  • Status changed from ASSIGNED to POST

Added by ipanova@redhat.com over 3 years ago

Revision 7158c26a | View on GitHub

Create and return empty blob on the fly.

backports #8631 closes #8654

(cherry picked from commit c16e10f7d7e680821f48a5c55f2818cb55383b7f)

Added by ipanova@redhat.com over 3 years ago

Revision 7158c26a | View on GitHub

Create and return empty blob on the fly.

backports #8631 closes #8654

(cherry picked from commit c16e10f7d7e680821f48a5c55f2818cb55383b7f)

Actions #9

Updated by ipanova@redhat.com over 3 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100
Actions #10

Updated by ipanova@redhat.com over 3 years ago

  • Sprint/Milestone set to 2.1.2
Actions #11

Updated by pulpbot over 3 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF