https://pulp.plan.io/https://pulp.plan.io/favicon.ico2021-03-01T13:46:40ZPulpFile Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=680382021-03-01T13:46:40Zvatavu
<ul></ul><p>vatavu wrote:</p>
<blockquote>
<p>Scenario:</p>
<ol>
<li>
<p>We have a Pulp3 repo of type file</p>
</li>
<li>
<p>We upload in the repo from step 1 a compressed files called testFile.tgz</p>
</li>
<li>
<p>The upload is done with success and the PULP_MANIFEST files showa as expected.</p>
</li>
<li>
<p>We have a Pulp2 repo of type iso</p>
</li>
<li>
<p>The Pulp2 repo tries to sync from Pulp3 repo.</p>
</li>
</ol>
<p>Expected result:
Sync should complete with success as it is the case for any other type of files</p>
<p>Actual result:
Sync fails with the following error:</p>
</blockquote>
<blockquote>
<p>*Downloading the Pulp Manifest...</p>
<p>Task Failed</p>
<p>[{'name': u'k8s-db-manager/k8s-db-manager-0.0.0.tgz', 'error': 'Downloading
<k8s-db-manager/k8s-db-manager-0.0.0.tgz> failed validation. The manifest
specified that the file should be 1646 bytes, but the downloaded file is 5120
bytes.'}]*</p>
<p>To be noticed that the tgz size is 1646 bytes indeed but the content of the tgz file is 5120 bytes.</p>
<p>Notice: Using tar.gz compression works as expected.</p>
</blockquote> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=680842021-03-02T15:43:54Zdaviddavis
<ul><li><strong>Tags</strong> <i>Pulp 2</i> added</li></ul> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=680852021-03-02T15:44:13Zdaviddavis
<ul><li><strong>Tags</strong> deleted (<del><i>Pulp 2</i></del>)</li></ul> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=680862021-03-02T15:49:26Zjsherril@redhat.comjsherril@redhat.com
<ul><li><strong>Tags</strong> <i>Katello</i> added</li></ul> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=680912021-03-02T16:15:34Zdalleydalley@redhat.com
<ul></ul><p>This is probably the client (pulp2 in this case) trying to auto-extract the contents based on the HTTP headers, or something along those lines.</p> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=680942021-03-02T16:40:01Zttereshcttereshc@redhat.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/68094/diff?detail_id=68239">diff</a>)</li></ul><p>pre'd</p> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=684572021-03-09T17:23:22Zttereshcttereshc@redhat.com
<ul><li><strong>Triaged</strong> changed from <i>No</i> to <i>Yes</i></li></ul> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=696932021-04-14T00:50:12Zdalleydalley@redhat.com
<ul></ul><p>Hi @vatavu.</p>
<p>We had an issue like this about a year ago, that was resolved [0]. How old is this particular installation of Pulp? Could you provide us with the versions of the Pulp 2 and Pulp 3 packages?</p>
<p>I tried this on the most recent Pulp, and was unable to reproduce. I suspect that you are on version 3.4, if you are experiencing this issue.</p>
<p>[0] <a href="https://pulp.plan.io/issues/6831" class="external">https://pulp.plan.io/issues/6831</a></p> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=696942021-04-14T00:52:54Zdalleydalley@redhat.com
<ul></ul><p>If that's not the case, please paste what you see when you run "curl --head $file" for .tar.gz and .tgz files served by Pulp 3.</p>
<pre><code>(pulp) [vagrant@pulp3-source-fedora33 devel]$ curl --head http://localhost:24816/pulp/content/tgz_test/test.tgz
HTTP/1.1 200 OK
Content-Type: application/x-tar
Last-Modified: Wed, 14 Apr 2021 00:22:24 GMT
Content-Length: 195979
Accept-Ranges: bytes
Date: Wed, 14 Apr 2021 00:37:02 GMT
Server: Python/3.9 aiohttp/3.7.4.post0
(pulp) [vagrant@pulp3-source-fedora33 devel]$ curl --head http://localhost:24816/pulp/content/tgz_test/test.tar.gz
HTTP/1.1 200 OK
Content-Type: application/x-tar
Last-Modified: Wed, 14 Apr 2021 00:22:24 GMT
Content-Length: 195979
Accept-Ranges: bytes
Date: Wed, 14 Apr 2021 00:37:10 GMT
</code></pre> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=699992021-04-24T19:05:57Zdalleydalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>NEW</i> to <i>CLOSED - WORKSFORME</i></li></ul><p>Please re-open if you're still encountering this issue, on a recent version of Pulpcore.</p> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=700002021-04-24T19:09:49Zdalleydalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>CLOSED - WORKSFORME</i> to <i>NEW</i></li></ul><p>I'll re-open in case we want to assign it to Pulp 2, once someone gets a chance to test.</p> File Support - Issue #8312: Pulp2 fails to validate file size for tgz from the manifest generated by Pulp3https://pulp.plan.io/issues/8312?journal_id=700712021-04-27T16:14:00Zdalleydalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>NEW</i> to <i>CLOSED - WORKSFORME</i></li></ul><p>@ipanova tested this with Pulp 2, and was not able to reproduce. As mentioned previously, if you still encounter this after upgrading, please re-open and provide us with version information.</p>