https://pulp.plan.io/https://pulp.plan.io/favicon.ico2016-04-14T05:05:53ZPulpRPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=107792016-04-14T05:05:53Zmmccune@redhat.commmccune@redhat.com
<ul><li><strong>Severity</strong> changed from <i>2. Medium</i> to <i>3. High</i></li><li><strong>Version</strong> set to <i>2.8.0</i></li></ul><p>this is fairly severe in that it breaks a good porting of RHEL provisioning. moved to High severity</p> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=107822016-04-14T13:34:16Zjcline@redhat.comjcline@redhat.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/10782/diff?detail_id=11480">diff</a>)</li></ul> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=107872016-04-14T15:20:45Zjcline@redhat.comjcline@redhat.com
<ul><li><strong>Subject</strong> changed from <i>Pulp-to-pulp distribution syncing is almost certainly broken in some cases</i> to <i>Pulp publishes invalid PULP_DISTRIBUTION.xml metadata</i></li><li><strong>Description</strong> updated (<a title="View differences" href="/journals/10787/diff?detail_id=11484">diff</a>)</li><li><strong>Status</strong> changed from <i>NEW</i> to <i>ASSIGNED</i></li><li><strong>Assignee</strong> set to <i>jcline@redhat.com</i></li></ul><p>I've re-written the issue to narrow the focus, since the original was very broad. There are already several known issues with distributions (issue <a class="issue tracker-1 status-11 priority-7 priority-high2 closed" title="Issue: Unable to sync RHEL 5 repositories with a distribution (CLOSED - CURRENTRELEASE)" href="https://pulp.plan.io/issues/1768">#1768</a> which was only a very short-term fix and doesn't address the incorrect modeling and <a class="issue tracker-3 status-9 priority-6 priority-default closed" title="Story: As a user, I would like to be able to sync distribution trees (CLOSED - WONTFIX)" href="https://pulp.plan.io/issues/1769">#1769</a> which describes content we fail to mirror).</p>
<p>I intend to ensure Pulp doesn't publish metadata that references files that doesn't exist. However, it may be that it won't reference files that <em>need</em> to exist. I don't know what is using (or not using) `repodata/productid` and I find it troubling that we don't mirror upstream, but I don't think I should to tackle all the problems we have as part of this issue.</p> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=107892016-04-14T15:43:48Zmhrivnakmhrivnak@redhat.com
<ul></ul><p>A simple work-around that would improve, but not fix the situation, would be to do the same filtering during sync that we do during publish. Then at least pulp deployments with that change would happily ignore the same files that publish ignores.</p>
<p>As you point out, a better option is to modify the XML at publish time to filter out any files that don't actually get published. This would be more effort, but is still very doable.</p>
<p>And of course the best option would require figuring out why exactly pulp ignores those files, document that somewhere (at least in the code if not elsewhere), and determine if skipping those files is in fact appropriate.</p>
<p>To unblock katello, perhaps a combination of the first two would be valuable. You could probably make a PR for the first work-around very quickly, and then follow with the second option shortly thereafter. That would buy us time to further investigate why pulp is doing this at all. What do you think of that?</p> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=107942016-04-14T20:40:21Zmhrivnakmhrivnak@redhat.com
<ul><li><strong>Priority</strong> changed from <i>Normal</i> to <i>High</i></li><li><strong>Sprint/Milestone</strong> set to <i>19</i></li><li><strong>Platform Release</strong> set to <i>2.8.3</i></li></ul> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=108252016-04-15T15:27:47Zmhrivnakmhrivnak@redhat.com
<ul><li><strong>Triaged</strong> changed from <i>No</i> to <i>Yes</i></li></ul> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=108512016-04-15T19:47:08Zjcline@redhat.comjcline@redhat.com
<ul><li><strong>Status</strong> changed from <i>ASSIGNED</i> to <i>POST</i></li></ul><p><a href="https://github.com/pulp/pulp_rpm/pull/846" class="external">https://github.com/pulp/pulp_rpm/pull/846</a></p>
<p>Note that the first suggested work-around in note 4 isn't possible because it would break lazy syncs.</p> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=108752016-04-19T14:01:11ZAnonymous
<ul><li><strong>Status</strong> changed from <i>POST</i> to <i>MODIFIED</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>100</i></li></ul><p>Applied in changeset <a class="changeset" title="Regenerate PULP_DISTRIBUTION.xml on publish if necessary The PULP_DISTRIBUTION.xml file used to ..." href="https://pulp.plan.io/projects/pulp_rpm/repository/9/revisions/9f97669b4227a948fb5235ebf05eef478caf7a6c">9f97669b4227a948fb5235ebf05eef478caf7a6c</a>.</p> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=110462016-04-26T22:39:04Zsemyerssean.myers@redhat.com
<ul><li><strong>Status</strong> changed from <i>MODIFIED</i> to <i>5</i></li></ul> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=113432016-05-06T14:52:55Zpthomas@redhat.com
<ul><li><strong>Status</strong> changed from <i>5</i> to <i>6</i></li></ul><p>verified</p>
<pre><code>
[root@ibm-x3250m4-03 ~]# pulp-admin rpm repo sync run --repo-id rhel6
+----------------------------------------------------------------------+
Synchronizing Repository [rhel6]
+----------------------------------------------------------------------+
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[|]
... completed
Downloading repository content...
[-]
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed
Importing errata...
[-]
... completed
Importing package groups/categories...
[-]
... completed
Cleaning duplicate packages...
[-]
... completed
Task Succeeded
Copying files
[-]
... completed
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[|]
... completed
Publishing RPMs
[/]
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[-]
... completed
Publishing Comps file
[==================================================] 100%
212 of 212 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[\]
... completed
Writing Listings File
[-]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
</code></pre> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=115502016-05-17T19:32:00Zsemyerssean.myers@redhat.com
<ul><li><strong>Status</strong> changed from <i>6</i> to <i>CLOSED - CURRENTRELEASE</i></li></ul> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=252222018-03-08T18:21:09Zbmbouterbmbouter@redhat.com
<ul><li><strong>Sprint</strong> set to <i>Sprint 1</i></li></ul> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=252472018-03-08T18:21:50Zbmbouterbmbouter@redhat.com
<ul><li><strong>Sprint/Milestone</strong> deleted (<del><i>19</i></del>)</li></ul> RPM Support - Issue #1843: Pulp publishes invalid PULP_DISTRIBUTION.xml metadatahttps://pulp.plan.io/issues/1843?journal_id=389882019-04-15T20:31:56Zbmbouterbmbouter@redhat.com
<ul><li><strong>Tags</strong> <i>Pulp 2</i> added</li></ul>