Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2019-05-15T18:45:10ZPulp
Planio RPM Support - Issue #4826 (CLOSED - WORKSFORME): Pulp RPM Publish Comps File Errorhttps://pulp.plan.io/issues/48262019-05-15T18:45:10ZAnonymous
<p>Hello!</p>
<p>I have had an issue over the last little while since updating several Centos 7 boxes to 2.19. When the repos go to publish it would fail out during "Publishing Comps File" on all repos. Long story short I have tracked it down to a change was made in <a href="https://github.com/pulp/pulp_rpm/blame/2.19-release/plugins/pulp_rpm/plugins/distributors/yum/publish.py" class="external">https://github.com/pulp/pulp_rpm/blame/2.19-release/plugins/pulp_rpm/plugins/distributors/yum/publish.py</a> line 1181-1190. Now that sqliterepo_c is in use instead of createrepo_c (<a href="https://github.com/pulp/pulp_rpm/blame/c5f27803ad26dd8f5ff6c36b7d14f2a95e30ec25/plugins/pulp_rpm/plugins/distributors/yum/publish.py" class="external">https://github.com/pulp/pulp_rpm/blame/c5f27803ad26dd8f5ff6c36b7d14f2a95e30ec25/plugins/pulp_rpm/plugins/distributors/yum/publish.py</a> line 1179), sqliterepo_c doesnt know to look into the ./scratch folder in the job and fails out. More details below.</p>
<p><strong>Problem</strong>:<br>
Running a stock 2.19 on Centos fresh, installed for me hooked up to global repos would sync, but on publish would give the following (I turned on verbose sqliterepo_c output)</p>
<pre><code class="text syntaxhl" data-language="text">[root@test repodata]# pulp-admin rpm repo export run --repo-id centos7-x86_64-os-global
+----------------------------------------------------------------------+
Publishing Repository [centos7-x86_64-os-global]
+----------------------------------------------------------------------+
This command may be exited via ctrl+c without affecting the request.
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[==================================================] 100%
10019 of 10019 items
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[-]
... completed
Publishing Modules
... skipped
Publishing Comps file
[========================================= ] 83%
92 of 110 items
Task Failed
Error occurred during 'sqliterepo_c' execution:
::
15:16:48: Version:
0.10.0
15:16:48: Signal handler setup
15:16:48: cr_get_local_metadata:
/var/cache/pulp/reserved_resource_worker-3@test/96de374b-b164-454d-9c1f-20d6c18e5462/repodata/repomd.xml doesn't
exists
repomd.xml doesn't exist
</code></pre>
<pre><code class="text syntaxhl" data-language="text">May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) Exception caught from plugin during publish for repo [centos7-x86_64-os-global]
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) Traceback (most recent call last):
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1259, in _do_publish
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) publish_report = publish_repo(transfer_repo, conduit, call_config)
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 737, in wrap_f
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) return f(*args, **kwargs)
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/export_distributor/distributor.py", line 138, in publish_repo
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) return self._publisher.process_lifecycle()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 572, in process_lifecycle
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) super(PluginStep, self).process_lifecycle()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) step.process()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 256, in process
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) self._process_block()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 303, in _process_block
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) self.process_main()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 1191, in process_main
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) stderr=stderr)
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) PulpCodedException: Error occurred during 'sqliterepo_c' execution:
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) ::
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) repomd.xml doesn't exist
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184)
</code></pre>
<p><strong>Fix</strong>:<br>
It should be looking in /var/cache/pulp/reserved_resource_worker-3@test/96de374b-b164-454d-9c1f-20d6c18e5462/scratch/repodata/repomd.xml instead.</p>
<p>I replaced publish.py with the last revision (using createrepo_c) and it worked right away. I also was able to get it to work with sqliterepo_c by adding '/scratch/' to the command. Both tested and gave me a working ISO. :)</p> RPM Support - Story #211 (CLOSED - WONTFIX): [RFE] pulp allows corrupt rpms to be pushed into reposhttps://pulp.plan.io/issues/2112015-02-19T01:12:08ZAnonymous
<p>+<span>+ This bug was initially created as a clone of <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1023335" class="external">Bugzilla Bug #1023335</a> +</span>+</p>
<p>Description of problem:</p>
<p>Description of problem:<br>
I create a repo, and push to it a corrupt rpm, which won't install.</p>
<p>Version-Release number of selected component (if applicable):<br>
2.2.0-1</p>
<p>How reproducible:<br>
always</p>
<p>Steps to Reproduce:</p>
<p>1. locate a corrupt rpm:<br>
rpm -K /tmp/corruptrpm-1.0-1.noarch.rpm: RSA sha1 ((MD5) PGP) md5 NOT OK (MISSING KEYS: (MD5) PGP#f44e7eb7)</p>
<p>2. pulp-admin rpm repo create --repo-id test-repo2 --relative-url test-repo2</p>
<p>3. pulp-admin rpm repo uploads rpm -f /tmp/corruptrpm-1.0-1.noarch.rpm --repo-id=test-repo2<br>
<span>----------------------------------------------------------------------</span><br>
Unit Upload<br>
<span><del>--------------------------------------------------------------------</del></span></p>
<p>Extracting necessary metadata for each request...<br>
[==================================================] 100%<br>
Analyzing: corruptrpm-1.0-1.noarch.rpm<br>
... completed</p>
<p>Creating upload requests on the server...<br>
[==================================================] 100%<br>
Initializing: corruptrpm-1.0-1.noarch.rpm<br>
... completed</p>
<p>Starting upload of selected units. If this process is stopped through ctrl+c,<br>
the uploads will be paused and may be resumed later using the resume command or<br>
cancelled entirely using the cancel command.</p>
<p>Uploading: corruptrpm-1.0-1.noarch.rpm<br>
[==================================================] 100%<br>
2729160/2729160 bytes<br>
... completed</p>
<p>Importing into the repository...<br>
... completed</p>
<p>Deleting the upload request...<br>
... completed</p>
<p>Actual results:</p>
<p>Corrult rpm successfully pushed into pulp.</p>
<p>Expected results:</p>
<p>rpm upload should fail due to incorrect checksum</p>
<p>Additional info:</p>
<p>--- Additional comment from <a href="mailto:petter.hassberg@netent.com" class="email">petter.hassberg@netent.com</a> at 10/25/2013 08:49:45 ---</p>
<p>this was not a corrupt rpm after all.</p>
<p>--- Additional comment from <a href="mailto:petter.hassberg@netent.com" class="email">petter.hassberg@netent.com</a> at 11/11/2013 14:49:22 ---</p>
<p>This also is applicable with actual corrupt rpm:s with sha1sum mismatch,.</p>
<p>--- Additional comment from <a href="mailto:skarmark@redhat.com" class="email">skarmark@redhat.com</a> at 11/13/2013 16:56:04 ---</p>
<p>***** Bug 1029085 has been marked as a duplicate of this bug. ***</p> Puppet Support - Task #73 (CLOSED - WONTFIX): Pulp puppet tests should mirror python path hierarchyhttps://pulp.plan.io/issues/732014-12-18T16:12:42ZAnonymous
<p>It seems all of the pulp puppet unit tests are contained at pulp_puppet_plugins/test/unit/These tests do not follow the convention of mirroring the python path hierarchy with directories in the test folder.The existing tests should be re-worked to mirror the python path hierarchy as they do in pulp platform.</p> RPM Support - Story #63 (CLOSED - WONTFIX): Errata Applicability Stress Testshttps://pulp.plan.io/issues/632014-12-18T16:12:41ZAnonymousRPM Support - Story #60 (CLOSED - WONTFIX): As an API user, I have documentation describing the I...https://pulp.plan.io/issues/602014-12-18T16:12:41ZAnonymous
<p>We need to document the ISO sync progress report format for API users.</p> RPM Support - Story #58 (CLOSED - WONTFIX): Consumer applicability scalability and performance te...https://pulp.plan.io/issues/582014-12-18T16:12:41ZAnonymousRPM Support - Story #54 (CLOSED - WONTFIX): Client: RPM Bind Command UI Clean Uphttps://pulp.plan.io/issues/542014-12-18T16:12:40ZAnonymousPuppet Support - Story #57 (CLOSED - WONTFIX): Puppet: Dependency Resolution by Module Listhttps://pulp.plan.io/issues/572014-12-18T16:12:40ZAnonymousPuppet Support - Story #56 (CLOSED - WONTFIX): Puppet: Dependency Resolution Across Repositorieshttps://pulp.plan.io/issues/562014-12-18T16:12:40ZAnonymousPuppet Support - Story #55 (CLOSED - WONTFIX): Puppet: Puppet Master Profile Trackinghttps://pulp.plan.io/issues/552014-12-18T16:12:40ZAnonymousRPM Support - Story #38 (CLOSED - WONTFIX): Yum Plugins: Revisit search indexeshttps://pulp.plan.io/issues/382014-12-18T16:12:38ZAnonymousRPM Support - Story #27 (CLOSED - WONTFIX): Yum Plugins: Resolution for retain-old-count & errata...https://pulp.plan.io/issues/272014-12-18T16:12:37ZAnonymous
<p>Deliverable: decide what needs to happen, but don't write any new code decide if it is ok for --retain-old-count to break availability of RPMs for errata</p> Puppet Support - Story #32 (CLOSED - WONTFIX): As a developer of pulp_puppet, I have docs about p...https://pulp.plan.io/issues/322014-12-18T16:12:37ZAnonymous
<p>Deliverables: documentation about the format of any progress reports produced by the pulp_puppet plugins.</p> RPM Support - Story #12 (CLOSED - DUPLICATE): As a user, I can upload environment groupshttps://pulp.plan.io/issues/122014-12-18T16:12:35ZAnonymous
<p>Deliverables:</p>
<ul>
<li>yum importer can handle uploads of environment groups</li>
<li>CLI has a command to upload environment groups</li>
</ul> RPM Support - Refactor #5 (CLOSED - WONTFIX): [Task] Make pulp_rpm sync use step processing frame...https://pulp.plan.io/issues/52014-12-18T16:12:34ZAnonymous