Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2015-06-24T20:53:33ZPulp
Planio RPM Support - Issue #1088 (CLOSED - WONTFIX): Incremental publish could use the wrong primary.xml...https://pulp.plan.io/issues/10882015-06-24T20:53:33Zbcourtbcourt@redhat.com
<p>The incremental publish searches for the most recently modified file with a filename that matches a regex. It would be more robust to identify the file from the old repomd.xml instead of searching for one on the filesystem. For example, if there are two primary.xml files in the repodata directory, the incremental publish should use the one from the repodata.xml and not the first one it finds.</p>
<p>This regex is performed here[0].</p>
<p>[0]: <a href="https://github.com/pulp/pulp/blob/60d8aa1406703bb0f20d3632d0a8e2f5f48b66a6/server/pulp/plugins/util/metadata_writer.py#L325-L334" class="external">https://github.com/pulp/pulp/blob/60d8aa1406703bb0f20d3632d0a8e2f5f48b66a6/server/pulp/plugins/util/metadata_writer.py#L325-L334</a></p> RPM Support - Issue #1087 (CLOSED - CURRENTRELEASE): publishing of distribution units should igno...https://pulp.plan.io/issues/10872015-06-24T20:51:42Zbcourtbcourt@redhat.com
<p>Publishing of distribution units should ignore files in the repodata directory. This caused a corrupted publish where the distribution included a primary.xml and the incremental update picked the wrong file because there were two primary.xml files in the directory.</p> RPM Support - Issue #1086 (CLOSED - CURRENTRELEASE): pulp_distribution.xml sync should ignore rep...https://pulp.plan.io/issues/10862015-06-24T20:49:25Zbcourtbcourt@redhat.com
<p>Files that are synced via the pulp_distribution.xml file should ignore all files in the repodata/ directory of the repository.</p> RPM Support - Refactor #1056 (CLOSED - WONTFIX): Restructure distribution units to allow deprecat...https://pulp.plan.io/issues/10562015-06-15T13:39:27Zbcourtbcourt@redhat.com
<p>Currently distribution units keep a "files" attribute that lists each file that is part of the distribution. This should be changed to allow the contents of the distribution unit to be overlaid on top of the repository without needing to list every file.</p>
<p>1) The (treeinfo/.treeinfo) file is renamed to "treeinfo" during the sync.<br>
2) The existence of the treeinfo file is indicated on the unit object<br>
3) During publish time the contents of the distribution are overlaid on the repository being generated.<br>
4) The files attribute can be deprecated/removed</p> RPM Support - Issue #1045 (CLOSED - DUPLICATE): incremental publish does not remove old updateinf...https://pulp.plan.io/issues/10452015-06-10T14:56:32Zbcourtbcourt@redhat.com
<p>When an incremental publish is performed the old updateinfo.xml is not removed if a checksum is specified. Each publish adds a new updateinfo, which has a different checksum.</p>
<p>After each publish there should be only one updateinfo.xml in the repodata directory.</p> RPM Support - Issue #1044 (CLOSED - WONTFIX): Yum distributor validation of relative url is match...https://pulp.plan.io/issues/10442015-06-10T13:02:50Zbcourtbcourt@redhat.com
<p>The validation of relative urls for the yum distributor is overly broad and is matching ISO repos as well as yum repos. This is causing problems because they are actually served from different paths and are causing false negatives from the validation: pulp_rpm/plugins/distributors/yum/configuration.py:456</p> RPM Support - Issue #1042 (CLOSED - CURRENTRELEASE): Exception raised when building error message...https://pulp.plan.io/issues/10422015-06-09T17:33:31Zbcourtbcourt@redhat.com
<p>If a repo is created using a relative_url</p>
<p>The line <a href="https://github.com/pulp/pulp_rpm/blob/pulp-rpm-2.6.1-1/plugins/pulp_rpm/plugins/distributors/yum/configuration.py#L469" class="external">https://github.com/pulp/pulp_rpm/blob/pulp-rpm-2.6.1-1/plugins/pulp_rpm/plugins/distributors/yum/configuration.py#L469</a><br>
is checking which will raise a KeyError if 'relative_url' has not been defined in the distributor config.</p>
<pre><code>conflicting_relative_url = distributor['config']['relative_url'] or conflicting_repo_id
</code></pre>
<p>This should be replaced with something like</p>
<pre><code>if 'relative_url' in distributor['config']:
conflicting_relative_url = distributor['config']['relative_url'] or conflicting_repo_id
else:
conflicting_relative_url = conflicting_repo_id
</code></pre> Docker Support - Refactor #1037 (CLOSED - CURRENTRELEASE): Remove manual setting for repo.repo_idhttps://pulp.plan.io/issues/10372015-06-05T19:34:46Zbcourtbcourt@redhat.com
<p>Remove manual setting of repo.repo_id = repo_transfer.id throughout Docker and OSTree plugins.</p>
<p>All other usages should already use repo_transfer.repo_obj to access the native object (with its id) from the repo_transfer object.</p> Nectar - Story #1031 (CLOSED - WONTFIX): Create a jenkins job to automatically test all Nectar PRshttps://pulp.plan.io/issues/10312015-06-04T13:56:12Zbcourtbcourt@redhat.com
<p>Create a jenkins job similar to the one for Pulp that automatically tests all PR requests</p> Crane - Story #1030 (CLOSED - WONTFIX): Create a jenkins job to automatically test all Crane PRshttps://pulp.plan.io/issues/10302015-06-04T13:54:55Zbcourtbcourt@redhat.com
<p>Create a Jenkins job similar to our plugin builders to automatically unit test all PRs automatically.</p> Pulp - Story #1029 (CLOSED - WONTFIX): Automatically verify release note existence in the test ru...https://pulp.plan.io/issues/10292015-06-04T13:49:06Zbcourtbcourt@redhat.com
<p>In pulp/devel/test_runner.py optionally verify the standard release notes exist for the version specified in a project spec file.</p>
<p>Each project would provide an optional release_notes_dir argument when they call pulp/devel/test_runner.py. If this is specified then<br>
1) Get the current version being built from the spec file in the project root<br>
2) Validate that a <release_notes_dir>/<major>.<minor>.x.rst file exists<br>
3) Validate that the major.minor.version number exists in the rst file</p> Pulp - Refactor #994 (CLOSED - WONTFIX): Repository content_unit counts should be calculated usin...https://pulp.plan.io/issues/9942015-05-20T21:09:51Zbcourtbcourt@redhat.com
<p>Currently the unit counts on repositories is calculated by atomically adding or subtracting values from the current value. Pulp should let mongo calculate these values for us using an aggregation query:<br>
db.repo_content_units.aggregate({'$match':{'repo_id': '<repo_id>'}}, {'$group': {'_id':'$unit_type_id','sum' :{'$sum':1}}})</p>
<p>With some general testing this query took 0.12 seconds on a repository with 11k total packages (3k erratum and 8k rpm)</p> Pulp - Issue #993 (CLOSED - CURRENTRELEASE): Worker discovery takes 30 seconds when all services ...https://pulp.plan.io/issues/9932015-05-20T17:39:07Zbcourtbcourt@redhat.com
<p>When all of the pulp services are restarted at the same time it often takes 30 seconds before the workers are discovered.</p>
<p>When running the script:</p>
<pre><code>[root@bcourt pulp]# /home/bcourt/bin/restart-pulp.sh
++ systemctl stop httpd
++ systemctl stop pulp_workers
++ systemctl stop pulp_resource_manager
++ systemctl stop pulp_celerybeat
++ systemctl stop goferd
++ systemctl stop qpidd
++ systemctl start qpidd
++ systemctl start goferd
++ systemctl start pulp_celerybeat
++ systemctl start pulp_resource_manager
++ systemctl start pulp_workers
++ systemctl start httpd
[root@bcourt pulp]#
</code></pre>
<p>The following are the relevant log entries:</p>
<pre><code>May 20 13:33:42 bcourt.usersys.redhat.com pulp[8229]: pulp.server.webservices.application:INFO: *************************************************************
May 20 13:33:42 bcourt.usersys.redhat.com pulp[8229]: pulp.server.webservices.application:INFO: The Pulp server has been successfully initialized
May 20 13:33:42 bcourt.usersys.redhat.com pulp[8229]: pulp.server.webservices.application:INFO: *************************************************************
May 20 13:33:42 bcourt.usersys.redhat.com pulp[8229]: gofer.messaging.adapter.qpid.connection:INFO: opened: qpid+tcp://localhost:5672
May 20 13:33:42 bcourt.usersys.redhat.com pulp[8229]: gofer.messaging.adapter.connect:INFO: connected: qpid+tcp://localhost:5672
May 20 13:34:10 bcourt.usersys.redhat.com pulp[8185]: pulp.server.async.worker_watcher:INFO: New worker 'reserved_resource_worker-1@bcourt.usersys.redhat.com' discovered
May 20 13:34:10 bcourt.usersys.redhat.com pulp[8185]: pulp.server.async.worker_watcher:INFO: New worker 'reserved_resource_worker-3@bcourt.usersys.redhat.com' discovered
May 20 13:34:10 bcourt.usersys.redhat.com pulp[8185]: pulp.server.async.worker_watcher:INFO: New worker 'reserved_resource_worker-0@bcourt.usersys.redhat.com' discovered
May 20 13:34:11 bcourt.usersys.redhat.com pulp[8185]: pulp.server.async.worker_watcher:INFO: New worker 'reserved_resource_worker-2@bcourt.usersys.redhat.com' discovered
</code></pre>
<p>This looks like a race condition where the initial heartbeat from the worker is missed as celerybeat is still starting up. A simple solution would be to have the workers heartbeat faster initially and then back off once they have communication with celerybeat.</p> Packaging - Issue #964 (CLOSED - WONTFIX): registry-admin.py unable to create grant https://pulp.plan.io/issues/9642015-05-08T14:08:24Zbcourtbcourt@redhat.com
<p>Relocated from: <a href="https://github.com/pulp/pulp_packaging/issues/53" class="external">https://github.com/pulp/pulp_packaging/issues/53</a><br>
This command line is taken from the README.md file.</p>
<pre><code>[lvu@lvupulp ~]$ python repos/pulp_packaging/dockerfiles/registry-admin.py pulp "auth permission grant --role-id contributor --resource /repositories -o create -o read -o update -o execute"
User certificate not found.
Enter registry username [lvu]: admin
Enter registry password:
Warning: path should have mode 0700 because it may contain sensitive information: /root/.pulp/
Command: login
Description: login and download a session certificate
Available Arguments:
--username, -u - (required) server account username
--password, -p - server account password
The following options were specified but do not exist on the command:
--role-id
Warning: path should have mode 0700 because it may contain sensitive information: /root/.pulp/
The server hostname configured on the client did not match the name found in the
server's SSL certificate. The client attempted to connect to
[lvupulp.dyn.intelerad] but the server returned [pulpapi] as its hostname. The
expected hostname can be changed in the client configuration file.
[lvu@lvupulp ~]$
</code></pre> RPM Support - Issue #951 (CLOSED - CURRENTRELEASE): checksum is not honored if sqlite generation ...https://pulp.plan.io/issues/9512015-05-05T18:51:45Zbcourtbcourt@redhat.com
<p>If sqlite generation is enabled the checksum is always using sha256</p>