Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2017-12-06T15:59:26ZPulp
Planio Infrastructure - Issue #3170 (CLOSED - WORKSFORME): Blog posts not showing uphttps://pulp.plan.io/issues/31702017-12-06T15:59:26Zbmbouterbmbouter@redhat.com
<p>There are posts in the repo for Nov 9 and Nov 21, but those corresponding posts, don't show up on the website: <a href="https://pulpproject.org/blog/" class="external">https://pulpproject.org/blog/</a></p>
<p>For example take this post: <a href="https://github.com/pulp/pulpproject.org/blob/gh-pages/_posts/2017-11-09-community-demo.md" class="external">https://github.com/pulp/pulpproject.org/blob/gh-pages/_posts/2017-11-09-community-demo.md</a></p>
<p>It should be listed here: <a href="https://pulpproject.org/blog/" class="external">https://pulpproject.org/blog/</a></p>
<p>When I push that same code to my forked version on Github Pages, I do see it here: <a href="https://bmbouter.github.io/pulpproject.org/blog/" class="external">https://bmbouter.github.io/pulpproject.org/blog/</a></p> RPM Support - Issue #3020 (CLOSED - WORKSFORME): Distribution files mismatchhttps://pulp.plan.io/issues/30202017-09-19T12:16:08Zbeny
<p>We mirror CentOS repositories in our Pulp and we've hit the issue described in [1] with releases 7.2 and 7.4.<br>
It affects all files in the <code>LiveOS</code> and <code>images</code> directories as follows (note the 7.2 and 7.4 symlink pointing to the same file):</p>
<pre><code>:/var/lib/pulp] find ./published/yum/master/yum_distributor/centos-7* -iname vmlinuz -ls
11163912 4 lrwxrwxrwx 1 apache apache 129 Sep 19 12:17 ./published/yum/master/yum_distributor/centos-72/1505816224.61/images/pxeboot/vmlinuz -> /var/lib/pulp/content/units/distribution/de/d64602f1a2165af46f6cd4c8c2645a0422607173fb34617458c9f419e2c7bf/images/pxeboot/vmlinuz
34740815 4 lrwxrwxrwx 1 apache apache 129 Sep 19 13:16 ./published/yum/master/yum_distributor/centos-73/1505819770.72/images/pxeboot/vmlinuz -> /var/lib/pulp/content/units/distribution/8d/d927134b78ab15e3c803b686a6baf564c5ccb97154da48f9ead7041eb53188/images/pxeboot/vmlinuz
11021555 4 lrwxrwxrwx 1 apache apache 129 Sep 19 08:39 ./published/yum/master/yum_distributor/centos-74/1505803143.84/images/pxeboot/vmlinuz -> /var/lib/pulp/content/units/distribution/de/d64602f1a2165af46f6cd4c8c2645a0422607173fb34617458c9f419e2c7bf/images/pxeboot/vmlinuz
</code></pre>
<p>Even when the repos are deleted and created again, pulp still thinks the 7.2 and 7.4 distribution files are the same. When downloaded manually form upstream we feed our pulp from [2, 3], the files indeed differ.</p>
<pre><code>md5sum 72/vmlinuz 74/vmlinuz
418a1a0074554d7d7d63b514990c2d1f 72/vmlinuz
43a395b89485ec908e6c0622273299c4 74/vmlinuz
</code></pre>
<p>I use a workaround of removng the <code>feed</code> and <code>sync schedule</code> of 7.4 to have up-to-date 7.2 distribution files. This allows me to serve both 7.2 and 7.4 rpms, but I'm unable to mirror both 7.2 and 7.4 distribution files simultaneously</p>
<p>[1] <a href="https://www.redhat.com/archives/pulp-list/2016-January/msg00003.html" class="external">https://www.redhat.com/archives/pulp-list/2016-January/msg00003.html</a><br>
[2] <a href="http://vault.centos.org/centos/7.2.1511/os/x86_64/" class="external">http://vault.centos.org/centos/7.2.1511/os/x86_64/</a><br>
[3] <a href="http://mirror.centos.org/centos/7.4.1708/os/x86_64/" class="external">http://mirror.centos.org/centos/7.4.1708/os/x86_64/</a></p> RPM Support - Issue #2793 (CLOSED - WORKSFORME): applicable rpms only show up if at least one err...https://pulp.plan.io/issues/27932017-06-05T19:56:19Zjsherril@redhat.comjsherril@redhat.com
<p>Steps to reproduce:</p>
<p>1) Register a consumer<br>
2) create and sync a yum repository without errata (such as centos7 updates <a href="http://mirror.centos.org/centos/7/updates/x86_64/" class="external">http://mirror.centos.org/centos/7/updates/x86_64/</a>)<br>
3) bind the consumer to repo 2)<br>
4) ensure that at least one package is older than is available (such as running 'yum downgrade screen')<br>
5) generate repo applicability using the call:</p>
<p>POST /pulp/api/v2/consumers/actions/content/regenerate_applicability/ with body:</p>
<pre><code>{ 'consumer_criteria' : { 'filters' : { 'id' : { '$in' : [UUID] } } } }
</code></pre>
<p>6) fetch applicable rpm ids:<br>
/consumers/content/applicability/</p>
<pre><code>{
'criteria' : { 'filters' : { 'id' : { '$in' : [UUID] } } },
'content_types' : ['rpm']
}
</code></pre>
<p>The list will be empty. However if you then</p>
<p>7) create a new repo with errata (<a href="https://jlsherrill.fedorapeople.org/fake-repos/needed-errata/" class="external">https://jlsherrill.fedorapeople.org/fake-repos/needed-errata/</a>), sync it<br>
8) bind that repo to the consumer<br>
9) install the older version of walrus (0.71)<br>
10) trigger applicability generation in the same way<br>
11) fetch applicable rpm ids again</p>
<p>you'll see that now walrus AND the needed centos rpms are showing as applicable. The rpms applicable from the 2nd repo have nothing to do with the first repo. It seems like maybe pulp is ignoring all applicable rpms if no errata are applicable.</p> Pulp - Issue #2504 (CLOSED - WORKSFORME): errata applicability fails if errata packagelist doesn'...https://pulp.plan.io/issues/25042016-12-21T17:36:25Zjsherril@redhat.comjsherril@redhat.com
<p>If you sync a repo with an errata that does not have a package list such as this one here:</p>
<p><a href="https://github.com/Katello/runcible/blob/master/test/fixtures/repositories/zoo5/updateinfo.xml#L3-L9" class="external">https://github.com/Katello/runcible/blob/master/test/fixtures/repositories/zoo5/updateinfo.xml#L3-L9</a></p>
<p>and then try to generate applicability for a consumer, you will get an error:</p>
<pre><code>"traceback"=>"Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 488, in __call__
return super(Task, self).__call__(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 103, in __call__
return super(PulpTask, self).__call__(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__
return self.run(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/managers/consumer/applicability.py", line 107, in regenerate_applicability_for_consumers
manager.regenerate_applicability(profile_hash, content_type, profile_id, repo_id)
File "/usr/lib/python2.7/site-packages/pulp/server/managers/consumer/applicability.py", line 257, in regenerate_applicability
profiler_conduit)
File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/profilers/yum.py", line 65, in calculate_applicable_units
bound_repo_id, config, conduit)}
File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/profilers/yum.py", line 212, in _calculate_applicable_units
unit, profile_lookup_table, available_rpm_nevras)
File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/profilers/yum.py", line 314, in _is_errata_applicable
errata_rpms = YumProfiler._get_rpms_from_errata(errata)
File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/profilers/yum.py", line 292, in _get_rpms_from_errata
for pkgs in errata.metadata['pkglist']:
TypeError: 'NoneType' object is not iterable
</code></pre>
<p>This used to work (on at least 2.8.7), but no longer does on 2.9.3 an newer.</p> Pulp - Issue #2379 (CLOSED - WORKSFORME): repomd.xml points to wrong updateinfo.xml.gz filehttps://pulp.plan.io/issues/23792016-11-01T13:59:56Zbmbouterbmbouter@redhat.com
<p>As Issue <a class="issue tracker-1 status-11 priority-6 priority-default closed" title="Issue: Additional updateinfo.xml after second publish (CLOSED - CURRENTRELEASE)" href="https://pulp.plan.io/issues/2096">#2096</a> identifies, each incremental publish leaves a copy of updateinfo.xml.gz in the repodata folder. The repomd.xml file sometimes links to the wrong updateinof.xml.gz file. If that incremental publish brings in additional errata then those errata will not be published.</p> Pulp - Issue #2050 (CLOSED - WORKSFORME): HTTP 500 rather than a HTTP 404 when a missing resource...https://pulp.plan.io/issues/20502016-07-01T13:16:22Zjcline@redhat.comjcline@redhat.com
<p>In current master, requesting a URL that doesn't exist triggers a 404, but that triggers a 500 when Django encounters the following error:</p>
<pre><code>Jul 01 13:10:51 dev pulp[1928]: django.request:WARNING: Not Found: /var/www/pub/yum/https/repos/NaN
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) Internal Server Error: /var/www/pub/yum/https/repos/NaN
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) Traceback (most recent call last):
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 92, in get_exception_response
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) response = callback(request, **dict(param_dict, exception=exception))
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/utils/decorators.py", line 149, in _wrapped_view
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) response = view_func(request, *args, **kwargs)
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/views/defaults.py", line 40, in page_not_found
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) body = template.render(context, request)
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/template/backends/django.py", line 95, in render
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) return self.template.render(context)
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/template/base.py", line 204, in render
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) with context.bind_template(self):
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) return self.gen.next()
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/template/context.py", line 260, in bind_template
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) updates.update(processor(self.request))
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/contrib/auth/context_processors.py", line 60, in auth
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) from django.contrib.auth.models import AnonymousUser
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/contrib/auth/models.py", line 6, in <module>
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) from django.contrib.contenttypes.models import ContentType
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/contrib/contenttypes/models.py", line 161, in <module>
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) class ContentType(models.Model):
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) File "/usr/lib/python2.7/site-packages/django/db/models/base.py", line 102, in __new__
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) "INSTALLED_APPS." % (module, name)
Jul 01 13:10:51 dev pulp[1928]: django.request:ERROR: (1928-96352) RuntimeError: Model class django.contrib.contenttypes.models.ContentType doesn't declare an explicit app_label and isn't in an application in INSTALLED_APPS.
</code></pre>
<p>This is quite unpleasant and it's unclear what went wrong unless you look at the logs and realize it's a HTTP 404.</p>
<p>To reproduce:</p>
<p>1. Request a url that doesn't exist. Something like <a href="https://dev.example.com/pulp/repos/NaN" class="external">https://dev.example.com/pulp/repos/NaN</a><br>
2. See a HTTP 500</p>
<p>Note this occurs with python2-django-1.9.7-1.fc24.noarch</p> Pulp - Issue #2008 (CLOSED - WORKSFORME): qpidd exceeded 2000 connections limithttps://pulp.plan.io/issues/20082016-06-14T14:30:30Zjluzajluza@redhat.com
<pre><code>Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) Traceback (most recent call last):
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) R = retval = fun(*args, **kwargs)
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 473, in __call__
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) return super(Task, self).__call__(*args, **kwargs)
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 103, in __call__
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) return super(PulpTask, self).__call__(*args, **kwargs)
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in __protected_call__
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) return self.run(*args, **kwargs)
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib/python2.6/site-packages/pulp/server/controllers/repository.py", line 1162, in download_deferred
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) download_step.start()
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib/python2.6/site-packages/pulp/server/controllers/repository.py", line 1358, in start
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) self.downloader.download(self.download_requests)
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib/python2.6/site-packages/nectar/downloaders/threaded.py", line 142, in download
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) worker_thread.start()
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) File "/usr/lib64/python2.6/threading.py", line 474, in start
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) _start_new_thread(self.__bootstrap, ())
Jun 13 21:37:57 pulp-docker01 pulp: celery.worker.job:ERROR: (4062-22208) error: can't start new thread
Jun 13 21:41:43 pulp-docker01 qpidd[26643]: 2016-06-13 21:41:43 [Security] error Client max total connection count limit of 2000 exceeded by 'qpid.127.0.0.1:5672-127.0.0.1:47832', user: 'guest@QPID'. Connection refused
Jun 13 21:41:43 pulp-docker01 qpidd[26643]: 2016-06-13 21:41:43 [Security] error Client max total connection count limit of 2000 exceeded by 'qpid.127.0.0.1:5672-127.0.0.1:47833', user: 'anonymous'. Connection refused
Jun 13 21:41:43 pulp-docker01 pulp: kombu.transport.qpid:ERROR: Unable to authenticate to qpid using the following mechanisms: ['PLAIN', 'ANONYMOUS']
Jun 13 21:41:53 pulp-docker01 qpidd[26643]: 2016-06-13 21:41:53 [System] error Connection qpid.127.0.0.1:5672-127.0.0.1:47832 No protocol received closing
Jun 13 21:41:53 pulp-docker01 qpidd[26643]: 2016-06-13 21:41:53 [System] error Connection qpid.127.0.0.1:5672-127.0.0.1:47833 No protocol received closing
Jun 13 21:42:46 pulp-docker01 qpidd[26643]: 2016-06-13 21:42:46 [Security] error Client max total connection count limit of 2000 exceeded by 'qpid.127.0.0.1:5672-127.0.0.1:47842', user: 'guest@QPID'. Connection refused
</code></pre>
<p>that ^ repeated many times and at one point qpidd probably crashed, because logs changed to:</p>
<pre><code>Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) pulp.task
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) Traceback (most recent call last):
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) File "/usr/lib/python2.6/site-packages/gofer/messaging/consumer.py", line 68, in _open
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) self._reader.open()
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) File "/usr/lib/python2.6/site-packages/gofer/messaging/adapter/model.py", line 39, in _fn
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) return fn(*args, **keywords)
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) File "/usr/lib/python2.6/site-packages/gofer/messaging/adapter/model.py", line 587, in open
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) self._impl.open()
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) File "/usr/lib/python2.6/site-packages/gofer/messaging/adapter/qpid/reliability.py", line 34, in _fn
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) raise NotFound(*e.args)
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4179-50016) NotFound: no such queue: pulp.task
Jun 14 03:25:06 pulp-docker01 pulp: gofer.messaging.consumer:ERROR: (4181-50016) pulp.task
</code></pre>
<p>Installed packages:</p>
<pre><code>qpid-tools-0.30-4.el6.noarch
python-qpid-0.30-6.el6.noarch
qpid-qmf-0.30-5.el6.x86_64
qpid-cpp-server-0.30-6.el6.x86_64
python-qpid-qmf-0.30-5.el6.x86_64
python-gofer-qpid-2.6.8-1.el6.noarch
qpid-cpp-client-0.30-6.el6.x86_64
qpid-proton-c-0.7-5.el6.x86_64
pulp-nodes-admin-extensions-2.8.1.2-1.el6sat.noarch
python-pulp-client-lib-2.8.1.2-1.el6sat.noarch
pulp-server-2.8.1.2-1.el6sat.noarch
pulp-selinux-2.8.1.2-1.el6sat.noarch
python-pulp-cdn-distributor-common-2.8.0-8.el6eng.noarch
python-pulp-agent-lib-2.8.1.2-1.el6sat.noarch
pulp-docker-admin-extensions-2.0.0.2-1.el6sat.noarch
pulp-nodes-consumer-extensions-2.8.1.2-1.el6sat.noarch
python-pulp-oid_validation-2.8.1.2-1.el6sat.noarch
pulp-agent-2.8.1.2-1.el6sat.noarch
m2crypto-0.21.1.pulp-8.el6.x86_64
python-pulp-repoauth-2.8.1.2-1.el6sat.noarch
pulp-consumer-client-2.8.1.2-1.el6sat.noarch
pulp-docker-plugins-2.0.0.2-1.el6sat.noarch
python-pulp-streamer-2.8.1.2-1.el6sat.noarch
python-isodate-0.5.0-1.pulp.el6.noarch
mod_wsgi-3.4-1.pulp.el6.x86_64
python-pulp-bindings-2.8.1.2-1.el6sat.noarch
pulp-admin-client-2.8.1.2-1.el6sat.noarch
pulp-cdn-distributor-plugins-2.8.0-8.el6eng.noarch
python-kombu-3.0.24-5.pulp.el6ui.noarch
python-pulp-docker-common-2.0.0.2-1.el6sat.noarch
pulp-nodes-common-2.8.1.2-1.el6sat.noarch
pulp-nodes-child-2.8.1.2-1.el6sat.noarch
python-pulp-common-2.8.1.2-1.el6sat.noarch
python-celery-3.1.11-1.el6.noarch
</code></pre> Docker Support - Issue #1986 (CLOSED - WORKSFORME): Download Error When Syncing OpenShift Registryhttps://pulp.plan.io/issues/19862016-06-08T15:56:56Zlucarvallucarval@redhat.com
<p>I'm unable to perform a docker repo sync with an Integrated Openshift Registry.<br>
I modified the "docker_importer" config to contain "basic_auth_username" and "basic_auth_password" attributes as suggested in <a href="https://pulp.plan.io/issues/1975" class="external">https://pulp.plan.io/issues/1975</a>.</p>
<p>Authentication seems to work properly as some of the task steps are successful.</p>
<p>However, it seems to fail during the "Downloading remote files" stage.</p>
<pre><code>$ pulp-admin docker repo sync run --repo-id devops-osbs-openshift
+----------------------------------------------------------------------+
Synchronizing Repository [devops-osbs-openshift]
+----------------------------------------------------------------------+
This command may be exited via ctrl+c without affecting the request.
Downloading manifests
[\]
... completed
Copying units already in pulp
[-]
... completed
Copying units already in pulp
[-]
... completed
Downloading remote files
[ ] 0%
0 of 4 items
Task Failed
Content import of
/var/cache/pulp/reserved_resource_worker-2@brew-pulp-docker01.web.qa.ext.phx1.re
dhat.com/fb14c674-0d47-4948-9662-3000bcb10f2f/sha256:478be19d61cd9d6871c440ac574
f7ce9b966c35d51a392dabf99a8dc01a2e924 failed - must be an existing file.
</code></pre>
<p>We've identified the file mentioned above is an image layer.</p>
<p>Debugging information indicates that download failed but file was still attempted to be copied, which seems odd. All error messages/tracebacks available are from this copy step which does not appear to be the root cause of the issue considering download failed.</p>
<pre><code>{
"num_success": 0,
"description": "Downloading remote files",
"step_type": "sync_step_download",
"items_total": 3,
"state": "FAILED",
"error_details": [],
"details": "",
"num_failures": 3,
"step_id": "88062216-6722-4522-aebb-f029737450cf",
"num_processed": 3
},
{
"num_success": 0,
"description": "Saving Manifests and Blobs",
"step_type": "sync_step_save",
"items_total": 1,
"state": "FAILED",
"error_details": [
{
"traceback": " File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 232, in process\n self._process_block(item=item)\n\n File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.
py\", line 291, in _process_block\n self.process_main(item=item)\n\n File \"/usr/lib/python2.7/site-packages/pulp_docker/plugins/importers/sync.py\", line 282, in process_main\n item.save_and_import_content(os.path.join(self.get_wo
rking_dir(), item.digest))\n\n File \"/usr/lib/python2.7/site-packages/pulp/server/db/model/__init__.py\", line 801, in save_and_import_content\n self.safe_import_content(path, location)\n\n File \"/usr/lib/python2.7/site-packages/pu
lp/server/db/model/__init__.py\", line 814, in safe_import_content\n self.import_content(path, location)\n\n File \"/usr/lib/python2.7/site-packages/pulp/server/db/model/__init__.py\", line 786, in import_content\n raise exceptions
.PulpCodedException(error_code=error_codes.PLP0037, path=path)\n",
"error": "Content import of /var/cache/pulp/reserved_resource_worker-2@brew-pulp-docker01.web.qa.ext.phx1.redhat.com/121483e4-7453-454d-ba83-8bc83dba115f/sha256:18c96d12bd777da143dbdac5daaaaa5abb8b77d5697c43611b5be58a5097e220
failed - must be an existing file."
}
],
"details": "",
"num_failures": 1,
"step_id": "755c0fa6-6e9f-48ed-a5fd-212a7ea67028",
"num_processed": 1
},
</code></pre>
<p>Importer config being used:</p>
<pre><code>
{
"_href": "/pulp/api/v2/repositories/devops-osbs-openshift/importers/docker_importer/",
"_id": {
"$oid": "57582fed11573f410613dba6"
},
"_ns": "repo_importers",
"config": {
"basic_auth_password": "*****",
"basic_auth_username": "lucarval",
"enable_v1": false,
"enable_v2": true,
"feed": "https://my-registry-url",
"upstream_name": "osbs-qa01/helloworld"
},
"id": "docker_importer",
"importer_type_id": "docker_importer",
"last_sync": null,
"repo_id": "devops-osbs-openshift",
"scratchpad": null
}
</code></pre> Pulp - Issue #1867 (CLOSED - WORKSFORME): pulp-admin fails silently to publish all files of a repohttps://pulp.plan.io/issues/18672016-04-26T15:04:37Zbriccib.ricci@opentech.com
<p>Greetings,<br>
I'm trying to create an ossec private repo, and I'm stuck in publishing one file. The repository seems to be created correctly, and the upload procedure seems to go just fine, as well as the publish operation. However, every time I try to list all the files of the published repo, one file is always missing.</p>
<p>Steps to reproduce:<br>
1) wget -r --no-parent -A ossec*2.8.3-53*.rpm <a href="https://www6.atomicorp.com/channels/ossec/centos/7/x86_64/RPMS/" class="external">https://www6.atomicorp.com/channels/ossec/centos/7/x86_64/RPMS/</a><br>
2) pulp-admin rpm repo create --repo-id myrepo --display-name myrepo --description "my provate repo" --relative-url "myrepo" --serve-http true --serve-https true<br>
3) pulp-admin rpm repo uploads rpm --repo-id myrepo --dir www6.atomicorp.com/channels/ossec/centos/7/x86_64/RPMS/<br>
4) pulp-admin rpm repo publish run --repo-id myrepo<br>
5) open a web browser, navigate to pulp repository content, the file ossec-hids-server-2.8.3-53.el7.art.x86_64.rpm should be missing<br>
6) pulp-admin rpm repo content rpm --repo-id=opentech --match 'name=^ossec' ---> the file should be listed.</p>
<p>Thanks in advance.</p> Pulp - Issue #1091 (CLOSED - WORKSFORME): registering consumer prints a message about RSA key dow...https://pulp.plan.io/issues/10912015-06-25T18:17:52Zdkliban@redhat.com
<pre><code>sudo pulp-consumer -u admin -p admin register --consumer-id c1
Download server RSA key failed [<urlopen error [SSL: CERTIFICATE_VERIFY_FAILED]
certificate verify failed (_ssl.c:581)>]
Consumer [c1] successfully registered
</code></pre> Pulp - Issue #1018 (CLOSED - WORKSFORME): nux-dextop-el7-x86_64 repo sync gets stuckhttps://pulp.plan.io/issues/10182015-06-01T08:58:54ZBen.StanleyBen.Stanley@exemail.com.au
<p>I have observed that attempts to sync my repo nux-dextop-el7-x86_64 do not complete.<br>
The feed comes from<br>
<a href="http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/" class="external">http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/</a></p>
<p>--------------------------------------------------------------------------------<br>
[root@bumblebee ]# pulp-admin rpm repo sync run --repo-id=nux-dextop-el7-x86_64<br>
<span><del>--------------------------------------------------------------------</del></span><br>
Synchronizing Repository [nux-dextop-el7-x86_64]<br>
<span><del>--------------------------------------------------------------------</del></span></p>
<p>This command may be exited via ctrl+c without affecting the request.</p>
<p>[-]<br>
Waiting to begin...<br>
--------------------------------------------------------------------------------<br>
Nothing appears in the logs.</p>
<p>I know that no sync is progressing because nload tells me there is no network traffic.</p>
<p>The tasks list says<br>
--------------------------------------------------------------------------------<br>
[root@bumblebee ~]# pulp-admin tasks list<br>
Operations: sync<br>
Resources: nux-dextop-el7-x86_64 (repository)<br>
State: Waiting<br>
Start Time: Unstarted<br>
Finish Time: Incomplete<br>
Task Id: b621280e-75b5-42eb-932c-c2e3f8a23cfa<br>
--------------------------------------------------------------------------------</p>
<p>Other tasks referencing this repository are either Cancelled or Successful.</p>
<p>Listing the details of the repo reveals the following:<br>
--------------------------------------------------------------------------------<br>
[root@bumblebee ~]# pulp-admin rpm repo list --details<br>
Id: nux-dextop-el7-x86_64<br>
Display Name: nux-dextop-el7-x86_64<br>
Description: None<br>
Content Unit Counts:<br>
Rpm: 1834<br>
Notes:<br>
Importers:<br>
Config:<br>
Feed: <a href="http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64" class="external">http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64</a><br>
Validate: True<br>
Id: yum_importer<br>
Importer Type Id: yum_importer<br>
Last Sync: None<br>
Repo Id: nux-dextop-el7-x86_64<br>
Scheduled Syncs:<br>
Distributors:<br>
Auto Publish: True<br>
Config:<br>
Http: True<br>
Https: False<br>
Relative URL: nux/dextop/el7/x86_64<br>
Distributor Type Id: yum_distributor<br>
Id: yum_distributor<br>
Last Publish: None<br>
Repo Id: nux-dextop-el7-x86_64<br>
Scheduled Publishes:<br>
Auto Publish: False<br>
Config:<br>
Http: True<br>
Https: False<br>
Distributor Type Id: export_distributor<br>
Id: export_distributor<br>
Last Publish: None<br>
Repo Id: nux-dextop-el7-x86_64<br>
Scheduled Publishes:<br>
--------------------------------------------------------------------------------</p>
<p>How can I find out what is preventing this sync from running?</p>
<p>I have found that I can fix errors of this type by deleting the repo and re-creating it.</p>
<p>I am preserving the state of this problem so that we can investigate it.</p> Docker Support - Issue #1017 (CLOSED - WORKSFORME): docker repo creation does not support specify...https://pulp.plan.io/issues/10172015-05-29T20:52:37Zcduryeecduryee@redhat.com
<p>In Pulp 2.7 w/ docker plugins version 1.1.0, docker repo create does not support the "include_ssl" flags related to feed URL parameters. These include "--feed-ca-cert", "--verify-feed-ssl", "--feed-cert", and "--feed-key".</p>
<p>I would like at least feed-ca-cert and verify-feed-ssl to be available so I can sync from repos that use a specified CA cert, but if it's easier to enable them all, that works too:)</p> Pulp - Issue #748 (CLOSED - WORKSFORME): Apache httpd getattr denial on RHEL7 after restart of Pulphttps://pulp.plan.io/issues/7482015-03-11T09:57:30Zlzap@redhat.com
<p>We see denial during pulp restart on RHEL7. It looks like wsgi files are not given correct file contexts.</p>
<p>RHEL7:</p>
<pre><code>[root@dell-per905-01 ~]# ausearch -m AVC
----
time->Tue Mar 10 22:03:22 2015
type=SYSCALL msg=audit(1426039402.284:509): arch=c000003e syscall=6 success=no exit=-13 a0=7f1c6c0d1478 a1=7fffc7451ac0 a2=7fffc7451ac0 a3=0 items=0 ppid=2534 pid=2616 auid=4294967295 uid=48 gid=48 euid=48 suid=48 fsuid=48 egid=48 sgid=48 fsgid=48 tty=(none) ses=4294967295 comm="httpd" exe="/usr/sbin/httpd" subj=system_u:system_r:httpd_t:s0 key=(null)
type=AVC msg=audit(1426039402.284:509): avc: denied { getattr } for pid=2616 comm="httpd" path="/srv/pulp/webservices.wsgi" dev="dm-1" ino=1965416 scontext=system_u:system_r:httpd_t:s0 tcontext=system_u:object_r:var_t:s0 tclass=file
[root@dell-per905-01 ~]# ll /srv/pulp -Z
-rw-r--r--. root root system_u:object_r:var_t:s0 puppet_forge_post33_api.wsgi
-rw-r--r--. root root system_u:object_r:var_t:s0 puppet_forge_pre33_api.wsgi
-rw-r--r--. root root system_u:object_r:var_t:s0 repo_auth.wsgi
-rw-r--r--. root root system_u:object_r:var_t:s0 webservices.wsgi
[root@dell-per905-01 ~]# rpm -qa | grep pulp-selinux
pulp-selinux-2.6.0-0.7.beta.1.el7sat.noarch
No problems on RHEL6:
[root@sgi-xe320-01 ~]# ausearch -m AVC
<no matches>
[root@sgi-xe320-01 ~]# ll /srv/pulp -Z
-rw-r--r--. root root system_u:object_r:httpd_sys_content_t:s0 puppet_forge_post33_api.wsgi
-rw-r--r--. root root system_u:object_r:httpd_sys_content_t:s0 puppet_forge_pre33_api.wsgi
-rw-r--r--. root root system_u:object_r:httpd_sys_content_t:s0 repo_auth.wsgi
-rw-r--r--. root root system_u:object_r:httpd_sys_content_t:s0 webservices.wsgi
[root@sgi-xe320-01 ~]# rpm -qa | grep pulp-selinux
pulp-selinux-2.6.0-0.7.beta.1.el6_6sat.noarch
</code></pre>
<p>Cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1200722" class="external">https://bugzilla.redhat.com/show_bug.cgi?id=1200722</a></p> Docker Support - Issue #739 (CLOSED - WORKSFORME): Not a directory error when publishinghttps://pulp.plan.io/issues/7392015-03-06T14:23:24Zjgreguskejgregusk@redhat.com
<p>When publishing a docker repository, I get an error.</p>
<p>Here are details of the repository</p>
<pre><code>{'_href': '/pulp/api/v2/repositories/redhat-openshift3_beta-ose-deployer/',
'_id': {'$oid': '54f8da6baa9ea96c3522e6d7'},
'_ns': 'repos',
'content_unit_counts': {'docker_image': 9},
'description': 'Handles deploying containers when new versions are available or triggered',
'display_name': 'redhat-openshift3_beta-ose-deployer',
'distributors': [{'_id': {'$oid': '54f8da6baa9ea96c3522e6da'},
'_ns': 'repo_distributors',
'auto_publish': True,
'config': {'protected': False,
'redirect-url': 'http://internal.redhat.server.com/containers/registry/',
'repo-registry-id': 'openshift3_beta/ose-deployer'},
'distributor_type_id': 'docker_distributor_web',
'id': 'docker_web_distributor_name_cli',
'last_publish': '2015-03-06T13:44:07Z',
'repo_id': 'redhat-openshift3_beta-ose-deployer',
'scheduled_publishes': []},
{'_id': {'$oid': '54f8da6baa9ea96c3522e6d9'},
'_ns': 'repo_distributors',
'auto_publish': True,
'config': {'protected': False,
'redirect-url': 'http://internal.redhat.server.com/containers/registry/',
'repo-registry-id': 'openshift3_beta/ose-deployer'},
'distributor_type_id': 'docker_distributor_export',
'id': 'docker_export_distributor_name_cli',
'last_publish': '2015-03-06T13:44:00Z',
'repo_id': 'redhat-openshift3_beta-ose-deployer',
'scheduled_publishes': []}],
'id': 'redhat-openshift3_beta-ose-deployer',
'importers': [{'_id': {'$oid': '54f8da6baa9ea96c3522e6d8'},
'_ns': 'repo_importers',
'config': {},
'id': 'docker_importer',
'importer_type_id': 'docker_importer',
'last_sync': None,
'repo_id': 'redhat-openshift3_beta-ose-deployer',
'scheduled_syncs': []}],
'last_unit_added': '2015-03-05T22:36:28Z',
'last_unit_removed': None,
'notes': {'_repo-type': 'docker-repo'},
'scratchpad': {'tags': [{'image_id': 'c6bc2d82fcfd0c7a5a9560970b520dc7dddbc477bd97065aeb421b1749c8b73b',
'tag': 'latest'},
{'image_id': 'c6bc2d82fcfd0c7a5a9560970b520dc7dddbc477bd97065aeb421b1749c8b73b',
'tag': 'v0.3'}]}}
</code></pre>
<p>Attempting to publish with the REST API (or CLI) leads to a traceback in the spawned subtask:</p>
<pre><code>Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 337, in __call__
return super(Task, self).__call__(*args, **kwargs)
File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in __protected_call__
return self.run(*args, **kwargs)
File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 98, in publish
transfer_repo, conduit, call_config)
File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 130, in _do_publish
publish_report = publish_repo(transfer_repo, conduit, call_config)
File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 492, in wrap_f
return f(*args, **kwargs)
File "/opt/pulp_docker/plugins/pulp_docker/plugins/distributors/distributor_web.py", line 123, in publish_repo
return self._publisher.publish()
File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 508, in publish
return self.process_lifecycle()
File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 457, in process_lifecycle
super(PluginStep, self).process_lifecycle()
File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 122, in process_lifecycle
step.process()
File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 180, in process
self._process_block()
File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 215, in _process_block
self.process_main()
File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 776, in process_main
shutil.copytree(timestamp_master_location, publish_location, symlinks=True)
File "/usr/lib64/python2.6/shutil.py", line 136, in copytree
names = os.listdir(src)
OSError: [Errno 20] Not a directory: '/var/lib/pulp/published/docker/master/redhat-openshift3_beta-ose-deployer/1425648629.96/redhat-openshift3_beta-ose-deployer.json'
</code></pre> RPM Support - Task #144 (CLOSED - WORKSFORME): Ensure that DNF works with Pulp rpm reposhttps://pulp.plan.io/issues/1442015-02-05T14:53:01Zcduryeecduryee@redhat.com
<p>With Fedora 22 DNF will be the default instead of yum[0].</p>
<p>This task is to subscribe to a pulp rpm repo and download content with DNF. The output of this task is not necessarily to fix any issues but just to put in bugzilla entries for any breakage.</p>
<p>[0] <a href="http://fedoraproject.org/wiki/Changes/ReplaceYumWithDNF" class="external">http://fedoraproject.org/wiki/Changes/ReplaceYumWithDNF</a></p>