Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2021-10-20T17:27:32ZPulp
Planio Ansible Plugin - Issue #9525 (CLOSED - WORKSFORME): Performing sync in Hub ignores sync toggle an...https://pulp.plan.io/issues/95252021-10-20T17:27:32Zawcrosby
<p>This is seen in galaxy_ng 4.3.3 performing a sync against c.rh.c:</p>
<ul>
<li>galaxy_ng==4.3.3 includes: pulpcore==3.11.2, pulp-ansible==0.7.3</li>
<li>c.rh.com includes: pulpcore==3.11.2 pulp-ansible==0.7.3</li>
<li>FWIW on console.rh.com, editing the sync toggles changes the <code>content_count</code> (527) at <a href="https://console.redhat.com/api/automation-hub/_ui/v1/my-distributions/" class="external">https://console.redhat.com/api/automation-hub/_ui/v1/my-distributions/</a> for <code>5910538-synclist</code> but it does not change the <code>count</code> (104) at <a href="https://console.redhat.com/api/automation-hub/content/5910538-synclist/v3/collections/" class="external">https://console.redhat.com/api/automation-hub/content/5910538-synclist/v3/collections/</a>
</li>
</ul>
<p>This is also seen in galaxy_ng <code>master</code> performing a sync against c.rh.c and c.stage.rh.c</p>
<ul>
<li>galaxy_ng==<code>master</code> includes: pulpcore==3.15.2, pulp-ansible==0.10.1</li>
<li>c.stage.rh.com includes: pulpcore==3.14.6, pulp-ansible==0.9.2</li>
<li>FWIW the count c.stage.rh.com <###>-synclist/v3/collections/ does change after sync toggles</li>
</ul> Container Support - Issue #8408 (CLOSED - WORKSFORME): global_access_conditions.has_obj_perms() t...https://pulp.plan.io/issues/84082021-03-15T20:10:44Zalikins
<p>When using:</p>
<pre><code>$ docker exec galaxy_ng_api_1 pulpcore-manager access-policy-views --url /pulp/api/v3/pulp_container/namespaces/ --userid 2
</code></pre>
<p>management command 'access-policy-views' is cli tool to introspect pulp rbac info for each viewset, in this case the '--userid 2' arg trys to test 'safe' viewset objects has_permission for the user in question.</p>
<p>userid=2 is 'alikins', a non-admin user in this galaxy_ng instance.</p>
<p>When it tries to introspect the 'retrive' action on the namespace viewset, it triggers the DRF errror:</p>
<pre><code>AssertionError: Expected view ContainerNamespaceViewSet to be called with a URL keyword argument named "pk". Fix your URL conf, or set the `.lookup_field` attribute on the view correctly.
</code></pre>
<p>Output from the command including some DEBUG logging and full stack trace:</p>
<pre><code>DEBUG 2021-03-15 19:57:54,169 galaxy_ng.app.management.commands.access-policy-views access-policy-views._has_permission:326 809 - pre viewset_info={'url': '/pulp/api/v3/pulp_container/namespaces/', 'module': 'pulp_container.app.viewsets.ContainerNamespaceViewSet', 'name': 'pulp_container/namespaces-list', 'permission_classes': (<class 'pulp_container.app.access_policy.NamespaceAccessPolicy'>,), 'perms': [<pulp_container.app.access_policy.NamespaceAccessPolicy object at 0x7f361e2c61d0>], 'access_policy': <pulp_container.app.access_policy.NamespaceAccessPolicy object at 0x7f361e2c61d0>, 'path_regex': '/pulp/api/v3/pulp_container/namespaces/', 'decorators': '', 'view': <class 'pulp_container.app.viewsets.ContainerNamespaceViewSet'>, 'resolved_match': ResolverMatch(func=pulp_container.app.viewsets.ContainerNamespaceViewSet, args=(), kwargs={}, url_name=pulp_container/namespaces-list, app_names=[], namespaces=[], route=/pulp/api/v3/pulp_container/namespaces/), 'p': <URLPattern '/pulp/api/v3/pulp_container/namespaces/' [name='pulp_container/namespaces-list']>} action=retrieve user=alikins url=/pulp/api/v3/pulp_container/namespaces/
DEBUG 2021-03-15 19:57:54,170 galaxy_ng.app.management.commands.access-policy-views access-policy-views._has_permission:341 809 - request: <galaxy_ng.app.management.commands.access-policy-views.FauxRequest object at 0x7f361e2c6898> request.method: GET
DEBUG 2021-03-15 19:57:54,170 galaxy_ng.app.management.commands.access-policy-views access-policy-views._has_permission:347 809 - view_instance: <pulp_container.app.viewsets.ContainerNamespaceViewSet object at 0x7f361e2836a0>
Traceback (most recent call last):
File "/venv/bin/pulpcore-manager", line 33, in <module>
sys.exit(load_entry_point('pulpcore', 'console_scripts', 'pulpcore-manager')())
File "/src/pulpcore/pulpcore/app/manage.py", line 11, in manage
execute_from_command_line(sys.argv)
File "/venv/lib64/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
utility.execute()
File "/venv/lib64/python3.6/site-packages/django/core/management/__init__.py", line 375, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/venv/lib64/python3.6/site-packages/django/core/management/base.py", line 323, in run_from_argv
self.execute(*args, **cmd_options)
File "/venv/lib64/python3.6/site-packages/django/core/management/base.py", line 364, in execute
output = self.handle(*args, **options)
File "/src/galaxy_ng/galaxy_ng/app/management/commands/access-policy-views.py", line 195, in handle
self.show_access_policy(view, **options)
File "/src/galaxy_ng/galaxy_ng/app/management/commands/access-policy-views.py", line 313, in show_access_policy
result = self._has_permission(viewset_info, user, action, viewset_info['url'])
File "/src/galaxy_ng/galaxy_ng/app/management/commands/access-policy-views.py", line 350, in _has_permission
result = policy.has_permission(request, view_instance)
File "/venv/lib64/python3.6/site-packages/rest_access_policy/access_policy.py", line 26, in has_permission
return self._evaluate_statements(statements, request, view, action)
File "/venv/lib64/python3.6/site-packages/rest_access_policy/access_policy.py", line 63, in _evaluate_statements
request, view, action, matched
File "/venv/lib64/python3.6/site-packages/rest_access_policy/access_policy.py", line 177, in _get_statements_matching_context_conditions
passed = bool(boolExpr.parseString(condition)[0])
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1943, in parseString
loc, tokens = self._parse(instring, 0)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1683, in _parseNoCache
loc, tokens = self.parseImpl(instring, preloc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 4462, in parseImpl
return self.expr._parse(instring, loc, doActions, callPreParse=False)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1683, in _parseNoCache
loc, tokens = self.parseImpl(instring, preloc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 4462, in parseImpl
return self.expr._parse(instring, loc, doActions, callPreParse=False)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1683, in _parseNoCache
loc, tokens = self.parseImpl(instring, preloc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 4254, in parseImpl
ret = e._parse(instring, loc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1683, in _parseNoCache
loc, tokens = self.parseImpl(instring, preloc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 4462, in parseImpl
return self.expr._parse(instring, loc, doActions, callPreParse=False)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1683, in _parseNoCache
loc, tokens = self.parseImpl(instring, preloc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 4254, in parseImpl
ret = e._parse(instring, loc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1683, in _parseNoCache
loc, tokens = self.parseImpl(instring, preloc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 4462, in parseImpl
return self.expr._parse(instring, loc, doActions, callPreParse=False)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1683, in _parseNoCache
loc, tokens = self.parseImpl(instring, preloc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 4254, in parseImpl
ret = e._parse(instring, loc, doActions)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1716, in _parseNoCache
tokens = fn(instring, tokensStart, retTokens)
File "/venv/lib64/python3.6/site-packages/pyparsing.py", line 1316, in wrapper
ret = func(*args[limit[0]:])
File "/venv/lib64/python3.6/site-packages/rest_access_policy/parsing.py", line 13, in __init__
self.value = self.check_condition_fn(t[0])
File "/venv/lib64/python3.6/site-packages/rest_access_policy/access_policy.py", line 164, in <lambda>
cond, request, view, action
File "/venv/lib64/python3.6/site-packages/rest_access_policy/access_policy.py", line 201, in _check_condition
result = method(request, view, action, arg)
File "/src/pulpcore/pulpcore/app/global_access_conditions.py", line 104, in has_model_or_obj_perms
if has_obj_perms(request, view, action, permission):
File "/src/pulpcore/pulpcore/app/global_access_conditions.py", line 68, in has_obj_perms
obj = view.get_object()
File "/venv/lib64/python3.6/site-packages/rest_framework/generics.py", line 92, in get_object
(self.__class__.__name__, lookup_url_kwarg)
AssertionError: Expected view ContainerNamespaceViewSet to be called with a URL keyword argument named "pk". Fix your URL conf, or set the `.lookup_field` attribute on the view correctly.
</code></pre> RPM Support - Issue #7786 (CLOSED - WORKSFORME): Pulp_rpm sync reports "completed" but does not u...https://pulp.plan.io/issues/77862020-11-04T07:51:35ZAant
<p>This is a copy of <a href="https://pulp.plan.io/issues/7535?next_issue_id=7534" class="external">https://pulp.plan.io/issues/7535?next_issue_id=7534</a>. The issue persists.
Even if I delete and recreate the publication and distribution after synchronization I still experience this issue.
This is a very severe bug as it makes me believe that my systems are up to date while they are not.</p>
<a name="What-would-be-the-proper-workflow-to-resynchronise-a-repo-after-it-is-created"></a>
<h2 >What would be the proper workflow to resynchronise a repo after it is created?<a href="#What-would-be-the-proper-workflow-to-resynchronise-a-repo-after-it-is-created" class="wiki-anchor">¶</a></h2>
<p>I have set up Pulpcore v3.6.3 with Pulp_rpm v3.6.2 - later updated both to 3.7.0.
I created the following remote:</p>
<pre><code>{
"pulp_href": "/pulp/api/v3/remotes/rpm/rpm/d8fb524c-e73b-4afc-ba2e-05eea7f5b6a8/",
"pulp_created": "2020-08-18T08:47:19.183836Z",
"name": "centos8_base",
"url": "http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/",
"ca_cert": null,
"client_cert": null,
"client_key": null,
"tls_validation": true,
"proxy_url": "http://<proxy server>",
"username": null,
"password": null,
"pulp_last_updated": "2020-08-18T08:47:19.183855Z",
"download_concurrency": 10,
"policy": "immediate",
"sles_auth_token": null
}
</code></pre>
<p>and this repository:</p>
<pre><code>{
"pulp_href": "/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/",
"pulp_created": "2020-08-18T08:47:17.704104Z",
"versions_href": "/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/versions/",
"latest_version_href": "/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/versions/1/",
"name": "centos8_base",
"description": null,
"remote": null,
"metadata_signing_service": null,
"retain_package_versions": 0
}
</code></pre>
<p>If I sync, it reports success:</p>
<pre><code>http --auth admin --auth-type basic :9000/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/sync/ remote=/pulp/api/v3/remotes/rpm/rpm/d8fb524c-e73b-4afc-ba2e-05eea7f5b6a8/
http: password for admin@localhost:9000:
HTTP/1.1 202 Accepted
Allow: POST, OPTIONS
Connection: close
Content-Length: 67
Content-Type: application/json
Date: Mon, 21 Sep 2020 08:10:11 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN
{
"task": "/pulp/api/v3/tasks/655d2e7b-2783-4496-a851-3bcd8d5e442e/"
}
</code></pre>
<p>Let's take a closer look at the task:</p>
<pre><code> http --auth admin --auth-type basic :9000/pulp/api/v3/tasks/655d2e7b-2783-4496-a851-3bcd8d5e442e/
http: password for admin@localhost:9000:
HTTP/1.1 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: close
Content-Length: 743
Content-Type: application/json
Date: Mon, 21 Sep 2020 08:10:29 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN
{
"child_tasks": [],
"created_resources": [],
"error": null,
"finished_at": "2020-09-21T08:10:11.585792Z",
"name": "pulp_rpm.app.tasks.synchronizing.synchronize",
"parent_task": null,
"progress_reports": [
{
"code": "optimizing.sync",
"done": 1,
"message": "Optimizing Sync",
"state": "completed",
"suffix": null,
"total": null
}
],
"pulp_created": "2020-09-21T08:10:11.257796Z",
"pulp_href": "/pulp/api/v3/tasks/655d2e7b-2783-4496-a851-3bcd8d5e442e/",
"reserved_resources_record": [
"/pulp/api/v3/remotes/rpm/rpm/d8fb524c-e73b-4afc-ba2e-05eea7f5b6a8/",
"/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/"
],
"started_at": "2020-09-21T08:10:11.507912Z",
"state": "completed",
"task_group": null,
"worker": "/pulp/api/v3/workers/80ca382e-fdec-4eef-94b4-6c1c67433511/"
}
</code></pre>
<p>Let's use this repo on the same machine:</p>
<pre><code>cat /etc/yum.repos.d/CentOS-Base.repo
[Base]
name=CentOS-$releasever - Base
enabled=1
baseurl=https://<myurl>/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial
</code></pre>
<p>Now if I do <code>yum check-update</code> it does not find any package to update.
If I change <code>baseurl=</code> to <code>http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/</code> (which is the same url I have in the remote) and I do <code>yum check-update</code>, then it finds 28 outdated packages. How is it possible?</p> Migration Plugin - Issue #7719 (CLOSED - WORKSFORME): 'Directory not empty' error in publishinghttps://pulp.plan.io/issues/77192020-10-17T17:54:57Zadam.winberg@smhi.se
<p>Running a pulp2 migration always results in an error when the migration runs the publishing jobs:</p>
<pre><code> "error": {
"description": "[Errno 39] Directory not empty: '/var/lib/pulp/tmp/2287063@lxserv2285.smhi.se/7b022048-0d39-4d6d-a278-91ecb3c4779c'",
"traceback": " File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 936, in perform_job\n rv = job.perform()\n File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 684, in perform\n self._result = self._execute()\n File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 690, in _execute\n return self.func(*self.args, **self.kwargs)\n File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/tasks/migrate.py\", line 142, in migrate_from_pulp2\n create_repoversions_publications_distributions(plan)\n File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 293, in create_repoversions_publications_distributions\n task_func(*task_args)\n File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 187, in simple_plugin_migration\n migrate_repo_distributor(dist_migrator, progress_dist, pulp2_dist)\n File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 391, in migrate_repo_distributor\n pulp2dist, repo_version)\n File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/rpm/repository.py\", line 74, in migrate_to_pulp3\n publish(repo_version.pk, checksum_types=checksum_types)\n File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py\", line 300, in publish\n metadata_signing_service=metadata_signing_service\n File \"/usr/lib/python3.6/site-packages/pulpcore/tasking/services/storage.py\", line 178, in __exit__\n self.delete()\n File \"/usr/lib/python3.6/site-packages/pulpcore/tasking/services/storage.py\", line 80, in delete\n self._delete()\n File \"/usr/lib/python3.6/site-packages/pulpcore/tasking/services/storage.py\", line 90, in _delete\n shutil.rmtree(self.path)\n File \"/usr/lib64/python3.6/shutil.py\", line 490, in rmtree\n onerror(os.rmdir, path, sys.exc_info())\n File \"/usr/lib64/python3.6/shutil.py\", line 488, in rmtree\n os.rmdir(path)\n"
},
</code></pre>
<p>/var/lib/pulp/ is a NFS share. Checking the directory in the error message shows that it is empty. Maybe an issue with NFS lock files?</p>
<p>This is on an rpm based installation on RHEL8:</p>
<pre><code>python3-pulpcore-3.7.1-3.el8.noarch
python3-pulp-rpm-3.7.0-1.el8.noarch
python3-pulp-2to3-migration-0.4.0-1.el8.noarch
</code></pre> RPM Support - Issue #7535 (CLOSED - WORKSFORME): Pulp_rpm sync reports "completed" but does not u...https://pulp.plan.io/issues/75352020-09-21T08:28:31ZAant
<p>I have set up Pulpcore v3.6.3 with Pulp_rpm v3.6.2.
I created the following remote:</p>
<pre><code>{
"pulp_href": "/pulp/api/v3/remotes/rpm/rpm/d8fb524c-e73b-4afc-ba2e-05eea7f5b6a8/",
"pulp_created": "2020-08-18T08:47:19.183836Z",
"name": "centos8_base",
"url": "http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/",
"ca_cert": null,
"client_cert": null,
"client_key": null,
"tls_validation": true,
"proxy_url": "http://<proxy server>",
"username": null,
"password": null,
"pulp_last_updated": "2020-08-18T08:47:19.183855Z",
"download_concurrency": 10,
"policy": "immediate",
"sles_auth_token": null
}
</code></pre>
<p>and this repository:</p>
<pre><code>{
"pulp_href": "/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/",
"pulp_created": "2020-08-18T08:47:17.704104Z",
"versions_href": "/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/versions/",
"latest_version_href": "/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/versions/1/",
"name": "centos8_base",
"description": null,
"remote": null,
"metadata_signing_service": null,
"retain_package_versions": 0
}
</code></pre>
<p>If I sync, it reports success:</p>
<pre><code>http --auth admin --auth-type basic :9000/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/sync/ remote=/pulp/api/v3/remotes/rpm/rpm/d8fb524c-e73b-4afc-ba2e-05eea7f5b6a8/
http: password for admin@localhost:9000:
HTTP/1.1 202 Accepted
Allow: POST, OPTIONS
Connection: close
Content-Length: 67
Content-Type: application/json
Date: Mon, 21 Sep 2020 08:10:11 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN
{
"task": "/pulp/api/v3/tasks/655d2e7b-2783-4496-a851-3bcd8d5e442e/"
}
</code></pre>
<p>Let's take a closer look at the task:</p>
<pre><code> http --auth admin --auth-type basic :9000/pulp/api/v3/tasks/655d2e7b-2783-4496-a851-3bcd8d5e442e/
http: password for admin@localhost:9000:
HTTP/1.1 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: close
Content-Length: 743
Content-Type: application/json
Date: Mon, 21 Sep 2020 08:10:29 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN
{
"child_tasks": [],
"created_resources": [],
"error": null,
"finished_at": "2020-09-21T08:10:11.585792Z",
"name": "pulp_rpm.app.tasks.synchronizing.synchronize",
"parent_task": null,
"progress_reports": [
{
"code": "optimizing.sync",
"done": 1,
"message": "Optimizing Sync",
"state": "completed",
"suffix": null,
"total": null
}
],
"pulp_created": "2020-09-21T08:10:11.257796Z",
"pulp_href": "/pulp/api/v3/tasks/655d2e7b-2783-4496-a851-3bcd8d5e442e/",
"reserved_resources_record": [
"/pulp/api/v3/remotes/rpm/rpm/d8fb524c-e73b-4afc-ba2e-05eea7f5b6a8/",
"/pulp/api/v3/repositories/rpm/rpm/7696b222-3788-4754-b4a6-747e64228d7a/"
],
"started_at": "2020-09-21T08:10:11.507912Z",
"state": "completed",
"task_group": null,
"worker": "/pulp/api/v3/workers/80ca382e-fdec-4eef-94b4-6c1c67433511/"
}
</code></pre>
<p>Let's use this repo on the same machine:</p>
<pre><code>cat /etc/yum.repos.d/CentOS-Base.repo
[Base]
name=CentOS-$releasever - Base
enabled=1
baseurl=https://<myurl>/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial
</code></pre>
<p>Now if I do <code>yum check-update</code> it does not find any package to update.
If I change <code>baseurl=</code> to <code>http://mirror.centos.org/centos-8/8/BaseOS/x86_64/os/</code> (which is the same url I have in the remote) and I do <code>yum check-update</code>, then it finds 28 outdated packages. How is it possible?</p> Pulp - Issue #7495 (CLOSED - WORKSFORME): duplicate key violation, Repository.next_version alread...https://pulp.plan.io/issues/74952020-09-11T13:18:50Zawcrosby
<p>We have run into the situation where the <code>my_repo.next_version</code> integer already exists as one of the <code>RepositoryVersion.number</code>s for <code>my_repo</code>. This causes a duplicate key violation when trying to to call <code>my_repo.new_version()</code></p>
<p>This has happened twice when using <code>move_content()</code> on a CollectionVersion <a href="https://github.com/ansible/galaxy_ng/blob/master/galaxy_ng/app/api/v3/viewsets/collection.py#L268" class="external">https://github.com/ansible/galaxy_ng/blob/master/galaxy_ng/app/api/v3/viewsets/collection.py#L268</a> which uses these tasks <a href="https://github.com/ansible/galaxy_ng/blob/master/galaxy_ng/app/tasks/promotion.py" class="external">https://github.com/ansible/galaxy_ng/blob/master/galaxy_ng/app/tasks/promotion.py</a>, but we don’t have recreation steps at the moment.</p>
<p>I would think this situation would not be possible due to <a href="https://github.com/pulp/pulpcore/blob/master/pulpcore/app/models/repository.py#L809" class="external">https://github.com/pulp/pulpcore/blob/master/pulpcore/app/models/repository.py#L809</a>, but maybe there is a bug in pulp or non-ideal use of locks in galaxy_ng.</p> RPM Support - Issue #4826 (CLOSED - WORKSFORME): Pulp RPM Publish Comps File Errorhttps://pulp.plan.io/issues/48262019-05-15T18:45:10ZAnonymous
<p>Hello!</p>
<p>I have had an issue over the last little while since updating several Centos 7 boxes to 2.19. When the repos go to publish it would fail out during "Publishing Comps File" on all repos. Long story short I have tracked it down to a change was made in <a href="https://github.com/pulp/pulp_rpm/blame/2.19-release/plugins/pulp_rpm/plugins/distributors/yum/publish.py" class="external">https://github.com/pulp/pulp_rpm/blame/2.19-release/plugins/pulp_rpm/plugins/distributors/yum/publish.py</a> line 1181-1190. Now that sqliterepo_c is in use instead of createrepo_c (<a href="https://github.com/pulp/pulp_rpm/blame/c5f27803ad26dd8f5ff6c36b7d14f2a95e30ec25/plugins/pulp_rpm/plugins/distributors/yum/publish.py" class="external">https://github.com/pulp/pulp_rpm/blame/c5f27803ad26dd8f5ff6c36b7d14f2a95e30ec25/plugins/pulp_rpm/plugins/distributors/yum/publish.py</a> line 1179), sqliterepo_c doesnt know to look into the ./scratch folder in the job and fails out. More details below.</p>
<p><strong>Problem</strong>:<br>
Running a stock 2.19 on Centos fresh, installed for me hooked up to global repos would sync, but on publish would give the following (I turned on verbose sqliterepo_c output)</p>
<pre><code class="text syntaxhl" data-language="text">[root@test repodata]# pulp-admin rpm repo export run --repo-id centos7-x86_64-os-global
+----------------------------------------------------------------------+
Publishing Repository [centos7-x86_64-os-global]
+----------------------------------------------------------------------+
This command may be exited via ctrl+c without affecting the request.
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[==================================================] 100%
10019 of 10019 items
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[-]
... completed
Publishing Modules
... skipped
Publishing Comps file
[========================================= ] 83%
92 of 110 items
Task Failed
Error occurred during 'sqliterepo_c' execution:
::
15:16:48: Version:
0.10.0
15:16:48: Signal handler setup
15:16:48: cr_get_local_metadata:
/var/cache/pulp/reserved_resource_worker-3@test/96de374b-b164-454d-9c1f-20d6c18e5462/repodata/repomd.xml doesn't
exists
repomd.xml doesn't exist
</code></pre>
<pre><code class="text syntaxhl" data-language="text">May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) Exception caught from plugin during publish for repo [centos7-x86_64-os-global]
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) Traceback (most recent call last):
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1259, in _do_publish
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) publish_report = publish_repo(transfer_repo, conduit, call_config)
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 737, in wrap_f
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) return f(*args, **kwargs)
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/export_distributor/distributor.py", line 138, in publish_repo
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) return self._publisher.process_lifecycle()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 572, in process_lifecycle
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) super(PluginStep, self).process_lifecycle()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) step.process()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 256, in process
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) self._process_block()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 303, in _process_block
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) self.process_main()
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 1191, in process_main
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) stderr=stderr)
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) PulpCodedException: Error occurred during 'sqliterepo_c' execution:
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) ::
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184) repomd.xml doesn't exist
May 14 17:32:34 test pulp[472707]: pulp.server.controllers.repository:ERROR: [25c1e177] (472707-25184)
</code></pre>
<p><strong>Fix</strong>:<br>
It should be looking in /var/cache/pulp/reserved_resource_worker-3@test/96de374b-b164-454d-9c1f-20d6c18e5462/scratch/repodata/repomd.xml instead.</p>
<p>I replaced publish.py with the last revision (using createrepo_c) and it worked right away. I also was able to get it to work with sqliterepo_c by adding '/scratch/' to the command. Both tested and gave me a working ISO. :)</p> Pulp - Issue #4575 (CLOSED - WORKSFORME): Cannot upload file when using django runserverhttps://pulp.plan.io/issues/45752019-03-25T18:45:17Zamacdona@redhat.comaustin@redhat.com
<pre><code>[vagrant@pulp3-source-fedora28 ~]$ http --form POST localhost:8000/pulp/api/v3/artifacts/ file@~/devel/pulp_python/pulpcore-3.0.0b23-py3-none-any.whl
HTTP/1.1 500 Internal Server Error
Content-Length: 27
Content-Type: text/html
Date: Mon, 25 Mar 2019 18:42:35 GMT
Server: WSGIServer/0.2 CPython/3.6.5
Vary: Cookie
X-Frame-Options: SAMEORIGIN
<h1>Server Error (500)</h1>
pulp: django.request:ERROR: Internal Server Error: /pulp/api/v3/artifacts/
Traceback (most recent call last):
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/handlers/exception.py", line 34, in inner
response = get_response(request)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/handlers/base.py", line 126, in _get_response
response = self.process_exception_by_middleware(e, request)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/handlers/base.py", line 124, in _get_response
response = wrapped_callback(request, *callback_args, **callback_kwargs)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view
return view_func(*args, **kwargs)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/viewsets.py", line 116, in view
return self.dispatch(request, *args, **kwargs)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/views.py", line 495, in dispatch
response = self.handle_exception(exc)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/views.py", line 455, in handle_exception
self.raise_uncaught_exception(exc)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/views.py", line 492, in dispatch
response = handler(request, *args, **kwargs)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/mixins.py", line 19, in create
serializer = self.get_serializer(data=request.data)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/request.py", line 212, in data
self._load_data_and_files()
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/request.py", line 275, in _load_data_and_files
self._data, self._files = self._parse()
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/request.py", line 350, in _parse
parsed = parser.parse(stream, media_type, self.parser_context)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rest_framework/parsers.py", line 113, in parse
data, files = parser.parse()
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/http/multipartparser.py", line 227, in parse
content_length, charset, content_type_extra,
File "/home/vagrant/devel/pulpcore/pulpcore/app/files.py", line 60, in new_file
content_type_extra)
File "/home/vagrant/devel/pulpcore/pulpcore/app/files.py", line 16, in __init__
super().__init__(name, content_type, size, charset, content_type_extra)
File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/files/uploadedfile.py", line 61, in __init__
file = tempfile.NamedTemporaryFile(suffix='.upload' + ext, dir=settings.FILE_UPLOAD_TEMP_DIR)
File "/usr/lib64/python3.6/tempfile.py", line 549, in NamedTemporaryFile
(fd, name) = _mkstemp_inner(dir, prefix, suffix, flags, output_type)
File "/usr/lib64/python3.6/tempfile.py", line 260, in _mkstemp_inner
fd = _os.open(file, flags, 0o600)
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/tmp/tmp9hsz2e4m.upload.whl'
</code></pre>
<p>After this, I killed the django runserver and started the wsgi app via systemctl. Upload worked as expected.</p>
<pre><code>[vagrant@pulp3-source-fedora28 ~]$ http --form POST localhost:8000/pulp/api/v3/artifacts/ file@~/devel/pulp_python/pulpcore-3.0.0b23-py3-none-any.whl
HTTP/1.1 201 Created
Allow: GET, POST, HEAD, OPTIONS
Connection: close
Content-Length: 694
Content-Type: application/json
Date: Mon, 25 Mar 2019 18:42:55 GMT
Location: /pulp/api/v3/artifacts/08bfeac4-fb7a-4b7b-9dbd-a1ed0ae278a5/
Server: gunicorn/19.9.0
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN
{
"_created": "2019-03-25T18:42:55.199443Z",
"_href": "/pulp/api/v3/artifacts/08bfeac4-fb7a-4b7b-9dbd-a1ed0ae278a5/",
"file": "artifact/0b/50a064be9e7b20e752399486357df586bdac574fac64e62c3ca50bef449dc8",
"md5": "9d8822eea690bd8765f5b0b01e10ca9c",
"sha1": "da80295413a8a73ab171a2bca90896e8f5a4eb11",
"sha224": "9baf50097129d2f48fe861904f029dabefe4117432c27a57281f4896",
"sha256": "0b50a064be9e7b20e752399486357df586bdac574fac64e62c3ca50bef449dc8",
"sha384": "86caad0492aa3a6829327ff2507500152cf2e5aa91a180305782ccea873242428708b0198c2c3bb9a655412245ad0991",
"sha512": "05130b5ef51ba477393c06e5981c3778775f7a26724579de070aa00c710dcc4033c302098dc4b32c017267571ec285dedf782ed81f54234b9fa6f5cb10fac7ff",
"size": 156352
}
</code></pre> Pulp - Issue #4317 (CLOSED - WORKSFORME): AttributeError: 'RpmRemote' object has no attribute 'co...https://pulp.plan.io/issues/43172019-01-14T19:11:47ZalexandreC
<p>Hi, I'm currently trying to use pulp 3 with the RPM plugin, and I'm facing a problem when I follow the workflows. After creating the repo and the remote, I want to sync the repo, and the API returns the task, and nothing happens. After checking the logs an error has occurred</p>
<p>Jan 14 11:06:19 localhost.localdomain rq[15377]: File "pulpvenv/lib64/python3.6/site-packages/pulpcore/plugin/models/remote.py", line 61, in get_downloader<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: return self.download_factory.build(url, **kwargs)<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: File "pulpvenv/lib64/python3.6/site-packages/pulpcore/plugin/models/remote.py", line 42, in download_factory<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: self._download_factory = DownloaderFactory(self)<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: File "pulpvenv/lib64/python3.6/site-packages/pulpcore/plugin/download/factory.py", line 67, in <em>init</em><br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: self._semaphore = asyncio.Semaphore(value=remote.connection_limit)<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: AttributeError: 'RpmRemote' object has no attribute 'connection_limit'<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: pulp: rq.worker:WARNING: Moving job to 'failed' queue<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: pulp: rq.worker:INFO: <a href="mailto:reserved_resource_worker_1@localhost.localdomain" class="email">reserved_resource_worker_1@localhost.localdomain</a>: pulpcore.tasking.tasks._release_resources('1faacd76-dc8a-4b4a-a772-11313f...-902785495358)<br>
Jan 14 11:06:19 localhost.localdomain rq[15377]: pulp: rq.worker:INFO: <a href="mailto:reserved_resource_worker_1@localhost.localdomain" class="email">reserved_resource_worker_1@localhost.localdomain</a>: Job OK (546f5a9f-f4b1-4498-b494-902785495358)</p>
<p>Has anyone had this issue before?</p> Debian Support - Issue #4022 (CLOSED - WORKSFORME): very simple (1 package) ubuntu repo not prope...https://pulp.plan.io/issues/40222018-09-17T17:50:00ZAnonymousPulp - Issue #3679 (CLOSED - WORKSFORME): Error on pulp_resource_manager and pulp_celerybeat reso...https://pulp.plan.io/issues/36792018-05-17T13:46:55ZAnonymous
<p>Followed the instructions to configure Qpid+SSL and Qpidd/Httpd service seems to work fine but pulp_resource_manager as well as pulp_celerybeat fail.</p>
<a name="Environment"></a>
<h3 >Environment<a href="#Environment" class="wiki-anchor">¶</a></h3>
<ul>
<li>RHEL 7.x</li>
<li>Pulp 2.13.1</li>
</ul>
<a name="Steps-to-Reproduce"></a>
<h3 >Steps to Reproduce<a href="#Steps-to-Reproduce" class="wiki-anchor">¶</a></h3>
<ul>
<li>Follow the instructions to configure Qpid Over SSL using <a href="https://docs.pulpproject.org/user-guide/qpid.html" class="external">https://docs.pulpproject.org/user-guide/qpid.html</a>
</li>
<li>
<strong>qpid-cpp-server-ssl</strong> is not needed on RHEL 7.x and is already included on <strong>qpid-cpp-server</strong>
</li>
<li>Change the permissions on the /etc/pki/pulp/qpid/**.crt to allow <strong>qpid</strong> user to read. Otherwise the Qpidd service will not start.</li>
</ul>
<p>I get the following error and is very similar for <strong>pulp_resource_manager</strong> and <strong>pulp_celerybeat</strong></p>
<pre><code class="java syntaxhl" data-language="java"><span class="n">pulp_celerybeat</span><span class="o">.</span><span class="na">service</span> <span class="o">-</span> <span class="nc">Pulp</span><span class="err">'</span><span class="n">s</span> <span class="nc">Celerybeat</span>
<span class="nl">Loaded:</span> <span class="n">loaded</span> <span class="o">(/</span><span class="n">usr</span><span class="o">/</span><span class="n">lib</span><span class="o">/</span><span class="n">systemd</span><span class="o">/</span><span class="n">system</span><span class="o">/</span><span class="n">pulp_celerybeat</span><span class="o">.</span><span class="na">service</span><span class="o">;</span> <span class="n">enabled</span><span class="o">;</span> <span class="n">vendor</span> <span class="nl">preset:</span> <span class="n">disabled</span><span class="o">)</span>
<span class="nl">Active:</span> <span class="n">inactive</span> <span class="o">(</span><span class="n">dead</span><span class="o">)</span> <span class="n">since</span> <span class="nc">Thu</span> <span class="mi">2018</span><span class="o">-</span><span class="mo">05</span><span class="o">-</span><span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">41</span> <span class="no">CDT</span><span class="o">;</span> <span class="mi">1</span><span class="n">min</span> <span class="mi">41</span><span class="n">s</span> <span class="n">ago</span>
<span class="nl">Process:</span> <span class="mi">45045</span> <span class="nc">ExecStart</span><span class="o">=/</span><span class="n">usr</span><span class="o">/</span><span class="n">bin</span><span class="o">/</span><span class="n">celery</span> <span class="n">beat</span> <span class="o">--</span><span class="n">app</span><span class="o">=</span><span class="n">pulp</span><span class="o">.</span><span class="na">server</span><span class="o">.</span><span class="na">async</span><span class="o">.</span><span class="na">celery_instance</span><span class="o">.</span><span class="na">celery</span> <span class="o">--</span><span class="n">scheduler</span><span class="o">=</span><span class="n">pulp</span><span class="o">.</span><span class="na">server</span><span class="o">.</span><span class="na">async</span><span class="o">.</span><span class="na">scheduler</span><span class="o">.</span><span class="na">Scheduler</span> <span class="o">(</span><span class="n">code</span><span class="o">=</span><span class="n">exited</span><span class="o">,</span> <span class="n">status</span><span class="o">=</span><span class="mi">0</span><span class="o">/</span><span class="no">SUCCESS</span><span class="o">)</span>
<span class="nc">Main</span> <span class="nl">PID:</span> <span class="mi">45045</span> <span class="o">(</span><span class="n">code</span><span class="o">=</span><span class="n">exited</span><span class="o">,</span> <span class="n">status</span><span class="o">=</span><span class="mi">0</span><span class="o">/</span><span class="no">SUCCESS</span><span class="o">)</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="k">return</span> <span class="n">self</span><span class="o">.</span><span class="na">connection</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="nc">File</span> <span class="s">"/usr/lib/python2.7/site-packages/kombu/connection.py"</span><span class="o">,</span> <span class="n">line</span> <span class="mi">741</span><span class="o">,</span> <span class="n">in</span> <span class="n">connection</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="n">self</span><span class="o">.</span><span class="na">_connection</span> <span class="o">=</span> <span class="n">self</span><span class="o">.</span><span class="na">_establish_connection</span><span class="o">()</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="nc">File</span> <span class="s">"/usr/lib/python2.7/site-packages/kombu/connection.py"</span><span class="o">,</span> <span class="n">line</span> <span class="mi">696</span><span class="o">,</span> <span class="n">in</span> <span class="n">_establish_connection</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="n">conn</span> <span class="o">=</span> <span class="n">self</span><span class="o">.</span><span class="na">transport</span><span class="o">.</span><span class="na">establish_connection</span><span class="o">()</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="nc">File</span> <span class="s">"/usr/lib/python2.7/site-packages/kombu/transport/qpid.py"</span><span class="o">,</span> <span class="n">line</span> <span class="mi">1600</span><span class="o">,</span> <span class="n">in</span> <span class="n">establish_connection</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="n">conn</span> <span class="o">=</span> <span class="n">self</span><span class="o">.</span><span class="na">Connection</span><span class="o">(**</span><span class="n">opts</span><span class="o">)</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="nc">File</span> <span class="s">"/usr/lib/python2.7/site-packages/kombu/transport/qpid.py"</span><span class="o">,</span> <span class="n">line</span> <span class="mi">1284</span><span class="o">,</span> <span class="n">in</span> <span class="n">__init__</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="n">raise</span> <span class="nf">AuthenticationFailure</span><span class="o">(</span><span class="n">sys</span><span class="o">.</span><span class="na">exc_info</span><span class="o">()[</span><span class="mi">1</span><span class="o">])</span>
<span class="nc">May</span> <span class="mi">17</span> <span class="mi">08</span><span class="o">:</span><span class="mi">34</span><span class="o">:</span><span class="mi">40</span> <span class="n">pulpserver</span> <span class="n">pulp</span><span class="o">[</span><span class="mi">45045</span><span class="o">]:</span> <span class="n">celery</span><span class="o">.</span><span class="na">beat</span><span class="o">:</span><span class="nl">CRITICAL:</span> <span class="o">(</span><span class="mi">45045</span><span class="o">-</span><span class="mi">85152</span><span class="o">)</span> <span class="nl">AuthenticationFailure:</span> <span class="n">connection</span><span class="o">-</span><span class="nl">forced:</span> <span class="nc">Connection</span> <span class="n">must</span> <span class="n">be</span> <span class="n">encrypted</span><span class="o">.(</span><span class="mi">320</span><span class="o">)</span>
<span class="nc">This</span> <span class="n">message</span> <span class="n">is</span> <span class="n">intended</span> <span class="k">for</span> <span class="n">use</span> <span class="n">only</span> <span class="n">by</span> <span class="n">the</span> <span class="nf">person</span><span class="o">(</span><span class="n">s</span><span class="o">)</span> <span class="n">addressed</span> <span class="n">above</span> <span class="n">and</span> <span class="n">may</span> <span class="n">contain</span> <span class="n">privileged</span> <span class="n">and</span> <span class="n">confidential</span> <span class="n">information</span><span class="o">.</span> <span class="nc">Disclosure</span> <span class="n">or</span> <span class="n">use</span> <span class="n">of</span> <span class="k">this</span> <span class="n">message</span> <span class="n">by</span> <span class="n">any</span> <span class="n">other</span> <span class="n">person</span> <span class="n">is</span> <span class="n">strictly</span> <span class="n">prohibited</span><span class="o">.</span> <span class="nc">If</span> <span class="k">this</span> <span class="n">message</span> <span class="n">is</span> <span class="n">received</span> <span class="n">in</span> <span class="n">error</span><span class="o">,</span> <span class="n">please</span> <span class="n">notify</span> <span class="n">the</span> <span class="n">sender</span> <span class="n">immediately</span> <span class="n">and</span> <span class="n">delete</span> <span class="k">this</span> <span class="n">message</span><span class="o">.</span>
</code></pre> RPM Support - Issue #2429 (CLOSED - WORKSFORME): repomd.xml in a published yum repository is empt...https://pulp.plan.io/issues/24292016-11-18T11:30:18Zalanoealanoe@linux.vnet.ibm.com
<p>Error:<br>
XML Parsing Error: no element found<br>
Location: <a href="http://pkvm-repomgr.aus.stglabs.ibm.com/pulp/repos/in-3.1.0.0-service-installer-20160805130000-binary/repodata/repomd.xml" class="external">http://pkvm-repomgr.aus.stglabs.ibm.com/pulp/repos/in-3.1.0.0-service-installer-20160805130000-binary/repodata/repomd.xml</a><br>
Line Number 1, Column 1:<br>
^</p>
<p>I get an empty file if I try to download the file. File content in server is OK (not empty). This blocks me to use the published yum repositories with yum; when I try, I get the following error:<br>
[Errno -1] Error importing repomd.xml for all: Damaged repomd.xml file</p>
<p>This occurs independently if XSendFile Apache module is enabled or not, so it seems to me it is not related to issue <a class="issue tracker-1 status-10 priority-6 priority-default closed" title="Issue: Apache's XSendFile directive causes 404 errors when trying to download rpm packages via HTTP (CLOSED - WORKSFORME)" href="https://pulp.plan.io/issues/2427">#2427</a>.</p> RPM Support - Issue #2427 (CLOSED - WORKSFORME): Apache's XSendFile directive causes 404 errors w...https://pulp.plan.io/issues/24272016-11-17T18:53:20Zalanoealanoe@linux.vnet.ibm.com
<p>arch: ppc64<br>
Apache: 2.4.6-40<br>
xsendfile module: 0.12-10</p>
<p>I am able to browse /pulp/repos/ and /pulp/content/var/www/pub/yum/http/repos/ paths via HTTP; however, when I click in a RPM package, Apache does not find it and I get a 404 status code in the HTTP response. Disabling xsendfile module by commenting the corresponding lines in /etc/httpd/conf.d/pulp_content.conf fixes the problem.</p> Pulp - Issue #1800 (CLOSED - WORKSFORME): Downloaded/synced packages are not published.https://pulp.plan.io/issues/18002016-03-31T09:39:53Zakegata@gmail.comakegata@gmail.com
<p>I'm syncing the pulp repo (<a href="https://repos.fedorapeople.org/repos/pulp/pulp/stable/2/6Server/x86_64/" class="external">https://repos.fedorapeople.org/repos/pulp/pulp/stable/2/6Server/x86_64/</a>).<br>
A pulp-admin rpm repo sync run --repo-id run of the repo seemingly works fine, no errors are shown.<br>
However, a number of rpm's are not published, specifically the rpms for pulp 2.8.x in this case.</p>
<ol>
<li>rpm -qa | grep pulp-server<br>
pulp-server-2.6.2-1.el6.noarch</li>
</ol>
<p>The package exists in /var/lib/pulp/content/rpm/pulp-server/, but there is no symlink in /var/lib/pulp/published/yum/master/yum_distributor for the package.</p> Pulp - Issue #1018 (CLOSED - WORKSFORME): nux-dextop-el7-x86_64 repo sync gets stuckhttps://pulp.plan.io/issues/10182015-06-01T08:58:54ZBen.StanleyBen.Stanley@exemail.com.au
<p>I have observed that attempts to sync my repo nux-dextop-el7-x86_64 do not complete.<br>
The feed comes from<br>
<a href="http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/" class="external">http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/</a></p>
<p>--------------------------------------------------------------------------------<br>
[root@bumblebee ]# pulp-admin rpm repo sync run --repo-id=nux-dextop-el7-x86_64<br>
<span><del>--------------------------------------------------------------------</del></span><br>
Synchronizing Repository [nux-dextop-el7-x86_64]<br>
<span><del>--------------------------------------------------------------------</del></span></p>
<p>This command may be exited via ctrl+c without affecting the request.</p>
<p>[-]<br>
Waiting to begin...<br>
--------------------------------------------------------------------------------<br>
Nothing appears in the logs.</p>
<p>I know that no sync is progressing because nload tells me there is no network traffic.</p>
<p>The tasks list says<br>
--------------------------------------------------------------------------------<br>
[root@bumblebee ~]# pulp-admin tasks list<br>
Operations: sync<br>
Resources: nux-dextop-el7-x86_64 (repository)<br>
State: Waiting<br>
Start Time: Unstarted<br>
Finish Time: Incomplete<br>
Task Id: b621280e-75b5-42eb-932c-c2e3f8a23cfa<br>
--------------------------------------------------------------------------------</p>
<p>Other tasks referencing this repository are either Cancelled or Successful.</p>
<p>Listing the details of the repo reveals the following:<br>
--------------------------------------------------------------------------------<br>
[root@bumblebee ~]# pulp-admin rpm repo list --details<br>
Id: nux-dextop-el7-x86_64<br>
Display Name: nux-dextop-el7-x86_64<br>
Description: None<br>
Content Unit Counts:<br>
Rpm: 1834<br>
Notes:<br>
Importers:<br>
Config:<br>
Feed: <a href="http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64" class="external">http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64</a><br>
Validate: True<br>
Id: yum_importer<br>
Importer Type Id: yum_importer<br>
Last Sync: None<br>
Repo Id: nux-dextop-el7-x86_64<br>
Scheduled Syncs:<br>
Distributors:<br>
Auto Publish: True<br>
Config:<br>
Http: True<br>
Https: False<br>
Relative URL: nux/dextop/el7/x86_64<br>
Distributor Type Id: yum_distributor<br>
Id: yum_distributor<br>
Last Publish: None<br>
Repo Id: nux-dextop-el7-x86_64<br>
Scheduled Publishes:<br>
Auto Publish: False<br>
Config:<br>
Http: True<br>
Https: False<br>
Distributor Type Id: export_distributor<br>
Id: export_distributor<br>
Last Publish: None<br>
Repo Id: nux-dextop-el7-x86_64<br>
Scheduled Publishes:<br>
--------------------------------------------------------------------------------</p>
<p>How can I find out what is preventing this sync from running?</p>
<p>I have found that I can fix errors of this type by deleting the repo and re-creating it.</p>
<p>I am preserving the state of this problem so that we can investigate it.</p>