Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2021-12-08T16:59:02ZPulp
Planio RPM Support - Issue #9619 (CLOSED - DUPLICATE): OpenAPI schema for ModulemdDefault is incorrecthttps://pulp.plan.io/issues/96192021-12-08T16:59:02Zdkliban@redhat.com
<p><strong>Ticket moved to GitHub</strong>: "pulp/pulp_rpm/2307":<a href="https://github.com/pulp/pulp_rpm/issues/2307" class="external">https://github.com/pulp/pulp_rpm/issues/2307</a></p>
<hr>
<p>The open api schema for ModulemdDefaults is incorrect. When trying to generate a client with openapi-generator-cli 5.3.0, the following exception is emitted:</p>
<pre><code>Exception in thread "main" java.lang.RuntimeException: Could not generate api file for 'ContentModulemdDefaults'
</code></pre> Pulp - Issue #9552 (CLOSED - DUPLICATE): Syncs are downloading every artifact, every timehttps://pulp.plan.io/issues/95522021-11-02T19:40:50Zdalleydalley@redhat.com
<p>Problem:
Syncs are resulting in the full download of every package to the “pulp_storage/tmp” folder but then making zero or only a few actual updates to the repository.</p>
<p>Expected outcome:
Remote metadata is parsed for a diff of packages and only the packages new or changed are downloaded and then sync’d. Packages with a a hash matching an existing artifact should not be downloaded.</p>
<p>Pulpcore version:
3.16</p>
<p>Pulp plugins installed and their versions:
rpm: 3.16.1
python: 3.5.2
file: 1.10
deb: 2.16.0
container: 2.9.0
certguard: 1.5.1
ansible: 0.10.1</p>
<p>Operating system - distribution and version:
Docker running on Oracle Linux 8.4</p>
<p><a href="https://discourse.pulpproject.org/t/syncs-of-rpm-repositories-are-downloading-every-artifact-every-time-in-3-16/213" class="external">https://discourse.pulpproject.org/t/syncs-of-rpm-repositories-are-downloading-every-artifact-every-time-in-3-16/213</a></p> Pulp - Issue #9396 (CLOSED - DUPLICATE): Duplicate key error during pulpcore.app.tasks.repository...https://pulp.plan.io/issues/93962021-09-14T14:27:33Ziballou
<p><strong>Ticket moved to GitHub</strong>: "pulp/pulpcore/2047":<a href="https://github.com/pulp/pulpcore/issues/2047" class="external">https://github.com/pulp/pulpcore/issues/2047</a></p>
<hr>
<p>During either an emptying of a repository (most likely) or a copying of package environments in Katello, the following error occurs for one user:</p>
<pre><code>duplicate key value violates unique constraint "core_repositorycontent_repository_id_content_id_df902e11_uniq"
</code></pre>
<p>Thread: <a href="https://community.theforeman.org/t/unable-to-publish-new-version-of-content-view-with-filter/23787" class="external">https://community.theforeman.org/t/unable-to-publish-new-version-of-content-view-with-filter/23787</a></p>
<p>All tasks:</p>
<pre>
---
pulp_tasks:
- pulp_href: "/pulp/api/v3/tasks/db1c311a-a744-40b6-a204-66ab51cdfdec/"
pulp_created: '2021-09-09T10:03:42.126+00:00'
state: failed
name: pulpcore.app.tasks.repository.add_and_remove
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
started_at: '2021-09-09T10:03:42.168+00:00'
finished_at: '2021-09-09T10:03:43.398+00:00'
error:
traceback: |2
File "/usr/lib/python3.6/site-packages/pulpcore/tasking/pulpcore_worker.py", line 272, in _perform_task
result = func(*args, **kwargs)
File "/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py", line 218, in add_and_remove
new_version.remove_content(models.Content.objects.filter(pk__in=remove_content_units))
File "/usr/lib/python3.6/site-packages/pulpcore/app/models/repository.py", line 796, in remove_content
q_set.update(version_removed=self)
File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 741, in update
rows = query.get_compiler(self.db).execute_sql(CURSOR)
File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql
cursor = super().execute_sql(result_type)
File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql
cursor.execute(sql, params)
File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 67, in execute
return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/usr/lib/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
description: |
duplicate key value violates unique constraint "core_repositorycontent_repository_id_content_id_df902e11_uniq"
DETAIL: Key (repository_id, content_id, version_removed_id)=(1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d, 995a0ffa-ad9c-45ab-b44e-6fb972ab5405, 8d4d8dc8-df24-490e-9d62-168e4cbcd66d) already exists.
worker: "/pulp/api/v3/workers/7a7376d4-ae32-4cd0-8774-407fb4bfc4b1/"
child_tasks: []
progress_reports: []
created_resources: []
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- pulp_href: "/pulp/api/v3/tasks/ce298bd4-9914-4e45-994e-d9ac75d4cd2b/"
pulp_created: '2021-09-09T10:03:42.191+00:00'
state: running
name: pulpcore.app.tasks.repository.add_and_remove
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
started_at: '2021-09-09T10:03:43.440+00:00'
worker: "/pulp/api/v3/workers/ec059f4c-140e-4075-9ef6-d406fcedcb4b/"
child_tasks: []
progress_reports: []
created_resources:
- ''
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- pulp_href: "/pulp/api/v3/tasks/c182237f-5c93-4e3d-9b2a-9062ee7f79cb/"
pulp_created: '2021-09-09T10:03:42.291+00:00'
state: completed
name: pulpcore.app.tasks.repository.add_and_remove
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
started_at: '2021-09-09T10:03:42.336+00:00'
finished_at: '2021-09-09T10:03:44.678+00:00'
worker: "/pulp/api/v3/workers/172f43a1-996b-4aea-9a76-ac992e3894d8/"
child_tasks: []
progress_reports: []
created_resources:
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/versions/29/"
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- pulp_href: "/pulp/api/v3/tasks/a4579e8e-71ac-4771-ac36-501ed6e6f847/"
pulp_created: '2021-09-09T10:03:42.362+00:00'
state: completed
name: pulpcore.app.tasks.repository.add_and_remove
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
started_at: '2021-09-09T10:03:44.736+00:00'
finished_at: '2021-09-09T10:03:45.129+00:00'
worker: "/pulp/api/v3/workers/172f43a1-996b-4aea-9a76-ac992e3894d8/"
child_tasks: []
progress_reports: []
created_resources:
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/versions/30/"
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- pulp_href: "/pulp/api/v3/tasks/9d5fef4c-2bcd-4d48-be17-e7956354208f/"
pulp_created: '2021-09-09T10:03:42.471+00:00'
state: completed
name: pulpcore.app.tasks.repository.add_and_remove
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
started_at: '2021-09-09T10:03:42.529+00:00'
finished_at: '2021-09-09T10:03:42.729+00:00'
worker: "/pulp/api/v3/workers/ec059f4c-140e-4075-9ef6-d406fcedcb4b/"
child_tasks: []
progress_reports: []
created_resources:
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/versions/6/"
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/"
- pulp_href: "/pulp/api/v3/tasks/bbce3145-0b85-4dfc-9d61-67c40f05368b/"
pulp_created: '2021-09-09T10:03:42.581+00:00'
state: completed
name: pulpcore.app.tasks.repository.add_and_remove
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
started_at: '2021-09-09T10:03:42.671+00:00'
finished_at: '2021-09-09T10:03:45.371+00:00'
worker: "/pulp/api/v3/workers/2a3cfeb4-faf4-4504-9c04-f296a99ede6c/"
child_tasks: []
progress_reports: []
created_resources:
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/versions/14/"
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/"
- pulp_href: "/pulp/api/v3/tasks/159f4aa2-9525-46b0-9dc4-5d334f589237/"
pulp_created: '2021-09-09T10:03:44.566+00:00'
state: waiting
name: pulp_rpm.app.tasks.copy.copy_content
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
child_tasks: []
progress_reports: []
created_resources: []
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/61fad74b-4d83-4b8c-acba-f8ca6278616a/"
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/"
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- "/pulp/api/v3/repositories/rpm/rpm/787f3878-67c4-488f-a290-e8932cfccb95/"
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/"
- "/pulp/api/v3/repositories/rpm/rpm/cec0ac99-ea41-471f-9e72-b63d1d5a4583/"
- "/pulp/api/v3/repositories/rpm/rpm/2d0225dd-f65e-492f-8f2d-06ec1be33ae9/"
- pulp_href: "/pulp/api/v3/tasks/ec69f182-aa0f-4b80-bf78-0e8fc4d0cf35/"
pulp_created: '2021-09-09T10:03:46.451+00:00'
state: waiting
name: pulp_rpm.app.tasks.copy.copy_content
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
child_tasks: []
progress_reports: []
created_resources: []
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/61fad74b-4d83-4b8c-acba-f8ca6278616a/"
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/"
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- "/pulp/api/v3/repositories/rpm/rpm/787f3878-67c4-488f-a290-e8932cfccb95/"
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/"
- "/pulp/api/v3/repositories/rpm/rpm/cec0ac99-ea41-471f-9e72-b63d1d5a4583/"
- "/pulp/api/v3/repositories/rpm/rpm/2d0225dd-f65e-492f-8f2d-06ec1be33ae9/"
- pulp_href: "/pulp/api/v3/tasks/3f3d49cc-fc15-41d2-ac12-ab59e3aa8f6d/"
pulp_created: '2021-09-09T10:03:46.871+00:00'
state: waiting
name: pulp_rpm.app.tasks.copy.copy_content
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
child_tasks: []
progress_reports: []
created_resources: []
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/61fad74b-4d83-4b8c-acba-f8ca6278616a/"
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/"
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- "/pulp/api/v3/repositories/rpm/rpm/787f3878-67c4-488f-a290-e8932cfccb95/"
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/"
- "/pulp/api/v3/repositories/rpm/rpm/cec0ac99-ea41-471f-9e72-b63d1d5a4583/"
- "/pulp/api/v3/repositories/rpm/rpm/2d0225dd-f65e-492f-8f2d-06ec1be33ae9/"
- pulp_href: "/pulp/api/v3/tasks/c314cb1e-4fc1-4bab-b6f5-8a75f03f4442/"
pulp_created: '2021-09-09T10:03:48.513+00:00'
state: waiting
name: pulp_rpm.app.tasks.copy.copy_content
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
child_tasks: []
progress_reports: []
created_resources: []
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/61fad74b-4d83-4b8c-acba-f8ca6278616a/"
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/"
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- "/pulp/api/v3/repositories/rpm/rpm/787f3878-67c4-488f-a290-e8932cfccb95/"
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/"
- "/pulp/api/v3/repositories/rpm/rpm/cec0ac99-ea41-471f-9e72-b63d1d5a4583/"
- "/pulp/api/v3/repositories/rpm/rpm/2d0225dd-f65e-492f-8f2d-06ec1be33ae9/"
- pulp_href: "/pulp/api/v3/tasks/fc2fb04a-ac9b-4087-833c-d4e5f2f51db4/"
pulp_created: '2021-09-09T10:03:48.633+00:00'
state: waiting
name: pulp_rpm.app.tasks.copy.copy_content
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
child_tasks: []
progress_reports: []
created_resources: []
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/61fad74b-4d83-4b8c-acba-f8ca6278616a/"
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/"
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- "/pulp/api/v3/repositories/rpm/rpm/787f3878-67c4-488f-a290-e8932cfccb95/"
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/"
- "/pulp/api/v3/repositories/rpm/rpm/cec0ac99-ea41-471f-9e72-b63d1d5a4583/"
- "/pulp/api/v3/repositories/rpm/rpm/2d0225dd-f65e-492f-8f2d-06ec1be33ae9/"
- pulp_href: "/pulp/api/v3/tasks/cd15cff0-b704-4909-bb59-5960a7658c81/"
pulp_created: '2021-09-09T10:03:48.883+00:00'
state: waiting
name: pulp_rpm.app.tasks.copy.copy_content
logging_cid: d5e3e73a-2d9f-4e98-b57a-fd4282b705a3
child_tasks: []
progress_reports: []
created_resources: []
reserved_resources_record:
- "/pulp/api/v3/repositories/rpm/rpm/61fad74b-4d83-4b8c-acba-f8ca6278616a/"
- "/pulp/api/v3/repositories/rpm/rpm/98a9f79c-fe16-4241-8cbd-ae17a724385a/"
- "/pulp/api/v3/repositories/rpm/rpm/3cbdb85f-28b8-4ad3-8b23-2f7cce718c52/"
- "/pulp/api/v3/repositories/rpm/rpm/787f3878-67c4-488f-a290-e8932cfccb95/"
- "/pulp/api/v3/repositories/rpm/rpm/1ed7e4cf-a8c7-423f-98b4-01ae9b18ef3d/"
- "/pulp/api/v3/repositories/rpm/rpm/eaa9beb3-3c1f-4ece-9414-8c8a75aa9b20/"
- "/pulp/api/v3/repositories/rpm/rpm/cec0ac99-ea41-471f-9e72-b63d1d5a4583/"
- "/pulp/api/v3/repositories/rpm/rpm/2d0225dd-f65e-492f-8f2d-06ec1be33ae9/"
task_groups: []
</pre>
<p>Pulp versions:</p>
<pre><code>root@foreman01 /root # pip3 list --format=columns| grep pulp
pulp-2to3-migration 0.12.0
pulp-ansible 0.9.0
pulp-certguard 1.4.0
pulp-container 2.7.1
pulp-deb 2.14.1
pulp-file 1.8.2
pulp-rpm 3.14.2
pulpcore 3.14.5
</code></pre> RPM Support - Issue #9337 (CLOSED - DUPLICATE): Dependency solving does not pull all stream depen...https://pulp.plan.io/issues/93372021-09-02T15:00:08Zdalleydalley@redhat.com
<p><strong>Ticket moved to GitHub</strong>: "pulp/pulp_rpm/2299":<a href="https://github.com/pulp/pulp_rpm/issues/2299" class="external">https://github.com/pulp/pulp_rpm/issues/2299</a></p> RPM Support - Issue #9336 (CLOSED - DUPLICATE): Assertion failure when performing depsolving-enab...https://pulp.plan.io/issues/93362021-09-02T14:57:42Zdalleydalley@redhat.comRPM Support - Issue #9331 (CLOSED - DUPLICATE): Dependency solver takes an extremely long time to...https://pulp.plan.io/issues/93312021-09-02T03:01:50Zdalleydalley@redhat.com
<p><strong>Ticket moved to GitHub</strong>: "pulp/pulp_rpm/2298":<a href="https://github.com/pulp/pulp_rpm/issues/2298" class="external">https://github.com/pulp/pulp_rpm/issues/2298</a></p> Pulp - Issue #9275 (CLOSED - CURRENTRELEASE): Content app db connection can be closed while match...https://pulp.plan.io/issues/92752021-08-23T15:28:21Zttereshcttereshc@redhat.com
<p>To reproduce (not reliably):</p>
<ul>
<li>sync/publish/distribute an on_demand kickstart repo</li>
<li>try to browse this repo</li>
<li>you likely need to have many other repositories in pulp.</li>
</ul>
<pre><code>Aug 18 09:42:49 ktordeur-testathon pulpcore-content: [2021-08-18 08:42:49 +0000] [27629] [ERROR] Error handling request
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: Traceback (most recent call last):
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 235, in _cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._prepare_cursor(self.create_cursor(name))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/postgresql/base.py", line 223, in create_cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: cursor = self.connection.cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: psycopg2.InterfaceError: connection already closed
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: The above exception was the direct cause of the following exception:
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: Traceback (most recent call last):
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib64/python3.6/site-packages/aiohttp/web_protocol.py", line 422, in _handle_request
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: resp = await self._request_handler(request)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib64/python3.6/site-packages/aiohttp/web_app.py", line 499, in _handle
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: resp = await handler(request)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 212, in stream_content
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return await self._match_and_stream(path, request)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 443, in _match_and_stream
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: distro = await loop.run_in_executor(None, match_distribution_blocking)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib64/python3.6/concurrent/futures/thread.py", line 56, in run
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: result = self.fn(*self.args, **self.kwargs)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 441, in match_distribution_blocking
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._match_distribution(path)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 256, in _match_distribution
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: .get(base_path__in=base_paths)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 402, in get
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: num = len(clone)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 256, in __len__
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: self._fetch_all()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: self._result_cache = list(self._iterable_class(self))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1140, in execute_sql
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: cursor = self.connection.cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 235, in _cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._prepare_cursor(self.create_cursor(name))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: raise dj_exc_value.with_traceback(traceback) from exc_value
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 235, in _cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._prepare_cursor(self.create_cursor(name))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/postgresql/base.py", line 223, in create_cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: cursor = self.connection.cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: django.db.utils.InterfaceError: connection already closed
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: [18/Aug/2021:08:42:49 +0000] "GET /pulp/content/Default_Organization/Library/content/dist/rhel8/8.4/x86_64/appstream/kickstart/ HTTP/1.1" 500 334 "-" "Mozilla/5.0 (X11; Fedora; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Safari/537.36"
</code></pre> RPM Support - Issue #9219 (CLOSED - DUPLICATE): Mirrored .treeinfo metadata needs to be rewritten...https://pulp.plan.io/issues/92192021-08-09T16:25:57Zdalleydalley@redhat.com
<p>When .treeinfo contains relative paths to a location outside of the repository, as is the case with CentOS 8, Pulp cannot serve those sub-repos precisely as they are. So it syncs all of them and publishes all of them into one repository with subdirectories for the sub-repos, and writes the locations of these sub-repos into the .treeinfo metadata.</p>
<p>In the mirrored metadata case, the .treeinfo file will be pointing to the wrong locations, so we need to rewrite the .treeinfo file just like we do during a standard publish.</p>
<p>As .treeinfo isn't checksummed or signed we aren't prevented from doing this.</p> Debian Support - Issue #9164 (CLOSED - CURRENTRELEASE): Dropping Python 3.6 and 3.7 from the 2.14...https://pulp.plan.io/issues/91642021-07-28T11:43:11Zquba42
<p>It looks like this was merged prematurely on my part.</p>
<p>Users have reported the following:</p>
<pre><code>I tried to update pulp_deb plugins using ansible but getting error as per below.
TASK [pulp.pulp_installer.pulp_common : Install prerequisites] ******************************************************************************************************************************************************************************
fatal: [pulptest008.karmalab.net]: FAILED! => {"changed": false, "msg": "No package matching 'rh-python38-python' found available, installed or updated", "rc": 126, "results": ["python-setuptools-0.9.8-7.el7.noarch providing python-setuptools is already installed", "No package matching 'rh-python38-python' found available, installed or updated"]}
</code></pre>
<p>Fresh installs are also suffering weird dependency effects where Python 3 is not being installed at all.</p> RPM Support - Issue #9133 (CLOSED - NOTABUG): RPM repository sync errorhttps://pulp.plan.io/issues/91332021-07-23T07:56:53Zgvde
<p>I have been collecting all information on this problem here: <a href="https://community.theforeman.org/t/centos-8-4-baseos-sync-error" class="external">https://community.theforeman.org/t/centos-8-4-baseos-sync-error</a></p>
<p>In short: occasionally my sync of the CentOS 8 BaseOS repository from centos.org ends with errors:</p>
<pre><code>Error message: the server returns an error
HTTP status code: 400
Response headers: {"date"=>"Thu, 22 Jul 2021 20:36:46 GMT", "server"=>"gunicorn", "content-type"=>"application/json", "vary"=>"Accept,Cookie", "allow"=>"GET, POST, HEAD, OPTIONS", "x-frame-options"=>"SAMEORIGIN", "content-length"=>"67", "correlation-id"=>"ded10b33-c063-4471-9182-3b62facbd36b", "access-control-expose-headers"=>"Correlation-ID", "via"=>"1.1 foreman.example.com", "connection"=>"close"}
Response body: {"repository_version":["Invalid hyperlink - Incorrect URL match."]}Error message: the server returns an error
HTTP status code: 400
Response headers: {"date"=>"Thu, 22 Jul 2021 20:36:47 GMT", "server"=>"gunicorn", "content-type"=>"application/json", "vary"=>"Accept,Cookie", "allow"=>"GET, POST, HEAD, OPTIONS", "x-frame-options"=>"SAMEORIGIN", "content-length"=>"112", "correlation-id"=>"ded10b33-c063-4471-9182-3b62facbd36b", "access-control-expose-headers"=>"Correlation-ID", "via"=>"1.1 foreman.example.com", "connection"=>"close"}
Response body: ["URI /pulp/api/v3/publications/rpm/rpm/1ad1ad0e-c9c1-42ef-94f6-0b188c29f72d/ not found for repositoryversion."]
</code></pre>
<p>I can access the mentioned publication URI via API:</p>
<pre><code># curl -s --cert /etc/pki/katello/certs/pulp-client.crt --key /etc/pki/katello/private/pulp-client.key 'https://foreman.dkrz.de/pulp/api/v3/publications/rpm/rpm/1ad1ad0e-c9c1-42ef-94f6-0b188c29f72d/' | python -m json.tool
{
"gpgcheck": 0,
"metadata_checksum_type": "unknown",
"package_checksum_type": "unknown",
"pulp_created": "2021-07-22T20:36:04.962028Z",
"pulp_href": "/pulp/api/v3/publications/rpm/rpm/1ad1ad0e-c9c1-42ef-94f6-0b188c29f72d/",
"repo_gpgcheck": 1,
"repository": "/pulp/api/v3/repositories/rpm/rpm/3f9dc526-a51c-4a25-9547-95f82bedb3ee/",
"repository_version": "/pulp/api/v3/repositories/rpm/rpm/3f9dc526-a51c-4a25-9547-95f82bedb3ee/versions/4/",
"sqlite_metadata": true
}
</code></pre>
<p>However, the repository for that is not found:</p>
<pre><code># curl -s --cert /etc/pki/katello/certs/pulp-client.crt --key /etc/pki/katello/private/pulp-client.key 'https://foreman.dkrz.de/pulp/api/v3/repositories/rpm/rpm/3f9dc526-a51c-4a25-9547-95f82bedb3ee/' | python -m json.tool
{
"detail": "Not found."
}
</code></pre>
<p>Checking the pulpcore database I can find both:</p>
<pre><code>pulpcore=# select * from rpm_rpmpublication where publication_ptr_id = '1ad1ad0e-c9c1-42ef-94f6-0b188c29f72d';
publication_ptr_id | metadata_checksum_type | package_checksum_type | gpgcheck | repo_gpgcheck | sqlite_metadata
--------------------------------------+------------------------+-----------------------+----------+---------------+-----------------
1ad1ad0e-c9c1-42ef-94f6-0b188c29f72d | unknown | unknown | 0 | 1 | t
(1 row)
pulpcore=# select * from rpm_rpmrepository where repository_ptr_id = '3f9dc526-a51c-4a25-9547-95f82bedb3ee';
repository_ptr_id | sub_repo | metadata_signing_service_id | last_sync_remote_id | last_sync_repo_version | last_sync_revision
_number | original_checksum_types
| retain_package_versions | last_sync_repomd_checksum | autopublish | gpgcheck
| metadata_checksum_type | package_checksum_type | repo_gpgcheck | sqlite_metadata
--------------------------------------+----------+-----------------------------+--------------------------------------+------------------------+-------------------
--------+----------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------+-------------------------+------------------------------------------------------------------+-------------+----------
+------------------------+-----------------------+---------------+-----------------
3f9dc526-a51c-4a25-9547-95f82bedb3ee | t | | 69abed5c-b1e1-452a-b58b-f0cc23548924 | 4 | 8.4.2105
| {"group": "sha256", "other": "sha256", "modules": "sha256", "primary": "sha256", "group_xz": "sha256", "other_db": "sha256", "filelists": "sha256", "prim
ary_db": "sha256", "filelists_db": "sha256"} | 0 | c21c5d2410544fccf2dcc78ce0f472fd8ed9d8c3fc0de1a8f8061a72629a5c7e | f | 0
| sha256 | sha256 | 0 | f
(1 row)
</code></pre> Debian Support - Task #8682 (CLOSED - CURRENTRELEASE): Migrate to new Distribution model for pulp...https://pulp.plan.io/issues/86822021-05-03T12:21:35Zquba42Debian Support - Issue #8671 (CLOSED - CURRENTRELEASE): Sync with Main Debian Repo fails on a tra...https://pulp.plan.io/issues/86712021-04-30T08:43:16Ztp-hlawatsch
<p>Hello everybody,</p>
<p>we plan to use pulp as our main tool for repos . We testing at the moment Debian mirroring
Our pulp testinstance is runing with the latest offical docker image</p>
<p>This is the configured remote repo</p>
<p>{
"name": "debian",
"url": "<a href="http://ftp.de.debian.org/debian/" class="external">http://ftp.de.debian.org/debian/</a>",
"ca_cert": null,
"client_cert": null,
"client_key": null,
"tls_validation": false,
"proxy_url": null,
"proxy_username": null,
"proxy_password": null,
"username": null,
"password": null,
"pulp_labels": {},
"download_concurrency": "10",
"policy": "immediate",
"total_timeout": null,
"connect_timeout": null,
"sock_connect_timeout": null,
"sock_read_timeout": null,
"rate_limit": null,
"distributions": "buster",
"components": "main",
"architectures": "amd64",
"sync_sources": false,
"sync_udebs": false,
"sync_installer": false,
"gpgkey": null,
"ignore_missing_package_indices": false
}</p>
<p>the sync run in to the following error</p>
<p>{
"pulp_href": "/pulp/api/v3/tasks/a7bd851b-f001-4f5f-89eb-0e0de529a556/",
"pulp_created": "2021-04-30T07:53:11.537345Z",
"state": "failed",
"name": "pulp_deb.app.tasks.synchronizing.synchronize",
"logging_cid": "00de2125667f4c7e8b8e01554c401eeb",
"started_at": "2021-04-30T07:53:11.648803Z",
"finished_at": "2021-04-30T07:53:19.135647Z",
"error": {
"traceback": " File "/usr/local/lib/python3.6/site-packages/rq/worker.py", line 1008, in perform_job\n rv = job.perform()\n File "/usr/local/lib/python3.6/site-packages/rq/job.py", line 706, in perform\n self._result = self._execute()\n File "/usr/local/lib/python3.6/site-packages/rq/job.py", line 729, in _execute\n result = self.func(*self.args, **self.kwargs)\n File "/usr/local/lib/python3.6/site-packages/pulp_deb/app/tasks/synchronizing.py", line 122, in synchronize\n DebDeclarativeVersion(first_stage, repository, mirror=mirror).create()\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 149, in create\n loop.run_until_complete(pipeline)\n File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete\n return future.result()\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline\n await asyncio.gather(*futures)\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in <strong>call</strong>\n await self.run()\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py", line 266, in run\n RemoteArtifact.objects.bulk_get_or_create(self._needed_remote_artifacts(batch))\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py", line 324, in _needed_remote_artifacts\n msg.format(rp=content_artifact.relative_path, c=d_content.content)\n",
"description": "No declared artifact with relative path "dists/buster/main/i18n/Translation-ml.bz2" for content """
},</p>
<p>We do not see a misconfiguration on our side so I raised this issue here</p>
<p>Regards
Stephan Hlawatsch</p> Debian Support - Task #8388 (CLOSED - CURRENTRELEASE): Handle ALLOWED_CONTENT_CHECKSUMS settinghttps://pulp.plan.io/issues/83882021-03-11T14:59:24Zquba42
<p>Right now the pulp_deb plugin is dependend on the following hashs being present on artifacts: md5, sha1, sha256, sha512.</p>
<p>Starting with pulpcore 3.11 will exclude md5 and sha1 from ALLOWED_CONTENT_CHECKSUMS by default.</p>
<p>Pulp deb will need to handle this gracefully. There is still some debate on whether pulp_deb makes sense without md5 feature wise. As a result, the solution may need to include demanding or encouraging a different configuration from pulp_deb users than the pulpcore default configuration.</p>
<p>See the following mailing list threads:</p>
<ul>
<li><a href="https://listman.redhat.com/archives/pulp-dev/2021-February/msg00017.html" class="external">https://listman.redhat.com/archives/pulp-dev/2021-February/msg00017.html</a></li>
<li><a href="https://listman.redhat.com/archives/pulp-dev/2021-March/msg00013.html" class="external">https://listman.redhat.com/archives/pulp-dev/2021-March/msg00013.html</a></li>
</ul> CertGuard - Issue #7182 (CLOSED - CURRENTRELEASE): The docs aren't buildinghttps://pulp.plan.io/issues/71822020-07-21T20:25:23Zbmbouterbmbouter@redhat.com
<a name="The-docs-site-on-RTD-is-no-longer-building"></a>
<h2 >The docs site on RTD is no longer building<a href="#The-docs-site-on-RTD-is-no-longer-building" class="wiki-anchor">¶</a></h2>
<p>You can see the 1.0.0 and 1.0.1 changelogs are not present: <a href="https://pulp-certguard.readthedocs.io/en/latest/changes.html" class="external">https://pulp-certguard.readthedocs.io/en/latest/changes.html</a></p>
<p>The last successful build was Completed June 30, 2020. 6:54 p.m from (6d951eb3203a19f627d1f3e0e729f8c3a3107c0b)</p>
<p>The RTD builder fails with:</p>
<pre><code>DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Collecting PyOpenSSL
Downloading pyOpenSSL-19.1.0-py2.py3-none-any.whl (53 kB)
ERROR: Could not find a version that satisfies the requirement pulpcore<3.6,>=3.3 (from -r requirements.txt (line 2)) (from versions: 3.0.0a1.dev3, 3.0.0a1.dev4, 3.0.0a1.dev5, 3.0.0a1, 3.0.0a2, 3.0.0a3, 3.0.0a4, 3.0.0a5, 3.0.0a6, 3.0.0a7, 3.0.0a8, 3.0.0a9, 3.0.0a10, 3.0.0a11, 3.0.0a12, 3.0.0a13, 3.0.0a14, 3.0.0a15, 3.0.0a16, 3.0.0a17, 3.0.0a18, 3.0.0a19, 3.0.0a20, 3.0.0a21, 3.0.0a22, 3.0.0a23, 3.0.0a24, 3.0.0a25, 3.0.0a26, 3.0.0a27, 3.0.0a28, 3.0.0a29, 3.0.0b1, 3.0.0b2, 3.0.0b3, 3.0.0b4, 3.0.0b5, 3.0.0b6, 3.0.0b7)
ERROR: No matching distribution found for pulpcore<3.6,>=3.3 (from -r requirements.txt (line 2))
</code></pre> Pulp - Story #3778 (CLOSED - CURRENTRELEASE): [Epic] As a user, I can run Pulp 3 in a FIPS-enable...https://pulp.plan.io/issues/37782018-06-21T16:13:49Zdaviddavis