Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2021-08-23T15:28:21ZPulp
Planio Pulp - Issue #9275 (CLOSED - CURRENTRELEASE): Content app db connection can be closed while match...https://pulp.plan.io/issues/92752021-08-23T15:28:21Zttereshcttereshc@redhat.com
<p>To reproduce (not reliably):</p>
<ul>
<li>sync/publish/distribute an on_demand kickstart repo</li>
<li>try to browse this repo</li>
<li>you likely need to have many other repositories in pulp.</li>
</ul>
<pre><code>Aug 18 09:42:49 ktordeur-testathon pulpcore-content: [2021-08-18 08:42:49 +0000] [27629] [ERROR] Error handling request
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: Traceback (most recent call last):
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 235, in _cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._prepare_cursor(self.create_cursor(name))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/postgresql/base.py", line 223, in create_cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: cursor = self.connection.cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: psycopg2.InterfaceError: connection already closed
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: The above exception was the direct cause of the following exception:
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: Traceback (most recent call last):
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib64/python3.6/site-packages/aiohttp/web_protocol.py", line 422, in _handle_request
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: resp = await self._request_handler(request)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib64/python3.6/site-packages/aiohttp/web_app.py", line 499, in _handle
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: resp = await handler(request)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 212, in stream_content
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return await self._match_and_stream(path, request)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 443, in _match_and_stream
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: distro = await loop.run_in_executor(None, match_distribution_blocking)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib64/python3.6/concurrent/futures/thread.py", line 56, in run
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: result = self.fn(*self.args, **self.kwargs)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 441, in match_distribution_blocking
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._match_distribution(path)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/pulpcore/content/handler.py", line 256, in _match_distribution
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: .get(base_path__in=base_paths)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 402, in get
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: num = len(clone)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 256, in __len__
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: self._fetch_all()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: self._result_cache = list(self._iterable_class(self))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1140, in execute_sql
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: cursor = self.connection.cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 235, in _cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._prepare_cursor(self.create_cursor(name))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: raise dj_exc_value.with_traceback(traceback) from exc_value
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 235, in _cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: return self._prepare_cursor(self.create_cursor(name))
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: File "/usr/lib/python3.6/site-packages/django/db/backends/postgresql/base.py", line 223, in create_cursor
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: cursor = self.connection.cursor()
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: django.db.utils.InterfaceError: connection already closed
Aug 18 09:42:49 ktordeur-testathon pulpcore-content: [18/Aug/2021:08:42:49 +0000] "GET /pulp/content/Default_Organization/Library/content/dist/rhel8/8.4/x86_64/appstream/kickstart/ HTTP/1.1" 500 334 "-" "Mozilla/5.0 (X11; Fedora; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Safari/537.36"
</code></pre> Debian Support - Issue #9164 (CLOSED - CURRENTRELEASE): Dropping Python 3.6 and 3.7 from the 2.14...https://pulp.plan.io/issues/91642021-07-28T11:43:11Zquba42
<p>It looks like this was merged prematurely on my part.</p>
<p>Users have reported the following:</p>
<pre><code>I tried to update pulp_deb plugins using ansible but getting error as per below.
TASK [pulp.pulp_installer.pulp_common : Install prerequisites] ******************************************************************************************************************************************************************************
fatal: [pulptest008.karmalab.net]: FAILED! => {"changed": false, "msg": "No package matching 'rh-python38-python' found available, installed or updated", "rc": 126, "results": ["python-setuptools-0.9.8-7.el7.noarch providing python-setuptools is already installed", "No package matching 'rh-python38-python' found available, installed or updated"]}
</code></pre>
<p>Fresh installs are also suffering weird dependency effects where Python 3 is not being installed at all.</p> Debian Support - Issue #8910 (CLOSED - CURRENTRELEASE): When syncing with architecture filtering,...https://pulp.plan.io/issues/89102021-06-17T09:33:41Zquba42
<p>In addition to upstream repos using this format, this also affects pulp_deb (APT publisher) to pulp_deb syncs.</p>
<p>See also: <a href="https://community.theforeman.org/t/katello-3-18-debian-packages-are-not-fully-synchronized-on-smart-proxy/24047" class="external">https://community.theforeman.org/t/katello-3-18-debian-packages-are-not-fully-synchronized-on-smart-proxy/24047</a></p> RPM Support - Issue #8700 (CLOSED - CURRENTRELEASE): CentOS 8 stream repositories fails to synchr...https://pulp.plan.io/issues/87002021-05-05T12:30:27Zadam.tkac@gooddata.com
<p>Hello pulp upstream,</p>
<p>we are regularly mirroring various CentOS stream repos, but recently "sync" tasks started to fail with following traceback:</p>
<pre><code class="text syntaxhl" data-language="text">May 5 12:20:22 pulp32 rq[2083851]: Traceback (most recent call last):
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/rq/worker.py", line 1008, in perform_job
May 5 12:20:22 pulp32 rq[2083851]: rv = job.perform()
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/rq/job.py", line 706, in perform
May 5 12:20:22 pulp32 rq[2083851]: self._result = self._execute()
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/rq/job.py", line 729, in _execute
May 5 12:20:22 pulp32 rq[2083851]: result = self.func(*self.args, **self.kwargs)
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 255, in synchronize
May 5 12:20:22 pulp32 rq[2083851]: dv.create()
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 149, in create
May 5 12:20:22 pulp32 rq[2083851]: loop.run_until_complete(pipeline)
May 5 12:20:22 pulp32 rq[2083851]: File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
May 5 12:20:22 pulp32 rq[2083851]: return future.result()
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
May 5 12:20:22 pulp32 rq[2083851]: await asyncio.gather(*futures)
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in __call__
May 5 12:20:22 pulp32 rq[2083851]: await self.run()
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 439, in run
May 5 12:20:22 pulp32 rq[2083851]: await self.parse_modules_metadata()
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 495, in parse_modules_metadata
May 5 12:20:22 pulp32 rq[2083851]: modules_metadata_parser.parse()
May 5 12:20:22 pulp32 rq[2083851]: File "/opt/gdc/pulp3/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 747, in parse
May 5 12:20:22 pulp32 rq[2083851]: content = moduleyaml.read()
May 5 12:20:22 pulp32 rq[2083851]: File "/usr/lib64/python3.6/codecs.py", line 321, in decode
May 5 12:20:22 pulp32 rq[2083851]: (result, consumed) = self._buffer_decode(data, self.errors, final)
May 5 12:20:22 pulp32 rq[2083851]: UnicodeDecodeError: 'utf-8' codec can't decode byte 0xfd in position 0: invalid start byte
</code></pre>
<p>We are using following versions:</p>
<pre><code class="text syntaxhl" data-language="text">[root@pulp32:~] pulp status
{
"versions": [
{
"component": "core",
"version": "3.12.1"
},
{
"component": "rpm",
"version": "3.10.0"
},
{
"component": "file",
"version": "1.7.0"
}
</code></pre>
<p>Remote configuration:</p>
<pre><code class="text syntaxhl" data-language="text">[root@pulp32:~] pulp rpm remote show --name c8s-baseos-remote
{
"pulp_href": "/pulp/api/v3/remotes/rpm/rpm/dc58e56e-4a00-47f1-af0d-a9b6786af51c/",
"pulp_created": "2021-05-05T02:44:02.345456Z",
"name": "c8s-baseos-remote",
"url": "http://mirror.centos.org/centos/8-stream/BaseOS/x86_64/os/",
"ca_cert": null,
"client_cert": null,
"tls_validation": true,
"proxy_url": null,
"pulp_labels": {},
"pulp_last_updated": "2021-05-05T02:44:02.345474Z",
"download_concurrency": 10,
"policy": "immediate",
"total_timeout": null,
"connect_timeout": null,
"sock_connect_timeout": null,
"sock_read_timeout": null,
"headers": null,
"rate_limit": null,
"sles_auth_token": null
}
</code></pre>
<p>How to reproduce:</p>
<pre><code class="text syntaxhl" data-language="text">[root@pulp32:~] pulp rpm repository sync --name c8s-baseos --remote c8s-baseos-remote
Started background task /pulp/api/v3/tasks/e50f608f-9bf7-48a9-ad6a-03efb34014d6/
.Error: Task /pulp/api/v3/tasks/e50f608f-9bf7-48a9-ad6a-03efb34014d6/ failed: ''utf-8' codec can't decode byte 0xfd in position 0: invalid start byte'
</code></pre>
<p>Please let me know if you need any more details. Thank you in advance!</p> Debian Support - Task #8682 (CLOSED - CURRENTRELEASE): Migrate to new Distribution model for pulp...https://pulp.plan.io/issues/86822021-05-03T12:21:35Zquba42Debian Support - Issue #8671 (CLOSED - CURRENTRELEASE): Sync with Main Debian Repo fails on a tra...https://pulp.plan.io/issues/86712021-04-30T08:43:16Ztp-hlawatsch
<p>Hello everybody,</p>
<p>we plan to use pulp as our main tool for repos . We testing at the moment Debian mirroring
Our pulp testinstance is runing with the latest offical docker image</p>
<p>This is the configured remote repo</p>
<p>{
"name": "debian",
"url": "<a href="http://ftp.de.debian.org/debian/" class="external">http://ftp.de.debian.org/debian/</a>",
"ca_cert": null,
"client_cert": null,
"client_key": null,
"tls_validation": false,
"proxy_url": null,
"proxy_username": null,
"proxy_password": null,
"username": null,
"password": null,
"pulp_labels": {},
"download_concurrency": "10",
"policy": "immediate",
"total_timeout": null,
"connect_timeout": null,
"sock_connect_timeout": null,
"sock_read_timeout": null,
"rate_limit": null,
"distributions": "buster",
"components": "main",
"architectures": "amd64",
"sync_sources": false,
"sync_udebs": false,
"sync_installer": false,
"gpgkey": null,
"ignore_missing_package_indices": false
}</p>
<p>the sync run in to the following error</p>
<p>{
"pulp_href": "/pulp/api/v3/tasks/a7bd851b-f001-4f5f-89eb-0e0de529a556/",
"pulp_created": "2021-04-30T07:53:11.537345Z",
"state": "failed",
"name": "pulp_deb.app.tasks.synchronizing.synchronize",
"logging_cid": "00de2125667f4c7e8b8e01554c401eeb",
"started_at": "2021-04-30T07:53:11.648803Z",
"finished_at": "2021-04-30T07:53:19.135647Z",
"error": {
"traceback": " File "/usr/local/lib/python3.6/site-packages/rq/worker.py", line 1008, in perform_job\n rv = job.perform()\n File "/usr/local/lib/python3.6/site-packages/rq/job.py", line 706, in perform\n self._result = self._execute()\n File "/usr/local/lib/python3.6/site-packages/rq/job.py", line 729, in _execute\n result = self.func(*self.args, **self.kwargs)\n File "/usr/local/lib/python3.6/site-packages/pulp_deb/app/tasks/synchronizing.py", line 122, in synchronize\n DebDeclarativeVersion(first_stage, repository, mirror=mirror).create()\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 149, in create\n loop.run_until_complete(pipeline)\n File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete\n return future.result()\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline\n await asyncio.gather(*futures)\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in <strong>call</strong>\n await self.run()\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py", line 266, in run\n RemoteArtifact.objects.bulk_get_or_create(self._needed_remote_artifacts(batch))\n File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py", line 324, in _needed_remote_artifacts\n msg.format(rp=content_artifact.relative_path, c=d_content.content)\n",
"description": "No declared artifact with relative path "dists/buster/main/i18n/Translation-ml.bz2" for content """
},</p>
<p>We do not see a misconfiguration on our side so I raised this issue here</p>
<p>Regards
Stephan Hlawatsch</p> Debian Support - Issue #8506 (CLOSED - CURRENTRELEASE): apt install - File has unexpected size - ...https://pulp.plan.io/issues/85062021-04-02T18:01:50Zrgp
<p>Apt install downloads packages by default using http pipelining. However, apt relies on "Size" field from "Packages" file to match responses, but pulp_deb repos do not appear to have it. In certain condition that causes apt to fail.</p>
<pre><code>root@aptbug:~# curl -sS https://repo.saltproject.io/py3/ubuntu/18.04/amd64/latest/dists/bionic/main/binary-amd64/Packages | grep -c ^Size
14
root@aptbug:~# curl -sS http://foreman.example.com/pulp/deb/MyOrg/Library/custom/Saltstack/ubuntu_18_04_salt_latest/dists/default/all/binary-amd64/Packages | grep -c ^Size
0
</code></pre>
<p>More details: <a href="https://projects.theforeman.org/issues/32178#note-9" class="external">https://projects.theforeman.org/issues/32178#note-9</a></p> Debian Support - Task #8388 (CLOSED - CURRENTRELEASE): Handle ALLOWED_CONTENT_CHECKSUMS settinghttps://pulp.plan.io/issues/83882021-03-11T14:59:24Zquba42
<p>Right now the pulp_deb plugin is dependend on the following hashs being present on artifacts: md5, sha1, sha256, sha512.</p>
<p>Starting with pulpcore 3.11 will exclude md5 and sha1 from ALLOWED_CONTENT_CHECKSUMS by default.</p>
<p>Pulp deb will need to handle this gracefully. There is still some debate on whether pulp_deb makes sense without md5 feature wise. As a result, the solution may need to include demanding or encouraging a different configuration from pulp_deb users than the pulpcore default configuration.</p>
<p>See the following mailing list threads:</p>
<ul>
<li><a href="https://listman.redhat.com/archives/pulp-dev/2021-February/msg00017.html" class="external">https://listman.redhat.com/archives/pulp-dev/2021-February/msg00017.html</a></li>
<li><a href="https://listman.redhat.com/archives/pulp-dev/2021-March/msg00013.html" class="external">https://listman.redhat.com/archives/pulp-dev/2021-March/msg00013.html</a></li>
</ul> Debian Support - Issue #8232 (CLOSED - CURRENTRELEASE): APT publications do not retain all fields...https://pulp.plan.io/issues/82322021-02-09T15:26:04Zmathiasdasilva
<p>Dear support,</p>
<p>When we plug our servers to our apt pulp repository, same packages are installed again an again.
I checked and there is a difference between source package manifest and pulp deb manifest.
There is an example for wget :</p>
<p>Ubuntu repository :</p>
<p>Package: wget
Architecture: amd64
Version: 1.20.3-1ubuntu1
Multi-Arch: foreign
Priority: standard
Section: web
Origin: Ubuntu
Maintainer: Ubuntu Developers <a href="mailto:ubuntu-devel-discuss@lists.ubuntu.com" class="email">ubuntu-devel-discuss@lists.ubuntu.com</a>
Original-Maintainer: Noël Köthe <a href="mailto:noel@debian.org" class="email">noel@debian.org</a>
Bugs: <a href="https://bugs.launchpad.net/ubuntu/+filebug" class="external">https://bugs.launchpad.net/ubuntu/+filebug</a>
Installed-Size: 992
Depends: libc6 (>= 2.17), libidn2-0 (>= 0.6), libpcre2-8-0 (>= 10.32), libpsl5 (>= 0.16.0), libssl1.1 (>= 1.1.0), libuuid1 (>= 2.16), zlib1g (>= 1:1.1.4)
Recommends: ca-certificates
Conflicts: wget-ssl
Filename: pool/main/w/wget/wget_1.20.3-1ubuntu1_amd64.deb
Size: 348824
MD5sum: ae9eb859432505828dab97c80edcb5b5
SHA1: 45504b6e948d4f1a7e2ba0233bb57a67b392ceea
SHA256: 68144dde6d45e1a54fa983d6d10be7043e6695e259c8d2b12fd03ea5e475d56a
Homepage: <a href="https://www.gnu.org/software/wget/" class="external">https://www.gnu.org/software/wget/</a>
Description: retrieves files from the web
Task: standard
Description-md5: 63a4a740bcd9e8e94bf661e4f1806e02</p>
<p>Pulp repository :
Package: wget
Version: 1.20.3-1ubuntu1
Architecture: amd64
Section: web
Priority: standard
Origin: Ubuntu
Bugs: <a href="https://bugs.launchpad.net/ubuntu/+filebug" class="external">https://bugs.launchpad.net/ubuntu/+filebug</a>
Installed-Size: 992
Maintainer: Ubuntu Developers <a href="mailto:ubuntu-devel-discuss@lists.ubuntu.com" class="email">ubuntu-devel-discuss@lists.ubuntu.com</a>
Description: retrieves files from the web
Homepage: <a href="https://www.gnu.org/software/wget/" class="external">https://www.gnu.org/software/wget/</a>
Conflicts: wget-ssl
Depends: libc6 (>= 2.17), libidn2-0 (>= 0.6), libpcre2-8-0 (>= 10.32), libpsl5 (>= 0.16.0), libssl1.1 (>= 1.1.0), libuuid1 (>= 2.16), zlib1g (>= 1:1.1.4)
Recommends: ca-certificates
MD5sum: ae9eb859432505828dab97c80edcb5b5
SHA1: 45504b6e948d4f1a7e2ba0233bb57a67b392ceea
SHA256: 68144dde6d45e1a54fa983d6d10be7043e6695e259c8d2b12fd03ea5e475d56a
Filename: pool/main/w/wget/wget_1.20.3-1ubuntu1_amd64.deb</p>
<p>This behavior seems to be identical to this ticket : <a href="https://pulp.plan.io/issues/7190" class="external">https://pulp.plan.io/issues/7190</a></p>
<p>Pulp version:</p>
<p>Pulp core: 3.9.0
Pulp deb: 2.9.0</p>
<p>Best regards,</p> Debian Support - Issue #7467 (CLOSED - CURRENTRELEASE): Missing architectures specified in Releas...https://pulp.plan.io/issues/74672020-09-07T13:50:18Zmbucher
<p>I am trying to sync release <code>focal-security</code> with components <code>main universe non-free</code> from <code>http://security.ubuntu.com/ubuntu/</code>.
This fails because the Release-file defines some architecture-files that are not present.
According to <a href="https://wiki.debian.org/DebianRepository/Format#Architectures" class="external">https://wiki.debian.org/DebianRepository/Format#Architectures</a> , architectures that are defined but not present, should be regarded as present but empty.</p>
<p>However, I am unsure if this also applies here, because here the Architectures are defined and even hashes for the Index files are defined, but are missing in the directory-structure. Persumably Ubuntu does this to not have to re-sign the Release-files.</p>
<pre><code> error:
traceback: |2
File "/usr/lib/python3.6/site-packages/rq/worker.py", line 883, in perform_job
rv = job.perform()
File "/usr/lib/python3.6/site-packages/rq/job.py", line 657, in perform
self._result = self._execute()
File "/usr/lib/python3.6/site-packages/rq/job.py", line 663, in _execute
return self.func(*self.args, **self.kwargs)
File "/usr/local/lib/python3.6/site-packages/pulp_deb/app/tasks/synchronizing.py", line 106, in synchronize
DebDeclarativeVersion(first_stage, repository, mirror=mirror).create()
File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 148, in create
loop.run_until_complete(pipeline)
File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
return future.result()
File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
await asyncio.gather(*futures)
File "/usr/local/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in __call__
await self.run()
File "/usr/local/lib/python3.6/site-packages/pulp_deb/app/tasks/synchronizing.py", line 286, in run
raise NoPackageIndexFile(relative_dir=relative_dir)
description: No suitable Package index file found in 'dists/focal-security/main/binary-armhf'.
</code></pre> Debian Support - Issue #7295 (CLOSED - CURRENTRELEASE): Structured publish for synced repos with ...https://pulp.plan.io/issues/72952020-08-10T09:29:45Zquba42
<p>See here: <a href="https://wiki.debian.org/DebianRepository/Format#Components" class="external">https://wiki.debian.org/DebianRepository/Format#Components</a></p>
<p>"(Components) May also be prefixed by parts of the path following the directory beneath dists, if the Release file is not in a directory directly beneath dists/."</p>
<p>The structured publisher builds the following path for package indices:</p>
<p>REPO_ROOT + "dists/" + DISTRIBUTION + COMPONENT + "/binary-" + ARCHITECTURE + "/" + FILENAME</p>
<p>The problem is that DISTRIBUTION already includes the extra path prefixes that may also be included in COMPONENT, causing them to be duplicated in the path.</p>
<p>The solution is to strip any prefixes from the COMPONENT as extracted from the Release files when building paths.</p> Debian Support - Issue #7257 (CLOSED - CURRENTRELEASE): Many pulp_deb control file fields are lim...https://pulp.plan.io/issues/72572020-08-03T13:13:18Zquba42
<p>This results in the following error when trying to sync or upload packages with too much data within some field:</p>
<p>django.db.utils.DataError: value too long for type character varying(255)</p>
<p>Can be reproduced using:</p>
<pre><code class="text syntaxhl" data-language="text">wget http://ftp.de.debian.org/debian/pool/main/b/burrow/burrow_1.2.1-1_amd64.deb
</code></pre>
<p>("Built-Using" field is too long.)</p>
<p>Proposal: Convert all fields were we are not certain they won't exceed the limit from CharField to TextField</p> CertGuard - Issue #7182 (CLOSED - CURRENTRELEASE): The docs aren't buildinghttps://pulp.plan.io/issues/71822020-07-21T20:25:23Zbmbouterbmbouter@redhat.com
<a name="The-docs-site-on-RTD-is-no-longer-building"></a>
<h2 >The docs site on RTD is no longer building<a href="#The-docs-site-on-RTD-is-no-longer-building" class="wiki-anchor">¶</a></h2>
<p>You can see the 1.0.0 and 1.0.1 changelogs are not present: <a href="https://pulp-certguard.readthedocs.io/en/latest/changes.html" class="external">https://pulp-certguard.readthedocs.io/en/latest/changes.html</a></p>
<p>The last successful build was Completed June 30, 2020. 6:54 p.m from (6d951eb3203a19f627d1f3e0e729f8c3a3107c0b)</p>
<p>The RTD builder fails with:</p>
<pre><code>DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Collecting PyOpenSSL
Downloading pyOpenSSL-19.1.0-py2.py3-none-any.whl (53 kB)
ERROR: Could not find a version that satisfies the requirement pulpcore<3.6,>=3.3 (from -r requirements.txt (line 2)) (from versions: 3.0.0a1.dev3, 3.0.0a1.dev4, 3.0.0a1.dev5, 3.0.0a1, 3.0.0a2, 3.0.0a3, 3.0.0a4, 3.0.0a5, 3.0.0a6, 3.0.0a7, 3.0.0a8, 3.0.0a9, 3.0.0a10, 3.0.0a11, 3.0.0a12, 3.0.0a13, 3.0.0a14, 3.0.0a15, 3.0.0a16, 3.0.0a17, 3.0.0a18, 3.0.0a19, 3.0.0a20, 3.0.0a21, 3.0.0a22, 3.0.0a23, 3.0.0a24, 3.0.0a25, 3.0.0a26, 3.0.0a27, 3.0.0a28, 3.0.0a29, 3.0.0b1, 3.0.0b2, 3.0.0b3, 3.0.0b4, 3.0.0b5, 3.0.0b6, 3.0.0b7)
ERROR: No matching distribution found for pulpcore<3.6,>=3.3 (from -r requirements.txt (line 2))
</code></pre> Pulp - Test #4383 (CLOSED - COMPLETE): Test Pulp on S3https://pulp.plan.io/issues/43832019-02-05T20:19:04Zdaviddavis
<p>Consider using Ceph which has an S3 REST API:</p>
<p><a href="http://docs.ceph.com/docs/mimic/radosgw/s3/" class="external">http://docs.ceph.com/docs/mimic/radosgw/s3/</a></p> Pulp - Story #3778 (CLOSED - CURRENTRELEASE): [Epic] As a user, I can run Pulp 3 in a FIPS-enable...https://pulp.plan.io/issues/37782018-06-21T16:13:49Zdaviddavis