Project

Profile

Help

Issue #6920

closed

Pulp 3 - pulp-deb : Issue synchronizing bullseye-security repo

Added by swisscom over 4 years ago. Updated about 3 years ago.

Status:
CLOSED - WORKSFORME
Priority:
Normal
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version - Debian:
master
Platform Release:
Target Release - Debian:
OS:
CentOS 7
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Katello
Sprint:
Quarter:

Description

Dear support team,

I just discovered that the sync task fails when bullseye-security distribution is included in a remote, like the following :

        {
            "architectures": "amd64", 
            "ca_cert": null, 
            "client_cert": null, 
            "client_key": null, 
            "components": null, 
            "distributions": "bullseye-security", 
            "download_concurrency": 20, 
            "gpgkey": null, 
            "name": "debian-security", 
            "policy": "on_demand", 
            "proxy_url": null, 
            "pulp_created": "2020-06-08T07:33:26.302753Z", 
            "pulp_href": "/pulp/api/v3/remotes/deb/apt/d394132f-413f-416b-b5aa-64e5e6883179/", 
            "pulp_last_updated": "2020-06-08T07:56:41.103430Z", 
            "sync_installer": false, 
            "sync_sources": false, 
            "sync_udebs": false, 
            "tls_validation": true, 
            "url": "http://security.debian.org/debian-security/"
        }, 

The error is the following :

File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line 886, in perform_job\n    rv = job.perform()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 664, in perform\n    self._result = self._execute()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 670, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_deb/app/tasks/synchronizing.py\", line 106, in synchronize\n    DebDeclarativeVersion(first_stage, repository, mirror=mirror).create()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\", line 149, in create\n    loop.run_until_complete(pipeline)\n  File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n    return future.result()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 228, in create_pipeline\n    await asyncio.gather(*futures)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 43, in __call__\n    await self.run()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/content_stages.py\", line 120, in run\n    ContentArtifact.objects.bulk_get_or_create(content_artifact_bulk)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/app/models/content.py\", line 55, in bulk_get_or_create\n    objs[i] = objs[i].__class__.objects.get(objs[i].q())\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/manager.py\", line 82, in manager_method\n    return getattr(self.get_queryset(), name)(*args, **kwargs)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py\", line 408, in get\n    self.model._meta.object_name\n

If I patch the remote and include some components like "main contrib", the sync task do not fail anymore but the resulting publication's (dists/bullseye-security) contain only the Release file, not the "main" and "contrib" directories.

So I guess Pulp has an issue to discover the components of bullseye-security remote

Any idea if the issue resides on Pulp side or on the remote itself ?


Related issues

Related to Debian Support - Test #6051: Add tests for known cases where the distribution is not the codename or suiteCLOSED - COMPLETEquba42Actions
Related to Debian Support - Issue #8028: Cannot sync Ubuntu repositoriesCLOSED - WORKSFORMEActions

Also available in: Atom PDF