Pulp

This is happens on master but not 100% reproducible.

After pclean and prestart create a repo and a remote( with corrupted upstream repo) , trigger sync. In my case I had a container repo which was missing files. on 404 pulp gave up on backoff, reports states were flipped to canceled meanwhile overall task state remained running

(pulp) [vagrant@pulp3-source-fedora32 _scripts]$ http  :24817/pulp/api/v3/tasks/
HTTP/1.1 200 OK
Access-Control-Expose-Headers: Correlation-ID
Allow: GET, HEAD, OPTIONS
Connection: close
Content-Length: 1102
Content-Type: application/json
Correlation-ID: 83f0319d8b464bf8b150b6ef0c67e5dd
Date: Thu, 15 Apr 2021 15:58:35 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN

{
    "count": 1,
    "next": null,
    "previous": null,
    "results": [
        {
            "child_tasks": [],
            "created_resources": [],
            "error": null,
            "finished_at": null,
            "logging_cid": "a47f9ae4316447dab5d287acb64ac652",
            "name": "pulp_container.app.tasks.synchronize.synchronize",
            "parent_task": null,
            "progress_reports": [
                {
                    "code": "sync.downloading.tag_list",
                    "done": 1,
                    "message": "Downloading tag list",
                    "state": "completed",
                    "suffix": null,
                    "total": 1
                },
                {
                    "code": "sync.downloading.artifacts",
                    "done": 0,
                    "message": "Downloading Artifacts",
                    "state": "canceled",
                    "suffix": null,
                    "total": null
                },
                {
                    "code": "associating.content",
                    "done": 0,
                    "message": "Associating Content",
                    "state": "canceled",
                    "suffix": null,
                    "total": null
                }
            ],
            "pulp_created": "2021-04-15T15:50:25.872155Z",
            "pulp_href": "/pulp/api/v3/tasks/3e8611c8-03d7-4bc6-ab4d-704ca903fe55/",
            "reserved_resources_record": [
                "/pulp/api/v3/repositories/container/container/27afa91e-5e99-444f-8ef1-4beac1626eb8/",
                "/pulp/api/v3/remotes/container/container/70bb5002-ad17-4f35-adbf-8518d90fa4ef/"
            ],
            "started_at": "2021-04-15T15:50:25.984691Z",
            "state": "running",
            "task_group": null,
            "worker": "/pulp/api/v3/workers/fe8928f3-589d-43bc-973b-47974661ebbc/"
        }
    ]
}

Apr 15 16:03:50 pulp3-source-fedora32.lan rq[43524]: pulp [46ce1d38b8244cfda5abc50347138e14]: backoff:ERROR: Giving up _run(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('http://pulp>
Apr 15 16:03:50 pulp3-source-fedora32.lan rq[43524]: Giving up _run(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('http://pulp2-nightly-pulp3-source-centos7.lan/pulp/container/ocp3-c>
Apr 15 16:03:50 pulp3-source-fedora32.lan rq[43524]: pulp [46ce1d38b8244cfda5abc50347138e14]: pulp_container.app.tasks.synchronize:INFO: Synchronizing: repository=cnbhm remote=my-hello-repo