Issue #9594: Sync repo from registry requiring authentication fails - Docker Support - Pulp

Actions

Send by e-mail Copy link

Issue #9594

closed

Sync repo from registry requiring authentication fails

Added by yuzheng about 3 years ago. Updated about 3 years ago.

Status:

MODIFIED

Priority:

Normal

Assignee:

Start date:

Due date:

Estimated time:

Severity:

2. Medium

Version - Docker:

Platform Release:

Target Release - Docker:

OS:

Triaged:

Groomed:

Sprint Candidate:

Tags:

Pulp 2

Sprint:

Quarter:

Description

Sync from a private repo in quay.io with basic auth credentials:

$ curl -X POST -u admin:admin -d '{"override_config": {"feed": "https://quay.io", "upstream_name": "redhat-dev/test----repo114", "tags": ["latest"], "basic_auth_username": "redhat-dev+copy_test", "basic_auth_password": "'$quay_password'"}}' https://docker-pulp-httpd/pulp/api/v2/repositories/redhat-operators/actions/sync/

The sync task fails with log:

Dec  1 03:54:45 docker-pulp-httpd pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.sync.sync[ddd7a76a-87ab-4cde-a1f6-a5321f005ec5]
...
Dec  1 03:54:45 docker-pulp-httpd pulp: nectar.downloaders.threaded:INFO: [ddd7a76a] Download succeeded: https://quay.io/v2/redhat-dev/test----repo114/tags/list.
...
Dec  1 03:54:45 docker-pulp-httpd pulp: nectar.downloaders.threaded:INFO: [ddd7a76a] Download succeeded: https://quay.io/v2/redhat-dev/test----repo114/manifests/latest.
...
Dec  1 03:54:45 docker-pulp-httpd pulp: nectar.downloaders.threaded:INFO: [ddd7a76a] Download succeeded: https://quay.io/v2/redhat-dev/test----repo114/manifests/sha256:37daa087fa88d8f5f0f97ba58e4facbba81e87513d6d6584bcf0f6417e994bd1.
...
Dec  1 03:54:46 docker-pulp-httpd pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://quay.io/v2/redhat-dev/test----repo114/blobs/sha256:41c24cf3eae7653c4ff3c0e8762ce2ffb21b8da07715e874bc7b901cc3227e8b failed with code 401: UNAUTHORIZED
...
Dec  1 03:54:46 docker-pulp-httpd pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://quay.io/v2/redhat-dev/test----repo114/blobs/sha256:41c24cf3eae7653c4ff3c0e8762ce2ffb21b8da07715e874bc7b901cc3227e8b failed with code 401: UNAUTHORIZED
...
Dec  1 03:54:47 docker-pulp-httpd pulp: pulp.server.async.tasks:INFO: [ddd7a76a] Task failed : [ddd7a76a-87ab-4cde-a1f6-a5321f005ec5] : Image download(s) from https://quay.io/v2/redhat-dev/test----repo114/blobs/sha256:41c24cf3eae7653c4ff3c0e8762ce2ffb21b8da07715e874bc7b901cc3227e8b failed. Sync task has failed to prevent a corrupted repository.

It can download tag list and manifests successfully, but has trouble to download blobs.

Pulp version:

# rpm -qa | grep pulp-docker
python-pulp-docker-common-3.2.3-3.el7eng.noarch
pulp-docker-plugins-3.2.3-3.el7eng.noarch
pulp-docker-admin-extensions-3.2.3-3.el7eng.noarch

Added by yuzheng about 3 years ago

Revision 89e5ec82 | View on GitHub

Fix issue of sync repo with auth

Downloading blobs fails because token auth is set in request headers while nectar adds basic auth in the request. Remove auth credentials from downloader config so that nectar won't add basic auth.