Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #8275

closed

ComplexRepoMigration fails with "file doesn't exists or not a regular file"

Added by laugmanuel@gmail.com about 3 years ago. Updated over 2 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
ggainey
Sprint/Milestone:
3.14.0
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
RHEL 7
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Katello
Sprint:
Sprint 101
Quarter:

Description

Hello,

currently I'm trying to migrate RPM content from Pulp2 to Pulp3 using the migration plugin. The migration plan is generated by Katello (everything is part of a Katello installation).

The content migration seems to break during publishing/distributor creation with File icons.tar.gz doesn't exists or not a regular file.

There are three tasks having the same problem; all seem to be related to a CentOS mirror (although I'm not 100% certain on that).

This is the task group:

 root@pulp:/var/lib/pulp# http --cert /etc/pki/katello/certs/pulp-client.crt --cert-key /etc/pki/katello/private/pulp-client.key "https://$(hostname -f)/pulp/api/v3/task-groups/5d1dc966-ec76-4cd4-bb9b-320796808fa6/"
HTTP/1.1 200 OK
Allow: GET, HEAD, OPTIONS
Connection: Keep-Alive
Content-Encoding: gzip
Content-Length: 275
Content-Type: application/json
Date: Thu, 18 Feb 2021 10:17:35 GMT
Keep-Alive: timeout=15, max=10000
Server: gunicorn/20.0.4
Vary: Accept,Cookie,Accept-Encoding
Via: 1.1 pulp.example.com
X-Frame-Options: SAMEORIGIN

{
    "all_tasks_dispatched": true,
    "canceled": 0,
    "completed": 74,
    "description": "Migration Sub-tasks",
    "failed": 3,
    "group_progress_reports": [
        {
            "code": "create.repo_version",
            "done": 0,
            "message": "Repo version creation",
            "suffix": null,
            "total": 0
        },
        {
            "code": "create.distribution",
            "done": 0,
            "message": "Distribution creation",
            "suffix": null,
            "total": 3
        }
    ],
    "pulp_href": "/pulp/api/v3/task-groups/5d1dc966-ec76-4cd4-bb9b-320796808fa6/",
    "running": 0,
    "skipped": 0,
    "waiting": 0
}

And here is the output of the failed tasks inside the task group:

 root@pulp:/var/lib/pulp# http --cert /etc/pki/katello/certs/pulp-client.crt --cert-key /etc/pki/katello/private/pulp-client.key "https://$(hostname -f)/pulp/api/v3/tasks/?state=failed&task_group=/pulp/api/v3/task-groups/5d1dc966-ec76-4cd4-bb9b-320796808fa6/"
HTTP/1.1 200 OK
Allow: GET, HEAD, OPTIONS
Connection: Keep-Alive
Content-Encoding: gzip
Content-Length: 1071
Content-Type: application/json
Date: Thu, 18 Feb 2021 10:15:50 GMT
Keep-Alive: timeout=15, max=10000
Server: gunicorn/20.0.4
Vary: Accept,Cookie,Accept-Encoding
Via: 1.1 pulp.example.com
X-Frame-Options: SAMEORIGIN

{
    "count": 3,
    "next": null,
    "previous": null,
    "results": [
        {
            "child_tasks": [],
            "created_resources": [],
            "error": {
                "description": "File icons.tar.gz doesn't exists or not a regular file",
                "traceback": "  File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 936, in perform_job\n    rv = job.perform()\n  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 684, in perform\n    self._result = self._execute()\n  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 690, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 277, in complex_repo_migration\n    migrated_repo.pulp3_repository_version\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 401, in migrate_repo_distributor\n    pulp2dist, repo_version)\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/rpm/repository.py\", line 76, in migrate_to_pulp3\n    publish(repo_version.pk, checksum_types=checksum_types)\n  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py\", line 290, in publish\n    metadata_signing_service=metadata_signing_service\n  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py\", line 486, in create_repomd_xml\n    record.fill(checksum_type)\n"
            },
            "finished_at": "2021-02-17T16:06:20.595544Z",
            "name": "pulp_2to3_migration.app.migration.complex_repo_migration",
            "parent_task": "/pulp/api/v3/tasks/23e52c2e-1b99-4ee8-b491-c0b2aead656d/",
            "progress_reports": [],
            "pulp_created": "2021-02-17T16:06:01.215851Z",
            "pulp_href": "/pulp/api/v3/tasks/e5259ac1-8e31-4c69-908e-d7c4ee93db9c/",
            "reserved_resources_record": [
                "/pulp/api/v3/repositories/rpm/rpm/1fa2b31f-be32-4b5a-94eb-026539d42f98/"
            ],
            "started_at": "2021-02-17T16:06:08.142256Z",
            "state": "failed",
            "task_group": "/pulp/api/v3/task-groups/5d1dc966-ec76-4cd4-bb9b-320796808fa6/",
            "worker": "/pulp/api/v3/workers/559e24b9-912e-425a-85b0-f70775a17138/"
        },
        {
            "child_tasks": [],
            "created_resources": [],
            "error": {
                "description": "File icons.tar.gz doesn't exists or not a regular file",
                "traceback": "  File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 936, in perform_job\n    rv = job.perform()\n  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 684, in perform\n    self._result = self._execute()\n  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 690, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 277, in complex_repo_migration\n    migrated_repo.pulp3_repository_version\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 401, in migrate_repo_distributor\n    pulp2dist, repo_version)\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/rpm/repository.py\", line 76, in migrate_to_pulp3\n    publish(repo_version.pk, checksum_types=checksum_types)\n  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py\", line 290, in publish\n    metadata_signing_service=metadata_signing_service\n  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py\", line 486, in create_repomd_xml\n    record.fill(checksum_type)\n"
            },
            "finished_at": "2021-02-17T16:06:25.453339Z",
            "name": "pulp_2to3_migration.app.migration.complex_repo_migration",
            "parent_task": "/pulp/api/v3/tasks/23e52c2e-1b99-4ee8-b491-c0b2aead656d/",
            "progress_reports": [],
            "pulp_created": "2021-02-17T16:05:59.983297Z",
            "pulp_href": "/pulp/api/v3/tasks/c2400638-fc38-421f-860e-e60cc861bcb8/",
            "reserved_resources_record": [
                "/pulp/api/v3/repositories/rpm/rpm/3b8f140d-2781-471c-aa28-d38537e3c545/"
            ],
            "started_at": "2021-02-17T16:06:02.210939Z",
            "state": "failed",
            "task_group": "/pulp/api/v3/task-groups/5d1dc966-ec76-4cd4-bb9b-320796808fa6/",
            "worker": "/pulp/api/v3/workers/2873b7db-1d77-4c5f-99dd-9fa408aacb3a/"
        },
        {
            "child_tasks": [],
            "created_resources": [],
            "error": {
                "description": "File icons.tar.gz doesn't exists or not a regular file",
                "traceback": "  File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 936, in perform_job\n    rv = job.perform()\n  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 684, in perform\n    self._result = self._execute()\n  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 690, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 277, in complex_repo_migration\n    migrated_repo.pulp3_repository_version\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py\", line 401, in migrate_repo_distributor\n    pulp2dist, repo_version)\n  File \"/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/rpm/repository.py\", line 76, in migrate_to_pulp3\n    publish(repo_version.pk, checksum_types=checksum_types)\n  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py\", line 290, in publish\n    metadata_signing_service=metadata_signing_service\n  File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py\", line 486, in create_repomd_xml\n    record.fill(checksum_type)\n"
            },
            "finished_at": "2021-02-17T16:06:23.617334Z",
            "name": "pulp_2to3_migration.app.migration.complex_repo_migration",
            "parent_task": "/pulp/api/v3/tasks/23e52c2e-1b99-4ee8-b491-c0b2aead656d/",
            "progress_reports": [],
            "pulp_created": "2021-02-17T16:05:59.487062Z",
            "pulp_href": "/pulp/api/v3/tasks/bd51d20a-fdaa-463d-9232-fc82f91ddd5b/",
            "reserved_resources_record": [
                "/pulp/api/v3/repositories/rpm/rpm/a9fe0b38-2440-498c-b4ed-e3523129c0b9/"
            ],
            "started_at": "2021-02-17T16:06:00.325158Z",
            "state": "failed",
            "task_group": "/pulp/api/v3/task-groups/5d1dc966-ec76-4cd4-bb9b-320796808fa6/",
            "worker": "/pulp/api/v3/workers/14cfcce7-4444-4a13-aa11-aacf404ac93e/"
        }
    ]
}

Versions used:

 root@pulp:/var/lib/pulp# rpm -qi pulp-server | head -n3
Name        : pulp-server
Version     : 2.21.5
Release     : 1.el7

 root@pulp:/var/lib/pulp# http "https://$(hostname -f)/pulp/api/v3/status/" | jq '.versions'
[
  {
    "component": "pulpcore",
    "version": "3.7.3"
  },
  {
    "component": "pulp_2to3_migration",
    "version": "0.6.0"
  },
  {
    "component": "pulp_rpm",
    "version": "3.7.0"
  },
  {
    "component": "pulp_file",
    "version": "1.3.0"
  },
  {
    "component": "pulp_deb",
    "version": "2.7.0"
  },
  {
    "component": "pulp_container",
    "version": "2.1.0"
  },
  {
    "component": "pulp_certguard",
    "version": "1.0.3"
  }
]

Related issues

Related to RPM Support - Issue #9096: Sync of SUSE, post-2to3-migration, exposes a bug in resolve_advisory_conflict()CLOSED - CURRENTRELEASEggaineyActions
Related to RPM Support - Backport #9113: Backport 8275 to pulp_rpm 3.11CLOSED - CURRENTRELEASEttereshc

Actions
Actions
Send by e-mail Copy link

Also available in: Atom PDF