Project

Profile

Help

Issue #5374

closed

re-run of migration tooling has incorrect counts

Added by jsherril@redhat.com over 4 years ago. Updated about 3 years ago.

Status:
CLOSED - WONTFIX
Priority:
Low
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Katello
Sprint:
Quarter:

Description

I synced a repo with ~14K files in pulp2 and then migrated all content to pulp3:

{
    "_created": "2019-08-29T18:59:50.347635Z", 
    "_href": "/pulp/api/v3/tasks/1a1a93c2-dfd6-4ba6-b54e-c74735a3ce5d/", 
    "created_resources": [], 
    "error": null, 
    "finished_at": "2019-08-29T19:01:37.544664Z", 
    "name": "pulp_2to3_migrate.app.tasks.migrate.migrate_from_pulp2", 
    "non_fatal_errors": [], 
    "parent": null, 
    "progress_reports": [
        {
            "done": 14444, 
            "message": "Pre-migrating Pulp 2 ISO content (general info)", 
            "state": "completed", 
            "suffix": null, 
            "total": 14447
        }, 
        {
            "done": 14444, 
            "message": "Pre-migrating Pulp 2 ISO content (detail info)", 
            "state": "completed", 
            "suffix": null, 
            "total": 14447
        }, 
        {
            "done": 14051, 
            "message": "Migrating ISO content to Pulp 3", 
            "state": "completed", 
            "suffix": null, 
            "total": 14453
        }, 
        {
            "done": 14453, 
            "message": "Migrating content to Pulp 3", 
            "state": "completed", 
            "suffix": null, 
            "total": 14453
        }
    ], 
    "reserved_resources_record": [
        "pulp_2to3_migration"
    ], 
    "spawned_tasks": [], 
    "started_at": "2019-08-29T18:59:50.474079Z", 
    "state": "completed", 
    "worker": "/pulp/api/v3/workers/75176664-9633-46f5-8989-456923ba333a/"
}

the task counts here looked correct. I then re-ran the migration without any changes, and it looked like this:

{
    "_created": "2019-08-29T19:24:08.615486Z", 
    "_href": "/pulp/api/v3/tasks/eee0440a-0d46-48f8-8d3b-2bf711b7b0c4/", 
    "created_resources": [], 
    "error": null, 
    "finished_at": "2019-08-29T19:24:11.410935Z", 
    "name": "pulp_2to3_migrate.app.tasks.migrate.migrate_from_pulp2", 
    "non_fatal_errors": [], 
    "parent": null, 
    "progress_reports": [
        {
            "done": 390, 
            "message": "Migrating ISO content to Pulp 3", 
            "state": "completed", 
            "suffix": null, 
            "total": 402
        }, 
        {
            "done": 402, 
            "message": "Migrating content to Pulp 3", 
            "state": "completed", 
            "suffix": null, 
            "total": 402
        }, 
        {
            "done": 0, 
            "message": "Pre-migrating Pulp 2 ISO content (general info)", 
            "state": "completed", 
            "suffix": null, 
            "total": 0
        }, 
        {
            "done": 0, 
            "message": "Pre-migrating Pulp 2 ISO content (detail info)", 
            "state": "completed", 
            "suffix": null, 
            "total": 0
        }
    ], 
    "reserved_resources_record": [
        "pulp_2to3_migration"
    ], 
    "spawned_tasks": [], 
    "started_at": "2019-08-29T19:24:08.732119Z", 
    "state": "completed", 
    "worker": "/pulp/api/v3/workers/75176664-9633-46f5-8989-456923ba333a/"
}

the counts for that first progress_report appears incorrect

Also available in: Atom PDF