Project

Profile

Help

Issue #8863

closed

Very old pulp content that does not have `downloaded` flag fails during pre-migration

Added by ipanova@redhat.com over 3 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Sprint/Milestone:
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 98
Quarter:

Description

$ http :24817/pulp/api/v3/tasks/e01961da-073e-4a4f-a855-5b182216b2e7/
HTTP/1.1 200 OK
Access-Control-Expose-Headers: Correlation-ID
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: close
Content-Length: 4252
Content-Type: application/json
Correlation-ID: be17738ab5504dcfbec5f84bb8be4038
Date: Thu, 03 Jun 2021 17:53:44 GMT
Server: gunicorn
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN

{
    "child_tasks": [],
    "created_resources": [
        "/pulp/api/v3/task-groups/f67de737-9ee5-45fa-990f-9d1722d84f97/"
    ],
    "error": {
        "description": "null value in column \"downloaded\" violates not-null constraint\nDETAIL:  Failing row contains (d23b6c28-f8bf-4ff5-b326-8df80646223e, 2021-06-03 17:53:28.77212+00, 2021-06-03 17:53:28.772125+00, 00fa951d-d5e4-4bbb-b91f-36cc1aeee553, rpm, 1621872969, /var/lib/pulp/content/units/rpm/06/590a1caa731ae6f1892e1e99df3f1..., null, null, null, ).\n",
        "traceback": "  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line 1013, in perform_job\n    rv = job.perform()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 709, in perform\n    self._result = self._execute()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 732, in _execute\n    result = self.func(*self.args, **self.kwargs)\n  File \"/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/tasks/migrate.py\", line 77, in migrate_from_pulp2\n    pre_migrate_all_content(plan)\n  File \"/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/pre_migration.py\", line 70, in pre_migrate_all_content\n    pre_migrate_content_type(content_model, mutable_type, lazy_type, premigrate_hook)\n  File \"/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/pre_migration.py\", line 242, in pre_migrate_content_type\n    ignore_conflicts=True)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/manager.py\", line 82, in manager_method\n    return getattr(self.get_queryset(), name)(*args, **kwargs)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py\", line 468, in bulk_create\n    self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py\", line 1211, in _batched_insert\n    self._insert(item, fields=fields, using=self.db, ignore_conflicts=ignore_conflicts)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py\", line 1186, in _insert\n    return query.get_compiler(using=using).execute_sql(return_id)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/sql/compiler.py\", line 1377, in execute_sql\n    cursor.execute(sql, params)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 67, in execute\n    return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 76, in _execute_with_wrappers\n    return executor(sql, params, many, context)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n    return self.cursor.execute(sql, params)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/utils.py\", line 89, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n    return self.cursor.execute(sql, params)\n"
    },
    "finished_at": "2021-06-03T17:53:28.914251Z",
    "logging_cid": "4d57ea4f734f4eeeb0b6c1cc42e86f9a",
    "name": "pulp_2to3_migration.app.tasks.migrate.migrate_from_pulp2",
    "parent_task": null,
    "progress_reports": [
        {
            "code": "processing.repositories",
            "done": 5,
            "message": "Processing Pulp 2 repositories, importers, distributors",
            "state": "completed",
            "suffix": null,
            "total": 5
        },
        {
            "code": "premigrating.content.general",
            "done": 0,
            "message": "Pre-migrating Pulp 2 rpm content (general info)",
            "state": "running",
            "suffix": null,
            "total": 129
        },
        {
            "code": "premigrating.content.detail",
            "done": 0,
            "message": "Pre-migrating Pulp 2 rpm content (detail info)",
            "state": "running",
            "suffix": null,
            "total": 129
        }
    ],
    "pulp_created": "2021-06-03T17:53:28.268346Z",
    "pulp_href": "/pulp/api/v3/tasks/e01961da-073e-4a4f-a855-5b182216b2e7/",
    "reserved_resources_record": [
        "pulp_2to3_migration"
    ],
    "started_at": "2021-06-03T17:53:28.405897Z",
    "state": "failed",
    "task_group": "/pulp/api/v3/task-groups/f67de737-9ee5-45fa-990f-9d1722d84f97/",
    "worker": "/pulp/api/v3/workers/7d27aae1-ae92-4b51-985b-9f706e304bbf/"
}

When this flag was added, the migration was not written https://github.com/pulp/pulp/pull/2147/files#diff-15dec39bbc93d3954990163924a66076cfbcda47abcef37968377c68517f3466R647

Actions #1

Updated by ipanova@redhat.com over 3 years ago

  • Subject changed from Very old pulp content that does not have to Very old pulp content that does not have `downloaded` flag fails during pre-migration
  • Description updated (diff)
Actions #2

Updated by ipanova@redhat.com over 3 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to ipanova@redhat.com
Actions #3

Updated by ipanova@redhat.com over 3 years ago

  • Sprint set to Sprint 98

Added by ipanova@redhat.com over 3 years ago

Revision 4904661b | View on GitHub

Pulp2 content that is missing downloaded flag is treated as downloaded

closes #8863

Added by ipanova@redhat.com over 3 years ago

Revision 4904661b | View on GitHub

Pulp2 content that is missing downloaded flag is treated as downloaded

closes #8863

Added by ipanova@redhat.com over 3 years ago

Revision 4904661b | View on GitHub

Pulp2 content that is missing downloaded flag is treated as downloaded

closes #8863

Actions #5

Updated by ipanova@redhat.com over 3 years ago

  • Status changed from ASSIGNED to MODIFIED
Actions #6

Updated by ttereshc over 3 years ago

  • Sprint/Milestone set to 0.11.2

Added by ipanova@redhat.com over 3 years ago

Revision e39528ac | View on GitHub

Pulp2 content that is missing downloaded flag is treated as downloaded

closes #8863

Added by ipanova@redhat.com over 3 years ago

Revision e39528ac | View on GitHub

Pulp2 content that is missing downloaded flag is treated as downloaded

closes #8863

Added by ipanova@redhat.com over 3 years ago

Revision e39528ac | View on GitHub

Pulp2 content that is missing downloaded flag is treated as downloaded

closes #8863

Actions #7

Updated by pulpbot over 3 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF