Actions
Issue #8863
closedVery old pulp content that does not have `downloaded` flag fails during pre-migration
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 98
Quarter:
Description
$ http :24817/pulp/api/v3/tasks/e01961da-073e-4a4f-a855-5b182216b2e7/
HTTP/1.1 200 OK
Access-Control-Expose-Headers: Correlation-ID
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: close
Content-Length: 4252
Content-Type: application/json
Correlation-ID: be17738ab5504dcfbec5f84bb8be4038
Date: Thu, 03 Jun 2021 17:53:44 GMT
Server: gunicorn
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN
{
"child_tasks": [],
"created_resources": [
"/pulp/api/v3/task-groups/f67de737-9ee5-45fa-990f-9d1722d84f97/"
],
"error": {
"description": "null value in column \"downloaded\" violates not-null constraint\nDETAIL: Failing row contains (d23b6c28-f8bf-4ff5-b326-8df80646223e, 2021-06-03 17:53:28.77212+00, 2021-06-03 17:53:28.772125+00, 00fa951d-d5e4-4bbb-b91f-36cc1aeee553, rpm, 1621872969, /var/lib/pulp/content/units/rpm/06/590a1caa731ae6f1892e1e99df3f1..., null, null, null, ).\n",
"traceback": " File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line 1013, in perform_job\n rv = job.perform()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 709, in perform\n self._result = self._execute()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 732, in _execute\n result = self.func(*self.args, **self.kwargs)\n File \"/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/tasks/migrate.py\", line 77, in migrate_from_pulp2\n pre_migrate_all_content(plan)\n File \"/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/pre_migration.py\", line 70, in pre_migrate_all_content\n pre_migrate_content_type(content_model, mutable_type, lazy_type, premigrate_hook)\n File \"/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/pre_migration.py\", line 242, in pre_migrate_content_type\n ignore_conflicts=True)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/manager.py\", line 82, in manager_method\n return getattr(self.get_queryset(), name)(*args, **kwargs)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py\", line 468, in bulk_create\n self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py\", line 1211, in _batched_insert\n self._insert(item, fields=fields, using=self.db, ignore_conflicts=ignore_conflicts)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py\", line 1186, in _insert\n return query.get_compiler(using=using).execute_sql(return_id)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/sql/compiler.py\", line 1377, in execute_sql\n cursor.execute(sql, params)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 67, in execute\n return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 76, in _execute_with_wrappers\n return executor(sql, params, many, context)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n return self.cursor.execute(sql, params)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/utils.py\", line 89, in __exit__\n raise dj_exc_value.with_traceback(traceback) from exc_value\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n return self.cursor.execute(sql, params)\n"
},
"finished_at": "2021-06-03T17:53:28.914251Z",
"logging_cid": "4d57ea4f734f4eeeb0b6c1cc42e86f9a",
"name": "pulp_2to3_migration.app.tasks.migrate.migrate_from_pulp2",
"parent_task": null,
"progress_reports": [
{
"code": "processing.repositories",
"done": 5,
"message": "Processing Pulp 2 repositories, importers, distributors",
"state": "completed",
"suffix": null,
"total": 5
},
{
"code": "premigrating.content.general",
"done": 0,
"message": "Pre-migrating Pulp 2 rpm content (general info)",
"state": "running",
"suffix": null,
"total": 129
},
{
"code": "premigrating.content.detail",
"done": 0,
"message": "Pre-migrating Pulp 2 rpm content (detail info)",
"state": "running",
"suffix": null,
"total": 129
}
],
"pulp_created": "2021-06-03T17:53:28.268346Z",
"pulp_href": "/pulp/api/v3/tasks/e01961da-073e-4a4f-a855-5b182216b2e7/",
"reserved_resources_record": [
"pulp_2to3_migration"
],
"started_at": "2021-06-03T17:53:28.405897Z",
"state": "failed",
"task_group": "/pulp/api/v3/task-groups/f67de737-9ee5-45fa-990f-9d1722d84f97/",
"worker": "/pulp/api/v3/workers/7d27aae1-ae92-4b51-985b-9f706e304bbf/"
}
When this flag was added, the migration was not written https://github.com/pulp/pulp/pull/2147/files#diff-15dec39bbc93d3954990163924a66076cfbcda47abcef37968377c68517f3466R647
Actions
Pulp2 content that is missing downloaded flag is treated as downloaded
closes #8863