Project

Profile

Help

Issue #5746

closed

Error on adding content to a repository

Added by fao89 over 4 years ago. Updated over 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 62
Quarter:

Description

Getting:
'description': 'null value in column "content_id" violates not-null constraint\nDETAIL: Failing row contains (62bbced836e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\n'}

E                   pulp_smash.exceptions.TaskReportError: ('Task report /pulp/api/v3/tasks/ed321eaa-a631-4d7a-a9bb-414a1e74d260/ contains a error: {\'traceback\': \'  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, in perform_job\\n    rv = job.perform()\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in perform\\n    self._result = self._execute()\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in _execute\\n    return self.func(*self.args, **self.kwargs)\\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 142, in synchronize\\n    dv.create()\\n  File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create\\n    loop.run_until_complete(pipeline)\\n  File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 631, in __exit__\\n    self.repository.finalize_new_version(self)\\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models.py", line 1370, in finalize_new_version\\n    resolve_module_packages(new_version, previous_version)\\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 39, in resolve_module_packages\\n    version.add_content(packages_to_add)\\n  File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 486, in add_content\\n    RepositoryContent.objects.bulk_create(repo_content)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method\\n    return getattr(self.get_queryset(), name)(*args, **kwargs)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 468, in bulk_create\\n    self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1204, in _batched_insert\\n    ignore_conflicts=ignore_conflicts,\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1186, in _insert\\n    return query.get_compiler(using=using).execute_sql(return_id)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/sql/compiler.py", line 1335, in execute_sql\\n    cursor.execute(sql, params)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 67, in execute\\n    return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers\\n    return executor(sql, params, many, context)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n    return self.cursor.execute(sql, params)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/utils.py", line 89, in __exit__\\n    raise dj_exc_value.with_traceback(traceback) from exc_value\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n    return self.cursor.execute(sql, params)\\n\', \'description\': \'null value in column "content_id" violates not-null constraint\\nDETAIL:  Failing row contains (62bbced8-36e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\\n\'}\nFull task report: {\'pulp_href\': \'/pulp/api/v3/tasks/ed321eaa-a631-4d7a-a9bb-414a1e74d260/\', \'pulp_created\': \'2019-11-18T19:59:58.674419Z\', \'state\': \'failed\', \'name\': \'pulp_rpm.app.tasks.synchronizing.synchronize\', \'started_at\': \'2019-11-18T19:59:58.747909Z\', \'finished_at\': \'2019-11-18T20:01:58.942688Z\', \'error\': {\'traceback\': \'  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, in perform_job\\n    rv = job.perform()\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in perform\\n    self._result = self._execute()\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in _execute\\n    return self.func(*self.args, **self.kwargs)\\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 142, in synchronize\\n    dv.create()\\n  File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create\\n    loop.run_until_complete(pipeline)\\n  File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 631, in __exit__\\n    self.repository.finalize_new_version(self)\\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models.py", line 1370, in finalize_new_version\\n    resolve_module_packages(new_version, previous_version)\\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 39, in resolve_module_packages\\n    version.add_content(packages_to_add)\\n  File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 486, in add_content\\n    RepositoryContent.objects.bulk_create(repo_content)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method\\n    return getattr(self.get_queryset(), name)(*args, **kwargs)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 468, in bulk_create\\n    self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1204, in _batched_insert\\n    ignore_conflicts=ignore_conflicts,\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1186, in _insert\\n    return query.get_compiler(using=using).execute_sql(return_id)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/sql/compiler.py", line 1335, in execute_sql\\n    cursor.execute(sql, params)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 67, in execute\\n    return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers\\n    return executor(sql, params, many, context)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n    return self.cursor.execute(sql, params)\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/utils.py", line 89, in __exit__\\n    raise dj_exc_value.with_traceback(traceback) from exc_value\\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n    return self.cursor.execute(sql, params)\\n\', \'description\': \'null value in column "content_id" violates not-null constraint\\nDETAIL:  Failing row contains (62bbced8-36e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\\n\'}, \'worker\': \'/pulp/api/v3/workers/c85a8f0e-4245-4ea1-bdfd-ceedd93516b5/\', \'parent\': None, \'spawned_tasks\': [], \'progress_reports\': [{\'message\': \'Downloading Metadata Files\', \'code\': \'downloading.metadata\', \'state\': \'completed\', \'total\': None, \'done\': 4, \'suffix\': None}, {\'message\': \'Parsed Packages\', \'code\': \'parsing.packages\', \'state\': \'completed\', \'total\': 5010, \'done\': 5010, \'suffix\': None}, {\'message\': \'Parsed Advisories\', \'code\': \'parsing.advisories\', \'state\': \'completed\', \'total\': None, \'done\': 0, \'suffix\': None}, {\'message\': \'Parse Modulemd\', \'code\': \'parsing.modulemds\', \'state\': \'completed\', \'total\': 57, \'done\': 57, \'suffix\': None}, {\'message\': \'Parse Modulemd-defaults\', \'code\': \'parsing.modulemddefaults\', \'state\': \'completed\', \'total\': 40, \'done\': 40, \'suffix\': None}, {\'message\': \'Parsed Comps\', \'code\': \'parsing.comps\', \'state\': \'completed\', \'total\': 67, \'done\': 67, \'suffix\': None}, {\'message\': \'Downloading Artifacts\', \'code\': \'downloading.artifacts\', \'state\': \'completed\', \'total\': None, \'done\': 0, \'suffix\': None}, {\'message\': \'Associating Content\', \'code\': \'associating.content\', \'state\': \'completed\', \'total\': None, \'done\': 5175, \'suffix\': None}], \'created_resources\': [None], \'reserved_resources_record\': [\'/pulp/api/v3/repositories/rpm/rpm/e6dea099-50b7-4257-8a60-7202bcc2e017/\', \'/pulp/api/v3/remotes/rpm/rpm/d197574e-6f70-4a4e-aee7-a89d3d88720d/\']}', {'pulp_href': '/pulp/api/v3/tasks/ed321eaa-a631-4d7a-a9bb-414a1e74d260/', 'pulp_created': '2019-11-18T19:59:58.674419Z', 'state': 'failed', 'name': 'pulp_rpm.app.tasks.synchronizing.synchronize', 'started_at': '2019-11-18T19:59:58.747909Z', 'finished_at': '2019-11-18T20:01:58.942688Z', 'error': {'traceback': '  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, in perform_job\n    rv = job.perform()\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in perform\n    self._result = self._execute()\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 142, in synchronize\n    dv.create()\n  File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create\n    loop.run_until_complete(pipeline)\n  File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 631, in __exit__\n    self.repository.finalize_new_version(self)\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models.py", line 1370, in finalize_new_version\n    resolve_module_packages(new_version, previous_version)\n  File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 39, in resolve_module_packages\n    version.add_content(packages_to_add)\n  File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 486, in add_content\n    RepositoryContent.objects.bulk_create(repo_content)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method\n    return getattr(self.get_queryset(), name)(*args, **kwargs)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 468, in bulk_create\n    self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1204, in _batched_insert\n    ignore_conflicts=ignore_conflicts,\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1186, in _insert\n    return query.get_compiler(using=using).execute_sql(return_id)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/sql/compiler.py", line 1335, in execute_sql\n    cursor.execute(sql, params)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 67, in execute\n    return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers\n    return executor(sql, params, many, context)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\n    return self.cursor.execute(sql, params)\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/utils.py", line 89, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\n    return self.cursor.execute(sql, params)\n', 'description': 'null value in column "content_id" violates not-null constraint\nDETAIL:  Failing row contains (62bbced8-36e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\n'}, 'worker': '/pulp/api/v3/workers/c85a8f0e-4245-4ea1-bdfd-ceedd93516b5/', 'parent': None, 'spawned_tasks': [], 'progress_reports': [{'message': 'Downloading Metadata Files', 'code': 'downloading.metadata', 'state': 'completed', 'total': None, 'done': 4, 'suffix': None}, {'message': 'Parsed Packages', 'code': 'parsing.packages', 'state': 'completed', 'total': 5010, 'done': 5010, 'suffix': None}, {'message': 'Parsed Advisories', 'code': 'parsing.advisories', 'state': 'completed', 'total': None, 'done': 0, 'suffix': None}, {'message': 'Parse Modulemd', 'code': 'parsing.modulemds', 'state': 'completed', 'total': 57, 'done': 57, 'suffix': None}, {'message': 'Parse Modulemd-defaults', 'code': 'parsing.modulemddefaults', 'state': 'completed', 'total': 40, 'done': 40, 'suffix': None}, {'message': 'Parsed Comps', 'code': 'parsing.comps', 'state': 'completed', 'total': 67, 'done': 67, 'suffix': None}, {'message': 'Downloading Artifacts', 'code': 'downloading.artifacts', 'state': 'completed', 'total': None, 'done': 0, 'suffix': None}, {'message': 'Associating Content', 'code': 'associating.content', 'state': 'completed', 'total': None, 'done': 5175, 'suffix': None}], 'created_resources': [None], 'reserved_resources_record': ['/pulp/api/v3/repositories/rpm/rpm/e6dea099-50b7-4257-8a60-7202bcc2e017/', '/pulp/api/v3/remotes/rpm/rpm/d197574e-6f70-4a4e-aee7-a89d3d88720d/']})

Related issues

Has duplicate RPM Support - Issue #5812: RHEL 8.1 AppStream Kickstart x86_64 repo syncing failsCLOSED - DUPLICATEActions
Actions #1

Updated by fao89 over 4 years ago

  • Status changed from ASSIGNED to POST
Actions #2

Updated by ttereshc over 4 years ago

  • Triaged changed from No to Yes
  • Sprint set to Sprint 62
Actions #3

Updated by daviddavis over 4 years ago

The root cause of this bug was a perl module in the centos 8 appstream repo that had no rpms.

Actions #4

Updated by fao89 over 4 years ago

  • Assignee changed from fao89 to daviddavis

Added by daviddavis over 4 years ago

Revision 1004c2bc | View on GitHub

Fixed error on adding modular content to a repository

The problem was use of values_list() which isn't meant for many-to-many relationships. Instead, build a set of packages.

fixes #5746 https://pulp.plan.io/issues/5746

Actions #6

Updated by daviddavis over 4 years ago

  • Status changed from POST to MODIFIED
Actions #7

Updated by daviddavis over 4 years ago

  • Has duplicate Issue #5812: RHEL 8.1 AppStream Kickstart x86_64 repo syncing fails added

Added by daviddavis over 4 years ago

Revision 1f7c4051 | View on GitHub

Fixed error on adding modular content to a repository

The problem was use of values_list() which isn't meant for many-to-many relationships. Instead, build a set of packages.

fixes #5746 https://pulp.plan.io/issues/5746

(cherry picked from commit 1004c2bc251605ed976fa3079f66cd9c2d4b80a3)

Actions #8

Updated by daviddavis over 4 years ago

Actions #9

Updated by ttereshc over 4 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF