Issue #5746
closedError on adding content to a repository
Description
Getting:
'description': 'null value in column "content_id" violates not-null constraint\nDETAIL: Failing row contains (62bbced836e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\n'}
E pulp_smash.exceptions.TaskReportError: ('Task report /pulp/api/v3/tasks/ed321eaa-a631-4d7a-a9bb-414a1e74d260/ contains a error: {\'traceback\': \' File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, in perform_job\\n rv = job.perform()\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in perform\\n self._result = self._execute()\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in _execute\\n return self.func(*self.args, **self.kwargs)\\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 142, in synchronize\\n dv.create()\\n File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create\\n loop.run_until_complete(pipeline)\\n File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 631, in __exit__\\n self.repository.finalize_new_version(self)\\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models.py", line 1370, in finalize_new_version\\n resolve_module_packages(new_version, previous_version)\\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 39, in resolve_module_packages\\n version.add_content(packages_to_add)\\n File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 486, in add_content\\n RepositoryContent.objects.bulk_create(repo_content)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method\\n return getattr(self.get_queryset(), name)(*args, **kwargs)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 468, in bulk_create\\n self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1204, in _batched_insert\\n ignore_conflicts=ignore_conflicts,\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1186, in _insert\\n return query.get_compiler(using=using).execute_sql(return_id)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/sql/compiler.py", line 1335, in execute_sql\\n cursor.execute(sql, params)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 67, in execute\\n return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers\\n return executor(sql, params, many, context)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n return self.cursor.execute(sql, params)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/utils.py", line 89, in __exit__\\n raise dj_exc_value.with_traceback(traceback) from exc_value\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n return self.cursor.execute(sql, params)\\n\', \'description\': \'null value in column "content_id" violates not-null constraint\\nDETAIL: Failing row contains (62bbced8-36e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\\n\'}\nFull task report: {\'pulp_href\': \'/pulp/api/v3/tasks/ed321eaa-a631-4d7a-a9bb-414a1e74d260/\', \'pulp_created\': \'2019-11-18T19:59:58.674419Z\', \'state\': \'failed\', \'name\': \'pulp_rpm.app.tasks.synchronizing.synchronize\', \'started_at\': \'2019-11-18T19:59:58.747909Z\', \'finished_at\': \'2019-11-18T20:01:58.942688Z\', \'error\': {\'traceback\': \' File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, in perform_job\\n rv = job.perform()\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in perform\\n self._result = self._execute()\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in _execute\\n return self.func(*self.args, **self.kwargs)\\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 142, in synchronize\\n dv.create()\\n File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create\\n loop.run_until_complete(pipeline)\\n File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 631, in __exit__\\n self.repository.finalize_new_version(self)\\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models.py", line 1370, in finalize_new_version\\n resolve_module_packages(new_version, previous_version)\\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 39, in resolve_module_packages\\n version.add_content(packages_to_add)\\n File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 486, in add_content\\n RepositoryContent.objects.bulk_create(repo_content)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method\\n return getattr(self.get_queryset(), name)(*args, **kwargs)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 468, in bulk_create\\n self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1204, in _batched_insert\\n ignore_conflicts=ignore_conflicts,\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1186, in _insert\\n return query.get_compiler(using=using).execute_sql(return_id)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/sql/compiler.py", line 1335, in execute_sql\\n cursor.execute(sql, params)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 67, in execute\\n return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers\\n return executor(sql, params, many, context)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n return self.cursor.execute(sql, params)\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/utils.py", line 89, in __exit__\\n raise dj_exc_value.with_traceback(traceback) from exc_value\\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\\n return self.cursor.execute(sql, params)\\n\', \'description\': \'null value in column "content_id" violates not-null constraint\\nDETAIL: Failing row contains (62bbced8-36e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\\n\'}, \'worker\': \'/pulp/api/v3/workers/c85a8f0e-4245-4ea1-bdfd-ceedd93516b5/\', \'parent\': None, \'spawned_tasks\': [], \'progress_reports\': [{\'message\': \'Downloading Metadata Files\', \'code\': \'downloading.metadata\', \'state\': \'completed\', \'total\': None, \'done\': 4, \'suffix\': None}, {\'message\': \'Parsed Packages\', \'code\': \'parsing.packages\', \'state\': \'completed\', \'total\': 5010, \'done\': 5010, \'suffix\': None}, {\'message\': \'Parsed Advisories\', \'code\': \'parsing.advisories\', \'state\': \'completed\', \'total\': None, \'done\': 0, \'suffix\': None}, {\'message\': \'Parse Modulemd\', \'code\': \'parsing.modulemds\', \'state\': \'completed\', \'total\': 57, \'done\': 57, \'suffix\': None}, {\'message\': \'Parse Modulemd-defaults\', \'code\': \'parsing.modulemddefaults\', \'state\': \'completed\', \'total\': 40, \'done\': 40, \'suffix\': None}, {\'message\': \'Parsed Comps\', \'code\': \'parsing.comps\', \'state\': \'completed\', \'total\': 67, \'done\': 67, \'suffix\': None}, {\'message\': \'Downloading Artifacts\', \'code\': \'downloading.artifacts\', \'state\': \'completed\', \'total\': None, \'done\': 0, \'suffix\': None}, {\'message\': \'Associating Content\', \'code\': \'associating.content\', \'state\': \'completed\', \'total\': None, \'done\': 5175, \'suffix\': None}], \'created_resources\': [None], \'reserved_resources_record\': [\'/pulp/api/v3/repositories/rpm/rpm/e6dea099-50b7-4257-8a60-7202bcc2e017/\', \'/pulp/api/v3/remotes/rpm/rpm/d197574e-6f70-4a4e-aee7-a89d3d88720d/\']}', {'pulp_href': '/pulp/api/v3/tasks/ed321eaa-a631-4d7a-a9bb-414a1e74d260/', 'pulp_created': '2019-11-18T19:59:58.674419Z', 'state': 'failed', 'name': 'pulp_rpm.app.tasks.synchronizing.synchronize', 'started_at': '2019-11-18T19:59:58.747909Z', 'finished_at': '2019-11-18T20:01:58.942688Z', 'error': {'traceback': ' File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 822, in perform_job\n rv = job.perform()\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 605, in perform\n self._result = self._execute()\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 611, in _execute\n return self.func(*self.args, **self.kwargs)\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 142, in synchronize\n dv.create()\n File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create\n loop.run_until_complete(pipeline)\n File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 631, in __exit__\n self.repository.finalize_new_version(self)\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models.py", line 1370, in finalize_new_version\n resolve_module_packages(new_version, previous_version)\n File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 39, in resolve_module_packages\n version.add_content(packages_to_add)\n File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 486, in add_content\n RepositoryContent.objects.bulk_create(repo_content)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method\n return getattr(self.get_queryset(), name)(*args, **kwargs)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 468, in bulk_create\n self._batched_insert(objs_with_pk, fields, batch_size, ignore_conflicts=ignore_conflicts)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1204, in _batched_insert\n ignore_conflicts=ignore_conflicts,\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/query.py", line 1186, in _insert\n return query.get_compiler(using=using).execute_sql(return_id)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/models/sql/compiler.py", line 1335, in execute_sql\n cursor.execute(sql, params)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 67, in execute\n return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers\n return executor(sql, params, many, context)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\n return self.cursor.execute(sql, params)\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/utils.py", line 89, in __exit__\n raise dj_exc_value.with_traceback(traceback) from exc_value\n File "/usr/local/lib/pulp/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute\n return self.cursor.execute(sql, params)\n', 'description': 'null value in column "content_id" violates not-null constraint\nDETAIL: Failing row contains (62bbced8-36e3-468d-abcf-1b6a61bdc634, 2019-11-18 20:01:58.927424+00, 2019-11-18 20:01:58.927447+00, null, e6dea099-50b7-4257-8a60-7202bcc2e017, c34b34fe-ac71-4c6a-b2a2-7466f1e90bd7, null).\n'}, 'worker': '/pulp/api/v3/workers/c85a8f0e-4245-4ea1-bdfd-ceedd93516b5/', 'parent': None, 'spawned_tasks': [], 'progress_reports': [{'message': 'Downloading Metadata Files', 'code': 'downloading.metadata', 'state': 'completed', 'total': None, 'done': 4, 'suffix': None}, {'message': 'Parsed Packages', 'code': 'parsing.packages', 'state': 'completed', 'total': 5010, 'done': 5010, 'suffix': None}, {'message': 'Parsed Advisories', 'code': 'parsing.advisories', 'state': 'completed', 'total': None, 'done': 0, 'suffix': None}, {'message': 'Parse Modulemd', 'code': 'parsing.modulemds', 'state': 'completed', 'total': 57, 'done': 57, 'suffix': None}, {'message': 'Parse Modulemd-defaults', 'code': 'parsing.modulemddefaults', 'state': 'completed', 'total': 40, 'done': 40, 'suffix': None}, {'message': 'Parsed Comps', 'code': 'parsing.comps', 'state': 'completed', 'total': 67, 'done': 67, 'suffix': None}, {'message': 'Downloading Artifacts', 'code': 'downloading.artifacts', 'state': 'completed', 'total': None, 'done': 0, 'suffix': None}, {'message': 'Associating Content', 'code': 'associating.content', 'state': 'completed', 'total': None, 'done': 5175, 'suffix': None}], 'created_resources': [None], 'reserved_resources_record': ['/pulp/api/v3/repositories/rpm/rpm/e6dea099-50b7-4257-8a60-7202bcc2e017/', '/pulp/api/v3/remotes/rpm/rpm/d197574e-6f70-4a4e-aee7-a89d3d88720d/']})
Related issues
Updated by fao89 about 5 years ago
- Status changed from ASSIGNED to POST
Updated by ttereshc about 5 years ago
- Triaged changed from No to Yes
- Sprint set to Sprint 62
Updated by daviddavis about 5 years ago
The root cause of this bug was a perl module in the centos 8 appstream repo that had no rpms.
Updated by daviddavis about 5 years ago
Added by daviddavis about 5 years ago
Updated by daviddavis about 5 years ago
- Status changed from POST to MODIFIED
Applied in changeset 1004c2bc251605ed976fa3079f66cd9c2d4b80a3.
Updated by daviddavis about 5 years ago
- Has duplicate Issue #5812: RHEL 8.1 AppStream Kickstart x86_64 repo syncing fails added
Added by daviddavis about 5 years ago
Revision 1f7c4051 | View on GitHub
Fixed error on adding modular content to a repository
The problem was use of values_list() which isn't meant for many-to-many relationships. Instead, build a set of packages.
fixes #5746 https://pulp.plan.io/issues/5746
(cherry picked from commit 1004c2bc251605ed976fa3079f66cd9c2d4b80a3)
Updated by daviddavis about 5 years ago
Applied in changeset 1f7c405144aaea43cd71d75b576789649c7829b5.
Updated by ttereshc about 5 years ago
- Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Fixed error on adding modular content to a repository
The problem was use of values_list() which isn't meant for many-to-many relationships. Instead, build a set of packages.
fixes #5746 https://pulp.plan.io/issues/5746