Issue #6229
closedSyncing both Fedora 30 and Fedora 31 modular repos into Pulp (different repos) will cause the later sync to fail
Description
Create 2 RPM repos
Create 2 RPM remotes pointing to:
- https://dl.fedoraproject.org/pub/fedora/linux/updates/30/Modular/x86_64/
- https://dl.fedoraproject.org/pub/fedora/linux/updates/31/Modular/x86_64/
Sync each repo with one of the remotes
The second sync will fail with the following error:
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: pulp: rq.worker:ERROR: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: Traceback (most recent call last):
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 884, in perform_job
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: rv = job.perform()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 664, in perform
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: self._result = self._execute()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 670, in _execute
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: return self.func(*self.args, **self.kwargs)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 152, in synchronize
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: dv.create()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: loop.run_until_complete(pipeline)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 784, in __exit__
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: repository.finalize_new_version(self)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models/repository.py", line 117, in finalize_new_version
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: resolve_module_packages(new_version, previous_version)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 44, in resolve_module_packages
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: version.add_content(Package.objects.filter(pk__in=packages_to_add))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 580, in add_content
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: _("Cannot create repository version. {msg}").format(msg=", ".join(error_messages))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: Traceback (most recent call last):
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 884, in perform_job
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: rv = job.perform()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 664, in perform
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: self._result = self._execute()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 670, in _execute
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: return self.func(*self.args, **self.kwargs)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 152, in synchronize
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: dv.create()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: loop.run_until_complete(pipeline)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 784, in __exit__
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: repository.finalize_new_version(self)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models/repository.py", line 117, in finalize_new_version
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: resolve_module_packages(new_version, previous_version)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 44, in resolve_module_packages
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: version.add_content(Package.objects.filter(pk__in=packages_to_add))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 580, in add_content
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: _("Cannot create repository version. {msg}").format(msg=", ".join(error_messages))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.
Related issues
Updated by dalley almost 5 years ago
- Project changed from Python Support to RPM Support
Updated by dalley almost 5 years ago
- Priority changed from Normal to High
- Severity changed from 2. Medium to 3. High
- Triaged changed from No to Yes
- Sprint set to Sprint 67
- Tags Pulp 3 RPM blocker added
Updated by daviddavis almost 5 years ago
The exception was added in #5567. My initial guess is that Pulp is trying to add the same package twice.
Updated by daviddavis almost 5 years ago
- Related to Issue #5567: Content with duplicate repo_key_fields can be added to a repo version added
Updated by ttereshc almost 5 years ago
- Status changed from NEW to POST
- Assignee set to ttereshc
Added by ttereshc almost 5 years ago
Updated by ttereshc almost 5 years ago
- Status changed from POST to MODIFIED
Applied in changeset 15f043b0139db7cd3aa49ce5af2441ca8e44c039.
Added by ttereshc almost 5 years ago
Revision ba90a854 | View on GitHub
Properly compare modular content between the versions.
closes #6229 https://pulp.plan.io/issues/6229
(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)
Updated by ttereshc almost 5 years ago
Applied in changeset ba90a854d10c114aa4b221d4bb6dcb1fca07ae94.
Added by ttereshc almost 5 years ago
Revision a626d977 | View on GitHub
Properly compare modular content between the versions.
closes #6229 https://pulp.plan.io/issues/6229
(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)
Updated by ttereshc almost 5 years ago
Applied in changeset a626d9770e2822b21f821a60943c8435aa4b2625.
Added by ttereshc almost 5 years ago
Revision 5bf86cf6 | View on GitHub
Properly compare modular content between the versions.
closes #6229 https://pulp.plan.io/issues/6229
(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)
Updated by ttereshc almost 5 years ago
Applied in changeset 5bf86cf66cf539c7582e6916537dd099b619d5dd.
Updated by dalley over 4 years ago
- Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Properly compare modular content between the versions.
closes #6229 https://pulp.plan.io/issues/6229