Project

Profile

Help

Issue #6229

closed

Syncing both Fedora 30 and Fedora 31 modular repos into Pulp (different repos) will cause the later sync to fail

Added by dalley over 4 years ago. Updated over 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Sprint/Milestone:
Start date:
Due date:
Estimated time:
Severity:
3. High
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 68
Quarter:

Description

Create 2 RPM repos

Create 2 RPM remotes pointing to:

Sync each repo with one of the remotes

The second sync will fail with the following error:

Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: pulp: rq.worker:ERROR: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: Traceback (most recent call last):
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 884, in perform_job
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     rv = job.perform()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 664, in perform
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     self._result = self._execute()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 670, in _execute
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     return self.func(*self.args, **self.kwargs)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 152, in synchronize
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     dv.create()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     loop.run_until_complete(pipeline)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 784, in __exit__
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     repository.finalize_new_version(self)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models/repository.py", line 117, in finalize_new_version
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     resolve_module_packages(new_version, previous_version)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 44, in resolve_module_packages
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     version.add_content(Package.objects.filter(pk__in=packages_to_add))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 580, in add_content
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     _("Cannot create repository version. {msg}").format(msg=", ".join(error_messages))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: Traceback (most recent call last):
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 884, in perform_job
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     rv = job.perform()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 664, in perform
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     self._result = self._execute()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 670, in _execute
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     return self.func(*self.args, **self.kwargs)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 152, in synchronize
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     dv.create()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     loop.run_until_complete(pipeline)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 784, in __exit__
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     repository.finalize_new_version(self)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models/repository.py", line 117, in finalize_new_version
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     resolve_module_packages(new_version, previous_version)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 44, in resolve_module_packages
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     version.add_content(Package.objects.filter(pk__in=packages_to_add))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 580, in add_content
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     _("Cannot create repository version. {msg}").format(msg=", ".join(error_messages))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.


Related issues

Related to Pulp - Issue #5567: Content with duplicate repo_key_fields can be added to a repo versionCLOSED - CURRENTRELEASEfao89Actions
Actions #1

Updated by dalley over 4 years ago

  • Project changed from Python Support to RPM Support
Actions #2

Updated by dalley over 4 years ago

  • Description updated (diff)
Actions #3

Updated by dalley over 4 years ago

  • Priority changed from Normal to High
  • Severity changed from 2. Medium to 3. High
  • Triaged changed from No to Yes
  • Sprint set to Sprint 67
  • Tags Pulp 3 RPM blocker added
Actions #4

Updated by daviddavis over 4 years ago

The exception was added in #5567. My initial guess is that Pulp is trying to add the same package twice.

Actions #5

Updated by daviddavis over 4 years ago

  • Related to Issue #5567: Content with duplicate repo_key_fields can be added to a repo version added
Actions #6

Updated by ttereshc over 4 years ago

  • Status changed from NEW to POST
  • Assignee set to ttereshc

Added by ttereshc over 4 years ago

Revision 15f043b0 | View on GitHub

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

Actions #7

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 67 to Sprint 68
Actions #8

Updated by ttereshc over 4 years ago

  • Status changed from POST to MODIFIED

Added by ttereshc over 4 years ago

Revision ba90a854 | View on GitHub

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)

Actions #9

Updated by ttereshc over 4 years ago

Added by ttereshc over 4 years ago

Revision a626d977 | View on GitHub

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)

Actions #10

Updated by ttereshc over 4 years ago

Added by ttereshc over 4 years ago

Revision 5bf86cf6 | View on GitHub

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)

Actions #11

Updated by ttereshc over 4 years ago

Actions #12

Updated by dalley over 4 years ago

  • Sprint/Milestone set to Pulp RPM 3.3.0
Actions #13

Updated by dalley over 4 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Actions #14

Updated by bmbouter over 4 years ago

  • Tags deleted (Pulp 3 RPM blocker)

Also available in: Atom PDF