Project

Profile

Help

Issue #6229

Syncing both Fedora 30 and Fedora 31 modular repos into Pulp (different repos) will cause the later sync to fail

Added by dalley 9 months ago. Updated 6 months ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Sprint/Milestone:
Start date:
Due date:
Estimated time:
Severity:
3. High
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 68
Quarter:

Description

Create 2 RPM repos

Create 2 RPM remotes pointing to:

Sync each repo with one of the remotes

The second sync will fail with the following error:

Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: pulp: rq.worker:ERROR: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: Traceback (most recent call last):
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 884, in perform_job
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     rv = job.perform()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 664, in perform
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     self._result = self._execute()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 670, in _execute
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     return self.func(*self.args, **self.kwargs)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 152, in synchronize
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     dv.create()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     loop.run_until_complete(pipeline)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 784, in __exit__
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     repository.finalize_new_version(self)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models/repository.py", line 117, in finalize_new_version
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     resolve_module_packages(new_version, previous_version)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 44, in resolve_module_packages
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     version.add_content(Package.objects.filter(pk__in=packages_to_add))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 580, in add_content
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     _("Cannot create repository version. {msg}").format(msg=", ".join(error_messages))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: Traceback (most recent call last):
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/worker.py", line 884, in perform_job
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     rv = job.perform()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 664, in perform
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     self._result = self._execute()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/rq/job.py", line 670, in _execute
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     return self.func(*self.args, **self.kwargs)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/synchronizing.py", line 152, in synchronize
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     dv.create()
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     loop.run_until_complete(pipeline)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 784, in __exit__
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     repository.finalize_new_version(self)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/models/repository.py", line 117, in finalize_new_version
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     resolve_module_packages(new_version, previous_version)
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/modulemd.py", line 44, in resolve_module_packages
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     version.add_content(Package.objects.filter(pk__in=packages_to_add))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:   File "/home/vagrant/devel/pulpcore/pulpcore/app/models/repository.py", line 580, in add_content
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]:     _("Cannot create repository version. {msg}").format(msg=", ".join(error_messages))
Feb 26 16:06:05 pulp3-source-fedora31.localhost.example.com rq[239405]: ValueError: Cannot create repository version. More than one rpm.package content with the duplicate values for name, epoch, version, release, arch.


Related issues

Related to Pulp - Issue #5567: Content with duplicate repo_key_fields can be added to a repo versionCLOSED - CURRENTRELEASE<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

Associated revisions

Revision 15f043b0 View on GitHub
Added by ttereshc 9 months ago

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

Revision ba90a854 View on GitHub
Added by ttereshc 9 months ago

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)

Revision a626d977 View on GitHub
Added by ttereshc 9 months ago

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)

Revision 5bf86cf6 View on GitHub
Added by ttereshc 9 months ago

Properly compare modular content between the versions.

closes #6229 https://pulp.plan.io/issues/6229

(cherry picked from commit 15f043b0139db7cd3aa49ce5af2441ca8e44c039)

History

#1 Updated by dalley 9 months ago

  • Project changed from Python Support to RPM Support

#2 Updated by dalley 9 months ago

  • Description updated (diff)

#3 Updated by dalley 9 months ago

  • Priority changed from Normal to High
  • Severity changed from 2. Medium to 3. High
  • Triaged changed from No to Yes
  • Sprint set to Sprint 67
  • Tags Pulp 3 RPM blocker added

#4 Updated by daviddavis 9 months ago

The exception was added in #5567. My initial guess is that Pulp is trying to add the same package twice.

#5 Updated by daviddavis 9 months ago

  • Related to Issue #5567: Content with duplicate repo_key_fields can be added to a repo version added

#6 Updated by ttereshc 9 months ago

  • Status changed from NEW to POST
  • Assignee set to ttereshc

#7 Updated by rchan 9 months ago

  • Sprint changed from Sprint 67 to Sprint 68

#8 Updated by ttereshc 9 months ago

  • Status changed from POST to MODIFIED

#9 Updated by ttereshc 9 months ago

#10 Updated by ttereshc 9 months ago

#11 Updated by ttereshc 9 months ago

#12 Updated by dalley 8 months ago

  • Sprint/Milestone set to Pulp RPM 3.3.0

#13 Updated by dalley 8 months ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

#14 Updated by bmbouter 6 months ago

  • Tags deleted (Pulp 3 RPM blocker)

Please register to edit this issue

Also available in: Atom PDF