https://pulp.plan.io/https://pulp.plan.io/favicon.ico2020-10-27T12:26:31ZPulpMigration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=642422020-10-27T12:26:31Zadam.winberg@smhi.se
<ul></ul><p>It doesn't seem like it's just a couple of files being deleted either, when i discover the problem and run 'sync' on pulp2 with 'force-full' there are quite a few rpm's being downloaded, some examples from different repos:</p>
<pre><code>RPMs: 2848/2848 items
...
RPMs: 2/2 items
...
RPMs: 2609/2609 items
</code></pre> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=642632020-10-27T12:57:08Zdalleydalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>NEW</i> to <i>CLOSED - DUPLICATE</i></li></ul><p>Nope, you understand perfectly, this is a serious issue. Luckily I just found the cause a few hours ago.</p> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=642642020-10-27T12:57:25Zdalleydalley@redhat.com
<ul><li><strong>Is duplicate of</strong> <i><a class="issue tracker-1 status-11 priority-8 priority-highest closed" href="/issues/7676">Issue #7676</a>: django-cleanup can silently delete files being used by existing artifacts in some circumstances</i> added</li></ul> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=643012020-10-27T15:56:05Zdalleydalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>CLOSED - DUPLICATE</i> to <i>NEW</i></li></ul><p>While it's pretty likely to be the same issue, marking it duplicate was probably premature.</p>
<p>I'm attempting to reproduce it now. Which repositories do you have synced and/or are trying to migrate? It might even be helpful if we could duplicate your setup and test that specific configuration in-depth, both to help you avoid future issues, and to make discovering them easier for us. Thanks again for helping us with finding and troubleshooting these issues.</p>
<p>If is the same issue as the one I linked earlier, this should resolve it. If you'd rather wait for me to try to reproduce it first that's totally fine:</p>
<ul>
<li>edit /usr/lib/python $$version$$/site-packages/pulpcore/app/settings.py (swap out $$version$$ for whatever Python is on your system, probably 3.6</li>
<li>remove or comment out the line "django_cleanup.apps.CleanupConfig" in the "INSTALLED_APPS" section</li>
<li>restart, repair pulp 2, remigrate</li>
</ul> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=643072020-10-27T18:05:40Zdalleydalley@redhat.com
<ul></ul><p>I was able to reproduce. Will now test the w/ the patch applied.</p> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=643102020-10-27T18:21:45Zdalleydalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>NEW</i> to <i>CLOSED - DUPLICATE</i></li></ul><p>It's the same issue, the patch resolves this as well, yay.</p>
<p>Will be included in pulpcore 3.7.3, and the filelists fix should go into migration plugin 0.5.1. Not sure when those will pop into the repository, probably by the end of the week.</p> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=643252020-10-28T06:14:03Zadam.winberg@smhi.se
<ul></ul><p>awesome work!</p>
<p>Will update and test as soon as packages are available.</p> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=645472020-11-03T13:23:20Zadam.winberg@smhi.se
<ul></ul><p>Status update, still waiting on the 3.7.3 package in the foreman repo.</p> Migration Plugin - Issue #7744: pulp2 data is deleted during migrationhttps://pulp.plan.io/issues/7744?journal_id=646872020-11-07T16:21:09Zadam.winberg@smhi.se
<ul></ul><p>I have now been able to test with 3.7.3 and this is indeed solved.</p>