Project

Profile

Help

Issue #3104

repomd.xml is empty

Added by Ichimonji10 about 2 years ago. Updated 3 months ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Severity:
2. Medium
Version:
Platform Release:
2.15.0
Blocks Release:
OS:
Backwards Incompatible:
No
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
QA Contact:
Complexity:
Smash Test:
Verified:
Yes
Verification Required:
Yes
Sprint:

Description

When Pulp publishes and RPM repository, it places a number of files in a repodata directory. The most important of these files is the repomd.xml file. This file tells clients where all other files live. When Pulp 2.15 publishes an RPM file, all repomd.xml files are empty.

Here's a simple way to reproduce the issue:

pulp-admin login -u admin -p admin
pulp-admin rpm repo create --repo-id foo --feed https://repos.fedorapeople.org/pulp/pulp/fixtures/rpm-unsigned/
pulp-admin rpm repo sync run --repo-id foo
find /var/lib/pulp -name repomd.xml -exec wc '{}' ';'

In my case, here's the final line of output:

0 0 0 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509121269.36/repodata/repomd.xml

This issue affects Pulp 2.15 on F24, F25 and RHEL 7. It probably affects Pulp 2.15 on F26 too, but there's installation issues there, so I can't say for sure.

This issue isn't caused by SELinux. I can reproduce the issue with SELinux disabled. Also, there's no AVC denials in the system logs.

This issue occurs in a wide varity of situations. Several dozen Pulp Smash test cases all fail because of this.

3104.txt (2.46 KB) pcreech, 10/27/2017 09:36 PM 3104.txt
clipboard-201910111003-x4qs7.png (1.63 KB) bailyd17, 10/11/2019 06:33 AM clipboard-201910111003-x4qs7.png
clipboard-201910111004-gopg5.png (1.89 KB) bailyd17, 10/11/2019 06:34 AM clipboard-201910111004-gopg5.png
clipboard-201910111004-fulry.png (1.89 KB) bailyd17, 10/11/2019 06:34 AM clipboard-201910111004-fulry.png
250
250
250

Associated revisions

Revision b3e2dd8b View on GitHub
Added by Paul Donohue about 2 years ago

Add missing super() call in f73805f6

re #3055
https://pulp.plan.io/issues/3055

History

#1 Updated by mhrivnak about 2 years ago

I did a fresh "vagrant up" of all the master branches for pulp 2. The vagrant box uses Fedora 25. I followed exactly your steps, although I had to be the "apache" user for both the "find" and "wc" commands. So far Pulp is creating the repomd.xml correctly.

[vagrant@pulp2 ~]$ sudo -u apache wc /var/lib/pulp/published/yum/master/yum_distributor/foo/1509123641.08/repodata/repomd.xml
   8   36 2153 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509123641.08/repodata/repomd.xml

#2 Updated by Ichimonji10 about 2 years ago

This may affect only our package-based installations. This affects systems on Jenkins, and all of my systems used package-based installations.

#3 Updated by pcreech about 2 years ago

Adding output from a clean fresh install I did from the install guide at docs.pulpproject.org pointing to the nightly repos on fedorapeople.org

#4 Updated by mhrivnak about 2 years ago

When I got on the VM @pcreech provided, I found that the repomd.xml file was still being held open by the worker process. Here is select output from "lsof":

celery    11915        apache  cwd       DIR               0,18       100      33131 /run/pulp
celery    11915        apache   19w      REG              253,0         0   16963172 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509132750.65/repodata/repomd.xml
celery    11915 11917  apache  cwd       DIR               0,18       100      33131 /run/pulp
celery    11915 11917  apache   19w      REG              253,0         0   16963172 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509132750.65/repodata/repomd.xml
celery    11915 11919  apache  cwd       DIR               0,18       100      33131 /run/pulp
celery    11915 11919  apache   19w      REG              253,0         0   16963172 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509132750.65/repodata/repomd.xml
celery    11915 12068  apache  cwd       DIR               0,18       100      33131 /run/pulp
celery    11915 12068  apache   19w      REG              253,0         0   16963172 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509132750.65/repodata/repomd.xml
celery    11915 12069  apache  cwd       DIR               0,18       100      33131 /run/pulp
celery    11915 12069  apache   19w      REG              253,0         0   16963172 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509132750.65/repodata/repomd.xml
celery    11915 12072  apache  cwd       DIR               0,18       100      33131 /run/pulp
celery    11915 12072  apache   19w      REG              253,0         0   16963172 /var/lib/pulp/published/yum/master/yum_distributor/foo/1509132750.65/repodata/repomd.xml

#5 Updated by bmbouter about 2 years ago

  • Status changed from NEW to MODIFIED
  • Assignee set to PaulSD
  • Verification Required changed from No to Yes

I'm thinking that this broke with this [0] PR and was fixed when this PR [1] got merged. Specifically there was a missing call to finalize() which is now back in place. So with that in mind I'm associating that commit and moving to MODIFIED. Since we're sending back after a failure I'm marking Verification Required as True.

[0]: https://github.com/pulp/pulp_rpm/pull/1065
[1]: https://github.com/pulp/pulp_rpm/pull/1067

#6 Updated by PaulSD about 2 years ago

Agreed, the missing finalize() call caused similar behavior during my testing, and should be fixed with the second PR.

#7 Updated by Ichimonji10 about 2 years ago

  • Description updated (diff)

#8 Updated by pcreech about 2 years ago

  • Platform Release set to 2.15.0

#9 Updated by pcreech about 2 years ago

  • Status changed from MODIFIED to ON_QA

#10 Updated by Ichimonji10 about 2 years ago

  • Verified changed from No to Yes

There are numerous tests already targeting this issue, and they all pass.

#11 Updated by pcreech about 2 years ago

  • Status changed from ON_QA to CLOSED - CURRENTRELEASE

#12 Updated by bmbouter 9 months ago

  • Tags Pulp 2 added

#13 Updated by lostman 7 months ago

This has been a challenging time, and I appreciate you so much.
http://setpoffice.com/setup

#14 Updated by bailyd17 3 months ago

250
250
250

This is really nice. I would like to thank you for the information in this article you gave to us. If Someone looking for help for your programming assignment or homework? No-hassle our expert will help you to provide the programming assignment and homework help.

[[https://www.allassignmenthelp.com/programming-language-assignment-help.html]]

Please register to edit this issue

Also available in: Atom PDF