Issue #3816
Updated by Ichimonji10 almost 6 years ago
When one publishes an RPM repository, a number of metadata files are created. These files should be cleaned up at some point. Otherwise, metadata files from various publishes will pile up and consume resources such as disk space and inodes. RPM distributors offer a pair of options to control this behaviour:
* <code>remove_old_repodata</code> defines whether old metadata should be cleaned up at some point.
* <code>remove_old_repodata_threshold</code> defines how old metadata should be before it's cleaned up.
The most aggressive possible combination is <code class="json">{"remove_old_repodata": true, "remove_old_repodata_threshold": 0}</code>. This combination of values should produce the following _apparent_ publish-time behaviour:
<pre>
# Pseudocode
if remove_old_repodata:
for metadata_file in metadata_files:
if age(metadata_file) >= remove_old_repodata_threshold:
delete(metadata_file)
generate_new_metadata()
</pre>
However, the Pulp 2 master code that will become Pulp 2.17 produces the following _apparent_ publish-time behaviour: _appears_ to generate new metadata before deciding whether to clean old metadata:
<pre>
# Pseudocode
generate_new_metadata()
if remove_old_repodata:
for metadata_file in metadata_files:
if age(metadata_file) >= remove_old_repodata_threshold:
delete(metadata_file)
</pre>
The underlying cause of the bug could be something else, of course. Notably, setting <code>remove_old_repodata_threshold</code> to 1 fixes the problem. Regardless of the exact reason, the end result is that one can publish an RPM repository that has absolutely no metdata. No <code>repomd.xml</code>, no <code>...-comps.xml</code>, nothing.
The easiest way to reproduce is to execute a Pulp Smash test: <code>python -m unittest pulp_smash.tests.pulp2.rpm.api_v2.test_republish.RemoveOldRepodataTestCase.test_cleanup_now</code>. To reproduce in a more manual fashion, create an RPM repository with a request like the following, then add content to Pulp and publish the repository:
<pre><code class="python">
{'distributors': [{'auto_publish': False,
'distributor_config': {'generate_sqlite': True,
'http': True,
'https': True,
'relative_url': '73d25e9e-24d7-4953-98bb-ebe055be3050/',
'remove_old_repodata_threshold': 0},
'distributor_id': 'e4cbd2ed-626c-4dc0-acde-7125fef8373e',
'distributor_type_id': 'yum_distributor'}],
'id': '653a3067-1d57-4114-bf5a-49b4fc08e3ff',
'importer_config': {},
'importer_type_id': 'yum_importer',
'notes': {'_repo-type': 'rpm-repo'}}
</code></pre>
Here's some logs from a target VM while the aforementioned Pulp Smash test is running. Notice the two "Removed outdated" blocks in the log. This is from the two publishes.
<pre>Jul 03 13:45:24 fedora-27-pulp-2-17-nightly audit[1541]: USER_START pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=su[168/197]
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly audit[1541]: CRYPTO_KEY_USER pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=server fp=SHA256:f5:76:e1:5e:6d:ce:2d:45:b7:ca:48:8e:95:de:44:3a:67:69:b
0:08:ae:83:fa:33:bb:c7:ed:f2:c1:68:1e:1c direction=? spid=1638 suid=0 exe="/usr/sbin/sshd" hostname=? addr=? terminal=? res=success'
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly audit[1541]: USER_START pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly audit[1541]: CRYPTO_KEY_USER pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=server fp=SHA256:f5:76:e1:5e:6d:ce:2d:45:b7:ca:48:8e:95:de:44:3a:67:69:b
0:08:ae:83:fa:33:bb:c7:ed:f2:c1:68:1e:1c direction=? spid=1653 suid=0 exe="/usr/sbin/sshd" hostname=? addr=? terminal=? res=success'
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly audit[1541]: USER_START pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly audit[1541]: CRYPTO_KEY_USER pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=server fp=SHA256:f5:76:e1:5e:6d:ce:2d:45:b7:ca:48:8e:95:de:44:3a:67:69:b
0:08:ae:83:fa:33:bb:c7:ed:f2:c1:68:1e:1c direction=? spid=1673 suid=0 exe="/usr/sbin/sshd" hostname=? addr=? terminal=? res=success'
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly audit[1541]: USER_END pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[845]: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1173]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[8067265b-f402-4372-bc0b-b241335b20c4] Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1302]: py.warnings:WARNING: [8067265b] (1302-18336) /usr/lib64/python2.7/site-packages/pymongo/topology.py:145: UserWarning: MongoClient opened before fork. Create MongoClient with connect=F
alse, or create client after forking. See PyMongo's documentation for details: http://api.mongodb.org/python/current/faq.html#pymongo-fork-safe>
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1302]: py.warnings:WARNING: [8067265b] (1302-18336) "MongoClient opened before fork. Create MongoClient "
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1302]: py.warnings:WARNING: [8067265b] (1302-18336)
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1302]: kombu.transport.qpid:INFO: [8067265b] Connected to qpid with SASL mechanism ANONYMOUS
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.managers.content.upload.import_uploaded_unit[62c45ebc-5795-4c4f-80fa-c2d3ae3aaaef]
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1299]: py.warnings:WARNING: [62c45ebc] (1299-82880) /usr/lib64/python2.7/site-packages/pymongo/topology.py:145: UserWarning: MongoClient opened before fork. Create MongoClient with connect=F
alse, or create client after forking. See PyMongo's documentation for details: http://api.mongodb.org/python/current/faq.html#pymongo-fork-safe>
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1299]: py.warnings:WARNING: [62c45ebc] (1299-82880) "MongoClient opened before fork. Create MongoClient "
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1299]: py.warnings:WARNING: [62c45ebc] (1299-82880)
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1302]: celery.app.trace:INFO: [8067265b] Task pulp.server.async.tasks._queue_reserved_task[8067265b-f402-4372-bc0b-b241335b20c4] succeeded in 0.067986821s: None
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[25719284-f645-44c1-8cf3-274d76c57576]
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [62c45ebc] Task pulp.server.managers.content.upload.import_uploaded_unit[62c45ebc-5795-4c4f-80fa-c2d3ae3aaaef] succeeded in 0.045987285s: {'details': {}, 'succe
ss_flag': True, 'summary': ''}
Jul 03 13:45:24 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [25719284] Task pulp.server.async.tasks._release_resource[25719284-f645-44c1-8cf3-274d76c57576] succeeded in 0.00345146399999s: None
Jul 03 13:45:26 fedora-27-pulp-2-17-nightly pulp[844]: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
Jul 03 13:45:26 fedora-27-pulp-2-17-nightly pulp[1173]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[c8332162-d924-4ae2-a5f3-37b3fd83599c]
Jul 03 13:45:26 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[18783006-8bc8-4701-9857-05d672c3dc0e]
Jul 03 13:45:26 fedora-27-pulp-2-17-nightly pulp[1302]: celery.app.trace:INFO: [c8332162] Task pulp.server.async.tasks._queue_reserved_task[c8332162-d924-4ae2-a5f3-37b3fd83599c] succeeded in 0.016684196s: None
Jul 03 13:45:26 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[29317462-3820-476d-a52f-6f31a9690876]
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated a27718cc28ec6d71432e0ef3e6da544b7f9d93f6bb7d0a55aacd592d03144b70-comps.xml
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated f3671e8d72f77ff71b21f20b784e1192b98e2f961398a53389dae7b72d7333d0-updateinfo.xml.gz
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated 4f949611b13e1e202a4ac03b581c2f2eb53b8d900eaa15c60a7839d3b999c7fc-primary.xml.gz
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated edb06f565ddf9156c623867135af4b1d5dadf64ac34313af20fd8ef3115604c9-filelists.xml.gz
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated 02af42693f5d14b5c9300310ba6db5e6ec49e428d69454d99c398b734075af82-other.xml.gz
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated 3f559e93b68449e48e9334b10dfdedebfc9fa4b3dcec1ce4542485a209797a51-primary.sqlite.bz2
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated ea2dfeef92713e70a2bc010df5463198670b4c02e9b6ffd9ea3161cca808ff57-filelists.sqlite.bz2
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated 99ebfac146e8d6a6a19cab8b157b18e40ca2d2c6c1dde840b9faf526da752584-other.sqlite.bz2
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated 9f7e68e69d7e2453caa3865a97f8165c1f34d089010c8eb00e7fef6396a6aafa-comps.xml.gz
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [18783006] Removed outdated repomd.xml
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [18783006] Task pulp.server.managers.repo.publish.publish[18783006-8bc8-4701-9857-05d672c3dc0e] succeeded in 0.239101687s: {'exception': None, 'repo_id': '98d7b
060-b886-4d3a-b0c3-0bff60975f93', 'traceback': None, 'started': '2018-07-03T17:45:26Z', '_ns': 'repo_publish_results', 'completed': datetime.datetime(2018, 7, 3, 17, 45, 27, 183453, tzinfo=<isodate.tzinfo.Utc object at 0x7f7e8953ad90>), 'e
rror_message': None, 'distributor_type_id': 'yum_distributor', 'distributor_id': '1352815b-f627-44f4-93a0-b2cb9182d81a', 'summary': {'generate sqlite': 'FINISHED', 'initialize_repo_metadata': 'FINISHED', 'rpms': 'FINISHED', 'repoview': 'SK
IPPED', 'close_repo_metadata': 'FINISHED', 'errata': 'FINISHED', 'comps': 'FINISHED', 'distribution': 'FINISHED', 'drpms': 'SKIPPED', 'publish_directory': 'FINISHED', 'remove_old_repodata': 'FINISHED', 'metadata': 'FINISHED'}, 'result': 's
uccess', 'id': '5b3bb637dc532105135ae42c', 'details': [{'num_processed': 1, 'items_total': 1, 'state': 'FINISHED', 'num_success': 1, 'error_details': [...], 'description': 'Initializing repo metadata', 'num_failures': 0, 'step_id': '51f823
76-04d7-4dec-97bd-87d822bcfcda', ...}]}
Jul 03 13:45:27 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [29317462] Task pulp.server.async.tasks._release_resource[29317462-3820-476d-a52f-6f31a9690876] succeeded in 0.00217074700001s: None
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly audit[1541]: USER_START pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly audit[1541]: CRYPTO_KEY_USER pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=server fp=SHA256:f5:76:e1:5e:6d:ce:2d:45:b7:ca:48:8e:95:de:44:3a:67:69:b
0:08:ae:83:fa:33:bb:c7:ed:f2:c1:68:1e:1c direction=? spid=1709 suid=0 exe="/usr/sbin/sshd" hostname=? addr=? terminal=? res=success'
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly audit[1541]: USER_END pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly audit[1541]: USER_START pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly audit[1541]: CRYPTO_KEY_USER pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=server fp=SHA256:f5:76:e1:5e:6d:ce:2d:45:b7:ca:48:8e:95:de:44:3a:67:69:b
0:08:ae:83:fa:33:bb:c7:ed:f2:c1:68:1e:1c direction=? spid=1723 suid=0 exe="/usr/sbin/sshd" hostname=? addr=? terminal=? res=success'
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly audit[1541]: USER_END pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[846]: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1173]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[00451519-3a07-4a1c-95e0-6ebcb7b8c69d]
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.managers.content.upload.import_uploaded_unit[92c9a64f-190f-4f44-8cc1-1c564cdbc489]
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1302]: celery.app.trace:INFO: [00451519] Task pulp.server.async.tasks._queue_reserved_task[00451519-3a07-4a1c-95e0-6ebcb7b8c69d] succeeded in 0.013211733s: None
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[b9234397-451a-4012-997b-ba90919f3f1f]
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [92c9a64f] Task pulp.server.managers.content.upload.import_uploaded_unit[92c9a64f-190f-4f44-8cc1-1c564cdbc489] succeeded in 0.024780344s: {'details': {}, 'succe
ss_flag': True, 'summary': ''}
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [b9234397] Task pulp.server.async.tasks._release_resource[b9234397-451a-4012-997b-ba90919f3f1f] succeeded in 0.001105817s: None
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1173]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[d5eabf70-3f9b-4b66-a482-65f5c7c9017f]
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[aa1b5d93-2f05-45c0-a5a3-3d1670fa2ec6]
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[b673bd19-9d54-4ae4-8f62-fe0aa3a04dd0]
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1302]: celery.app.trace:INFO: [d5eabf70] Task pulp.server.async.tasks._queue_reserved_task[d5eabf70-3f9b-4b66-a482-65f5c7c9017f] succeeded in 0.022670332s: None
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated a27718cc28ec6d71432e0ef3e6da544b7f9d93f6bb7d0a55aacd592d03144b70-comps.xml
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated c5cb88c5f87df629b9fea02eda85586b6ab0518f2d67b76c10c816573c91eb77-updateinfo.xml.gz
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated 6b0ea8e21b7874e23daf8402924deee2e9a66cedea2bb6d130496ea025919745-primary.xml.gz
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated c0951a5232bd369545841cb95c4bb996da45358e3057268544d5207bf215f5c3-filelists.xml.gz
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated f028e70abb787680e085bc62cee4cda9b8cbed485e1f5de008d9d6e487ea3857-other.xml.gz
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated 30e3cbf4041e63e6d57ba24dbf228c98c6467153c59a55a4179098c5b5267792-primary.sqlite.bz2
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated 2d85f935a9d19ea9634fc3533589d58b9bc471a7bee90dfbb4cbf44d6f4a0569-filelists.sqlite.bz2
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated 902a7b2edb8f9ae47a4efbae9982dbacef88f105e757372552a57f736a9739bd-other.sqlite.bz2
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated 9f7e68e69d7e2453caa3865a97f8165c1f34d089010c8eb00e7fef6396a6aafa-comps.xml.gz
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: pulp.plugins.pulp_rpm.plugins.distributors.yum.publish:INFO: [aa1b5d93] Removed outdated repomd.xml
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [aa1b5d93] Task pulp.server.managers.repo.publish.publish[aa1b5d93-2f05-45c0-a5a3-3d1670fa2ec6] succeeded in 0.16950536s: {'exception': None, 'repo_id': '98d7b0
60-b886-4d3a-b0c3-0bff60975f93', 'traceback': None, 'started': '2018-07-03T17:45:29Z', '_ns': 'repo_publish_results', 'completed': datetime.datetime(2018, 7, 3, 17, 45, 29, 832412, tzinfo=<isodate.tzinfo.Utc object at 0x7f7e8953ad90>), 'er
ror_message': None, 'distributor_type_id': 'yum_distributor', 'distributor_id': '1352815b-f627-44f4-93a0-b2cb9182d81a', 'summary': {'generate sqlite': 'FINISHED', 'initialize_repo_metadata': 'FINISHED', 'remove_old_repodata': 'FINISHED', '
rpms': 'FINISHED', 'repoview': 'SKIPPED', 'close_repo_metadata': 'FINISHED', 'drpms': 'SKIPPED', 'comps': 'FINISHED', 'distribution': 'FINISHED', 'save_tar': 'FINISHED', 'publish_directory': 'FINISHED', 'errata': 'FINISHED', 'metadata': 'F
INISHED'}, 'result': 'success', 'id': '5b3bb639dc532105135ae42d', 'details': [{'num_processed': 1, 'items_total': 1, 'state': 'FINISHED', 'num_success': 1, 'error_details': [...], 'description': 'Copying files', 'num_failures': 0, 'step_id
': '159c25af-8eea-4225-b0f3-976...', ...}]}
Jul 03 13:45:29 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [b673bd19] Task pulp.server.async.tasks._release_resource[b673bd19-9d54-4ae4-8f62-fe0aa3a04dd0] succeeded in 0.001217657s: None
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly audit[1541]: USER_START pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly audit[1541]: CRYPTO_KEY_USER pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=server fp=SHA256:f5:76:e1:5e:6d:ce:2d:45:b7:ca:48:8e:95:de:44:3a:67:69:b
0:08:ae:83:fa:33:bb:c7:ed:f2:c1:68:1e:1c direction=? spid=1750 suid=0 exe="/usr/sbin/sshd" hostname=? addr=? terminal=? res=success'
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly audit[1541]: USER_END pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly audit[1541]: USER_START pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly audit[1541]: CRYPTO_KEY_USER pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=server fp=SHA256:f5:76:e1:5e:6d:ce:2d:45:b7:ca:48:8e:95:de:44:3a:67:69:b
0:08:ae:83:fa:33:bb:c7:ed:f2:c1:68:1e:1c direction=? spid=1764 suid=0 exe="/usr/sbin/sshd" hostname=? addr=? terminal=? res=success'
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly audit[1541]: USER_END pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly pulp[1173]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[80b1e894-c8b8-4e02-85f6-9b1c1686e797]
Jul 03 13:45:31 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.tasks.repository.delete[d72d6e11-d996-409c-b5c3-18f1cffa0b3a]
Jul 03 13:45:32 fedora-27-pulp-2-17-nightly pulp[1302]: celery.app.trace:INFO: [80b1e894] Task pulp.server.async.tasks._queue_reserved_task[80b1e894-c8b8-4e02-85f6-9b1c1686e797] succeeded in 0.032215876s: None
Jul 03 13:45:32 fedora-27-pulp-2-17-nightly pulp[1195]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[4ee27b41-702b-4141-815e-371af8000b00]
Jul 03 13:45:32 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [d72d6e11] Task pulp.server.tasks.repository.delete[d72d6e11-d996-409c-b5c3-18f1cffa0b3a] succeeded in 0.114818868s: <pulp.server.async.tasks.TaskResult object
at 0x7f7e706586d0>
Jul 03 13:45:32 fedora-27-pulp-2-17-nightly pulp[1299]: celery.app.trace:INFO: [4ee27b41] Task pulp.server.async.tasks._release_resource[4ee27b41-702b-4141-815e-371af8000b00] succeeded in 0.002619303s: None
Jul 03 13:45:34 fedora-27-pulp-2-17-nightly audit[1541]: USER_END pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
Jul 03 13:45:34 fedora-27-pulp-2-17-nightly audit[1541]: USER_END pid=1541 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login id=0 exe="/usr/sbin/sshd" hostname=? addr=192.168.101.1 terminal=ssh res=success'
</pre>
Here's the RPMs on an affected VM:
<pre>[root@fedora-27-pulp-2-17-nightly ~]# rpm -qa | grep pulp | sort
pulp-admin-client-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
pulp-deb-admin-extensions-1.8.0-0.1.alpha.201807021614git4df9825.fc27.noarch
pulp-deb-plugins-1.8.0-0.1.alpha.201807021614git4df9825.fc27.noarch
pulp-docker-admin-extensions-3.2.0-0.1.alpha.201807021600git6dd2677.fc27.noarch
pulp-docker-plugins-3.2.0-0.1.alpha.201807021600git6dd2677.fc27.noarch
pulp-ostree-admin-extensions-1.4.0-0.1.alpha.201807021602git2c2d534.fc27.noarch
pulp-ostree-plugins-1.4.0-0.1.alpha.201807021602git2c2d534.fc27.noarch
pulp-puppet-admin-extensions-2.17.0-0.1.alpha.201807021604git44a02f8.fc27.noarch
pulp-puppet-plugins-2.17.0-0.1.alpha.201807021604git44a02f8.fc27.noarch
pulp-puppet-tools-2.17.0-0.1.alpha.201807021604git44a02f8.fc27.noarch
pulp-python-admin-extensions-2.1.0-0.1.alpha.201807021558gitfabd48c.fc27.noarch
pulp-python-plugins-2.1.0-0.1.alpha.201807021558gitfabd48c.fc27.noarch
pulp-rpm-admin-extensions-2.17.0-0.1.alpha.201807021606git9e64a04.fc27.noarch
pulp-rpm-plugins-2.17.0-0.1.alpha.201807021606git9e64a04.fc27.noarch
pulp-selinux-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
pulp-server-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
python-pulp-bindings-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
python-pulp-client-lib-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
python-pulp-common-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
python-pulp-deb-common-1.8.0-0.1.alpha.201807021614git4df9825.fc27.noarch
python-pulp-docker-common-3.2.0-0.1.alpha.201807021600git6dd2677.fc27.noarch
python-pulp-oid_validation-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
python-pulp-ostree-common-1.4.0-0.1.alpha.201807021602git2c2d534.fc27.noarch
python-pulp-puppet-common-2.17.0-0.1.alpha.201807021604git44a02f8.fc27.noarch
python-pulp-python-common-2.1.0-0.1.alpha.201807021558gitfabd48c.fc27.noarch
python-pulp-repoauth-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch
python-pulp-rpm-common-2.17.0-0.1.alpha.201807021606git9e64a04.fc27.noarch
python-pulp-streamer-2.17.0-0.1.alpha.201807021608gitd738592.fc27.noarch</pre>
.