Issue #512
closedPulp cannot sync an EPEL 5 repository that was published by Pulp
Description
Description of problem:
I cannot sync an EPEL 5 repository that was published by Pulp.
Version-Release number of selected component (if applicable):
2.4.1-0.7.beta.
How reproducible:
Every time.
Steps to Reproduce:
1. Sync/Publish EPEL 5 (https://download.fedoraproject.org/pub/epel/5/x86_64/)
2. Create a new repo that has the Pulp published EPEL 5 as its feed.
3. Sync the new repo
Actual results:
$ pulp-admin rpm repo sync run --repo-id epel-5 --------------------------------------------------------------------
Synchronizing Repository [epel-5]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[|]
... completed
Downloading repository content...
[==================================================] 100%
RPMs: 55/55 items
Delta RPMs: 0/0 items
... failed
Task Failed
Importer indicated a failed response
$ sudo cat /var/log/messages | grep <the_fail>
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call last):
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 113, in run
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.update_content(metadata_files)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 267, in update_content
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: purge.purge_unwanted_units(metadata_files, self.sync_conduit, self.call_config)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/purge.py", line 37, in purge_unwanted_units
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: remove_missing_errata(metadata_files, conduit)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/purge.py", line 127, in remove_missing_errata
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: updateinfo.process_package_element)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/purge.py", line 255, in get_remote_units
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: for model in package_info_generator:
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 63, in package_list_generator
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: package_info = process_func(element)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/repomd/updateinfo.py", line 27, in process_package_element
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 'description': element.find('description').text,
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: AttributeError: 'NoneType' object has no attribute 'text'
Sep 4 17:38:18 grapefruit pulp: celery.worker.job:ERROR: Task pulp.server.tasks.repository.sync_with_auto_publish[6a7f5fdd-6214-47ae-b9ff-fa569924bbe3] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Expected results:
The second repo sync should succeed.
Additional info:
I noticed this with EPEL 5, though it may not be unique to EPEL 5. I haven't tried to do this same operation with other repositories.
+ This bug was cloned from Bugzilla Bug #1138475 +
Related issues
Updated by rbarlow about 9 years ago
I should add that the "source" repo was on a 2.4.0-1 system, and it was 2.4.1-0.7.beta that was failing to sync. Those versions are extremely similar when it comes to the yum plugins, so I doubt that data makes much of a difference, but I thought it was worth noting.
+ This comment was cloned from Bugzilla #1138475 comment 1 +
Updated by mhrivnak about 9 years ago
https://github.com/pulp/pulp_rpm/pull/560
+ This comment was cloned from Bugzilla #1138475 comment 2 +
Updated by veiko@linux.ee about 9 years ago
I can confirm this. Happens with EPEL 6 as well.
I have different stages of local development branches of repositories, one of them being EPEL 6. Base system is CentOS 6.5. All other repositories work fine, but EPEL 6 fails.
First stage gets repository contents from remote mirror and following stages get their contents from each other (--feed file:///), those stages are chained together and worked with Pulp 2.2 and 2.3.
I get error when trying to sync from first stage to second stage locally.
--------------------------------------------------------------------
Synchronizing Repository [epel-6-int]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[|]
... completed
Downloading repository content...
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed
Importing errata...
[-]
... failed
Task Failed
Importer indicated a failed response
NOTE that /var/lib/pulp/published/yum/https/repos/epel/6/x86_64/ is existing and contains EPEL 6 RPM-s and repodata directory with proper contents.
From /var/log/messages
Oct 29 17:45:48 tstplp01 pulp: celery.worker.strategy:INFO: Received task: pulp.server.tasks.repository.sync_with_auto_publish[5d207c6a-8df5-40b4-8e2f-216bebac0646]
Oct 29 17:45:48 tstplp01 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_release_resource[66da6f4e-7534-4b85-a865-b13c1e7038b2]
Oct 29 17:45:48 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from file:///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.
Oct 29 17:45:48 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Generating metadata databases.
Oct 29 17:46:29 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Determining which units need to be downloaded.
Oct 29 17:47:44 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading 0 RPMs.
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading additional units.
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: File "/usr/lib/python2.6/site-packages/nectar/downloaders/local.py", line 144, in copy
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: src_handle = open(src_path, 'rb')
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: File "/usr/lib/python2.6/site-packages/nectar/downloaders/local.py", line 144, in _copy
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: src_handle = open(src_path, 'rb')
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 133, in run
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.get_errata(metadata_files)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 462, in get_errata
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.save_fileless_units(errata_file_handle, updateinfo.PACKAGE_TAG, updateinfo.process_package_element)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 522, in save_fileless_units
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: to_save = existing.check_repo(wanted, self.sync_conduit.get_units)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 37, in check_repo
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sorted_units = _sort_by_type(wanted)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 162, in _sort_by_type
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: for unit in wanted:
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 520, in <genexpr>
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: wanted = (model.as_named_tuple for model in package_info_generator)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 63, in package_list_generator
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: package_info = process_func(element)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/updateinfo.py", line 27, in process_package_element
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 'description': element.find('description').text,
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: AttributeError: 'NoneType' object has no attribute 'text'
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: Task pulp.server.tasks.repository.sync_with_auto_publish[5d207c6a-8df5-40b4-8e2f-216bebac0646] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: R = retval = fun(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 306, incall_
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: return super(Task, self).__call__(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in protected_call
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: return self.run(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/tasks/repository.py", line 210, in sync_with_auto_publish
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: sync_result = managers.repo_sync_manager().sync(repo_id, sync_config_override=overrides)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 113, in sync
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: raise PulpExecutionException(_('Importer indicated a failed response'))
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: PulpExecutionException: Importer indicated a failed response
Oct 29 17:48:03 tstplp01 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[1b11a963-e339-43de-b26a-1093c465eba3]
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_release_resource[66da6f4e-7534-4b85-a865-b13c1e7038b2] succeeded in 0.0187427470228s: None
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[1b11a963-e339-43de-b26a-1093c465eba3] succeeded in 0.039365892997s: None
From ~/.pulp/server_calls.log
2014-10-29 17:48:04,038 - INFO - GET request to /pulp/api/v2/tasks/5d207c6a-8df5-40b4-8e2f-216bebac0646/ with parameters None
2014-10-29 17:48:04,038 - INFO - Response status : 200
2014-10-29 17:48:04,039 - INFO - Response body :
{
"exception": null,
"task_type": "pulp.server.tasks.repository.sync_with_auto_publish",
"_href": "/pulp/api/v2/tasks/5d207c6a-8df5-40b4-8e2f-216bebac0646/",
"task_id": "5d207c6a-8df5-40b4-8e2f-216bebac0646",
"tags": [
"pulp:repository:epel-6-int",
"pulp:action:sync"
],
"finish_time": "2014-10-29T17:48:03Z",
"_ns": "task_status",
"start_time": "2014-10-29T17:45:48Z",
"traceback": "Traceback (most recent call last):\n File \"/usr/lib/python2.6/site-packages/celery/app/trace.py\", line 240, in trace_task\n R = retval = fun(*args, **kwargs)\n File \"/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py\", line 306, in call\n return super(Task, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.6/site-packages/celery/app/trace.py\", line 437, in protected_call\n return self.run(*args, **kwargs)\n File \"/usr/lib/python2.6/site-packages/pulp/server/tasks/repository.py\", line 210, in sync_with_auto_publish\n sync_result = managers.repo_sync_manager().sync(repo_id, sync_config_override=overrides)\n File \"/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py\", line 113, in sync\n raise PulpExecutionException(_('Importer indicated a failed response'))\nPulpExecutionException: Importer indicated a failed response\n",
"spawned_tasks": [],
"progress_report": {
"yum_importer": {
"content": {
"size_total": 0,
"items_left": 0,
"items_total": 0,
"state": "FINISHED",
"size_left": 0,
"details": {
"rpm_total": 0,
"rpm_done": 0,
"drpm_total": 0,
"drpm_done": 0
},
"error_details": []
},
"comps": {
"state": "NOT_STARTED"
},
"distribution": {
"items_total": 0,
"state": "FINISHED",
"error_details": [],
"items_left": 0
},
"errata": {
"state": "FAILED",
"error": "'NoneType' object has no attribute 'text'"
},
"metadata": {
"state": "FINISHED"
}
}
},
"queue": "reserved_resource_worker-0@tstplp01.foobar.com.dq",
"state": "error",
"result": null,
"error": {
"code": "PLP0000",
"data": {},
"description": "Importer indicated a failed response",
"sub_errors": []
},
"_id": {
"$oid": "545127ccd604ff01e4d822c2"
},
"id": "545127cc727e241efa7814cf"
}
+ This comment was cloned from Bugzilla #1138475 comment 3 +
Updated by veiko@linux.ee about 9 years ago
Adding Pulp package versions that are missing from previous post.
python-pulp-common-2.4.3-1.el6.noarch
python-pulp-client-lib-2.4.3-1.el6.noarch
python-pulp-puppet-common-2.4.3-1.el6.noarch
python-isodate-0.5.0-4.pulp.el6.noarch
python-rhsm-1.8.0-2.pulp.el6.x86_64
python-pulp-rpm-common-2.4.3-1.el6.noarch
pulp-rpm-plugins-2.4.3-1.el6.noarch
python-pulp-bindings-2.4.3-1.el6.noarch
pulp-rpm-admin-extensions-2.4.3-1.el6.noarch
pulp-selinux-2.4.3-1.el6.noarch
pulp-puppet-admin-extensions-2.4.3-1.el6.noarch
mod_wsgi-3.4-1.pulp.el6.x86_64
python-kombu-3.0.15-12.pulp.el6.noarch
pulp-server-2.4.3-1.el6.noarch
pulp-admin-client-2.4.3-1.el6.noarch
pulp-puppet-plugins-2.4.3-1.el6.noarch
+ This comment was cloned from Bugzilla #1138475 comment 4 +
Updated by veiko@linux.ee about 9 years ago
(In reply to Michael Hrivnak from comment #2)
Applied that patch to pulp-server-2.4.3-1.el6.noarch
Oct 29 21:54:34 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call last):
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 133, in run
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.get_errata(metadata_files)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 462, in get_errata
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.save_fileless_units(errata_file_handle, updateinfo.PACKAGE_TAG, updateinfo.process_package_element)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 522, in save_fileless_units
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: to_save = existing.check_repo(wanted, self.sync_conduit.get_units)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 37, in check_repo
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sorted_units = _sort_by_type(wanted)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 162, in _sort_by_type
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: for unit in wanted:
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 520, in <genexpr>
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: wanted = (model.as_named_tuple for model in package_info_generator)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 63, in package_list_generator
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: package_info = process_func(element)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/updateinfo.py", line 27, in process_package_element
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 'description': element.find('description').text,
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: AttributeError: 'NoneType' object has no attribute 'text'
Oct 29 21:54:34 tstplp01 pulp: celery.worker.job:ERROR: Task pulp.server.tasks.repository.sync_with_auto_publish[d9a8ab94-43bd-4a3a-b15a-fd595431dd8b] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
+ This comment was cloned from Bugzilla #1138475 comment 5 +
Updated by veiko@linux.ee about 9 years ago
Workaround is to create first stage local repository with '--feed http://someremotefeed --skip erratum'. No need to skip any components in second stage local repository.
+ This comment was cloned from Bugzilla #1138475 comment 6 +
Updated by cduryee about 9 years ago
fixed in pulp 2.6.0-0.2.beta
+ This comment was cloned from Bugzilla #1138475 comment 7 +
Updated by igulina@redhat.com about 9 years ago
for EPEL 5 repo on pulp-server-2.6.0-0.4.beta.fc20.noarch
pulp-admin rpm repo create --repo-id epel5_1 --feed https://download.fedoraproject.org/pub/epel/5/x86_64/
Successfully created repository [epel5_1]
pulp-admin rpm repo sync run --repo-id epel5_1
--------------------------------------------------------------------
Synchronizing Repository [epel5_1]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[-]
... completed
Downloading repository content...
[==================================================] 100%
RPMs: 6848/6848 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed
Importing errata...
[\]
... completed
Importing package groups/categories...
[\]
... completed
Task Succeeded
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[==================================================] 100%
6848 of 6848 items
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[==================================================] 100%
1998 of 1998 items
... completed
Publishing Comps file
[==================================================] 100%
41 of 41 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[\]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
pulp-admin rpm repo list
--------------------------------------------------------------------
RPM Repositories
--------------------------------------------------------------------
Id: zoo_repo
Display Name: zoo_repo
Description: None
Content Unit Counts:
Erratum: 4
Package Category: 1
Package Group: 2
Rpm: 32
Id: test_repo
Display Name: test_repo
Description: None
Content Unit Counts:
Rpm: 734
Id: epel5_1
Display Name: epel5_1
Description: None
Content Unit Counts:
Erratum: 1998
Package Category: 5
Package Group: 36
Rpm: 6848
Yum Repo Metadata File: 1
pulp-admin rpm repo publish run --repo-id epel5_1
--------------------------------------------------------------------
Publishing Repository [epel5_1]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Copying files
[\]
... completed
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[\]
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[==================================================] 100%
1998 of 1998 items
... completed
Publishing Comps file
[==================================================] 100%
41 of 41 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[|]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
ls -l /var/lib/pulp/published/yum/master/yum_distributor/epel5_1/1421344139.7/
Display all 6849 possibilities? (y or n)
pulp-admin rpm repo create --repo-id epel5_2 --feed file:///var/lib/pulp/published/yum/master/yum_distributor/epel5_1/1421344139.7/
Successfully created repository [epel5_2]
pulp-admin rpm repo sync run --repo-id epel5_2
--------------------------------------------------------------------
Synchronizing Repository [epel5_2]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[-]
... completed
Downloading repository content...
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed
Importing errata...
[\]
... completed
Importing package groups/categories...
[\]
... completed
Task Succeeded
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[==================================================] 100%
6848 of 6848 items
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[==================================================] 100%
1998 of 1998 items
... completed
Publishing Comps file
[==================================================] 100%
41 of 41 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[\]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
pulp-admin rpm repo list
--------------------------------------------------------------------
RPM Repositories
--------------------------------------------------------------------
Id: zoo_repo
Display Name: zoo_repo
Description: None
Content Unit Counts:
Erratum: 4
Package Category: 1
Package Group: 2
Rpm: 32
Id: test_repo
Display Name: test_repo
Description: None
Content Unit Counts:
Rpm: 734
Id: epel5_1
Display Name: epel5_1
Description: None
Content Unit Counts:
Erratum: 1998
Package Category: 5
Package Group: 36
Rpm: 6848
Yum Repo Metadata File: 1
Id: epel5_2
Display Name: epel5_2
Description: None
Content Unit Counts:
Erratum: 1998
Package Category: 5
Package Group: 36
Rpm: 6848
Yum Repo Metadata File: 1
+ This comment was cloned from Bugzilla #1138475 comment 8 +
Updated by igulina@redhat.com about 9 years ago
Needed to be checked for EPEL 6 on rhel6 pulp 2.6-0.4 according to comment [1], but depends on BZ 1176698 [2]
[1] https://bugzilla.redhat.com/show_bug.cgi?id=1138475#c3
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1176698
+ This comment was cloned from Bugzilla #1138475 comment 9 +
Updated by igulina@redhat.com about 9 years ago
rpm -qa pulp-server
pulp-server-2.6.0-0.5.beta.el6.noarch
pulp-admin rpm repo create --repo-id epel_6_1 --feed https://download.fedoraproject.org/pub/epel/6/x86_64/
Successfully created repository [epel_6_1]
pulp-admin rpm repo sync run --repo-id epel_6_1
--------------------------------------------------------------------
Synchronizing Repository [epel_6_1]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[\]
... completed
Downloading repository content...
[==================================================] 100%
RPMs: 11189/11189 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed
Importing errata...
[|]
... completed
Importing package groups/categories...
[|]
... completed
Task Succeeded
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[==================================================] 100%
11189 of 11189 items
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed
Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[|]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
pulp-admin rpm repo publish run --repo-id epel_6_1
--------------------------------------------------------------------
Publishing Repository [epel_6_1]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Copying files
[|]
... completed
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[\]
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed
Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[-]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
pulp-admin rpm repo create --repo-id epel_6_2 --feed file:///var/lib/pulp/published/yum/master/yum_distributor/epel_6_1/1421693520.56/
Successfully created repository [epel_6_2]
pulp-admin rpm repo sync run --repo-id epel_6_2
--------------------------------------------------------------------
Synchronizing Repository [epel_6_2]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[-]
... completed
Downloading repository content...
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed
Importing errata...
[/]
... completed
Importing package groups/categories...
[|]
... completed
Task Succeeded
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[==================================================] 100%
11189 of 11189 items
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed
Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[|]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
pulp-admin rpm repo publish run --repo-id epel_6_2
--------------------------------------------------------------------
Publishing Repository [epel_6_2]
--------------------------------------------------------------------
This command may be exited via ctrl+c without affecting the request.
Copying files
[|]
... completed
Initializing repo metadata
[-]
... completed
Publishing Distribution files
[-]
... completed
Publishing RPMs
[\]
... completed
Publishing Delta RPMs
... skipped
Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed
Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed
Publishing Metadata.
[-]
... completed
Closing repo metadata
[-]
... completed
Generating sqlite files
... skipped
Publishing files to web
[/]
... completed
Writing Listings File
[-]
... completed
Task Succeeded
pulp-admin rpm repo list
--------------------------------------------------------------------
RPM Repositories
--------------------------------------------------------------------
Id: epel_6_1
Display Name: epel_6_1
Description: None
Content Unit Counts:
Erratum: 3639
Package Category: 3
Package Group: 208
Rpm: 11189
Yum Repo Metadata File: 1
Id: epel_6_2
Display Name: epel_6_2
Description: None
Content Unit Counts:
Erratum: 3639
Package Category: 3
Package Group: 208
Rpm: 11189
Yum Repo Metadata File: 1
ls -l /var/lib/pulp/published/yum/master/yum_distributor/
total 8
drwxr-xr-x. 3 apache apache 4096 Jan 19 13:52 epel_6_1
drwxr-xr-x. 3 apache apache 4096 Jan 19 14:21 epel_6_2
+ This comment was cloned from Bugzilla #1138475 comment 10 +
Updated by bmbouter about 9 years ago
- Blocked by Issue #647: rpm repo publish fails with "Incorrect length of data produced" error added
Updated by bmbouter almost 9 years ago
- Severity changed from Medium to 2. Medium
Updated by rbarlow almost 9 years ago
- Status changed from 6 to CLOSED - CURRENTRELEASE