Project

Profile

Help

Issue #512

closed

Pulp cannot sync an EPEL 5 repository that was published by Pulp

Added by rbarlow about 9 years ago. Updated almost 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
2.4.1
Platform Release:
2.6.0
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

Description of problem:
I cannot sync an EPEL 5 repository that was published by Pulp.

Version-Release number of selected component (if applicable):
2.4.1-0.7.beta.

How reproducible:
Every time.

Steps to Reproduce:
1. Sync/Publish EPEL 5 (https://download.fedoraproject.org/pub/epel/5/x86_64/)
2. Create a new repo that has the Pulp published EPEL 5 as its feed.
3. Sync the new repo

Actual results:
$ pulp-admin rpm repo sync run --repo-id epel-5 --------------------------------------------------------------------
Synchronizing Repository [epel-5]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[|]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 55/55 items
Delta RPMs: 0/0 items

... failed

Task Failed

Importer indicated a failed response

$ sudo cat /var/log/messages | grep <the_fail>
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call last):
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 113, in run
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.update_content(metadata_files)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 267, in update_content
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: purge.purge_unwanted_units(metadata_files, self.sync_conduit, self.call_config)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/purge.py", line 37, in purge_unwanted_units
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: remove_missing_errata(metadata_files, conduit)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/purge.py", line 127, in remove_missing_errata
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: updateinfo.process_package_element)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/purge.py", line 255, in get_remote_units
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: for model in package_info_generator:
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 63, in package_list_generator
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: package_info = process_func(element)
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/home/rbarlow/devel/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/repomd/updateinfo.py", line 27, in process_package_element
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 'description': element.find('description').text,
Sep 4 17:38:18 grapefruit pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: AttributeError: 'NoneType' object has no attribute 'text'
Sep 4 17:38:18 grapefruit pulp: celery.worker.job:ERROR: Task pulp.server.tasks.repository.sync_with_auto_publish[6a7f5fdd-6214-47ae-b9ff-fa569924bbe3] raised unexpected: PulpExecutionException('Importer indicated a failed response',)

Expected results:
The second repo sync should succeed.

Additional info:
I noticed this with EPEL 5, though it may not be unique to EPEL 5. I haven't tried to do this same operation with other repositories.

+ This bug was cloned from Bugzilla Bug #1138475 +


Related issues

Blocked by Pulp - Issue #647: rpm repo publish fails with "Incorrect length of data produced" errorCLOSED - CURRENTRELEASEbcourtActions
Actions #1

Updated by rbarlow about 9 years ago

I should add that the "source" repo was on a 2.4.0-1 system, and it was 2.4.1-0.7.beta that was failing to sync. Those versions are extremely similar when it comes to the yum plugins, so I doubt that data makes much of a difference, but I thought it was worth noting.

+ This comment was cloned from Bugzilla #1138475 comment 1 +

Actions #3

Updated by veiko@linux.ee about 9 years ago

I can confirm this. Happens with EPEL 6 as well.

I have different stages of local development branches of repositories, one of them being EPEL 6. Base system is CentOS 6.5. All other repositories work fine, but EPEL 6 fails.

First stage gets repository contents from remote mirror and following stages get their contents from each other (--feed file:///), those stages are chained together and worked with Pulp 2.2 and 2.3.

I get error when trying to sync from first stage to second stage locally.

--------------------------------------------------------------------
Synchronizing Repository [epel-6-int]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[|]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[-]
... failed

Task Failed

Importer indicated a failed response

NOTE that /var/lib/pulp/published/yum/https/repos/epel/6/x86_64/ is existing and contains EPEL 6 RPM-s and repodata directory with proper contents.

From /var/log/messages

Oct 29 17:45:48 tstplp01 pulp: celery.worker.strategy:INFO: Received task: pulp.server.tasks.repository.sync_with_auto_publish[5d207c6a-8df5-40b4-8e2f-216bebac0646]
Oct 29 17:45:48 tstplp01 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_release_resource[66da6f4e-7534-4b85-a865-b13c1e7038b2]
Oct 29 17:45:48 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from file:///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.
Oct 29 17:45:48 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Generating metadata databases.
Oct 29 17:46:29 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Determining which units need to be downloaded.
Oct 29 17:47:44 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading 0 RPMs.
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading additional units.
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: File "/usr/lib/python2.6/site-packages/nectar/downloaders/local.py", line 144, in copy
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: src_handle = open(src_path, 'rb')
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: File "/usr/lib/python2.6/site-packages/nectar/downloaders/local.py", line 144, in _copy
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: src_handle = open(src_path, 'rb')
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 133, in run
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.get_errata(metadata_files)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 462, in get_errata
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.save_fileless_units(errata_file_handle, updateinfo.PACKAGE_TAG, updateinfo.process_package_element)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 522, in save_fileless_units
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: to_save = existing.check_repo(wanted, self.sync_conduit.get_units)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 37, in check_repo
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sorted_units = _sort_by_type(wanted)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 162, in _sort_by_type
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: for unit in wanted:
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 520, in <genexpr>
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: wanted = (model.as_named_tuple for model in package_info_generator)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 63, in package_list_generator
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: package_info = process_func(element)
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/updateinfo.py", line 27, in process_package_element
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 'description': element.find('description').text,
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: AttributeError: 'NoneType' object has no attribute 'text'
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: Task pulp.server.tasks.repository.sync_with_auto_publish[5d207c6a-8df5-40b4-8e2f-216bebac0646] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: Traceback (most recent call last):
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: R = retval = fun(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 306, incall
_
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: return super(Task, self).__call__(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in protected_call
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: return self.run(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/tasks/repository.py", line 210, in sync_with_auto_publish
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: sync_result = managers.repo_sync_manager().sync(repo_id, sync_config_override=overrides)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 113, in sync
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: raise PulpExecutionException(_('Importer indicated a failed response'))
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: PulpExecutionException: Importer indicated a failed response
Oct 29 17:48:03 tstplp01 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[1b11a963-e339-43de-b26a-1093c465eba3]
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_release_resource[66da6f4e-7534-4b85-a865-b13c1e7038b2] succeeded in 0.0187427470228s: None
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[1b11a963-e339-43de-b26a-1093c465eba3] succeeded in 0.039365892997s: None

From ~/.pulp/server_calls.log
2014-10-29 17:48:04,038 - INFO - GET request to /pulp/api/v2/tasks/5d207c6a-8df5-40b4-8e2f-216bebac0646/ with parameters None
2014-10-29 17:48:04,038 - INFO - Response status : 200

2014-10-29 17:48:04,039 - INFO - Response body :
{
"exception": null,
"task_type": "pulp.server.tasks.repository.sync_with_auto_publish",
"_href": "/pulp/api/v2/tasks/5d207c6a-8df5-40b4-8e2f-216bebac0646/",
"task_id": "5d207c6a-8df5-40b4-8e2f-216bebac0646",
"tags": [
"pulp:repository:epel-6-int",
"pulp:action:sync"
],
"finish_time": "2014-10-29T17:48:03Z",
"_ns": "task_status",
"start_time": "2014-10-29T17:45:48Z",
"traceback": "Traceback (most recent call last):\n File \"/usr/lib/python2.6/site-packages/celery/app/trace.py\", line 240, in trace_task\n R = retval = fun(*args, **kwargs)\n File \"/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py\", line 306, in call\n return super(Task, self).__call__(*args, **kwargs)\n File \"/usr/lib/python2.6/site-packages/celery/app/trace.py\", line 437, in protected_call\n return self.run(*args, **kwargs)\n File \"/usr/lib/python2.6/site-packages/pulp/server/tasks/repository.py\", line 210, in sync_with_auto_publish\n sync_result = managers.repo_sync_manager().sync(repo_id, sync_config_override=overrides)\n File \"/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py\", line 113, in sync\n raise PulpExecutionException(_('Importer indicated a failed response'))\nPulpExecutionException: Importer indicated a failed response\n",
"spawned_tasks": [],
"progress_report": {
"yum_importer": {
"content": {
"size_total": 0,
"items_left": 0,
"items_total": 0,
"state": "FINISHED",
"size_left": 0,
"details": {
"rpm_total": 0,
"rpm_done": 0,
"drpm_total": 0,
"drpm_done": 0
},
"error_details": []
},
"comps": {
"state": "NOT_STARTED"
},
"distribution": {
"items_total": 0,
"state": "FINISHED",
"error_details": [],
"items_left": 0
},
"errata": {
"state": "FAILED",
"error": "'NoneType' object has no attribute 'text'"
},
"metadata": {
"state": "FINISHED"
}
}
},
"queue": "",
"state": "error",
"result": null,
"error": {
"code": "PLP0000",
"data": {},
"description": "Importer indicated a failed response",
"sub_errors": []
},
"_id": {
"$oid": "545127ccd604ff01e4d822c2"
},
"id": "545127cc727e241efa7814cf"
}

+ This comment was cloned from Bugzilla #1138475 comment 3 +

Actions #4

Updated by veiko@linux.ee about 9 years ago

Adding Pulp package versions that are missing from previous post.
python-pulp-common-2.4.3-1.el6.noarch
python-pulp-client-lib-2.4.3-1.el6.noarch
python-pulp-puppet-common-2.4.3-1.el6.noarch
python-isodate-0.5.0-4.pulp.el6.noarch
python-rhsm-1.8.0-2.pulp.el6.x86_64
python-pulp-rpm-common-2.4.3-1.el6.noarch
pulp-rpm-plugins-2.4.3-1.el6.noarch
python-pulp-bindings-2.4.3-1.el6.noarch
pulp-rpm-admin-extensions-2.4.3-1.el6.noarch
pulp-selinux-2.4.3-1.el6.noarch
pulp-puppet-admin-extensions-2.4.3-1.el6.noarch
mod_wsgi-3.4-1.pulp.el6.x86_64
python-kombu-3.0.15-12.pulp.el6.noarch
pulp-server-2.4.3-1.el6.noarch
pulp-admin-client-2.4.3-1.el6.noarch
pulp-puppet-plugins-2.4.3-1.el6.noarch

+ This comment was cloned from Bugzilla #1138475 comment 4 +

Actions #5

Updated by veiko@linux.ee about 9 years ago

(In reply to Michael Hrivnak from comment #2)

https://github.com/pulp/pulp_rpm/pull/560

Applied that patch to pulp-server-2.4.3-1.el6.noarch

Oct 29 21:54:34 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: [Errno 2] No such file or directory: u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call last):
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 133, in run
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.get_errata(metadata_files)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 462, in get_errata
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: self.save_fileless_units(errata_file_handle, updateinfo.PACKAGE_TAG, updateinfo.process_package_element)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 522, in save_fileless_units
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: to_save = existing.check_repo(wanted, self.sync_conduit.get_units)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 37, in check_repo
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: sorted_units = _sort_by_type(wanted)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", line 162, in _sort_by_type
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: for unit in wanted:
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 520, in <genexpr>
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: wanted = (model.as_named_tuple for model in package_info_generator)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py", line 63, in package_list_generator
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: package_info = process_func(element)
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/updateinfo.py", line 27, in process_package_element
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 'description': element.find('description').text,
Oct 29 21:54:34 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: AttributeError: 'NoneType' object has no attribute 'text'
Oct 29 21:54:34 tstplp01 pulp: celery.worker.job:ERROR: Task pulp.server.tasks.repository.sync_with_auto_publish[d9a8ab94-43bd-4a3a-b15a-fd595431dd8b] raised unexpected: PulpExecutionException('Importer indicated a failed response',)

+ This comment was cloned from Bugzilla #1138475 comment 5 +

Actions #6

Updated by veiko@linux.ee about 9 years ago

Workaround is to create first stage local repository with '--feed http://someremotefeed --skip erratum'. No need to skip any components in second stage local repository.

+ This comment was cloned from Bugzilla #1138475 comment 6 +

Actions #7

Updated by cduryee about 9 years ago

fixed in pulp 2.6.0-0.2.beta

+ This comment was cloned from Bugzilla #1138475 comment 7 +

Actions #8

Updated by igulina@redhat.com about 9 years ago

for EPEL 5 repo on pulp-server-2.6.0-0.4.beta.fc20.noarch

pulp-admin rpm repo create --repo-id epel5_1 --feed https://download.fedoraproject.org/pub/epel/5/x86_64/

Successfully created repository [epel5_1]

pulp-admin rpm repo sync run --repo-id epel5_1

--------------------------------------------------------------------
Synchronizing Repository [epel5_1]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[-]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 6848/6848 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[\]
... completed

Importing package groups/categories...
[\]
... completed

Task Succeeded

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[==================================================] 100%
6848 of 6848 items
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
1998 of 1998 items
... completed

Publishing Comps file
[==================================================] 100%
41 of 41 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[\]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

pulp-admin rpm repo list

--------------------------------------------------------------------
RPM Repositories
--------------------------------------------------------------------

Id: zoo_repo
Display Name: zoo_repo
Description: None
Content Unit Counts:
Erratum: 4
Package Category: 1
Package Group: 2
Rpm: 32

Id: test_repo
Display Name: test_repo
Description: None
Content Unit Counts:
Rpm: 734

Id: epel5_1
Display Name: epel5_1
Description: None
Content Unit Counts:
Erratum: 1998
Package Category: 5
Package Group: 36
Rpm: 6848
Yum Repo Metadata File: 1

pulp-admin rpm repo publish run --repo-id epel5_1

--------------------------------------------------------------------
Publishing Repository [epel5_1]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Copying files
[\]
... completed

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[\]
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
1998 of 1998 items
... completed

Publishing Comps file
[==================================================] 100%
41 of 41 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[|]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

ls -l /var/lib/pulp/published/yum/master/yum_distributor/epel5_1/1421344139.7/

Display all 6849 possibilities? (y or n)

pulp-admin rpm repo create --repo-id epel5_2 --feed file:///var/lib/pulp/published/yum/master/yum_distributor/epel5_1/1421344139.7/

Successfully created repository [epel5_2]

pulp-admin rpm repo sync run --repo-id epel5_2

--------------------------------------------------------------------
Synchronizing Repository [epel5_2]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[-]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[\]
... completed

Importing package groups/categories...
[\]
... completed

Task Succeeded

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[==================================================] 100%
6848 of 6848 items
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
1998 of 1998 items
... completed

Publishing Comps file
[==================================================] 100%
41 of 41 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[\]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

pulp-admin rpm repo list

--------------------------------------------------------------------
RPM Repositories
--------------------------------------------------------------------

Id: zoo_repo
Display Name: zoo_repo
Description: None
Content Unit Counts:
Erratum: 4
Package Category: 1
Package Group: 2
Rpm: 32

Id: test_repo
Display Name: test_repo
Description: None
Content Unit Counts:
Rpm: 734

Id: epel5_1
Display Name: epel5_1
Description: None
Content Unit Counts:
Erratum: 1998
Package Category: 5
Package Group: 36
Rpm: 6848
Yum Repo Metadata File: 1

Id: epel5_2
Display Name: epel5_2
Description: None
Content Unit Counts:
Erratum: 1998
Package Category: 5
Package Group: 36
Rpm: 6848
Yum Repo Metadata File: 1

+ This comment was cloned from Bugzilla #1138475 comment 8 +

Actions #9

Updated by igulina@redhat.com about 9 years ago

Needed to be checked for EPEL 6 on rhel6 pulp 2.6-0.4 according to comment [1], but depends on BZ 1176698 [2]

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1138475#c3
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1176698

+ This comment was cloned from Bugzilla #1138475 comment 9 +

Actions #10

Updated by igulina@redhat.com about 9 years ago

rpm -qa pulp-server

pulp-server-2.6.0-0.5.beta.el6.noarch

pulp-admin rpm repo create --repo-id epel_6_1 --feed https://download.fedoraproject.org/pub/epel/6/x86_64/

Successfully created repository [epel_6_1]

pulp-admin rpm repo sync run --repo-id epel_6_1

--------------------------------------------------------------------
Synchronizing Repository [epel_6_1]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[\]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 11189/11189 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[|]
... completed

Importing package groups/categories...
[|]
... completed

Task Succeeded

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[==================================================] 100%
11189 of 11189 items
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed

Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[|]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

pulp-admin rpm repo publish run --repo-id epel_6_1

--------------------------------------------------------------------
Publishing Repository [epel_6_1]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Copying files
[|]
... completed

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[\]
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed

Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[-]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

pulp-admin rpm repo create --repo-id epel_6_2 --feed file:///var/lib/pulp/published/yum/master/yum_distributor/epel_6_1/1421693520.56/

Successfully created repository [epel_6_2]

pulp-admin rpm repo sync run --repo-id epel_6_2

--------------------------------------------------------------------
Synchronizing Repository [epel_6_2]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[-]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[/]
... completed

Importing package groups/categories...
[|]
... completed

Task Succeeded

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[==================================================] 100%
11189 of 11189 items
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed

Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[|]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

pulp-admin rpm repo publish run --repo-id epel_6_2

--------------------------------------------------------------------
Publishing Repository [epel_6_2]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Copying files
[|]
... completed

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[\]
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
3639 of 3639 items
... completed

Publishing Comps file
[==================================================] 100%
211 of 211 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[/]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

pulp-admin rpm repo list

--------------------------------------------------------------------
RPM Repositories
--------------------------------------------------------------------

Id: epel_6_1
Display Name: epel_6_1
Description: None
Content Unit Counts:
Erratum: 3639
Package Category: 3
Package Group: 208
Rpm: 11189
Yum Repo Metadata File: 1

Id: epel_6_2
Display Name: epel_6_2
Description: None
Content Unit Counts:
Erratum: 3639
Package Category: 3
Package Group: 208
Rpm: 11189
Yum Repo Metadata File: 1

ls -l /var/lib/pulp/published/yum/master/yum_distributor/

total 8
drwxr-xr-x. 3 apache apache 4096 Jan 19 13:52 epel_6_1
drwxr-xr-x. 3 apache apache 4096 Jan 19 14:21 epel_6_2

+ This comment was cloned from Bugzilla #1138475 comment 10 +

Actions #11

Updated by bmbouter about 9 years ago

  • Blocked by Issue #647: rpm repo publish fails with "Incorrect length of data produced" error added
Actions #12

Updated by bmbouter almost 9 years ago

  • Severity changed from Medium to 2. Medium
Actions #13

Updated by rbarlow almost 9 years ago

  • Status changed from 6 to CLOSED - CURRENTRELEASE
Actions #15

Updated by bmbouter almost 5 years ago

  • Tags Pulp 2 added

Also available in: Atom PDF