Issue #2745
Updated by ipanova@redhat.com almost 7 years ago
<pre> </pre> $ pulp-admin rpm repo create --repo-id=test-repo --feed=http://resources.ovirt.org/pub/ovirt-4.0/rpm/el7/ --download-policy on_demand Successfully created repository [test-repo] $ pulp-admin -v rpm repo sync run --repo-id test-repo +----------------------------------------------------------------------+ Synchronizing Repository [test-repo] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [\] ... completed Downloading repository content... [/] [================================================ ] 97% RPMs: 799/899 items Delta RPMs: 0/0 items Task Failed Importer indicated a failed response May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) command document too large May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) Traceback (most recent call last): May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/home/ipanova/pulp_development/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 268, in run May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) self.update_content(metadata_files, url) May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/home/ipanova/pulp_development/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 548, in update_content May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) self.download_rpms(metadata_files, rpms_to_download, url) May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/home/ipanova/pulp_development/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 775, in download_rpms May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) unit = self.add_rpm_unit(metadata_files, unit) May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/home/ipanova/pulp_development/pulp_rpm/plugins/pulp_rpm/plugins/importers/yum/sync.py", line 700, in add_rpm_unit May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) unit.save() May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/usr/lib/python2.7/site-packages/mongoengine/document.py", line 324, in save May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) object_id = collection.save(doc, **write_concern) May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 2180, in save May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) check_keys, False, manipulate, write_concern) May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 709, in _update May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) codec_options=self.codec_options).copy() May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 216, in command May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) self._raise_connection_failure(error) May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 343, in _raise_connection_failure May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) raise error May 3 14:15:05 ina pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [11055fd6] (28670-39552) DocumentTooLarge: command document too large May 3 14:15:05 ina pulp: pulp.server.async.tasks:INFO: [11055fd6] Task failed : [11055fd6-a277-4680-938f-0c6a742eafbb] May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) Task pulp.server.managers.repo.sync.sync[11055fd6-a277-4680-938f-0c6a742eafbb] raised unexpected: PulpExecutionException('Importer indicated a failed response',) May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) Traceback (most recent call last): May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) R = retval = fun(*args, **kwargs) May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) File "/home/ipanova/pulp_development/pulp/server/pulp/server/async/tasks.py", line 506, in __call__ May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) return super(Task, self).__call__(*args, **kwargs) May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) File "/home/ipanova/pulp_development/pulp/server/pulp/server/async/tasks.py", line 107, in __call__ May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) return super(PulpTask, self).__call__(*args, **kwargs) May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__ May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) return self.run(*args, **kwargs) May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) File "/home/ipanova/pulp_development/pulp/server/pulp/server/controllers/repository.py", line 827, in sync May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response')) May 3 14:15:05 ina pulp: celery.worker.job:ERROR: (28500-39552) PulpExecutionException: Importer indicated a failed response May 3 14:15:05 ina pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[f35b3277-42d6-433e-bc3c-5aa41a7709b9] succeeded in 0.0117766209878s: None </pre> With *immediate policy* there is not error raised but the offending rpm still does not get synced, saved, and therefore published. <pre> $ pulp-admin -v rpm repo sync run --repo-id test-repo +----------------------------------------------------------------------+ Synchronizing Repository [test-repo] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [\] ... completed Downloading repository content... [\] [================================================= ] 99% RPMs: 898/899 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 0/0 items ... completed Importing errata... [-] ... completed Importing package groups/categories... [-] ... completed Cleaning duplicate packages... [-] ... completed Task Succeeded Initializing repo metadata [-] ... completed Publishing Distribution files [-] ... completed Publishing RPMs [==================================================] 100% 898 of 898 items ... completed Publishing Delta RPMs ... skipped Publishing Errata [\] ... completed Publishing Comps file [-] ... completed Publishing Metadata. [-] ... completed Closing repo metadata [-] ... completed Generating sqlite files ... skipped Generating HTML files ... skipped Publishing files to web [-] ... completed Writing Listings File [\] ... completed Task Succeeded Task details: Operations: sync Resources: test-repo (repository) State: Successful Start Time: 2017-05-03T12:58:04Z Finish Time: 2017-05-03T13:13:11Z Result: Added Count: 898 Completed: 2017-05-03T13:13:11Z Details: Comps: State: FINISHED Content: Details: Drpm Done: 0 Drpm Total: 0 Rpm Done: 898 Rpm Total: 899 Error Details: Items Left: 1 Items Total: 899 Size Left: 40862680 Size Total: 15620421457 State: FINISHED Distribution: Error Details: Items Left: 0 Items Total: 0 State: FINISHED Errata: State: FINISHED Metadata: State: FINISHED Purge Duplicates: State: FINISHED Error Message: None Exception: None Id: 5909d76745ef487f3924ff11 Importer Id: yum_importer Importer Type Id: yum_importer Removed Count: 0 Repo Id: test-repo Result: success Started: 2017-05-03T12:58:04Z Summary: Comps: State: FINISHED Content: State: FINISHED Distribution: State: FINISHED Errata: State: FINISHED Metadata: State: FINISHED Purge Duplicates: State: FINISHED Traceback: None Updated Count: 0 Task Id: 09c39264-dd68-4263-8012-8c7862f3b32b Progress Report: Yum Importer: Comps: State: FINISHED Content: Details: Drpm Done: 0 Drpm Total: 0 Rpm Done: 898 Rpm Total: 899 Error Details: Items Left: 1 Items Total: 899 Size Left: 40862680 Size Total: 15620421457 State: FINISHED Distribution: Error Details: Items Left: 0 Items Total: 0 State: FINISHED Errata: State: FINISHED Metadata: State: FINISHED Purge Duplicates: State: FINISHED </pre>
.