Issue #4392
closed
Trying sync ubuntu repos from 2 different source and both make the same error
Description
i'm trying to sync the repo but i get error
Action:
Actions::Pulp::Repository::Sync
Input:
{"pulp_id"=>"1bcf1f8e-3c72-41b1-b43f-9d80ac4091d1",
"task_id"=>nil,
"source_url"=>nil,
"options"=>{},
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{"pulp_tasks"=>
[{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.sync.sync",
"_href"=>"/pulp/api/v2/tasks/99c285b3-f43b-45ac-9c85-46cae7990615/",
"task_id"=>"99c285b3-f43b-45ac-9c85-46cae7990615",
"tags"=>
["pulp:repository:1bcf1f8e-3c72-41b1-b43f-9d80ac4091d1",
"pulp:action:sync"],
"finish_time"=>"2019-02-07T04:02:25Z",
"_ns"=>"task_status",
"start_time"=>"2019-02-07T03:56:36Z",
"traceback"=>
"Traceback (most recent call last):\n" +
" File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 382, in trace_task\n" +
" R = retval = fun(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 529, in call\n" +
" return super(Task, self).__call__(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 107, in call\n" +
" return super(PulpTask, self).__call__(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 641, in protected_call\n" +
" return self.run(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 770, in sync\n" +
" sync_report = sync_repo(transfer_repo, conduit, call_config)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 737, in wrap_f\n" +
" return f(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/importer.py\", line 135, in sync_repo\n" +
" report = self._current_sync.process_lifecycle()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 572, in process_lifecycle\n" +
" super(PluginStep, self).process_lifecycle()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 163, in process_lifecycle\n" +
" step.process()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n" +
" self._process_block()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n" +
" self.process_main()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/sync.py\", line 326, in process_main\n" +
" with open(path, \"rb\") as fobj:\n" +
"IOError: [Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'\n",
"spawned_tasks"=>[],
"progress_report"=>
{"deb_importer"=>
[{"num_success"=>2,
"description"=>"Retrieving metadata: release file(s)",
"step_type"=>"sync_step_release_download",
"items_total"=>2,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"8d8ddfdd-657a-48a0-ac11-47d50eac2dcb",
"num_processed"=>2},
{"num_success"=>1,
"description"=>"Parse Release Files",
"step_type"=>"sync_step_release_parse",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"49a913c2-538c-4022-b2c4-c8eefa35f267",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Retrieving metadata: Packages files",
"step_type"=>"sync_step_packages_download",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"543ae281-ba89-4b92-a9d1-d0967ea55a98",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Parse Packages Files",
"step_type"=>"sync_step_packages_parse",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"0242a51c-1f00-4983-bd5a-c18c5b234960",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Copying units already in pulp",
"step_type"=>"get_local",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"1d7b302d-ce06-4470-b7fa-10dd54c2916b",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Prepare Package Download",
"step_type"=>"sync_step_unit_download_requests",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7924e2c1-a8eb-4c8f-9bcd-f923524d2852",
"num_processed"=>1},
{"num_success"=>973,
"description"=>"Retrieving units",
"step_type"=>"sync_step_unit_download",
"items_total"=>8608,
"state"=>"FAILED",
"error_details"=>[],
"details"=>"",
"num_failures"=>7635,
"step_id"=>"2fed0e51-958d-4afc-a59c-c1a28ce27e19",
"num_processed"=>8608},
{"num_success"=>0,
"description"=>"Save and associate downloaded units",
"step_type"=>"sync_step_save",
"items_total"=>1,
"state"=>"FAILED",
"error_details"=>
[{"traceback"=>
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n" +
" self._process_block()\n" +
"\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n" +
" self.process_main()\n" +
"\n" +
" File \"/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/sync.py\", line 326, in process_main\n" +
" with open(path, \"rb\") as fobj:\n",
"error"=>
"[Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'"}],
"details"=>"",
"num_failures"=>1,
"step_id"=>"8d02c4dc-5454-46d5-9b1b-644e2532e216",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Save metadata",
"step_type"=>"sync_step_save_meta",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"fd61791c-a0f3-4dcb-8bf0-980255b4137d",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Orphan removed units",
"step_type"=>"sync_step_orphan_removed_units",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"e27235af-828e-4153-9a32-68d87411d253",
"num_processed"=>0}]},
"queue"=>
"reserved_resource_worker-2@qacvtitm049.quantium.com.au.local.dq2",
"state"=>"error",
"worker_name"=>
"reserved_resource_worker-2@qacvtitm049.quantium.com.au.local",
"result"=>nil,
"error"=>
{"code"=>"PLP0000",
"data"=>{},
"description"=>
"[Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'",
"sub_errors"=>[]},
"_id"=>{"$oid"=>"5c5bac74a120c77d1b6ec865"},
"id"=>"5c5bac74a120c77d1b6ec865"}],
"contents_changed"=>true,
"poll_attempts"=>{"total"=>42, "failed"=>1}}
Exception:
Katello::Errors::PulpError: PLP0000: [Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'
Backtrace:
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/pulp/abstract_async_task.rb:122:in `block in external_task='
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/pulp/abstract_async_task.rb:120:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/pulp/abstract_async_task.rb:120:in `external_task='
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/pulp/repository/sync.rb:34:in `external_task='
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action/polling.rb:98:in `poll_external_task_with_rescue'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action/polling.rb:21:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action/cancellable.rb:13:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/pulp/abstract_async_task.rb:45:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:539:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:31:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/remote_action.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/execution_wrapper.rb:87:in `wrap'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action/progress.rb:30:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action/progress.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/keep_locale.rb:11:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/keep_locale.rb:22:in `with_locale'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.10.0/app/lib/actions/middleware/keep_locale.rb:11:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/keep_current_user.rb:43:in `restore_curent_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/keep_current_taxonomies.rb:44:in `restore_current_taxonomies'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.14.3/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:18:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware.rb:31:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/middleware/world.rb:30:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:538:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:537:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:537:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:451:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:451:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:451:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:532:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/action.rb:278:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/execution_plan/steps/abstract.rb:162:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:30:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:15:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/director.rb:56:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/executors/parallel/worker.rb:14:in `block in on_message'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/executors.rb:12:in `run_user_code'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/executors/parallel/worker.rb:13:in `on_message'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/context.rb:46:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/executes_context.rb:7:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.1.2/lib/dynflow/actor.rb:26:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/awaits.rb:15:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/buffer.rb:38:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/buffer.rb:31:in `process_envelopes?'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/buffer.rb:20:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/termination.rb:55:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/removes_child.rb:10:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/core.rb:161:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/core.rb:95:in `block in on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/core.rb:118:in `block (2 levels) in schedule_execution'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `block in synchronize'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.4/lib/concurrent/actor/core.rb:115:in `block in schedule_execution'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/serialized_execution.rb:18:in `call'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/serialized_execution.rb:96:in `work'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/serialized_execution.rb:77:in `block in call_job'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `run_task'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:337:in `block (3 levels) in create_worker'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `loop'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `block (2 levels) in create_worker'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `catch'
/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.0.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `block in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
Action:
Actions::Pulp::Repository::Sync
Input:
{"pulp_id"=>"1bcf1f8e-3c72-41b1-b43f-9d80ac4091d1",
"task_id"=>nil,
"source_url"=>nil,
"options"=>{},
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{"pulp_tasks"=>
[{"exception"=>nil,
"task_type"=>"pulp.server.managers.repo.sync.sync",
"_href"=>"/pulp/api/v2/tasks/99c285b3-f43b-45ac-9c85-46cae7990615/",
"task_id"=>"99c285b3-f43b-45ac-9c85-46cae7990615",
"tags"=>
["pulp:repository:1bcf1f8e-3c72-41b1-b43f-9d80ac4091d1",
"pulp:action:sync"],
"finish_time"=>"2019-02-07T04:02:25Z",
"_ns"=>"task_status",
"start_time"=>"2019-02-07T03:56:36Z",
"traceback"=>
"Traceback (most recent call last):\n" +
" File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 382, in trace_task\n" +
" R = retval = fun(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 529, in call\n" +
" return super(Task, self).__call__(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 107, in call\n" +
" return super(PulpTask, self).__call__(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 641, in protected_call\n" +
" return self.run(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 770, in sync\n" +
" sync_report = sync_repo(transfer_repo, conduit, call_config)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 737, in wrap_f\n" +
" return f(*args, **kwargs)\n" +
" File \"/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/importer.py\", line 135, in sync_repo\n" +
" report = self._current_sync.process_lifecycle()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 572, in process_lifecycle\n" +
" super(PluginStep, self).process_lifecycle()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 163, in process_lifecycle\n" +
" step.process()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n" +
" self._process_block()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n" +
" self.process_main()\n" +
" File \"/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/sync.py\", line 326, in process_main\n" +
" with open(path, \"rb\") as fobj:\n" +
"IOError: [Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'\n",
"spawned_tasks"=>[],
"progress_report"=>
{"deb_importer"=>
[{"num_success"=>2,
"description"=>"Retrieving metadata: release file(s)",
"step_type"=>"sync_step_release_download",
"items_total"=>2,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"8d8ddfdd-657a-48a0-ac11-47d50eac2dcb",
"num_processed"=>2},
{"num_success"=>1,
"description"=>"Parse Release Files",
"step_type"=>"sync_step_release_parse",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"49a913c2-538c-4022-b2c4-c8eefa35f267",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Retrieving metadata: Packages files",
"step_type"=>"sync_step_packages_download",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"543ae281-ba89-4b92-a9d1-d0967ea55a98",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Parse Packages Files",
"step_type"=>"sync_step_packages_parse",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"0242a51c-1f00-4983-bd5a-c18c5b234960",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Copying units already in pulp",
"step_type"=>"get_local",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"1d7b302d-ce06-4470-b7fa-10dd54c2916b",
"num_processed"=>1},
{"num_success"=>1,
"description"=>"Prepare Package Download",
"step_type"=>"sync_step_unit_download_requests",
"items_total"=>1,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"7924e2c1-a8eb-4c8f-9bcd-f923524d2852",
"num_processed"=>1},
{"num_success"=>973,
"description"=>"Retrieving units",
"step_type"=>"sync_step_unit_download",
"items_total"=>8608,
"state"=>"FAILED",
"error_details"=>[],
"details"=>"",
"num_failures"=>7635,
"step_id"=>"2fed0e51-958d-4afc-a59c-c1a28ce27e19",
"num_processed"=>8608},
{"num_success"=>0,
"description"=>"Save and associate downloaded units",
"step_type"=>"sync_step_save",
"items_total"=>1,
"state"=>"FAILED",
"error_details"=>
[{"traceback"=>
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 256, in process\n" +
" self._process_block()\n" +
"\n" +
" File \"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py\", line 303, in _process_block\n" +
" self.process_main()\n" +
"\n" +
" File \"/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/sync.py\", line 326, in process_main\n" +
" with open(path, \"rb\") as fobj:\n",
"error"=>
"[Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'"}],
"details"=>"",
"num_failures"=>1,
"step_id"=>"8d02c4dc-5454-46d5-9b1b-644e2532e216",
"num_processed"=>1},
{"num_success"=>0,
"description"=>"Save metadata",
"step_type"=>"sync_step_save_meta",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"fd61791c-a0f3-4dcb-8bf0-980255b4137d",
"num_processed"=>0},
{"num_success"=>0,
"description"=>"Orphan removed units",
"step_type"=>"sync_step_orphan_removed_units",
"items_total"=>1,
"state"=>"NOT_STARTED",
"error_details"=>[],
"details"=>"",
"num_failures"=>0,
"step_id"=>"e27235af-828e-4153-9a32-68d87411d253",
"num_processed"=>0}]},
"queue"=>
"reserved_resource_worker-2@qacvtitm049.quantium.com.au.local.dq2",
"state"=>"error",
"worker_name"=>
"reserved_resource_worker-2@qacvtitm049.quantium.com.au.local",
"result"=>nil,
"error"=>
{"code"=>"PLP0000",
"data"=>{},
"description"=>
"[Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'",
"sub_errors"=>[]},
"_id"=>{"$oid"=>"5c5bac74a120c77d1b6ec865"},
"id"=>"5c5bac74a120c77d1b6ec865"}],
"contents_changed"=>true,
"poll_attempts"=>{"total"=>42, "failed"=>1}}
Action:
Actions::Katello::Repository::IndexContent
Input:
{"id"=>1,
"contents_changed"=>Step(3).output[:contents_changed],
"full_index"=>false,
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{"repo"=>1,
"last_updated"=>"2019-02-07 14:56:34 +1100",
"contents_changed"=>Step(3).output[:contents_changed],
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{"repo"=>1,
"last_updated"=>"2019-02-07 14:56:34 +1100",
"contents_changed"=>Step(3).output[:contents_changed],
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{"repository"=>{"id"=>1, "name"=>"Updates", "label"=>"Updates"},
"product"=>
{"id"=>1,
"name"=>"Ubuntu Updates",
"label"=>"Ubuntu_Updates",
"cp_id"=>"357460975618"},
"provider"=>{"id"=>1, "name"=>"Anonymous"},
"organization"=>{"id"=>1, "name"=>"Quantium", "label"=>"Quantium"},
"services_checked"=>["pulp", "pulp_auth"],
"id"=>1,
"sync_result"=>Step(3).output,
"skip_metadata_check"=>false,
"validate_contents"=>false,
"contents_changed"=>Step(3).output[:contents_changed],
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Updated by CodeHeeler about 5 years ago
- Project changed from Pulp to Debian Support
Updated by quba42 about 5 years ago
Can you tell us what you are trying to synchronize? (Repository URL, Releases, Components, Architectures etc.)
Then I can see if I can reproduce the problem.
It sounds like the Ubuntu mirrors are missing a package, but who knows...
Updated by mdellweg about 5 years ago
"[Errno 2] No such file or directory: u'/var/cache/pulp/reserved_resource_worker-2@qacvtitm049.quantium.com.au.local/99c285b3-f43b-45ac-9c85-46cae7990615/packages/00/02/linux-cloud-tools-3.16.0-53-generic_3.16.0-53.72~14.04.1_amd64.deb'"
Seems like a File is missing or failed to download. Could it be removed from the servers? Is your HD full? ... FS out of inodes?
Updated by mgamboa about 5 years ago
Im using archive. Ubuntu. Com and also us. Archive. Ubuntu. Com and au.
archive.ubuntu.com so with 3 different mirrors and happen the same i found
if i create the directory the issue for this packsge gone but ha ve again
with another one i try same workaround but didn't work
On Sat, Feb 9, 2019, 3:00 AM Pulp <notifications@plan.io wrote:
Updated by mgamboa about 5 years ago
The filesystem is not out of inodes i can still download rpm but the deb now have issues as i said before i just using the normal archive.ubuntu.com repo but when starting to fail test on au.archive.ubuntu.com and us.archive.ubuntu.com but both have same result i notice if i create the directory the error about the package disappear but is now appear with another one
Updated by quba42 almost 5 years ago
mgamboa wrote:
Im using archive. Ubuntu. Com and also us. Archive. Ubuntu. Com and au.
archive.ubuntu.com so with 3 different mirrors and happen the same i found
if i create the directory the issue for this packsge gone but ha ve again
with another one i try same workaround but didn't workOn Sat, Feb 9, 2019, 3:00 AM Pulp <notifications@plan.io wrote:
Can you post the full pulp-admin commands you are using? (Or, if you are not using pulp-admin, tell us how exactly you are creating and syncing your pulp repositories.)
Updated by mdellweg almost 5 years ago
- Status changed from NEW to CLOSED - DUPLICATE
.