Actions
Issue #7367
closed
Unicode error when syncing CentOS 7 OS repo
Status:
CLOSED - DUPLICATE
Priority:
Normal
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Katello
Sprint:
Quarter:
Description
A user reported a unicode error during pulp_rpm.app.tasks.synchronizing.synchronize. I am unable to reproduce it myself, but here are the details:
Upstream url: http://mirror.centos.org/centos/7/os/x86_64/
Download policy: on demand
Mirror: false
Pulp 3 versions:
python3-pulpcore-3.4.1-1.el7.noarch
python3-pulp-rpm-3.5.0-3.el7.noarch
Stack trace from Katello + Pulp 3:
Actions::Pulp3::Repository::Sync
Input:
{"repo_id"=>1,
"smart_proxy_id"=>1,
"options"=>
{"smart_proxy_id"=>1, "repo_id"=>1, "source_url"=>nil, "options"=>{}},
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{"pulp_tasks"=>
[{"pulp_href"=>"/pulp/api/v3/tasks/3d6ae9ce-ca5d-42f2-a1b2-ee9409c7eb18/",
"pulp_created"=>"2020-08-21T11:44:36.278+00:00",
"state"=>"failed",
"name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
"started_at"=>"2020-08-21T11:44:36.370+00:00",
"finished_at"=>"2020-08-21T11:44:42.213+00:00",
"error"=>
{"traceback"=>
" File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 883, in perform_job\n" +
" rv = job.perform()\n" +
" File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 645, in perform\n" +
" self._result = self._execute()\n" +
" File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 651, in _execute\n" +
" return self.func(*self.args, **self.kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 208, in synchronize\n" +
" dv.create()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\", line 148, in create\n" +
" loop.run_until_complete(pipeline)\n" +
" File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n" +
" return future.result()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 225, in create_pipeline\n" +
" await asyncio.gather(*futures)\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 43, in __call__\n" +
" await self.run()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/content_stages.py\", line 102, in run\n" +
" d_content.content.save()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/app/models/base.py\", line 110, in save\n" +
" return super().save(*args, **kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 741, in save\n" +
" force_update=force_update, update_fields=update_fields)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 779, in save_base\n" +
" force_update, using, update_fields,\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 870, in _save_table\n" +
" result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 908, in _do_insert\n" +
" using=using, raw=raw)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/manager.py\", line 82, in manager_method\n" +
" return getattr(self.get_queryset(), name)(*args, **kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/query.py\", line 1186, in _insert\n" +
" return query.get_compiler(using=using).execute_sql(return_id)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py\", line 1375, in execute_sql\n" +
" cursor.execute(sql, params)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 67, in execute\n" +
" return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 76, in _execute_with_wrappers\n" +
" return executor(sql, params, many, context)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n" +
" return self.cursor.execute(sql, params)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/utils.py\", line 89, in __exit__\n" +
" raise dj_exc_value.with_traceback(traceback) from exc_value\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n" +
" return self.cursor.execute(sql, params)\n",
"description"=>
"unsupported Unicode escape sequence\n" +
"LINE 1: ...\"name\": \"technical-writing\", \"default\": false}]', '{\"as\": \"\\...\n" +
" ^\n" +
"DETAIL: Unicode escape values cannot be used for code point values above 007F when the server encoding is not UTF8.\n" +
"CONTEXT: JSON data, line 1: {\"as\":...\n"},
"worker"=>"/pulp/api/v3/workers/f6d307f5-6ea4-4b9e-9e53-9313c9be88ae/",
"child_tasks"=>[],
"progress_reports"=>
[{"message"=>"Downloading Metadata Files",
"code"=>"downloading.metadata",
"state"=>"canceled",
"done"=>4},
{"message"=>"Downloading Artifacts",
"code"=>"downloading.artifacts",
"state"=>"canceled",
"done"=>1},
{"message"=>"Associating Content",
"code"=>"associating.content",
"state"=>"canceled",
"done"=>0},
{"message"=>"Parsed Comps",
"code"=>"parsing.comps",
"state"=>"completed",
"total"=>109,
"done"=>109},
{"message"=>"Parsed Packages",
"code"=>"parsing.packages",
"state"=>"canceled",
"total"=>10070,
"done"=>3004}],
"created_resources"=>[],
"reserved_resources_record"=>
["/pulp/api/v3/repositories/rpm/rpm/ad0b8056-009b-4846-8344-c4b8161c272a/",
"/pulp/api/v3/remotes/rpm/rpm/355f0abf-1c22-4af7-a635-adcbe43c5ed1/"]}],
"create_version"=>true,
"task_groups"=>[],
"poll_attempts"=>{"total"=>8, "failed"=>1}}
Exception:
Katello::Errors::Pulp3Error: unsupported Unicode escape sequence
LINE 1: ..."name": "technical-writing", "default": false}]', '{"as": "\...
^
DETAIL: Unicode escape values cannot be used for code point values above 007F when the server encoding is not UTF8.
CONTEXT: JSON data, line 1: {"as":...
Backtrace:
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/pulp3/abstract_async_task.rb:101:in `block in check_for_errors'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/pulp3/abstract_async_task.rb:99:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/pulp3/abstract_async_task.rb:99:in `check_for_errors'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/pulp3/abstract_async_task.rb:132:in `poll_external_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action/polling.rb:22:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action/cancellable.rb:14:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:563:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.0/app/lib/actions/middleware/remote_action.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/execution_wrapper.rb:88:in `wrap'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action/progress.rb:17:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:49:in `restore_current_request_id'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:44:in `restore_curent_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/middleware/world.rb:31:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:562:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:561:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:561:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:475:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:475:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:475:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:556:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/action.rb:285:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/director.rb:93:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/executors.rb:18:in `run_user_code'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.6/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:192:in `execute_job'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:165:in `block (2 levels) in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:128:in `block in invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:133:in `invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:164:in `block in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:137:in `block (6 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:109:in `local'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:136:in `block (5 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq.rb:37:in `block in <module:Sidekiq>'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:132:in `block (4 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:250:in `stats'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:127:in `block (3 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_logger.rb:8:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:126:in `block (2 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:74:in `global'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:125:in `block in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:48:in `with_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:42:in `with_job_hash_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:124:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:163:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:83:in `process_one'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:71:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:16:in `watchdog'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:25:in `block in safe_thread'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
Action:
Actions::Pulp3::Repository::Sync
Input:
{"repo_id"=>1,
"smart_proxy_id"=>1,
"options"=>
{"smart_proxy_id"=>1, "repo_id"=>1, "source_url"=>nil, "options"=>{}},
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{"pulp_tasks"=>
[{"pulp_href"=>"/pulp/api/v3/tasks/3d6ae9ce-ca5d-42f2-a1b2-ee9409c7eb18/",
"pulp_created"=>"2020-08-21T11:44:36.278+00:00",
"state"=>"failed",
"name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
"started_at"=>"2020-08-21T11:44:36.370+00:00",
"finished_at"=>"2020-08-21T11:44:42.213+00:00",
"error"=>
{"traceback"=>
" File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 883, in perform_job\n" +
" rv = job.perform()\n" +
" File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 645, in perform\n" +
" self._result = self._execute()\n" +
" File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 651, in _execute\n" +
" return self.func(*self.args, **self.kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 208, in synchronize\n" +
" dv.create()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\", line 148, in create\n" +
" loop.run_until_complete(pipeline)\n" +
" File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n" +
" return future.result()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 225, in create_pipeline\n" +
" await asyncio.gather(*futures)\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 43, in __call__\n" +
" await self.run()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/content_stages.py\", line 102, in run\n" +
" d_content.content.save()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/app/models/base.py\", line 110, in save\n" +
" return super().save(*args, **kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 741, in save\n" +
" force_update=force_update, update_fields=update_fields)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 779, in save_base\n" +
" force_update, using, update_fields,\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 870, in _save_table\n" +
" result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/base.py\", line 908, in _do_insert\n" +
" using=using, raw=raw)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/manager.py\", line 82, in manager_method\n" +
" return getattr(self.get_queryset(), name)(*args, **kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/query.py\", line 1186, in _insert\n" +
" return query.get_compiler(using=using).execute_sql(return_id)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py\", line 1375, in execute_sql\n" +
" cursor.execute(sql, params)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 67, in execute\n" +
" return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 76, in _execute_with_wrappers\n" +
" return executor(sql, params, many, context)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n" +
" return self.cursor.execute(sql, params)\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/utils.py\", line 89, in __exit__\n" +
" raise dj_exc_value.with_traceback(traceback) from exc_value\n" +
" File \"/usr/lib/python3.6/site-packages/django/db/backends/utils.py\", line 84, in _execute\n" +
" return self.cursor.execute(sql, params)\n",
"description"=>
"unsupported Unicode escape sequence\n" +
"LINE 1: ...\"name\": \"technical-writing\", \"default\": false}]', '{\"as\": \"\\...\n" +
" ^\n" +
"DETAIL: Unicode escape values cannot be used for code point values above 007F when the server encoding is not UTF8.\n" +
"CONTEXT: JSON data, line 1: {\"as\":...\n"},
"worker"=>"/pulp/api/v3/workers/f6d307f5-6ea4-4b9e-9e53-9313c9be88ae/",
"child_tasks"=>[],
"progress_reports"=>
[{"message"=>"Downloading Metadata Files",
"code"=>"downloading.metadata",
"state"=>"canceled",
"done"=>4},
{"message"=>"Downloading Artifacts",
"code"=>"downloading.artifacts",
"state"=>"canceled",
"done"=>1},
{"message"=>"Associating Content",
"code"=>"associating.content",
"state"=>"canceled",
"done"=>0},
{"message"=>"Parsed Comps",
"code"=>"parsing.comps",
"state"=>"completed",
"total"=>109,
"done"=>109},
{"message"=>"Parsed Packages",
"code"=>"parsing.packages",
"state"=>"canceled",
"total"=>10070,
"done"=>3004}],
"created_resources"=>[],
"reserved_resources_record"=>
["/pulp/api/v3/repositories/rpm/rpm/ad0b8056-009b-4846-8344-c4b8161c272a/",
"/pulp/api/v3/remotes/rpm/rpm/355f0abf-1c22-4af7-a635-adcbe43c5ed1/"]}],
"create_version"=>true,
"task_groups"=>[],
"poll_attempts"=>{"total"=>8, "failed"=>1}}
Action:
Actions::Pulp3::Repository::SaveVersion
Input:
{"repository_id"=>1,
"tasks"=>Step(4).output[:pulp_tasks],
"repository_details"=>nil,
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Pulp3::Repository::CreatePublication
Input:
{"repository_id"=>1,
"smart_proxy_id"=>1,
"contents_changed"=>Step(7).output[:contents_changed],
"options"=>{"contents_changed"=>Step(7).output[:contents_changed]},
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Pulp3::Repository::SavePublication
Input:
{"repository_id"=>1,
"tasks"=>Step(10).output,
"contents_changed"=>Step(7).output[:contents_changed],
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Pulp3::Orchestration::Repository::Sync
Input:
{"subaction_output"=>Step(7).output,
"remote_user"=>"admin",
"remote_cp_user"=>"admin",
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::IndexContent
Input:
{"id"=>1,
"contents_changed"=>Step(17).output[:contents_changed],
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{"repo"=>1,
"last_updated"=>"2020-08-21 13:44:35 +0200",
"contents_changed"=>Step(17).output[:contents_changed],
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::ErrataMail
Input:
{"repo"=>1,
"last_updated"=>"2020-08-21 13:44:35 +0200",
"contents_changed"=>Step(17).output[:contents_changed],
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Applicability::Repository::Regenerate
Input:
{"repo_id"=>1,
"contents_changed"=>Step(17).output[:contents_changed],
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{"repository"=>
{"id"=>1, "name"=>"CentOS7_base", "label"=>"CentOS7_base_x86_64"},
"product"=>
{"id"=>1,
"name"=>"CentOS7_repos",
"label"=>"CentOS7_repos",
"cp_id"=>"146432708083"},
"provider"=>{"id"=>1, "name"=>"Anonymous"},
"organization"=>
{"id"=>1, "name"=>"Default Organization", "label"=>"Default_Organization"},
"services_checked"=>["pulp3"],
"id"=>1,
"sync_result"=>Step(17).output,
"skip_metadata_check"=>false,
"validate_contents"=>false,
"contents_changed"=>Step(17).output[:contents_changed],
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::Sync
Input:
{"repository"=>
{"id"=>1, "name"=>"CentOS7_base", "label"=>"CentOS7_base_x86_64"},
"product"=>
{"id"=>1,
"name"=>"CentOS7_repos",
"label"=>"CentOS7_repos",
"cp_id"=>"146432708083"},
"provider"=>{"id"=>1, "name"=>"Anonymous"},
"organization"=>
{"id"=>1, "name"=>"Default Organization", "label"=>"Default_Organization"},
"services_checked"=>["pulp3"],
"id"=>1,
"sync_result"=>Step(17).output,
"skip_metadata_check"=>false,
"validate_contents"=>false,
"contents_changed"=>Step(17).output[:contents_changed],
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Action:
Actions::Katello::Repository::ImportApplicability
Input:
{"repo_id"=>1,
"contents_changed"=>Step(17).output[:contents_changed],
"current_request_id"=>nil,
"current_timezone"=>"Europe/Zurich",
"current_user_id"=>4,
"current_organization_id"=>1,
"current_location_id"=>2}
Output:
{}
Updated by iballou over 3 years ago
The user is getting the same error on https://dl.fedoraproject.org/pub/epel/7Server/x86_64/
Updated by iballou over 3 years ago
Foreman community thread: https://community.theforeman.org/t/unable-to-sync-repo-encoding-error/20179/5
Updated by iballou over 3 years ago
- Status changed from NEW to CLOSED - DUPLICATE
Duplicate of https://pulp.plan.io/issues/7019
Actions
.