Actions
Issue #8978
closedUsers are reporting timeout issues during sync
Status:
CLOSED - DUPLICATE
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:
Description
I am uncertain if this is a bug in pulpcore or pulp_deb
, or if it can be remedied by mere configuration.
But users are frequently reporting that large syncs (think initial syncs of Debian main) run into timeouts when creating the new DebDeclarativeVersion
. Apparently this can then be worked around by re-syncing several times until the sync eventually completes. Presumably the later syncs don't need to re-download many packages and therefore avoid the timeout.
See the following foreman community discussion: https://community.theforeman.org/t/add-debian-10-repository/24157/13
See the following backtrace from a Katello user:
{"traceback"=>
" File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 975, in perform_job\n" +
" rv = job.perform()\n" +
" File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 696, in perform\n" +
" self._result = self._execute()\n" +
" File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 719, in _execute\n" +
" return self.func(*self.args, **self.kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/pulp_deb/app/tasks/synchronizing.py\", line 122, in synchronize\n" +
" DebDeclarativeVersion(first_stage, repository, mirror=mirror).create()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\", line 147, in create\n" +
" loop.run_until_complete(pipeline)\n" +
" File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n" +
" return future.result()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 225, in create_pipeline\n" +
" await asyncio.gather(*futures)\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 43, in __call__\n" +
" await self.run()\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py\", line 171, in run\n" +
" pb.done += task.result() # download_count\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/artifact_stages.py\", line 197, in _handle_content_unit\n" +
" await asyncio.gather(*downloaders_for_content)\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/models.py\", line 88, in download\n" +
" download_result = await downloader.run(extra_data=self.extra_data)\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/download/base.py\", line 227, in run\n" +
" return await self._run(extra_data=extra_data)\n" +
" File \"/usr/lib/python3.6/site-packages/backoff/_async.py\", line 133, in retry\n" +
" ret = await target(*args, **kwargs)\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/download/http.py\", line 218, in _run\n" +
" to_return = await self._handle_response(response)\n" +
" File \"/usr/lib/python3.6/site-packages/pulpcore/download/http.py\", line 185, in _handle_response\n" +
" chunk = await response.content.read(1048576) # 1 megabyte\n" +
" File \"/usr/lib64/python3.6/site-packages/aiohttp/streams.py\", line 380, in read\n" +
" await self._wait(\"read\")\n" +
" File \"/usr/lib64/python3.6/site-packages/aiohttp/streams.py\", line 306, in _wait\n" +
" await waiter\n" +
" File \"/usr/lib64/python3.6/site-packages/aiohttp/helpers.py\", line 656, in __exit__\n" +
" raise asyncio.TimeoutError from None\n",
"description"=>""},
Actions