Project

Profile

Help

Issue #7875

repair_version task will fail with [Errno 24] Too many open files

Added by jsherril@redhat.com 10 days ago. Updated 5 days ago.

Status:
CLOSED - DUPLICATE
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

from: https://community.theforeman.org/t/actions-repair-fails-with-too-many-open-files/21313

a user tried to repair a repository and hit this error. They worked around it by increasing the # of files the rq workers can open, but it feels like the worker might be leaking open file descriptors or keeping too many open at once.

Its possible this only happens when there are a lot of files to fix, that part is unclear

"error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 936, in perform_job\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 684, in perform\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 690, in _execute\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 118, in repair_version\n" +
       "  File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 87, in _repair_repository_version\n" +
       "  File \"/usr/lib64/python3.6/concurrent/futures/thread.py\", line 56, in run\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 65, in _verify_ca\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 65, in <lambda>\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/core/files/utils.py\", line 16, in <lambda>\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/db/models/fields/files.py\", line 43, in _get_file\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/core/files/storage.py\", line 36, in open\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/core/files/storage.py\", line 224, in _open\n",
      "description"=>
       "[Errno 24] Too many open files: '/var/lib/pulp/media/artifact/37/2448d165a2a37fc5f978dcb0301a91450751517a50445fe92174d0f01a6ce8'"},
    "worker"=>"/pulp/api/v3/workers/55e8f3bb-837a-470a-9d78-2e22e7e59249/",

Related issues

Related to Pulp - Issue #7735: RPM repo repair fails with "too many open files" on Katello 3.16.1.2MODIFIED<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by dalley 5 days ago

  • Status changed from NEW to CLOSED - DUPLICATE

#2 Updated by dalley 5 days ago

  • Related to Issue #7735: RPM repo repair fails with "too many open files" on Katello 3.16.1.2 added

#3 Updated by dalley 5 days ago

@jsherrill you could change this issue to a backport request

Please register to edit this issue

Also available in: Atom PDF