Project

Profile

Help

Issue #7875

closed

repair_version task will fail with [Errno 24] Too many open files

Added by jsherril@redhat.com over 3 years ago. Updated over 3 years ago.

Status:
CLOSED - DUPLICATE
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

from: https://community.theforeman.org/t/actions-repair-fails-with-too-many-open-files/21313

a user tried to repair a repository and hit this error. They worked around it by increasing the # of files the rq workers can open, but it feels like the worker might be leaking open file descriptors or keeping too many open at once.

Its possible this only happens when there are a lot of files to fix, that part is unclear

"error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.6/site-packages/rq/worker.py\", line 936, in perform_job\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 684, in perform\n" +
       "  File \"/usr/lib/python3.6/site-packages/rq/job.py\", line 690, in _execute\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 118, in repair_version\n" +
       "  File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 87, in _repair_repository_version\n" +
       "  File \"/usr/lib64/python3.6/concurrent/futures/thread.py\", line 56, in run\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 65, in _verify_ca\n" +
       "  File \"/usr/lib/python3.6/site-packages/pulpcore/app/tasks/repository.py\", line 65, in <lambda>\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/core/files/utils.py\", line 16, in <lambda>\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/db/models/fields/files.py\", line 43, in _get_file\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/core/files/storage.py\", line 36, in open\n" +
       "  File \"/usr/lib/python3.6/site-packages/django/core/files/storage.py\", line 224, in _open\n",
      "description"=>
       "[Errno 24] Too many open files: '/var/lib/pulp/media/artifact/37/2448d165a2a37fc5f978dcb0301a91450751517a50445fe92174d0f01a6ce8'"},
    "worker"=>"/pulp/api/v3/workers/55e8f3bb-837a-470a-9d78-2e22e7e59249/",

Related issues

Related to Pulp - Issue #7735: RPM repo repair fails with "too many open files" on Katello 3.16.1.2CLOSED - CURRENTRELEASEdalleyActions
Actions #1

Updated by dalley over 3 years ago

  • Status changed from NEW to CLOSED - DUPLICATE
Actions #2

Updated by dalley over 3 years ago

  • Related to Issue #7735: RPM repo repair fails with "too many open files" on Katello 3.16.1.2 added
Actions #3

Updated by dalley over 3 years ago

@jsherrill you could change this issue to a backport request

Also available in: Atom PDF